2024-02-23T23:31:23.930107331Z ... 2024-02-23T23:31:24.709083507Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-02-23T23:31:26.261347198Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-02-23T23:31:31.786744416Z [2024-02-23T23:31:31.785+0000] {db.py:755} INFO - Waiting for migrations... 0 second(s) 2024-02-23T23:31:48.021862699Z 2024-02-23T23:31:49.855472391Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-02-23T23:31:51.711963404Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-02-23T23:31:57.718000053Z ____________ _____________ 2024-02-23T23:31:57.718016288Z ____ |__( )_________ __/__ /________ __ 2024-02-23T23:31:57.718019916Z ____ /| |_ /__ ___/_ /_ __ /_ __ \_ | /| / / 2024-02-23T23:31:57.718023327Z ___ ___ | / _ / _ __/ _ / / /_/ /_ |/ |/ / 2024-02-23T23:31:57.718026663Z _/_/ |_/_/ /_/ /_/ /_/ \____/____/|__/ 2024-02-23T23:31:57.718030780Z [2024-02-23T23:31:57.714+0000] {scheduler_job.py:714} INFO - Starting the scheduler 2024-02-23T23:31:57.718034999Z [2024-02-23T23:31:57.714+0000] {scheduler_job.py:719} INFO - Processing each file at most -1 times 2024-02-23T23:31:58.482029556Z [2024-02-23T23:31:58.480+0000] {executor_loader.py:107} INFO - Loaded executor: CeleryExecutor 2024-02-23T23:31:58.553877311Z [2024-02-23T23:31:58.506+0000] {manager.py:165} INFO - Launched DagFileProcessorManager with pid: 15 2024-02-23T23:31:58.553888967Z [2024-02-23T23:31:58.551+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-23T23:31:58.574026150Z [2024-02-23T23:31:58.545+0000] {settings.py:59} INFO - Configured default timezone Timezone('UTC') 2024-02-23T23:31:58.583545340Z [2024-02-23T23:31:58.583+0000] {settings.py:549} INFO - Loaded airflow_local_settings from /opt/airflow/config/airflow_local_settings.py . 2024-02-23T23:33:01.972437261Z [2024-02-23T23:33:01.971+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:33:02.050737061Z [2024-02-23T23:33:02.050+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-23T23:33:02.050767984Z 2024-02-23T23:33:02.050827889Z [2024-02-23T23:33:02.050+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-23T23:33:02.051527561Z [2024-02-23T23:33:02.051+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:33:02.051540398Z 2024-02-23T23:33:02.055730488Z [2024-02-23T23:33:02.055+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-23T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:33:02.057255672Z [2024-02-23T23:33:02.055+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T23:33:02.352820112Z [2024-02-23T23:33:02.352+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-23T23:30:00+00:00 exited with status queued for try_number 1 2024-02-23T23:33:02.364757498Z [2024-02-23T23:33:02.364+0000] {scheduler_job.py:635} INFO - Setting external_id for to 283260da-55d7-4d13-9f6f-aad5e7f80398 2024-02-23T23:33:35.098362664Z [2024-02-23T23:33:35.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-23T23:30:00+00:00 exited with status success for try_number 1 2024-02-23T23:33:35.109014743Z [2024-02-23T23:33:35.108+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-23T23:30:00+00:00, map_index=-1, run_start_date=2024-02-23 23:33:03.423983+00:00, run_end_date=2024-02-23 23:33:33.890477+00:00, run_duration=30.466494, state=up_for_retry, executor_state=success, try_number=1, max_tries=1, job_id=3, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:33:02.051907+00:00, queued_by_job_id=2, pid=50 2024-02-23T23:33:44.658313926Z [2024-02-23T23:33:44.657+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-23T23:33:44.658340139Z 2024-02-23T23:33:44.661865199Z [2024-02-23T23:33:44.658+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-23T23:33:44.661885717Z [2024-02-23T23:33:44.659+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:33:44.661890818Z 2024-02-23T23:33:44.662362087Z [2024-02-23T23:33:44.662+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-23T23:30:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:33:44.662568743Z [2024-02-23T23:33:44.662+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T23:33:44.718820948Z [2024-02-23T23:33:44.718+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-23T23:30:00+00:00 exited with status queued for try_number 2 2024-02-23T23:33:44.723663065Z [2024-02-23T23:33:44.723+0000] {scheduler_job.py:635} INFO - Setting external_id for to a373325b-c86a-4ae7-83ac-961bf99808c8 2024-02-23T23:34:08.329818299Z [2024-02-23T23:34:08.326+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:34:08.330059681Z [2024-02-23T23:34:08.329+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-23 23:30:00+00:00, run_id=scheduled__2024-02-23T23:30:00+00:00, run_start_date=2024-02-23 23:33:01.985889+00:00, run_end_date=2024-02-23 23:34:08.329699+00:00, run_duration=66.34381, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:30:00+00:00, data_interval_end=2024-02-23 23:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-23T23:34:08.343076557Z [2024-02-23T23:34:08.342+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-23T23:32:00+00:00, run_after=2024-02-23T23:34:00+00:00 2024-02-23T23:34:08.378670894Z [2024-02-23T23:34:08.378+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-23T23:30:00+00:00 exited with status success for try_number 2 2024-02-23T23:34:08.389223428Z [2024-02-23T23:34:08.388+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-23T23:30:00+00:00, map_index=-1, run_start_date=2024-02-23 23:33:45.294460+00:00, run_end_date=2024-02-23 23:34:07.410166+00:00, run_duration=22.115706, state=success, executor_state=success, try_number=2, max_tries=1, job_id=4, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:33:44.660257+00:00, queued_by_job_id=2, pid=68 2024-02-23T23:34:09.497265405Z [2024-02-23T23:34:09.488+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:34:09.564049203Z [2024-02-23T23:34:09.563+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-23T23:34:09.564081649Z 2024-02-23T23:34:09.564085944Z [2024-02-23T23:34:09.563+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-23T23:34:09.566846604Z [2024-02-23T23:34:09.563+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:34:09.566885713Z 2024-02-23T23:34:09.571423619Z [2024-02-23T23:34:09.570+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-23T23:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:34:09.571449004Z [2024-02-23T23:34:09.571+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T23:34:09.693838093Z [2024-02-23T23:34:09.686+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-23T23:32:00+00:00 exited with status queued for try_number 1 2024-02-23T23:34:09.727650198Z [2024-02-23T23:34:09.725+0000] {scheduler_job.py:635} INFO - Setting external_id for to b05cf5c1-59a0-455d-a725-78e60423d14e 2024-02-23T23:34:11.253898377Z [2024-02-23T23:34:11.223+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:34:11.253927247Z [2024-02-23T23:34:11.223+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-23 23:32:00+00:00, run_id=scheduled__2024-02-23T23:32:00+00:00, run_start_date=2024-02-23 23:34:09.516979+00:00, run_end_date=2024-02-23 23:34:11.223613+00:00, run_duration=1.706634, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:32:00+00:00, data_interval_end=2024-02-23 23:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-23T23:34:11.253932313Z [2024-02-23T23:34:11.231+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-23T23:34:00+00:00, run_after=2024-02-23T23:36:00+00:00 2024-02-23T23:34:11.310180072Z [2024-02-23T23:34:11.300+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-23T23:32:00+00:00 exited with status success for try_number 1 2024-02-23T23:34:11.314638028Z [2024-02-23T23:34:11.312+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-23T23:32:00+00:00, map_index=-1, run_start_date=2024-02-23 23:34:10.277904+00:00, run_end_date=2024-02-23 23:34:10.613716+00:00, run_duration=0.335812, state=success, executor_state=success, try_number=1, max_tries=1, job_id=5, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:34:09.567165+00:00, queued_by_job_id=2, pid=75 2024-02-23T23:36:00.243425662Z [2024-02-23T23:36:00.242+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:36:00.288379568Z [2024-02-23T23:36:00.287+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-23T23:36:00.288412075Z 2024-02-23T23:36:00.288721247Z [2024-02-23T23:36:00.288+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-23T23:36:00.289645244Z [2024-02-23T23:36:00.289+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:36:00.289656782Z 2024-02-23T23:36:00.293042137Z [2024-02-23T23:36:00.292+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-23T23:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:36:00.293229636Z [2024-02-23T23:36:00.292+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T23:36:00.369490531Z [2024-02-23T23:36:00.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-23T23:34:00+00:00 exited with status queued for try_number 1 2024-02-23T23:36:00.374563935Z [2024-02-23T23:36:00.374+0000] {scheduler_job.py:635} INFO - Setting external_id for to 08e85b4f-05a0-4fdc-a7c2-fc117867b2c1 2024-02-23T23:36:02.016903726Z [2024-02-23T23:36:02.016+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:36:02.017395499Z [2024-02-23T23:36:02.017+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-23 23:34:00+00:00, run_id=scheduled__2024-02-23T23:34:00+00:00, run_start_date=2024-02-23 23:36:00.252581+00:00, run_end_date=2024-02-23 23:36:02.016800+00:00, run_duration=1.764219, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:34:00+00:00, data_interval_end=2024-02-23 23:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-23T23:36:02.025493281Z [2024-02-23T23:36:02.025+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-23T23:36:00+00:00, run_after=2024-02-23T23:38:00+00:00 2024-02-23T23:36:02.082835604Z [2024-02-23T23:36:02.082+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-23T23:34:00+00:00 exited with status success for try_number 1 2024-02-23T23:36:02.091833057Z [2024-02-23T23:36:02.091+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-23T23:34:00+00:00, map_index=-1, run_start_date=2024-02-23 23:36:00.959614+00:00, run_end_date=2024-02-23 23:36:01.421713+00:00, run_duration=0.462099, state=success, executor_state=success, try_number=1, max_tries=1, job_id=6, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:36:00.290348+00:00, queued_by_job_id=2, pid=108 2024-02-23T23:36:59.102852447Z [2024-02-23T23:36:59.102+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-23T23:38:00.859575817Z [2024-02-23T23:38:00.858+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:38:00.912874017Z [2024-02-23T23:38:00.912+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-23T23:38:00.912917587Z 2024-02-23T23:38:00.913014215Z [2024-02-23T23:38:00.912+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-23T23:38:00.913668246Z [2024-02-23T23:38:00.913+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:38:00.913683181Z 2024-02-23T23:38:00.916176907Z [2024-02-23T23:38:00.915+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-23T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:38:00.916438650Z [2024-02-23T23:38:00.916+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T23:38:00.980516133Z [2024-02-23T23:38:00.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-23T23:36:00+00:00 exited with status queued for try_number 1 2024-02-23T23:38:00.988770730Z [2024-02-23T23:38:00.988+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c38d0d0-a5e4-4354-99af-ca57e00575fc 2024-02-23T23:38:02.815132710Z [2024-02-23T23:38:02.814+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:38:02.815410861Z [2024-02-23T23:38:02.815+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-23 23:36:00+00:00, run_id=scheduled__2024-02-23T23:36:00+00:00, run_start_date=2024-02-23 23:38:00.875688+00:00, run_end_date=2024-02-23 23:38:02.815002+00:00, run_duration=1.939314, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:36:00+00:00, data_interval_end=2024-02-23 23:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-23T23:38:02.826964103Z [2024-02-23T23:38:02.826+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-23T23:38:00+00:00, run_after=2024-02-23T23:40:00+00:00 2024-02-23T23:38:02.860264751Z [2024-02-23T23:38:02.859+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-23T23:36:00+00:00 exited with status success for try_number 1 2024-02-23T23:38:02.869664210Z [2024-02-23T23:38:02.868+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-23T23:36:00+00:00, map_index=-1, run_start_date=2024-02-23 23:38:01.617598+00:00, run_end_date=2024-02-23 23:38:01.978916+00:00, run_duration=0.361318, state=success, executor_state=success, try_number=1, max_tries=1, job_id=7, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:38:00.914205+00:00, queued_by_job_id=2, pid=141 2024-02-23T23:39:11.899744741Z [2024-02-23T23:39:11.898+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:39:00+00:00, run_after=2024-02-23T23:40:00+00:00 2024-02-23T23:39:11.977817556Z [2024-02-23T23:39:11.977+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-23T23:39:11.977951046Z 2024-02-23T23:39:11.978654682Z [2024-02-23T23:39:11.978+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-23T23:39:11.980159193Z [2024-02-23T23:39:11.979+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:39:11.980188953Z 2024-02-23T23:39:11.985227808Z [2024-02-23T23:39:11.984+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:39:11.985812579Z [2024-02-23T23:39:11.985+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T23:39:12.052189793Z [2024-02-23T23:39:12.051+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:38:00+00:00 exited with status queued for try_number 1 2024-02-23T23:39:12.057873837Z [2024-02-23T23:39:12.057+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4aaa7833-fc0d-4f6d-95cf-db1931d7de41 2024-02-23T23:39:13.274412532Z [2024-02-23T23:39:13.273+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:39:13.275329996Z [2024-02-23T23:39:13.274+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-23 23:38:00+00:00, run_id=scheduled__2024-02-23T23:38:00+00:00, run_start_date=2024-02-23 23:39:11.919743+00:00, run_end_date=2024-02-23 23:39:13.274518+00:00, run_duration=1.354775, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:38:00+00:00, data_interval_end=2024-02-23 23:39:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-23T23:39:13.294559998Z [2024-02-23T23:39:13.293+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:39:00+00:00, run_after=2024-02-23T23:40:00+00:00 2024-02-23T23:39:13.335596269Z [2024-02-23T23:39:13.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:38:00+00:00 exited with status success for try_number 1 2024-02-23T23:39:13.345910740Z [2024-02-23T23:39:13.345+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:38:00+00:00, map_index=-1, run_start_date=2024-02-23 23:39:12.602639+00:00, run_end_date=2024-02-23 23:39:12.994908+00:00, run_duration=0.392269, state=success, executor_state=success, try_number=1, max_tries=1, job_id=8, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:39:11.981045+00:00, queued_by_job_id=2, pid=166 2024-02-23T23:39:20.522071670Z [2024-02-23T23:39:20.521+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:35:00+00:00, run_after=2024-02-23T23:40:00+00:00 2024-02-23T23:39:20.568152501Z [2024-02-23T23:39:20.567+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-23T23:39:20.568183359Z 2024-02-23T23:39:20.568299730Z [2024-02-23T23:39:20.568+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:39:20.569208925Z [2024-02-23T23:39:20.568+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:39:20.569221665Z 2024-02-23T23:39:20.572973528Z [2024-02-23T23:39:20.572+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-23T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-23T23:39:20.573125646Z [2024-02-23T23:39:20.572+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T23:39:20.621495484Z [2024-02-23T23:39:20.621+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-23T23:30:00+00:00 exited with status queued for try_number 1 2024-02-23T23:39:20.629217290Z [2024-02-23T23:39:20.628+0000] {scheduler_job.py:635} INFO - Setting external_id for to afd73d9f-b49a-4bb5-8932-92d6d198fb3d 2024-02-23T23:39:23.385130988Z [2024-02-23T23:39:23.384+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-23T23:39:23.385185979Z 2024-02-23T23:39:23.385196594Z [2024-02-23T23:39:23.384+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:39:23.385684601Z [2024-02-23T23:39:23.385+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:39:23.385701667Z 2024-02-23T23:39:23.389336316Z [2024-02-23T23:39:23.388+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-23T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-23T23:39:23.389396714Z [2024-02-23T23:39:23.389+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-23T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T23:39:23.452315956Z [2024-02-23T23:39:23.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-23T23:30:00+00:00 exited with status queued for try_number 1 2024-02-23T23:39:23.455005315Z [2024-02-23T23:39:23.452+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-23T23:30:00+00:00 exited with status success for try_number 1 2024-02-23T23:39:23.459674666Z [2024-02-23T23:39:23.459+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d76d2bc-d6d8-472e-92cb-773c9c3b62e6 2024-02-23T23:39:23.459914864Z [2024-02-23T23:39:23.459+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-23T23:30:00+00:00, map_index=-1, run_start_date=2024-02-23 23:39:22.333463+00:00, run_end_date=2024-02-23 23:39:22.775687+00:00, run_duration=0.442224, state=success, executor_state=success, try_number=1, max_tries=1, job_id=9, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:39:20.569569+00:00, queued_by_job_id=2, pid=179 2024-02-23T23:39:24.571445421Z [2024-02-23T23:39:24.571+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:39:00+00:00, run_after=2024-02-23T23:40:00+00:00 2024-02-23T23:39:24.643411949Z [2024-02-23T23:39:24.643+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-23T23:39:24.643463972Z 2024-02-23T23:39:24.643475992Z [2024-02-23T23:39:24.643+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:39:24.643953469Z [2024-02-23T23:39:24.643+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:39:24.643964570Z 2024-02-23T23:39:24.646196085Z [2024-02-23T23:39:24.645+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:39:24.646396987Z [2024-02-23T23:39:24.646+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T23:39:24.724666107Z [2024-02-23T23:39:24.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:38:00+00:00 exited with status queued for try_number 1 2024-02-23T23:39:24.731302442Z [2024-02-23T23:39:24.730+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab5d0ba9-4679-4210-aa5f-f3aa4f612527 2024-02-23T23:39:27.067537768Z [2024-02-23T23:39:27.067+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:39:27.128340252Z [2024-02-23T23:39:27.128+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-02-23T23:39:27.128364115Z 2024-02-23T23:39:27.128380560Z 2024-02-23T23:39:27.128696247Z [2024-02-23T23:39:27.128+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:39:27.128945937Z [2024-02-23T23:39:27.128+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:39:27.129590072Z [2024-02-23T23:39:27.129+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:39:27.129601340Z 2024-02-23T23:39:27.129604743Z 2024-02-23T23:39:27.132376150Z [2024-02-23T23:39:27.132+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-23T23:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-23T23:39:27.132629387Z [2024-02-23T23:39:27.132+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-23T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T23:39:27.132987636Z [2024-02-23T23:39:27.132+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:39:27.133271750Z [2024-02-23T23:39:27.133+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T23:39:27.422836380Z [2024-02-23T23:39:27.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-23T23:30:00+00:00 exited with status queued for try_number 1 2024-02-23T23:39:27.423768151Z [2024-02-23T23:39:27.423+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:38:00+00:00 exited with status queued for try_number 1 2024-02-23T23:39:27.425998492Z [2024-02-23T23:39:27.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-23T23:30:00+00:00 exited with status success for try_number 1 2024-02-23T23:39:27.482262528Z [2024-02-23T23:39:27.481+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-23T23:30:00+00:00, map_index=-1, run_start_date=2024-02-23 23:39:25.475279+00:00, run_end_date=2024-02-23 23:39:25.940841+00:00, run_duration=0.465562, state=success, executor_state=success, try_number=1, max_tries=1, job_id=10, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:39:23.385931+00:00, queued_by_job_id=2, pid=193 2024-02-23T23:39:27.482666809Z [2024-02-23T23:39:27.482+0000] {scheduler_job.py:635} INFO - Setting external_id for to cdff6bec-00b8-48a2-8429-afd5061a2ba9 2024-02-23T23:39:27.482916830Z [2024-02-23T23:39:27.482+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b93b490-130d-4ea8-8f84-691f91d04afe 2024-02-23T23:39:28.709135134Z [2024-02-23T23:39:28.708+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:39:28.709290556Z [2024-02-23T23:39:28.709+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:38:00+00:00, run_id=scheduled__2024-02-23T23:38:00+00:00, run_start_date=2024-02-23 23:39:24.597519+00:00, run_end_date=2024-02-23 23:39:28.709043+00:00, run_duration=4.111524, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:38:00+00:00, data_interval_end=2024-02-23 23:39:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-23T23:39:28.737492716Z [2024-02-23T23:39:28.737+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:39:00+00:00, run_after=2024-02-23T23:40:00+00:00 2024-02-23T23:39:30.019002559Z [2024-02-23T23:39:30.018+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:38:00+00:00 exited with status success for try_number 1 2024-02-23T23:39:30.030705990Z [2024-02-23T23:39:30.030+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:38:00+00:00, map_index=-1, run_start_date=2024-02-23 23:39:26.963347+00:00, run_end_date=2024-02-23 23:39:28.601196+00:00, run_duration=1.637849, state=success, executor_state=success, try_number=1, max_tries=1, job_id=11, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:39:24.644209+00:00, queued_by_job_id=2, pid=200 2024-02-23T23:39:31.178285347Z [2024-02-23T23:39:31.177+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-23T23:39:31.178313126Z 2024-02-23T23:39:31.178604743Z [2024-02-23T23:39:31.178+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:39:31.179222527Z [2024-02-23T23:39:31.179+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:39:31.179231837Z 2024-02-23T23:39:31.181491437Z [2024-02-23T23:39:31.181+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-23T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:39:31.181710178Z [2024-02-23T23:39:31.181+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-23T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T23:39:31.287913953Z [2024-02-23T23:39:31.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-23T23:30:00+00:00 exited with status queued for try_number 1 2024-02-23T23:39:31.289924775Z [2024-02-23T23:39:31.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-23T23:30:00+00:00 exited with status success for try_number 1 2024-02-23T23:39:31.310163676Z [2024-02-23T23:39:31.308+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99f1247b-800a-4817-ad18-0d8249faf655 2024-02-23T23:39:31.310608479Z [2024-02-23T23:39:31.310+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-23T23:30:00+00:00, map_index=0, run_start_date=2024-02-23 23:39:29.900623+00:00, run_end_date=2024-02-23 23:39:30.288408+00:00, run_duration=0.387785, state=success, executor_state=success, try_number=1, max_tries=1, job_id=13, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:39:27.130213+00:00, queued_by_job_id=2, pid=221 2024-02-23T23:39:32.392110777Z [2024-02-23T23:39:32.391+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:39:32.392223067Z [2024-02-23T23:39:32.392+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:38:00+00:00, run_id=scheduled__2024-02-23T23:38:00+00:00, run_start_date=2024-02-23 23:39:27.075205+00:00, run_end_date=2024-02-23 23:39:32.391953+00:00, run_duration=5.316748, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:38:00+00:00, data_interval_end=2024-02-23 23:39:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-23T23:39:32.420007660Z [2024-02-23T23:39:32.418+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:39:00+00:00, run_after=2024-02-23T23:40:00+00:00 2024-02-23T23:39:32.717949755Z [2024-02-23T23:39:32.709+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:38:00+00:00 exited with status success for try_number 1 2024-02-23T23:39:32.753921763Z [2024-02-23T23:39:32.752+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:38:00+00:00, map_index=-1, run_start_date=2024-02-23 23:39:29.783508+00:00, run_end_date=2024-02-23 23:39:31.470950+00:00, run_duration=1.687442, state=success, executor_state=success, try_number=1, max_tries=1, job_id=12, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:39:27.130213+00:00, queued_by_job_id=2, pid=220 2024-02-23T23:39:35.014824202Z [2024-02-23T23:39:35.014+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:39:35.017228067Z [2024-02-23T23:39:35.016+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:30:00+00:00, run_id=scheduled__2024-02-23T23:30:00+00:00, run_start_date=2024-02-23 23:39:20.531909+00:00, run_end_date=2024-02-23 23:39:35.016792+00:00, run_duration=14.484883, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:30:00+00:00, data_interval_end=2024-02-23 23:35:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-23T23:39:35.025408111Z [2024-02-23T23:39:35.025+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:35:00+00:00, run_after=2024-02-23T23:40:00+00:00 2024-02-23T23:39:35.054709807Z [2024-02-23T23:39:35.054+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-23T23:30:00+00:00 exited with status success for try_number 1 2024-02-23T23:39:35.058895061Z [2024-02-23T23:39:35.058+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-23T23:30:00+00:00, map_index=-1, run_start_date=2024-02-23 23:39:34.195058+00:00, run_end_date=2024-02-23 23:39:34.770099+00:00, run_duration=0.575041, state=success, executor_state=success, try_number=1, max_tries=1, job_id=14, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:39:31.179683+00:00, queued_by_job_id=2, pid=234 2024-02-23T23:40:00.657950967Z [2024-02-23T23:40:00.657+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:40:00+00:00, run_after=2024-02-23T23:41:00+00:00 2024-02-23T23:40:00.687771249Z [2024-02-23T23:40:00.687+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:40:00+00:00, run_after=2024-02-23T23:41:00+00:00 2024-02-23T23:40:00.698659592Z [2024-02-23T23:40:00.697+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:40:00.708384505Z [2024-02-23T23:40:00.707+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:40:00.723871121Z [2024-02-23T23:40:00.723+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:40:00+00:00, run_after=2024-02-23T23:45:00+00:00 2024-02-23T23:40:00.857340963Z [2024-02-23T23:40:00.856+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-02-23T23:40:00.857443192Z 2024-02-23T23:40:00.857587288Z 2024-02-23T23:40:00.857598796Z 2024-02-23T23:40:00.857607367Z 2024-02-23T23:40:00.857615920Z 2024-02-23T23:40:00.857794797Z [2024-02-23T23:40:00.857+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:40:00.857852160Z [2024-02-23T23:40:00.857+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-23T23:40:00.857911619Z [2024-02-23T23:40:00.857+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:40:00.858091954Z [2024-02-23T23:40:00.857+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-23T23:40:00.858392894Z [2024-02-23T23:40:00.857+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:40:00.859173101Z [2024-02-23T23:40:00.858+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:40:00.859187934Z 2024-02-23T23:40:00.859214972Z 2024-02-23T23:40:00.859219417Z 2024-02-23T23:40:00.859223376Z 2024-02-23T23:40:00.859227326Z 2024-02-23T23:40:00.866468153Z [2024-02-23T23:40:00.866+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-23T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-23T23:40:00.866574987Z [2024-02-23T23:40:00.866+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T23:40:00.866879000Z [2024-02-23T23:40:00.866+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-23T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:40:00.867042839Z [2024-02-23T23:40:00.866+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T23:40:00.867322255Z [2024-02-23T23:40:00.867+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:40:00.867486464Z [2024-02-23T23:40:00.867+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T23:40:00.867787492Z [2024-02-23T23:40:00.867+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:40:00.868048092Z [2024-02-23T23:40:00.867+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T23:40:00.868345385Z [2024-02-23T23:40:00.868+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:40:00.868499717Z [2024-02-23T23:40:00.868+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T23:40:01.474132328Z [2024-02-23T23:40:01.473+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-23T23:35:00+00:00 exited with status queued for try_number 1 2024-02-23T23:40:01.474361437Z [2024-02-23T23:40:01.474+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-23T23:38:00+00:00 exited with status queued for try_number 1 2024-02-23T23:40:01.474595393Z [2024-02-23T23:40:01.474+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:39:00+00:00 exited with status queued for try_number 1 2024-02-23T23:40:01.474887826Z [2024-02-23T23:40:01.474+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:39:00+00:00 exited with status queued for try_number 1 2024-02-23T23:40:01.475102309Z [2024-02-23T23:40:01.474+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:39:00+00:00 exited with status queued for try_number 1 2024-02-23T23:40:01.499991215Z [2024-02-23T23:40:01.499+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56ee9bf5-cf7c-46aa-8901-2dbdd345c832 2024-02-23T23:40:01.500382790Z [2024-02-23T23:40:01.500+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25f7fba6-8c2c-4c0e-b207-1f080a9ad094 2024-02-23T23:40:01.500714381Z [2024-02-23T23:40:01.500+0000] {scheduler_job.py:635} INFO - Setting external_id for to e76243b1-6314-4662-a3b8-b46566206121 2024-02-23T23:40:01.501014384Z [2024-02-23T23:40:01.500+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75121f84-38d5-44df-91ea-013937a88074 2024-02-23T23:40:01.501326574Z [2024-02-23T23:40:01.501+0000] {scheduler_job.py:635} INFO - Setting external_id for to d9913a1a-ff13-4b00-8c03-87271f1d4395 2024-02-23T23:40:02.959257119Z [2024-02-23T23:40:02.958+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:40:02.960648855Z [2024-02-23T23:40:02.960+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-23 23:38:00+00:00, run_id=scheduled__2024-02-23T23:38:00+00:00, run_start_date=2024-02-23 23:40:00.742612+00:00, run_end_date=2024-02-23 23:40:02.959155+00:00, run_duration=2.216543, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:38:00+00:00, data_interval_end=2024-02-23 23:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-23T23:40:02.969318879Z [2024-02-23T23:40:02.968+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-23T23:40:00+00:00, run_after=2024-02-23T23:42:00+00:00 2024-02-23T23:40:02.996760142Z [2024-02-23T23:40:02.996+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:40:02.997064036Z [2024-02-23T23:40:02.996+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-23 23:39:00+00:00, run_id=scheduled__2024-02-23T23:39:00+00:00, run_start_date=2024-02-23 23:40:00.747890+00:00, run_end_date=2024-02-23 23:40:02.996648+00:00, run_duration=2.248758, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:39:00+00:00, data_interval_end=2024-02-23 23:40:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-23T23:40:03.030021246Z [2024-02-23T23:40:03.029+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:40:00+00:00, run_after=2024-02-23T23:41:00+00:00 2024-02-23T23:40:03.162870599Z [2024-02-23T23:40:03.162+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-23T23:38:00+00:00 exited with status success for try_number 1 2024-02-23T23:40:03.162979072Z [2024-02-23T23:40:03.162+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:39:00+00:00 exited with status success for try_number 1 2024-02-23T23:40:03.183105074Z [2024-02-23T23:40:03.182+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-23T23:38:00+00:00, map_index=-1, run_start_date=2024-02-23 23:40:01.855373+00:00, run_end_date=2024-02-23 23:40:02.317665+00:00, run_duration=0.462292, state=success, executor_state=success, try_number=1, max_tries=1, job_id=15, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:40:00.860476+00:00, queued_by_job_id=2, pid=253 2024-02-23T23:40:03.183876377Z [2024-02-23T23:40:03.183+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:39:00+00:00, map_index=-1, run_start_date=2024-02-23 23:40:02.391382+00:00, run_end_date=2024-02-23 23:40:02.937262+00:00, run_duration=0.54588, state=success, executor_state=success, try_number=1, max_tries=1, job_id=16, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:40:00.860476+00:00, queued_by_job_id=2, pid=265 2024-02-23T23:40:04.293703316Z [2024-02-23T23:40:04.293+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-23T23:40:04.293802780Z 2024-02-23T23:40:04.293814869Z [2024-02-23T23:40:04.293+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:40:04.294309381Z [2024-02-23T23:40:04.294+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:40:04.294341926Z 2024-02-23T23:40:04.296715535Z [2024-02-23T23:40:04.296+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-23T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-23T23:40:04.296781732Z [2024-02-23T23:40:04.296+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-23T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T23:40:04.359771046Z [2024-02-23T23:40:04.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-23T23:35:00+00:00 exited with status queued for try_number 1 2024-02-23T23:40:04.359804570Z [2024-02-23T23:40:04.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-23T23:35:00+00:00 exited with status success for try_number 1 2024-02-23T23:40:04.368253246Z [2024-02-23T23:40:04.367+0000] {scheduler_job.py:635} INFO - Setting external_id for to d1c3e9b4-5ec3-4835-a7a3-aa18df7a7e67 2024-02-23T23:40:04.368366467Z [2024-02-23T23:40:04.368+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-23T23:35:00+00:00, map_index=-1, run_start_date=2024-02-23 23:40:03.310879+00:00, run_end_date=2024-02-23 23:40:03.719244+00:00, run_duration=0.408365, state=success, executor_state=success, try_number=1, max_tries=1, job_id=17, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:40:00.860476+00:00, queued_by_job_id=2, pid=285 2024-02-23T23:40:05.554990033Z [2024-02-23T23:40:05.554+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:40:05.555446961Z [2024-02-23T23:40:05.555+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:39:00+00:00, run_id=scheduled__2024-02-23T23:39:00+00:00, run_start_date=2024-02-23 23:40:00.745530+00:00, run_end_date=2024-02-23 23:40:05.555042+00:00, run_duration=4.809512, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:39:00+00:00, data_interval_end=2024-02-23 23:40:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-23T23:40:05.564653643Z [2024-02-23T23:40:05.564+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:40:00+00:00, run_after=2024-02-23T23:41:00+00:00 2024-02-23T23:40:05.667175925Z [2024-02-23T23:40:05.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:39:00+00:00 exited with status success for try_number 1 2024-02-23T23:40:05.675244658Z [2024-02-23T23:40:05.674+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:39:00+00:00, map_index=-1, run_start_date=2024-02-23 23:40:03.437674+00:00, run_end_date=2024-02-23 23:40:04.821222+00:00, run_duration=1.383548, state=success, executor_state=success, try_number=1, max_tries=1, job_id=18, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:40:00.860476+00:00, queued_by_job_id=2, pid=289 2024-02-23T23:40:06.754927747Z [2024-02-23T23:40:06.754+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:40:06.757490565Z [2024-02-23T23:40:06.757+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:39:00+00:00, run_id=scheduled__2024-02-23T23:39:00+00:00, run_start_date=2024-02-23 23:40:00.749931+00:00, run_end_date=2024-02-23 23:40:06.756815+00:00, run_duration=6.006884, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:39:00+00:00, data_interval_end=2024-02-23 23:40:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-23T23:40:06.781181175Z [2024-02-23T23:40:06.780+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:40:00+00:00, run_after=2024-02-23T23:41:00+00:00 2024-02-23T23:40:06.858956974Z [2024-02-23T23:40:06.858+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:39:00+00:00 exited with status success for try_number 1 2024-02-23T23:40:06.865182617Z [2024-02-23T23:40:06.864+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:39:00+00:00, map_index=-1, run_start_date=2024-02-23 23:40:03.637194+00:00, run_end_date=2024-02-23 23:40:05.550303+00:00, run_duration=1.913109, state=success, executor_state=success, try_number=1, max_tries=1, job_id=19, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:40:00.860476+00:00, queued_by_job_id=2, pid=295 2024-02-23T23:40:07.073829569Z [2024-02-23T23:40:07.073+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-23T23:40:07.073887530Z 2024-02-23T23:40:07.074739496Z [2024-02-23T23:40:07.074+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:40:07.078105971Z [2024-02-23T23:40:07.077+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:40:07.078134549Z 2024-02-23T23:40:07.085697643Z [2024-02-23T23:40:07.082+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-23T23:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-23T23:40:07.086022716Z [2024-02-23T23:40:07.085+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-23T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T23:40:07.213821884Z [2024-02-23T23:40:07.211+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-23T23:35:00+00:00 exited with status queued for try_number 1 2024-02-23T23:40:07.214051458Z [2024-02-23T23:40:07.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-23T23:35:00+00:00 exited with status success for try_number 1 2024-02-23T23:40:07.224274775Z [2024-02-23T23:40:07.223+0000] {scheduler_job.py:635} INFO - Setting external_id for to cf65d476-6c68-4c05-b020-6a12d5284918 2024-02-23T23:40:07.224680510Z [2024-02-23T23:40:07.224+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-23T23:35:00+00:00, map_index=-1, run_start_date=2024-02-23 23:40:06.223874+00:00, run_end_date=2024-02-23 23:40:06.823183+00:00, run_duration=0.599309, state=success, executor_state=success, try_number=1, max_tries=1, job_id=20, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:40:04.294634+00:00, queued_by_job_id=2, pid=313 2024-02-23T23:40:10.688051442Z [2024-02-23T23:40:10.687+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-23T23:40:10.688093271Z 2024-02-23T23:40:10.688100589Z [2024-02-23T23:40:10.687+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:40:10.689085180Z [2024-02-23T23:40:10.688+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:40:10.689102270Z 2024-02-23T23:40:10.692807589Z [2024-02-23T23:40:10.692+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-23T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:40:10.692976745Z [2024-02-23T23:40:10.692+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-23T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T23:40:10.759018606Z [2024-02-23T23:40:10.758+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-23T23:35:00+00:00 exited with status queued for try_number 1 2024-02-23T23:40:10.759258413Z [2024-02-23T23:40:10.758+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-23T23:35:00+00:00 exited with status success for try_number 1 2024-02-23T23:40:10.769475723Z [2024-02-23T23:40:10.768+0000] {scheduler_job.py:635} INFO - Setting external_id for to 51e650d0-554e-40d1-9a12-e8753245bdd1 2024-02-23T23:40:10.769792269Z [2024-02-23T23:40:10.769+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-23T23:35:00+00:00, map_index=0, run_start_date=2024-02-23 23:40:09.331716+00:00, run_end_date=2024-02-23 23:40:09.736252+00:00, run_duration=0.404536, state=success, executor_state=success, try_number=1, max_tries=1, job_id=21, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:40:07.078786+00:00, queued_by_job_id=2, pid=321 2024-02-23T23:40:14.304383445Z [2024-02-23T23:40:14.303+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:40:14.304811631Z [2024-02-23T23:40:14.304+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:35:00+00:00, run_id=scheduled__2024-02-23T23:35:00+00:00, run_start_date=2024-02-23 23:40:00.739808+00:00, run_end_date=2024-02-23 23:40:14.304272+00:00, run_duration=13.564464, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:35:00+00:00, data_interval_end=2024-02-23 23:40:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-23T23:40:14.311426725Z [2024-02-23T23:40:14.311+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:40:00+00:00, run_after=2024-02-23T23:45:00+00:00 2024-02-23T23:40:14.340008992Z [2024-02-23T23:40:14.339+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-23T23:35:00+00:00 exited with status success for try_number 1 2024-02-23T23:40:14.346185022Z [2024-02-23T23:40:14.345+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-23T23:35:00+00:00, map_index=-1, run_start_date=2024-02-23 23:40:12.661259+00:00, run_end_date=2024-02-23 23:40:13.118800+00:00, run_duration=0.457541, state=success, executor_state=success, try_number=1, max_tries=1, job_id=22, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:40:10.689704+00:00, queued_by_job_id=2, pid=329 2024-02-23T23:40:23.298514965Z [2024-02-23T23:40:23.298+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d to 2024-02-23T23:40:00+00:00, run_after=2024-02-23T23:45:00+00:00 2024-02-23T23:40:23.370515744Z [2024-02-23T23:40:23.370+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-23T23:40:23.370558776Z 2024-02-23T23:40:23.371578459Z [2024-02-23T23:40:23.370+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d has 0/16 running and queued tasks 2024-02-23T23:40:23.372883340Z [2024-02-23T23:40:23.372+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:40:23.372898724Z 2024-02-23T23:40:23.377237084Z [2024-02-23T23:40:23.376+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-23T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-23T23:40:23.377655448Z [2024-02-23T23:40:23.377+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T23:40:23.439727947Z [2024-02-23T23:40:23.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d.extract_metrics_from_vnfrs run_id=scheduled__2024-02-23T23:35:00+00:00 exited with status queued for try_number 1 2024-02-23T23:40:23.446206674Z [2024-02-23T23:40:23.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to 861902a8-5521-4ae6-8e24-95683593f67c 2024-02-23T23:40:25.690096050Z [2024-02-23T23:40:25.689+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-23T23:40:25.690188665Z 2024-02-23T23:40:25.690202327Z [2024-02-23T23:40:25.689+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d has 0/16 running and queued tasks 2024-02-23T23:40:25.691155837Z [2024-02-23T23:40:25.690+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:40:25.691186262Z 2024-02-23T23:40:25.694037628Z [2024-02-23T23:40:25.693+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d', task_id='split_metrics', run_id='scheduled__2024-02-23T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-23T23:40:25.694175174Z [2024-02-23T23:40:25.693+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d', 'split_metrics', 'scheduled__2024-02-23T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T23:40:25.745267119Z [2024-02-23T23:40:25.744+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d.split_metrics run_id=scheduled__2024-02-23T23:35:00+00:00 exited with status queued for try_number 1 2024-02-23T23:40:25.745602868Z [2024-02-23T23:40:25.745+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d.extract_metrics_from_vnfrs run_id=scheduled__2024-02-23T23:35:00+00:00 exited with status success for try_number 1 2024-02-23T23:40:25.751112950Z [2024-02-23T23:40:25.750+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8e51842-a63b-44e4-ab73-28eb14330d3b 2024-02-23T23:40:25.751231209Z [2024-02-23T23:40:25.750+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-23T23:35:00+00:00, map_index=-1, run_start_date=2024-02-23 23:40:25.007180+00:00, run_end_date=2024-02-23 23:40:25.419152+00:00, run_duration=0.411972, state=success, executor_state=success, try_number=1, max_tries=1, job_id=23, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:40:23.374135+00:00, queued_by_job_id=2, pid=337 2024-02-23T23:40:27.698555779Z [2024-02-23T23:40:27.698+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-23T23:40:27.698584026Z 2024-02-23T23:40:27.698846946Z [2024-02-23T23:40:27.698+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d has 0/16 running and queued tasks 2024-02-23T23:40:27.699531502Z [2024-02-23T23:40:27.699+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:40:27.699544254Z 2024-02-23T23:40:27.702221928Z [2024-02-23T23:40:27.701+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d', task_id='collect_metrics', run_id='scheduled__2024-02-23T23:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-23T23:40:27.702485569Z [2024-02-23T23:40:27.702+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d', 'collect_metrics', 'scheduled__2024-02-23T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T23:40:27.753163248Z [2024-02-23T23:40:27.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d.collect_metrics run_id=scheduled__2024-02-23T23:35:00+00:00 exited with status queued for try_number 1 2024-02-23T23:40:27.756896049Z [2024-02-23T23:40:27.756+0000] {scheduler_job.py:635} INFO - Setting external_id for to b364c222-9683-4722-8aa8-9c05d275be15 2024-02-23T23:40:27.805838934Z [2024-02-23T23:40:27.805+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d to 2024-02-23T23:40:00+00:00, run_after=2024-02-23T23:41:00+00:00 2024-02-23T23:40:27.850060456Z [2024-02-23T23:40:27.849+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-23T23:40:27.850099208Z 2024-02-23T23:40:27.850108610Z [2024-02-23T23:40:27.849+0000] {scheduler_job.py:425} INFO - DAG vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d has 0/16 running and queued tasks 2024-02-23T23:40:27.850405525Z [2024-02-23T23:40:27.850+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:40:27.850518319Z 2024-02-23T23:40:27.852527581Z [2024-02-23T23:40:27.852+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:40:27.852576244Z [2024-02-23T23:40:27.852+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T23:40:27.892188475Z [2024-02-23T23:40:27.891+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:39:00+00:00 exited with status queued for try_number 1 2024-02-23T23:40:27.892714310Z [2024-02-23T23:40:27.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d.split_metrics run_id=scheduled__2024-02-23T23:35:00+00:00 exited with status success for try_number 1 2024-02-23T23:40:27.902440237Z [2024-02-23T23:40:27.901+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d, task_id=split_metrics, run_id=scheduled__2024-02-23T23:35:00+00:00, map_index=-1, run_start_date=2024-02-23 23:40:27.195758+00:00, run_end_date=2024-02-23 23:40:27.546339+00:00, run_duration=0.350581, state=success, executor_state=success, try_number=1, max_tries=1, job_id=24, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:40:25.691332+00:00, queued_by_job_id=2, pid=350 2024-02-23T23:40:27.903165644Z [2024-02-23T23:40:27.902+0000] {scheduler_job.py:635} INFO - Setting external_id for to 08aeb832-4831-4a2d-ab94-6ab769fdb039 2024-02-23T23:40:30.155537382Z [2024-02-23T23:40:30.155+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:40:30.210723711Z [2024-02-23T23:40:30.210+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-02-23T23:40:30.210800408Z 2024-02-23T23:40:30.210813784Z 2024-02-23T23:40:30.210891278Z [2024-02-23T23:40:30.210+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d has 0/16 running and queued tasks 2024-02-23T23:40:30.211015735Z [2024-02-23T23:40:30.210+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d has 0/16 running and queued tasks 2024-02-23T23:40:30.211764172Z [2024-02-23T23:40:30.211+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:40:30.211786167Z 2024-02-23T23:40:30.211797037Z 2024-02-23T23:40:30.215085099Z [2024-02-23T23:40:30.214+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d', task_id='send_prometheus', run_id='scheduled__2024-02-23T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:40:30.215280926Z [2024-02-23T23:40:30.215+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d', 'send_prometheus', 'scheduled__2024-02-23T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T23:40:30.215644664Z [2024-02-23T23:40:30.215+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:40:30.215844745Z [2024-02-23T23:40:30.215+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T23:40:30.376638294Z [2024-02-23T23:40:30.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d.send_prometheus run_id=scheduled__2024-02-23T23:35:00+00:00 exited with status queued for try_number 1 2024-02-23T23:40:30.376881856Z [2024-02-23T23:40:30.376+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:39:00+00:00 exited with status queued for try_number 1 2024-02-23T23:40:30.377390097Z [2024-02-23T23:40:30.377+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d.collect_metrics run_id=scheduled__2024-02-23T23:35:00+00:00 exited with status success for try_number 1 2024-02-23T23:40:30.386564404Z [2024-02-23T23:40:30.386+0000] {scheduler_job.py:635} INFO - Setting external_id for to 552c2d44-a335-4604-94ea-4ce60bff28e7 2024-02-23T23:40:30.387066162Z [2024-02-23T23:40:30.386+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d, task_id=collect_metrics, run_id=scheduled__2024-02-23T23:35:00+00:00, map_index=0, run_start_date=2024-02-23 23:40:29.298077+00:00, run_end_date=2024-02-23 23:40:29.623237+00:00, run_duration=0.32516, state=success, executor_state=success, try_number=1, max_tries=1, job_id=25, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:40:27.699928+00:00, queued_by_job_id=2, pid=365 2024-02-23T23:40:30.387474212Z [2024-02-23T23:40:30.387+0000] {scheduler_job.py:635} INFO - Setting external_id for to 225124e7-38d4-416a-a628-47c0b2c465f8 2024-02-23T23:40:31.578462215Z [2024-02-23T23:40:31.578+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:40:31.578656500Z [2024-02-23T23:40:31.578+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d, execution_date=2024-02-23 23:39:00+00:00, run_id=scheduled__2024-02-23T23:39:00+00:00, run_start_date=2024-02-23 23:40:27.813722+00:00, run_end_date=2024-02-23 23:40:31.578374+00:00, run_duration=3.764652, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:39:00+00:00, data_interval_end=2024-02-23 23:40:00+00:00, dag_hash=1f2af53b2b9e8daef31aa1ee246ba43a 2024-02-23T23:40:31.589566311Z [2024-02-23T23:40:31.589+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d to 2024-02-23T23:40:00+00:00, run_after=2024-02-23T23:41:00+00:00 2024-02-23T23:40:31.627159180Z [2024-02-23T23:40:31.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:39:00+00:00 exited with status success for try_number 1 2024-02-23T23:40:31.633121138Z [2024-02-23T23:40:31.632+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:39:00+00:00, map_index=-1, run_start_date=2024-02-23 23:40:29.421752+00:00, run_end_date=2024-02-23 23:40:30.581113+00:00, run_duration=1.159361, state=success, executor_state=success, try_number=1, max_tries=1, job_id=26, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:40:27.850593+00:00, queued_by_job_id=2, pid=366 2024-02-23T23:40:32.874540893Z [2024-02-23T23:40:32.874+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d.send_prometheus run_id=scheduled__2024-02-23T23:35:00+00:00 exited with status success for try_number 1 2024-02-23T23:40:32.879711918Z [2024-02-23T23:40:32.879+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d, task_id=send_prometheus, run_id=scheduled__2024-02-23T23:35:00+00:00, map_index=-1, run_start_date=2024-02-23 23:40:32.213912+00:00, run_end_date=2024-02-23 23:40:32.593554+00:00, run_duration=0.379642, state=success, executor_state=success, try_number=1, max_tries=1, job_id=28, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:40:30.212414+00:00, queued_by_job_id=2, pid=387 2024-02-23T23:40:33.514370994Z [2024-02-23T23:40:33.513+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:40:33.514444094Z [2024-02-23T23:40:33.514+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d, execution_date=2024-02-23 23:35:00+00:00, run_id=scheduled__2024-02-23T23:35:00+00:00, run_start_date=2024-02-23 23:40:23.316871+00:00, run_end_date=2024-02-23 23:40:33.514102+00:00, run_duration=10.197231, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:35:00+00:00, data_interval_end=2024-02-23 23:40:00+00:00, dag_hash=844baffbd5a7f8b88757d53c4da62659 2024-02-23T23:40:33.525918591Z [2024-02-23T23:40:33.525+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d to 2024-02-23T23:40:00+00:00, run_after=2024-02-23T23:45:00+00:00 2024-02-23T23:40:34.625802567Z [2024-02-23T23:40:34.625+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:40:34.626256459Z [2024-02-23T23:40:34.625+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d, execution_date=2024-02-23 23:39:00+00:00, run_id=scheduled__2024-02-23T23:39:00+00:00, run_start_date=2024-02-23 23:40:30.165035+00:00, run_end_date=2024-02-23 23:40:34.625430+00:00, run_duration=4.460395, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:39:00+00:00, data_interval_end=2024-02-23 23:40:00+00:00, dag_hash=8abbcc7ed0c3f1f54fd86f1b170830f8 2024-02-23T23:40:34.639668222Z [2024-02-23T23:40:34.639+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d to 2024-02-23T23:40:00+00:00, run_after=2024-02-23T23:41:00+00:00 2024-02-23T23:40:34.676995380Z [2024-02-23T23:40:34.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:39:00+00:00 exited with status success for try_number 1 2024-02-23T23:40:34.683057595Z [2024-02-23T23:40:34.682+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:39:00+00:00, map_index=-1, run_start_date=2024-02-23 23:40:32.156413+00:00, run_end_date=2024-02-23 23:40:33.952469+00:00, run_duration=1.796056, state=success, executor_state=success, try_number=1, max_tries=1, job_id=27, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:40:30.212414+00:00, queued_by_job_id=2, pid=386 2024-02-23T23:40:59.327771534Z [2024-02-23T23:40:59.327+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96 to 2024-02-23T23:40:00+00:00, run_after=2024-02-23T23:41:00+00:00 2024-02-23T23:40:59.388936497Z [2024-02-23T23:40:59.388+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-23T23:40:59.388963932Z 2024-02-23T23:40:59.389427511Z [2024-02-23T23:40:59.388+0000] {scheduler_job.py:425} INFO - DAG vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96 has 0/16 running and queued tasks 2024-02-23T23:40:59.390921652Z [2024-02-23T23:40:59.390+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:40:59.390931190Z 2024-02-23T23:40:59.395719252Z [2024-02-23T23:40:59.395+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:40:59.395955560Z [2024-02-23T23:40:59.395+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T23:40:59.457646627Z [2024-02-23T23:40:59.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:39:00+00:00 exited with status queued for try_number 1 2024-02-23T23:40:59.467281687Z [2024-02-23T23:40:59.466+0000] {scheduler_job.py:635} INFO - Setting external_id for to f4f88274-e6ad-4f45-b65f-c2864c3f0e21 2024-02-23T23:41:00.753602169Z [2024-02-23T23:41:00.753+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:41:00.775462407Z [2024-02-23T23:41:00.775+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:41:00+00:00, run_after=2024-02-23T23:42:00+00:00 2024-02-23T23:41:00.800139813Z [2024-02-23T23:41:00.799+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:41:00.814701699Z [2024-02-23T23:41:00.814+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d to 2024-02-23T23:41:00+00:00, run_after=2024-02-23T23:42:00+00:00 2024-02-23T23:41:00.828817639Z [2024-02-23T23:41:00.828+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96 to 2024-02-23T23:41:00+00:00, run_after=2024-02-23T23:42:00+00:00 2024-02-23T23:41:00.847481062Z [2024-02-23T23:41:00.847+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:41:00+00:00, run_after=2024-02-23T23:42:00+00:00 2024-02-23T23:41:00.989981562Z [2024-02-23T23:41:00.989+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-02-23T23:41:00.990009166Z 2024-02-23T23:41:00.990012803Z 2024-02-23T23:41:00.990028347Z 2024-02-23T23:41:00.990031608Z 2024-02-23T23:41:00.990034648Z 2024-02-23T23:41:00.990038713Z 2024-02-23T23:41:00.990445539Z [2024-02-23T23:41:00.990+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d has 0/16 running and queued tasks 2024-02-23T23:41:00.990780327Z [2024-02-23T23:41:00.990+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-23T23:41:00.991123725Z [2024-02-23T23:41:00.990+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:41:00.991458364Z [2024-02-23T23:41:00.991+0000] {scheduler_job.py:425} INFO - DAG vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d has 0/16 running and queued tasks 2024-02-23T23:41:00.991792274Z [2024-02-23T23:41:00.991+0000] {scheduler_job.py:425} INFO - DAG vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96 has 1/16 running and queued tasks 2024-02-23T23:41:00.992133561Z [2024-02-23T23:41:00.991+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:41:00.993356953Z [2024-02-23T23:41:00.993+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:41:00.993367846Z 2024-02-23T23:41:00.993371181Z 2024-02-23T23:41:00.993374439Z 2024-02-23T23:41:00.993377560Z 2024-02-23T23:41:00.993380587Z 2024-02-23T23:41:00.993383713Z 2024-02-23T23:41:01.002492585Z [2024-02-23T23:41:01.002+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:41:01.004739810Z [2024-02-23T23:41:01.004+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T23:41:01.004903826Z [2024-02-23T23:41:01.004+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:41:01.004992604Z [2024-02-23T23:41:01.004+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T23:41:01.005127570Z [2024-02-23T23:41:01.005+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:41:01.005271216Z [2024-02-23T23:41:01.005+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T23:41:01.005448251Z [2024-02-23T23:41:01.005+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:41:01.005521856Z [2024-02-23T23:41:01.005+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T23:41:01.005702797Z [2024-02-23T23:41:01.005+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:41:01.005786986Z [2024-02-23T23:41:01.005+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T23:41:01.006008441Z [2024-02-23T23:41:01.005+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:41:01.006129588Z [2024-02-23T23:41:01.005+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T23:41:01.866958014Z [2024-02-23T23:41:01.866+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:40:00+00:00 exited with status queued for try_number 1 2024-02-23T23:41:01.867152329Z [2024-02-23T23:41:01.866+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:40:00+00:00 exited with status queued for try_number 1 2024-02-23T23:41:01.867249310Z [2024-02-23T23:41:01.867+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:40:00+00:00 exited with status queued for try_number 1 2024-02-23T23:41:01.868534172Z [2024-02-23T23:41:01.868+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:40:00+00:00 exited with status queued for try_number 1 2024-02-23T23:41:01.868652051Z [2024-02-23T23:41:01.868+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:40:00+00:00 exited with status queued for try_number 1 2024-02-23T23:41:01.868771363Z [2024-02-23T23:41:01.868+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:40:00+00:00 exited with status queued for try_number 1 2024-02-23T23:41:01.911793769Z [2024-02-23T23:41:01.911+0000] {scheduler_job.py:635} INFO - Setting external_id for to cff661a3-589e-405d-97ff-5a9c48cfdcde 2024-02-23T23:41:01.911977936Z [2024-02-23T23:41:01.911+0000] {scheduler_job.py:635} INFO - Setting external_id for to a10b438f-37a0-40cd-b529-1ad3d8eeec9a 2024-02-23T23:41:01.912126575Z [2024-02-23T23:41:01.912+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6d67d4b-46d7-489a-b742-47347249e79c 2024-02-23T23:41:01.912275355Z [2024-02-23T23:41:01.912+0000] {scheduler_job.py:635} INFO - Setting external_id for to a54950ef-a2d1-4acb-8843-9e9552dde967 2024-02-23T23:41:01.912418145Z [2024-02-23T23:41:01.912+0000] {scheduler_job.py:635} INFO - Setting external_id for to be6d2bf5-d36d-4e4b-8c84-7b27d317737a 2024-02-23T23:41:01.912555390Z [2024-02-23T23:41:01.912+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8078558-df5b-435b-a686-c34a641958ec 2024-02-23T23:41:03.171743334Z [2024-02-23T23:41:03.171+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:41:03.206608015Z [2024-02-23T23:41:03.206+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:41:03.206771852Z [2024-02-23T23:41:03.206+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96, execution_date=2024-02-23 23:39:00+00:00, run_id=scheduled__2024-02-23T23:39:00+00:00, run_start_date=2024-02-23 23:40:59.342738+00:00, run_end_date=2024-02-23 23:41:03.206509+00:00, run_duration=3.863771, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:39:00+00:00, data_interval_end=2024-02-23 23:40:00+00:00, dag_hash=0fc8b90b6322719222efb4564fbea5c7 2024-02-23T23:41:03.216239051Z [2024-02-23T23:41:03.215+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96 to 2024-02-23T23:40:00+00:00, run_after=2024-02-23T23:41:00+00:00 2024-02-23T23:41:03.235430711Z [2024-02-23T23:41:03.235+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:41:03.235607099Z [2024-02-23T23:41:03.235+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-23 23:40:00+00:00, run_id=scheduled__2024-02-23T23:40:00+00:00, run_start_date=2024-02-23 23:41:00.872434+00:00, run_end_date=2024-02-23 23:41:03.235347+00:00, run_duration=2.362913, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:40:00+00:00, data_interval_end=2024-02-23 23:41:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-23T23:41:03.245517272Z [2024-02-23T23:41:03.245+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:41:00+00:00, run_after=2024-02-23T23:42:00+00:00 2024-02-23T23:41:03.278472945Z [2024-02-23T23:41:03.278+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-23T23:41:03.278496403Z 2024-02-23T23:41:03.278506201Z [2024-02-23T23:41:03.278+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96 has 0/16 running and queued tasks 2024-02-23T23:41:03.278982546Z [2024-02-23T23:41:03.278+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:41:03.278993525Z 2024-02-23T23:41:03.281209205Z [2024-02-23T23:41:03.280+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:41:03.281274390Z [2024-02-23T23:41:03.281+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T23:41:03.375576256Z [2024-02-23T23:41:03.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:40:00+00:00 exited with status queued for try_number 1 2024-02-23T23:41:03.375624190Z [2024-02-23T23:41:03.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:39:00+00:00 exited with status success for try_number 1 2024-02-23T23:41:03.375636233Z [2024-02-23T23:41:03.375+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:40:00+00:00 exited with status success for try_number 1 2024-02-23T23:41:03.407154488Z [2024-02-23T23:41:03.406+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:39:00+00:00, map_index=-1, run_start_date=2024-02-23 23:41:00.980193+00:00, run_end_date=2024-02-23 23:41:02.845460+00:00, run_duration=1.865267, state=success, executor_state=success, try_number=1, max_tries=1, job_id=29, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:40:59.391772+00:00, queued_by_job_id=2, pid=414 2024-02-23T23:41:03.407508100Z [2024-02-23T23:41:03.407+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9ecaac7e-8cee-4104-a66d-46a2ef40ecc8 2024-02-23T23:41:03.407736390Z [2024-02-23T23:41:03.407+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:40:00+00:00, map_index=-1, run_start_date=2024-02-23 23:41:02.321313+00:00, run_end_date=2024-02-23 23:41:02.997176+00:00, run_duration=0.675863, state=success, executor_state=success, try_number=1, max_tries=1, job_id=30, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:41:00.995672+00:00, queued_by_job_id=2, pid=431 2024-02-23T23:41:03.516471879Z [2024-02-23T23:41:03.516+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96 to 2024-02-23T23:41:00+00:00, run_after=2024-02-23T23:42:00+00:00 2024-02-23T23:41:05.045638904Z [2024-02-23T23:41:05.045+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:40:00+00:00 exited with status failed for try_number 1 2024-02-23T23:41:05.048038363Z [2024-02-23T23:41:05.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:40:00+00:00 exited with status failed for try_number 1 2024-02-23T23:41:05.056598149Z [2024-02-23T23:41:05.056+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:40:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:41:00.995672+00:00, queued_by_job_id=2, pid=None 2024-02-23T23:41:05.057746374Z [2024-02-23T23:41:05.057+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-23T23:41:05.061811304Z [2024-02-23T23:41:05.061+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-23T23:41:05.091305558Z [2024-02-23T23:41:05.091+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240223T234000, start_date=, end_date=20240223T234105 2024-02-23T23:41:05.108310596Z [2024-02-23T23:41:05.107+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:40:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:41:00.995672+00:00, queued_by_job_id=2, pid=None 2024-02-23T23:41:05.108723791Z [2024-02-23T23:41:05.108+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-23T23:41:05.110908492Z [2024-02-23T23:41:05.110+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-23T23:41:05.123279482Z [2024-02-23T23:41:05.122+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240223T234000, start_date=, end_date=20240223T234105 2024-02-23T23:41:07.331861558Z [2024-02-23T23:41:07.331+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:41:07.332477015Z [2024-02-23T23:41:07.332+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:40:00+00:00, run_id=scheduled__2024-02-23T23:40:00+00:00, run_start_date=2024-02-23 23:41:00.873906+00:00, run_end_date=2024-02-23 23:41:07.331710+00:00, run_duration=6.457804, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:40:00+00:00, data_interval_end=2024-02-23 23:41:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-23T23:41:07.344243230Z [2024-02-23T23:41:07.343+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:41:00+00:00, run_after=2024-02-23T23:42:00+00:00 2024-02-23T23:41:07.355056645Z [2024-02-23T23:41:07.354+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:41:07.355855131Z [2024-02-23T23:41:07.355+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:40:00+00:00, run_id=scheduled__2024-02-23T23:40:00+00:00, run_start_date=2024-02-23 23:41:00.878097+00:00, run_end_date=2024-02-23 23:41:07.355143+00:00, run_duration=6.477046, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:40:00+00:00, data_interval_end=2024-02-23 23:41:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-23T23:41:07.374055471Z [2024-02-23T23:41:07.373+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:41:00+00:00, run_after=2024-02-23T23:42:00+00:00 2024-02-23T23:41:07.380959638Z [2024-02-23T23:41:07.380+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:41:07.381435017Z [2024-02-23T23:41:07.381+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96, execution_date=2024-02-23 23:40:00+00:00, run_id=scheduled__2024-02-23T23:40:00+00:00, run_start_date=2024-02-23 23:41:00.875574+00:00, run_end_date=2024-02-23 23:41:07.380859+00:00, run_duration=6.505285, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:40:00+00:00, data_interval_end=2024-02-23 23:41:00+00:00, dag_hash=0fc8b90b6322719222efb4564fbea5c7 2024-02-23T23:41:07.394118907Z [2024-02-23T23:41:07.393+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96 to 2024-02-23T23:41:00+00:00, run_after=2024-02-23T23:42:00+00:00 2024-02-23T23:41:07.400872962Z [2024-02-23T23:41:07.400+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:41:07.401089521Z [2024-02-23T23:41:07.400+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96, execution_date=2024-02-23 23:40:00+00:00, run_id=scheduled__2024-02-23T23:40:00+00:00, run_start_date=2024-02-23 23:41:03.183532+00:00, run_end_date=2024-02-23 23:41:07.400706+00:00, run_duration=4.217174, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:40:00+00:00, data_interval_end=2024-02-23 23:41:00+00:00, dag_hash=b5e0ef6395e3db9592f5f70c02ce9a02 2024-02-23T23:41:07.412025414Z [2024-02-23T23:41:07.411+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96 to 2024-02-23T23:41:00+00:00, run_after=2024-02-23T23:42:00+00:00 2024-02-23T23:41:07.466696942Z [2024-02-23T23:41:07.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:40:00+00:00 exited with status success for try_number 1 2024-02-23T23:41:07.467140640Z [2024-02-23T23:41:07.466+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:40:00+00:00 exited with status success for try_number 1 2024-02-23T23:41:07.467430565Z [2024-02-23T23:41:07.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:40:00+00:00 exited with status success for try_number 1 2024-02-23T23:41:07.467741201Z [2024-02-23T23:41:07.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:40:00+00:00 exited with status success for try_number 1 2024-02-23T23:41:07.488942775Z [2024-02-23T23:41:07.488+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:40:00+00:00, map_index=-1, run_start_date=2024-02-23 23:41:05.503035+00:00, run_end_date=2024-02-23 23:41:07.091592+00:00, run_duration=1.588557, state=success, executor_state=success, try_number=1, max_tries=1, job_id=34, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:41:03.279243+00:00, queued_by_job_id=2, pid=502 2024-02-23T23:41:07.489218386Z [2024-02-23T23:41:07.488+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:40:00+00:00, map_index=-1, run_start_date=2024-02-23 23:41:04.614320+00:00, run_end_date=2024-02-23 23:41:06.305706+00:00, run_duration=1.691386, state=success, executor_state=success, try_number=1, max_tries=1, job_id=32, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:41:00.995672+00:00, queued_by_job_id=2, pid=474 2024-02-23T23:41:07.489693282Z [2024-02-23T23:41:07.489+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:40:00+00:00, map_index=-1, run_start_date=2024-02-23 23:41:04.599476+00:00, run_end_date=2024-02-23 23:41:06.313626+00:00, run_duration=1.71415, state=success, executor_state=success, try_number=1, max_tries=1, job_id=31, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:41:00.995672+00:00, queued_by_job_id=2, pid=473 2024-02-23T23:41:07.490180548Z [2024-02-23T23:41:07.489+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:40:00+00:00, map_index=-1, run_start_date=2024-02-23 23:41:05.172328+00:00, run_end_date=2024-02-23 23:41:06.768140+00:00, run_duration=1.595812, state=success, executor_state=success, try_number=1, max_tries=1, job_id=33, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:41:00.995672+00:00, queued_by_job_id=2, pid=491 2024-02-23T23:41:16.095072441Z [2024-02-23T23:41:16.094+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-02-23T23:41:16.095104265Z 2024-02-23T23:41:16.095108132Z 2024-02-23T23:41:16.096004792Z [2024-02-23T23:41:16.095+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d has 0/16 running and queued tasks 2024-02-23T23:41:16.096347632Z [2024-02-23T23:41:16.096+0000] {scheduler_job.py:425} INFO - DAG vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d has 0/16 running and queued tasks 2024-02-23T23:41:16.097613784Z [2024-02-23T23:41:16.097+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:41:16.097627128Z 2024-02-23T23:41:16.097632015Z 2024-02-23T23:41:16.101467236Z [2024-02-23T23:41:16.101+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:40:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:41:16.101807514Z [2024-02-23T23:41:16.101+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T23:41:16.102303341Z [2024-02-23T23:41:16.102+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:40:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:41:16.102591304Z [2024-02-23T23:41:16.102+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T23:41:16.265856983Z [2024-02-23T23:41:16.265+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:40:00+00:00 exited with status queued for try_number 2 2024-02-23T23:41:16.266018858Z [2024-02-23T23:41:16.265+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:40:00+00:00 exited with status queued for try_number 2 2024-02-23T23:41:16.272184617Z [2024-02-23T23:41:16.271+0000] {scheduler_job.py:635} INFO - Setting external_id for to 47672aff-17db-4fde-bb43-ec31950ecfb0 2024-02-23T23:41:16.272453199Z [2024-02-23T23:41:16.272+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58563c68-3938-4a89-8930-37be023c299c 2024-02-23T23:41:18.165357792Z [2024-02-23T23:41:18.164+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:40:00+00:00 exited with status failed for try_number 2 2024-02-23T23:41:18.165714003Z [2024-02-23T23:41:18.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:40:00+00:00 exited with status failed for try_number 2 2024-02-23T23:41:18.174838596Z [2024-02-23T23:41:18.174+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:40:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-02-23 23:41:05.067473+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:41:16.098659+00:00, queued_by_job_id=2, pid=None 2024-02-23T23:41:18.175573753Z [2024-02-23T23:41:18.175+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-23T23:41:18.178865122Z [2024-02-23T23:41:18.178+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-23T23:41:18.193273932Z [2024-02-23T23:41:18.192+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240223T234000, start_date=, end_date=20240223T234118 2024-02-23T23:41:18.202138935Z [2024-02-23T23:41:18.201+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:40:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-02-23 23:41:05.113285+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:41:16.098659+00:00, queued_by_job_id=2, pid=None 2024-02-23T23:41:18.202725666Z [2024-02-23T23:41:18.202+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-23T23:41:18.205380605Z [2024-02-23T23:41:18.205+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-23T23:41:18.228462526Z [2024-02-23T23:41:18.227+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240223T234000, start_date=, end_date=20240223T234118 2024-02-23T23:41:18.696403100Z [2024-02-23T23:41:18.695+0000] {dagrun.py:586} ERROR - Marking run failed 2024-02-23T23:41:18.696861934Z [2024-02-23T23:41:18.696+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d, execution_date=2024-02-23 23:40:00+00:00, run_id=scheduled__2024-02-23T23:40:00+00:00, run_start_date=2024-02-23 23:41:00.870868+00:00, run_end_date=2024-02-23 23:41:18.696276+00:00, run_duration=17.825408, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:40:00+00:00, data_interval_end=2024-02-23 23:41:00+00:00, dag_hash=8abbcc7ed0c3f1f54fd86f1b170830f8 2024-02-23T23:41:18.705859745Z [2024-02-23T23:41:18.705+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d to 2024-02-23T23:41:00+00:00, run_after=2024-02-23T23:42:00+00:00 2024-02-23T23:41:18.711463416Z [2024-02-23T23:41:18.711+0000] {dagrun.py:586} ERROR - Marking run failed 2024-02-23T23:41:18.711684680Z [2024-02-23T23:41:18.711+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d, execution_date=2024-02-23 23:40:00+00:00, run_id=scheduled__2024-02-23T23:40:00+00:00, run_start_date=2024-02-23 23:41:00.875260+00:00, run_end_date=2024-02-23 23:41:18.711329+00:00, run_duration=17.836069, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:40:00+00:00, data_interval_end=2024-02-23 23:41:00+00:00, dag_hash=1f2af53b2b9e8daef31aa1ee246ba43a 2024-02-23T23:41:18.720180386Z [2024-02-23T23:41:18.719+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d to 2024-02-23T23:41:00+00:00, run_after=2024-02-23T23:42:00+00:00 2024-02-23T23:41:59.175951608Z [2024-02-23T23:41:59.175+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-23T23:42:00.829573222Z [2024-02-23T23:42:00.828+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:42:00.847726355Z [2024-02-23T23:42:00.847+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:42:00.874541159Z [2024-02-23T23:42:00.874+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d to 2024-02-23T23:42:00+00:00, run_after=2024-02-23T23:43:00+00:00 2024-02-23T23:42:00.892222797Z [2024-02-23T23:42:00.891+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:42:00+00:00, run_after=2024-02-23T23:43:00+00:00 2024-02-23T23:42:00.903314201Z [2024-02-23T23:42:00.902+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:42:00.912482347Z [2024-02-23T23:42:00.912+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:42:00.926475458Z [2024-02-23T23:42:00.926+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:42:00+00:00, run_after=2024-02-23T23:43:00+00:00 2024-02-23T23:42:00.940881931Z [2024-02-23T23:42:00.940+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96 to 2024-02-23T23:42:00+00:00, run_after=2024-02-23T23:43:00+00:00 2024-02-23T23:42:01.127104453Z [2024-02-23T23:42:01.126+0000] {scheduler_job.py:360} INFO - 8 tasks up for execution: 2024-02-23T23:42:01.127139574Z 2024-02-23T23:42:01.127146615Z 2024-02-23T23:42:01.127151935Z 2024-02-23T23:42:01.127156830Z 2024-02-23T23:42:01.127162262Z 2024-02-23T23:42:01.127167789Z 2024-02-23T23:42:01.127173284Z 2024-02-23T23:42:01.127178513Z 2024-02-23T23:42:01.127473789Z [2024-02-23T23:42:01.127+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-23T23:42:01.127904462Z [2024-02-23T23:42:01.127+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d has 0/16 running and queued tasks 2024-02-23T23:42:01.128283189Z [2024-02-23T23:42:01.128+0000] {scheduler_job.py:425} INFO - DAG vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d has 0/16 running and queued tasks 2024-02-23T23:42:01.128675162Z [2024-02-23T23:42:01.128+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-23T23:42:01.129119461Z [2024-02-23T23:42:01.128+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96 has 0/16 running and queued tasks 2024-02-23T23:42:01.129471727Z [2024-02-23T23:42:01.129+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:42:01.129873274Z [2024-02-23T23:42:01.129+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:42:01.130250305Z [2024-02-23T23:42:01.130+0000] {scheduler_job.py:425} INFO - DAG vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96 has 0/16 running and queued tasks 2024-02-23T23:42:01.131820266Z [2024-02-23T23:42:01.131+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:42:01.131833821Z 2024-02-23T23:42:01.131840431Z 2024-02-23T23:42:01.131846122Z 2024-02-23T23:42:01.131850939Z 2024-02-23T23:42:01.131855884Z 2024-02-23T23:42:01.131861153Z 2024-02-23T23:42:01.131866255Z 2024-02-23T23:42:01.131871994Z 2024-02-23T23:42:01.142173981Z [2024-02-23T23:42:01.141+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-23T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:42:01.142549790Z [2024-02-23T23:42:01.142+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T23:42:01.143081727Z [2024-02-23T23:42:01.142+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:42:01.143523409Z [2024-02-23T23:42:01.143+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T23:42:01.143975226Z [2024-02-23T23:42:01.143+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:42:01.144291982Z [2024-02-23T23:42:01.144+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T23:42:01.145013330Z [2024-02-23T23:42:01.144+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:42:01.145631385Z [2024-02-23T23:42:01.145+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T23:42:01.146209912Z [2024-02-23T23:42:01.145+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:42:01.146507903Z [2024-02-23T23:42:01.146+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T23:42:01.146924943Z [2024-02-23T23:42:01.146+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:42:01.147217488Z [2024-02-23T23:42:01.146+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T23:42:01.147629993Z [2024-02-23T23:42:01.147+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:42:01.147928959Z [2024-02-23T23:42:01.147+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T23:42:01.148402638Z [2024-02-23T23:42:01.148+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:42:01.148683670Z [2024-02-23T23:42:01.148+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T23:42:01.923562250Z [2024-02-23T23:42:01.920+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-23T23:40:00+00:00 exited with status queued for try_number 1 2024-02-23T23:42:01.923699954Z [2024-02-23T23:42:01.923+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:41:00+00:00 exited with status queued for try_number 1 2024-02-23T23:42:01.923767757Z [2024-02-23T23:42:01.923+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:41:00+00:00 exited with status queued for try_number 1 2024-02-23T23:42:01.923837190Z [2024-02-23T23:42:01.923+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:41:00+00:00 exited with status queued for try_number 1 2024-02-23T23:42:01.923900832Z [2024-02-23T23:42:01.923+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:41:00+00:00 exited with status queued for try_number 1 2024-02-23T23:42:01.923965968Z [2024-02-23T23:42:01.923+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:41:00+00:00 exited with status queued for try_number 1 2024-02-23T23:42:01.924039537Z [2024-02-23T23:42:01.923+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:41:00+00:00 exited with status queued for try_number 1 2024-02-23T23:42:01.924099229Z [2024-02-23T23:42:01.924+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:41:00+00:00 exited with status queued for try_number 1 2024-02-23T23:42:01.939255044Z [2024-02-23T23:42:01.938+0000] {scheduler_job.py:635} INFO - Setting external_id for to b1193f49-8446-402a-a7f5-e7ed8af894c3 2024-02-23T23:42:01.939284683Z [2024-02-23T23:42:01.939+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2701749a-e634-4641-a619-2cbeaf1437be 2024-02-23T23:42:01.939415281Z [2024-02-23T23:42:01.939+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5609071c-0337-42be-b041-403aacee5aee 2024-02-23T23:42:01.939513096Z [2024-02-23T23:42:01.939+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0204bcaa-9992-4cd4-b39c-85a2f83ec24d 2024-02-23T23:42:01.940033319Z [2024-02-23T23:42:01.939+0000] {scheduler_job.py:635} INFO - Setting external_id for to 02583544-4d6d-4de7-ad01-11b861a2d8ba 2024-02-23T23:42:01.940163026Z [2024-02-23T23:42:01.940+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8630b6b2-05ab-4d93-9a4b-402818fce362 2024-02-23T23:42:01.940270571Z [2024-02-23T23:42:01.940+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8afd5fdb-9244-4325-b9f6-3aeb8b947e62 2024-02-23T23:42:01.940404794Z [2024-02-23T23:42:01.940+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39f9d9dc-e26a-43d6-a320-b5c664dff3df 2024-02-23T23:42:05.723547167Z [2024-02-23T23:42:05.722+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:42:05.724199321Z [2024-02-23T23:42:05.723+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-23 23:40:00+00:00, run_id=scheduled__2024-02-23T23:40:00+00:00, run_start_date=2024-02-23 23:42:00.954513+00:00, run_end_date=2024-02-23 23:42:05.723377+00:00, run_duration=4.768864, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:40:00+00:00, data_interval_end=2024-02-23 23:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-23T23:42:05.736938139Z [2024-02-23T23:42:05.736+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-23T23:42:00+00:00, run_after=2024-02-23T23:44:00+00:00 2024-02-23T23:42:05.747592613Z [2024-02-23T23:42:05.747+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:42:05.748052722Z [2024-02-23T23:42:05.747+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-23 23:41:00+00:00, run_id=scheduled__2024-02-23T23:41:00+00:00, run_start_date=2024-02-23 23:42:00.968350+00:00, run_end_date=2024-02-23 23:42:05.747686+00:00, run_duration=4.779336, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:41:00+00:00, data_interval_end=2024-02-23 23:42:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-23T23:42:05.759410000Z [2024-02-23T23:42:05.759+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:42:00+00:00, run_after=2024-02-23T23:43:00+00:00 2024-02-23T23:42:05.846320455Z [2024-02-23T23:42:05.845+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-23T23:40:00+00:00 exited with status success for try_number 1 2024-02-23T23:42:05.846624752Z [2024-02-23T23:42:05.846+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:41:00+00:00 exited with status failed for try_number 1 2024-02-23T23:42:05.846944845Z [2024-02-23T23:42:05.846+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:41:00+00:00 exited with status failed for try_number 1 2024-02-23T23:42:05.847238395Z [2024-02-23T23:42:05.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:41:00+00:00 exited with status success for try_number 1 2024-02-23T23:42:05.847510270Z [2024-02-23T23:42:05.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:41:00+00:00 exited with status failed for try_number 1 2024-02-23T23:42:05.861140401Z [2024-02-23T23:42:05.860+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-23T23:40:00+00:00, map_index=-1, run_start_date=2024-02-23 23:42:03.740044+00:00, run_end_date=2024-02-23 23:42:04.430178+00:00, run_duration=0.690134, state=success, executor_state=success, try_number=1, max_tries=1, job_id=36, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:42:01.134594+00:00, queued_by_job_id=2, pid=562 2024-02-23T23:42:05.861566832Z [2024-02-23T23:42:05.861+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:41:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:42:01.134594+00:00, queued_by_job_id=2, pid=None 2024-02-23T23:42:05.862443135Z [2024-02-23T23:42:05.862+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-23T23:42:05.864916499Z [2024-02-23T23:42:05.864+0000] {dagbag.py:207} WARNING - Serialized DAG vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d no longer exists 2024-02-23T23:42:05.871493097Z [2024-02-23T23:42:05.866+0000] {scheduler_job.py:694} ERROR - Marking task instance as failed 2024-02-23T23:42:05.871506758Z Traceback (most recent call last): 2024-02-23T23:42:05.871510748Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/jobs/scheduler_job.py", line 692, in _process_executor_events 2024-02-23T23:42:05.871514037Z task = dag.get_task(ti.task_id) 2024-02-23T23:42:05.871517527Z AttributeError: 'NoneType' object has no attribute 'get_task' 2024-02-23T23:42:05.884368153Z [2024-02-23T23:42:05.884+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:41:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:42:01.134594+00:00, queued_by_job_id=2, pid=None 2024-02-23T23:42:05.884965475Z [2024-02-23T23:42:05.884+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-23T23:42:05.887465850Z [2024-02-23T23:42:05.887+0000] {dagbag.py:207} WARNING - Serialized DAG vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d no longer exists 2024-02-23T23:42:05.889335838Z [2024-02-23T23:42:05.887+0000] {scheduler_job.py:694} ERROR - Marking task instance as failed 2024-02-23T23:42:05.889359100Z Traceback (most recent call last): 2024-02-23T23:42:05.889369430Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/jobs/scheduler_job.py", line 692, in _process_executor_events 2024-02-23T23:42:05.889383904Z task = dag.get_task(ti.task_id) 2024-02-23T23:42:05.889395324Z AttributeError: 'NoneType' object has no attribute 'get_task' 2024-02-23T23:42:05.899554529Z [2024-02-23T23:42:05.899+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:41:00+00:00, map_index=-1, run_start_date=2024-02-23 23:42:03.064461+00:00, run_end_date=2024-02-23 23:42:04.354525+00:00, run_duration=1.290064, state=success, executor_state=success, try_number=1, max_tries=1, job_id=35, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:42:01.134594+00:00, queued_by_job_id=2, pid=559 2024-02-23T23:42:05.899844954Z [2024-02-23T23:42:05.899+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:41:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:42:01.134594+00:00, queued_by_job_id=2, pid=None 2024-02-23T23:42:05.900270800Z [2024-02-23T23:42:05.900+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-23T23:42:05.902627051Z [2024-02-23T23:42:05.902+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-23T23:42:05.915305741Z [2024-02-23T23:42:05.915+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240223T234100, start_date=, end_date=20240223T234205 2024-02-23T23:42:06.966795458Z [2024-02-23T23:42:06.966+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:42:06.967507951Z [2024-02-23T23:42:06.967+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:41:00+00:00, run_id=scheduled__2024-02-23T23:41:00+00:00, run_start_date=2024-02-23 23:42:00.965642+00:00, run_end_date=2024-02-23 23:42:06.966930+00:00, run_duration=6.001288, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:41:00+00:00, data_interval_end=2024-02-23 23:42:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-23T23:42:06.983134153Z [2024-02-23T23:42:06.982+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:42:00+00:00, run_after=2024-02-23T23:43:00+00:00 2024-02-23T23:42:06.993872333Z [2024-02-23T23:42:06.993+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:42:06.994182148Z [2024-02-23T23:42:06.993+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:41:00+00:00, run_id=scheduled__2024-02-23T23:41:00+00:00, run_start_date=2024-02-23 23:42:00.966886+00:00, run_end_date=2024-02-23 23:42:06.993801+00:00, run_duration=6.026915, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:41:00+00:00, data_interval_end=2024-02-23 23:42:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-23T23:42:07.006798325Z [2024-02-23T23:42:07.006+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:42:00+00:00, run_after=2024-02-23T23:43:00+00:00 2024-02-23T23:42:07.076169533Z [2024-02-23T23:42:07.075+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:41:00+00:00 exited with status success for try_number 1 2024-02-23T23:42:07.076444292Z [2024-02-23T23:42:07.076+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:41:00+00:00 exited with status failed for try_number 1 2024-02-23T23:42:07.084475972Z [2024-02-23T23:42:07.084+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:41:00+00:00, map_index=-1, run_start_date=2024-02-23 23:42:05.290442+00:00, run_end_date=2024-02-23 23:42:06.618402+00:00, run_duration=1.32796, state=success, executor_state=success, try_number=1, max_tries=1, job_id=38, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:42:01.134594+00:00, queued_by_job_id=2, pid=617 2024-02-23T23:42:07.084872838Z [2024-02-23T23:42:07.084+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:41:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:42:01.134594+00:00, queued_by_job_id=2, pid=None 2024-02-23T23:42:07.085424575Z [2024-02-23T23:42:07.085+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-23T23:42:07.088311052Z [2024-02-23T23:42:07.087+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-23T23:42:07.104215727Z [2024-02-23T23:42:07.103+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240223T234100, start_date=, end_date=20240223T234207 2024-02-23T23:42:08.208655225Z [2024-02-23T23:42:08.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:41:00+00:00 exited with status success for try_number 1 2024-02-23T23:42:08.214223548Z [2024-02-23T23:42:08.213+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:41:00+00:00, map_index=-1, run_start_date=2024-02-23 23:42:05.271365+00:00, run_end_date=2024-02-23 23:42:06.942738+00:00, run_duration=1.671373, state=success, executor_state=success, try_number=1, max_tries=1, job_id=37, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:42:01.134594+00:00, queued_by_job_id=2, pid=616 2024-02-23T23:42:16.987052521Z [2024-02-23T23:42:16.986+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-23T23:42:16.987148151Z 2024-02-23T23:42:16.987420012Z [2024-02-23T23:42:16.986+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96 has 0/16 running and queued tasks 2024-02-23T23:42:16.988463469Z [2024-02-23T23:42:16.988+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:42:16.988482263Z 2024-02-23T23:42:16.991980423Z [2024-02-23T23:42:16.991+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:41:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:42:16.992228240Z [2024-02-23T23:42:16.991+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T23:42:17.044939155Z [2024-02-23T23:42:17.044+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:41:00+00:00 exited with status queued for try_number 2 2024-02-23T23:42:17.050951833Z [2024-02-23T23:42:17.050+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa1288a8-39a0-4540-bccf-9af00ef5a1bf 2024-02-23T23:42:17.109531618Z [2024-02-23T23:42:17.108+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-23T23:42:17.109573020Z 2024-02-23T23:42:17.110172799Z [2024-02-23T23:42:17.109+0000] {scheduler_job.py:425} INFO - DAG vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96 has 0/16 running and queued tasks 2024-02-23T23:42:17.111764717Z [2024-02-23T23:42:17.111+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:42:17.111791470Z 2024-02-23T23:42:17.115750796Z [2024-02-23T23:42:17.115+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:41:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:42:17.116112984Z [2024-02-23T23:42:17.115+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T23:42:17.169545946Z [2024-02-23T23:42:17.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:41:00+00:00 exited with status queued for try_number 2 2024-02-23T23:42:17.180023738Z [2024-02-23T23:42:17.179+0000] {scheduler_job.py:635} INFO - Setting external_id for to acc04adc-7f6a-455b-8793-39b460f7ee7e 2024-02-23T23:42:19.496712598Z [2024-02-23T23:42:19.496+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:41:00+00:00 exited with status failed for try_number 2 2024-02-23T23:42:19.496947974Z [2024-02-23T23:42:19.496+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:41:00+00:00 exited with status failed for try_number 2 2024-02-23T23:42:19.505708767Z [2024-02-23T23:42:19.505+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:41:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-02-23 23:42:05.905040+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:42:16.988922+00:00, queued_by_job_id=2, pid=None 2024-02-23T23:42:19.506273376Z [2024-02-23T23:42:19.506+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-23T23:42:19.509368630Z [2024-02-23T23:42:19.508+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-23T23:42:19.526891476Z [2024-02-23T23:42:19.526+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240223T234100, start_date=, end_date=20240223T234219 2024-02-23T23:42:19.534273923Z [2024-02-23T23:42:19.533+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:41:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-02-23 23:42:07.090923+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:42:17.112696+00:00, queued_by_job_id=2, pid=None 2024-02-23T23:42:19.534739197Z [2024-02-23T23:42:19.534+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-23T23:42:19.536891325Z [2024-02-23T23:42:19.536+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-23T23:42:19.548792413Z [2024-02-23T23:42:19.548+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240223T234100, start_date=, end_date=20240223T234219 2024-02-23T23:42:19.865102313Z [2024-02-23T23:42:19.864+0000] {dagrun.py:586} ERROR - Marking run failed 2024-02-23T23:42:19.865766201Z [2024-02-23T23:42:19.865+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96, execution_date=2024-02-23 23:41:00+00:00, run_id=scheduled__2024-02-23T23:41:00+00:00, run_start_date=2024-02-23 23:42:00.969661+00:00, run_end_date=2024-02-23 23:42:19.865225+00:00, run_duration=18.895564, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:41:00+00:00, data_interval_end=2024-02-23 23:42:00+00:00, dag_hash=b5e0ef6395e3db9592f5f70c02ce9a02 2024-02-23T23:42:19.879499377Z [2024-02-23T23:42:19.879+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96 to 2024-02-23T23:42:00+00:00, run_after=2024-02-23T23:43:00+00:00 2024-02-23T23:42:19.889041886Z [2024-02-23T23:42:19.888+0000] {dagrun.py:586} ERROR - Marking run failed 2024-02-23T23:42:19.889421564Z [2024-02-23T23:42:19.889+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96, execution_date=2024-02-23 23:41:00+00:00, run_id=scheduled__2024-02-23T23:41:00+00:00, run_start_date=2024-02-23 23:42:00.970939+00:00, run_end_date=2024-02-23 23:42:19.889133+00:00, run_duration=18.918194, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:41:00+00:00, data_interval_end=2024-02-23 23:42:00+00:00, dag_hash=0fc8b90b6322719222efb4564fbea5c7 2024-02-23T23:42:19.900004487Z [2024-02-23T23:42:19.899+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96 to 2024-02-23T23:42:00+00:00, run_after=2024-02-23T23:43:00+00:00 2024-02-23T23:43:00.461075453Z [2024-02-23T23:43:00.460+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:43:00+00:00, run_after=2024-02-23T23:44:00+00:00 2024-02-23T23:43:00.467657936Z [2024-02-23T23:43:00.467+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:43:00.479602709Z [2024-02-23T23:43:00.479+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96 to 2024-02-23T23:43:00+00:00, run_after=2024-02-23T23:44:00+00:00 2024-02-23T23:43:00.491002042Z [2024-02-23T23:43:00.490+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:43:00+00:00, run_after=2024-02-23T23:44:00+00:00 2024-02-23T23:43:00.497844341Z [2024-02-23T23:43:00.497+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:43:00.624479858Z [2024-02-23T23:43:00.624+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-02-23T23:43:00.624511367Z 2024-02-23T23:43:00.624529853Z 2024-02-23T23:43:00.624533325Z 2024-02-23T23:43:00.624536677Z 2024-02-23T23:43:00.624539760Z 2024-02-23T23:43:00.624832031Z [2024-02-23T23:43:00.624+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96 has 0/16 running and queued tasks 2024-02-23T23:43:00.625097795Z [2024-02-23T23:43:00.624+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:43:00.625366634Z [2024-02-23T23:43:00.625+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:43:00.625635954Z [2024-02-23T23:43:00.625+0000] {scheduler_job.py:425} INFO - DAG vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96 has 0/16 running and queued tasks 2024-02-23T23:43:00.625964138Z [2024-02-23T23:43:00.625+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-23T23:43:00.626955900Z [2024-02-23T23:43:00.626+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:43:00.626965781Z 2024-02-23T23:43:00.626969049Z 2024-02-23T23:43:00.626972196Z 2024-02-23T23:43:00.626975190Z 2024-02-23T23:43:00.626978251Z 2024-02-23T23:43:00.639659642Z [2024-02-23T23:43:00.639+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:43:00.640169311Z [2024-02-23T23:43:00.639+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T23:43:00.640654818Z [2024-02-23T23:43:00.640+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:43:00.640995357Z [2024-02-23T23:43:00.640+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T23:43:00.641847708Z [2024-02-23T23:43:00.641+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:43:00.642190445Z [2024-02-23T23:43:00.641+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T23:43:00.642611825Z [2024-02-23T23:43:00.642+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:43:00.642896025Z [2024-02-23T23:43:00.642+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T23:43:00.643309892Z [2024-02-23T23:43:00.643+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:43:00.643589731Z [2024-02-23T23:43:00.643+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T23:43:01.300811718Z [2024-02-23T23:43:01.291+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:42:00+00:00 exited with status queued for try_number 1 2024-02-23T23:43:01.300841632Z [2024-02-23T23:43:01.292+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:42:00+00:00 exited with status queued for try_number 1 2024-02-23T23:43:01.300845340Z [2024-02-23T23:43:01.292+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:42:00+00:00 exited with status queued for try_number 1 2024-02-23T23:43:01.300848687Z [2024-02-23T23:43:01.292+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:42:00+00:00 exited with status queued for try_number 1 2024-02-23T23:43:01.300851798Z [2024-02-23T23:43:01.292+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:42:00+00:00 exited with status queued for try_number 1 2024-02-23T23:43:01.323624912Z [2024-02-23T23:43:01.320+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb45f9c3-1cff-4b7d-bf46-8bee0aaa7660 2024-02-23T23:43:01.323671020Z [2024-02-23T23:43:01.321+0000] {scheduler_job.py:635} INFO - Setting external_id for to daf96822-b18a-4ba4-aeac-97a961a2d0bc 2024-02-23T23:43:01.323674907Z [2024-02-23T23:43:01.321+0000] {scheduler_job.py:635} INFO - Setting external_id for to c44ac05f-7dbd-43f6-9e5f-68e4e51123a0 2024-02-23T23:43:01.323678027Z [2024-02-23T23:43:01.321+0000] {scheduler_job.py:635} INFO - Setting external_id for to e702e9a3-f4eb-4a51-a2dc-31ff04655001 2024-02-23T23:43:01.323681591Z [2024-02-23T23:43:01.321+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f99c8a6-ee9d-47be-9627-6464f367c3e5 2024-02-23T23:43:02.495325281Z [2024-02-23T23:43:02.494+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:43:02.495536314Z [2024-02-23T23:43:02.495+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-23 23:42:00+00:00, run_id=scheduled__2024-02-23T23:42:00+00:00, run_start_date=2024-02-23 23:43:00.511076+00:00, run_end_date=2024-02-23 23:43:02.495232+00:00, run_duration=1.984156, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:42:00+00:00, data_interval_end=2024-02-23 23:43:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-23T23:43:02.506082003Z [2024-02-23T23:43:02.505+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:43:00+00:00, run_after=2024-02-23T23:44:00+00:00 2024-02-23T23:43:02.554394829Z [2024-02-23T23:43:02.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:42:00+00:00 exited with status success for try_number 1 2024-02-23T23:43:02.560075298Z [2024-02-23T23:43:02.559+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:42:00+00:00, map_index=-1, run_start_date=2024-02-23 23:43:01.790898+00:00, run_end_date=2024-02-23 23:43:02.197226+00:00, run_duration=0.406328, state=success, executor_state=success, try_number=1, max_tries=1, job_id=39, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:43:00.628545+00:00, queued_by_job_id=2, pid=685 2024-02-23T23:43:03.747212756Z [2024-02-23T23:43:03.746+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:42:00+00:00 exited with status failed for try_number 1 2024-02-23T23:43:03.752956539Z [2024-02-23T23:43:03.752+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:42:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:43:00.628545+00:00, queued_by_job_id=2, pid=None 2024-02-23T23:43:03.753441938Z [2024-02-23T23:43:03.753+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-23T23:43:03.754739095Z [2024-02-23T23:43:03.754+0000] {dagbag.py:207} WARNING - Serialized DAG vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96 no longer exists 2024-02-23T23:43:03.756973503Z [2024-02-23T23:43:03.755+0000] {scheduler_job.py:694} ERROR - Marking task instance as failed 2024-02-23T23:43:03.756985513Z Traceback (most recent call last): 2024-02-23T23:43:03.756990500Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/jobs/scheduler_job.py", line 692, in _process_executor_events 2024-02-23T23:43:03.756993739Z task = dag.get_task(ti.task_id) 2024-02-23T23:43:03.756997959Z AttributeError: 'NoneType' object has no attribute 'get_task' 2024-02-23T23:43:04.878555496Z [2024-02-23T23:43:04.877+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:42:00+00:00 exited with status failed for try_number 1 2024-02-23T23:43:04.886160920Z [2024-02-23T23:43:04.885+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:42:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:43:00.628545+00:00, queued_by_job_id=2, pid=None 2024-02-23T23:43:04.887017509Z [2024-02-23T23:43:04.886+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-23T23:43:04.889138190Z [2024-02-23T23:43:04.888+0000] {dagbag.py:207} WARNING - Serialized DAG vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96 no longer exists 2024-02-23T23:43:04.891732086Z [2024-02-23T23:43:04.890+0000] {scheduler_job.py:694} ERROR - Marking task instance as failed 2024-02-23T23:43:04.891772476Z Traceback (most recent call last): 2024-02-23T23:43:04.891778766Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/jobs/scheduler_job.py", line 692, in _process_executor_events 2024-02-23T23:43:04.891783231Z task = dag.get_task(ti.task_id) 2024-02-23T23:43:04.891787991Z AttributeError: 'NoneType' object has no attribute 'get_task' 2024-02-23T23:43:05.963260437Z [2024-02-23T23:43:05.962+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:43:05.963398195Z [2024-02-23T23:43:05.963+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:42:00+00:00, run_id=scheduled__2024-02-23T23:42:00+00:00, run_start_date=2024-02-23 23:43:00.508002+00:00, run_end_date=2024-02-23 23:43:05.963077+00:00, run_duration=5.455075, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:42:00+00:00, data_interval_end=2024-02-23 23:43:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-23T23:43:05.972431267Z [2024-02-23T23:43:05.971+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:43:00+00:00, run_after=2024-02-23T23:44:00+00:00 2024-02-23T23:43:05.978935448Z [2024-02-23T23:43:05.978+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:43:05.979076669Z [2024-02-23T23:43:05.978+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:42:00+00:00, run_id=scheduled__2024-02-23T23:42:00+00:00, run_start_date=2024-02-23 23:43:00.509045+00:00, run_end_date=2024-02-23 23:43:05.978751+00:00, run_duration=5.469706, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:42:00+00:00, data_interval_end=2024-02-23 23:43:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-23T23:43:05.988395087Z [2024-02-23T23:43:05.987+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:43:00+00:00, run_after=2024-02-23T23:44:00+00:00 2024-02-23T23:43:06.040260798Z [2024-02-23T23:43:06.039+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:42:00+00:00 exited with status success for try_number 1 2024-02-23T23:43:06.040330498Z [2024-02-23T23:43:06.040+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:42:00+00:00 exited with status success for try_number 1 2024-02-23T23:43:06.049165637Z [2024-02-23T23:43:06.048+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:42:00+00:00, map_index=-1, run_start_date=2024-02-23 23:43:03.157312+00:00, run_end_date=2024-02-23 23:43:04.892627+00:00, run_duration=1.735315, state=success, executor_state=success, try_number=1, max_tries=1, job_id=40, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:43:00.628545+00:00, queued_by_job_id=2, pid=700 2024-02-23T23:43:06.049269440Z [2024-02-23T23:43:06.049+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:42:00+00:00, map_index=-1, run_start_date=2024-02-23 23:43:03.660632+00:00, run_end_date=2024-02-23 23:43:05.097185+00:00, run_duration=1.436553, state=success, executor_state=success, try_number=1, max_tries=1, job_id=41, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:43:00.628545+00:00, queued_by_job_id=2, pid=721 2024-02-23T23:44:00.962832521Z [2024-02-23T23:44:00.961+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:44:00.970144502Z [2024-02-23T23:44:00.969+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:44:00.982373380Z [2024-02-23T23:44:00.982+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:44:00+00:00, run_after=2024-02-23T23:45:00+00:00 2024-02-23T23:44:00.994258812Z [2024-02-23T23:44:00.993+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:44:00+00:00, run_after=2024-02-23T23:45:00+00:00 2024-02-23T23:44:01.063562423Z [2024-02-23T23:44:01.063+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-23T23:44:01.063588987Z 2024-02-23T23:44:01.063608635Z 2024-02-23T23:44:01.063614683Z 2024-02-23T23:44:01.063619592Z 2024-02-23T23:44:01.063751481Z [2024-02-23T23:44:01.063+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-23T23:44:01.063921401Z [2024-02-23T23:44:01.063+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-23T23:44:01.064074464Z [2024-02-23T23:44:01.063+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:44:01.064191849Z [2024-02-23T23:44:01.064+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:44:01.065210880Z [2024-02-23T23:44:01.064+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:44:01.065225274Z 2024-02-23T23:44:01.065228888Z 2024-02-23T23:44:01.065232324Z 2024-02-23T23:44:01.065235650Z 2024-02-23T23:44:01.069833019Z [2024-02-23T23:44:01.069+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-23T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:44:01.070024240Z [2024-02-23T23:44:01.069+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T23:44:01.070343420Z [2024-02-23T23:44:01.070+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:44:01.070442236Z [2024-02-23T23:44:01.070+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T23:44:01.070679914Z [2024-02-23T23:44:01.070+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:44:01.070806944Z [2024-02-23T23:44:01.070+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T23:44:01.071101468Z [2024-02-23T23:44:01.070+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:44:01.071288357Z [2024-02-23T23:44:01.071+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T23:44:02.063999018Z [2024-02-23T23:44:02.063+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-23T23:42:00+00:00 exited with status queued for try_number 1 2024-02-23T23:44:02.064203755Z [2024-02-23T23:44:02.063+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:43:00+00:00 exited with status queued for try_number 1 2024-02-23T23:44:02.064391759Z [2024-02-23T23:44:02.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:43:00+00:00 exited with status queued for try_number 1 2024-02-23T23:44:02.064528729Z [2024-02-23T23:44:02.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:43:00+00:00 exited with status queued for try_number 1 2024-02-23T23:44:02.095063047Z [2024-02-23T23:44:02.094+0000] {scheduler_job.py:635} INFO - Setting external_id for to b5fb0a88-bd83-4436-a6b3-391d46f59170 2024-02-23T23:44:02.102503797Z [2024-02-23T23:44:02.094+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f2d8f31-7daa-461e-b3d7-7110e3f718d1 2024-02-23T23:44:02.102782093Z [2024-02-23T23:44:02.102+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8b2d4dd-d699-493d-8660-760a8b85533a 2024-02-23T23:44:02.103002806Z [2024-02-23T23:44:02.102+0000] {scheduler_job.py:635} INFO - Setting external_id for to ecb9ecdf-7886-4ff8-b128-9610c1df56e0 2024-02-23T23:44:05.376435185Z [2024-02-23T23:44:05.375+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:44:05.382486489Z [2024-02-23T23:44:05.376+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-23 23:43:00+00:00, run_id=scheduled__2024-02-23T23:43:00+00:00, run_start_date=2024-02-23 23:44:01.009158+00:00, run_end_date=2024-02-23 23:44:05.376326+00:00, run_duration=4.367168, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:43:00+00:00, data_interval_end=2024-02-23 23:44:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-23T23:44:05.422832858Z [2024-02-23T23:44:05.422+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:44:00+00:00, run_after=2024-02-23T23:45:00+00:00 2024-02-23T23:44:05.450918944Z [2024-02-23T23:44:05.450+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:44:05.451458001Z [2024-02-23T23:44:05.451+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-23 23:42:00+00:00, run_id=scheduled__2024-02-23T23:42:00+00:00, run_start_date=2024-02-23 23:44:01.004333+00:00, run_end_date=2024-02-23 23:44:05.450788+00:00, run_duration=4.446455, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:42:00+00:00, data_interval_end=2024-02-23 23:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-23T23:44:05.467679074Z [2024-02-23T23:44:05.467+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-23T23:44:00+00:00, run_after=2024-02-23T23:46:00+00:00 2024-02-23T23:44:05.574723155Z [2024-02-23T23:44:05.574+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-23T23:42:00+00:00 exited with status success for try_number 1 2024-02-23T23:44:05.574783827Z [2024-02-23T23:44:05.574+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:43:00+00:00 exited with status success for try_number 1 2024-02-23T23:44:05.590457263Z [2024-02-23T23:44:05.590+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:43:00+00:00, map_index=-1, run_start_date=2024-02-23 23:44:03.065807+00:00, run_end_date=2024-02-23 23:44:04.526748+00:00, run_duration=1.460941, state=success, executor_state=success, try_number=1, max_tries=1, job_id=42, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:44:01.066369+00:00, queued_by_job_id=2, pid=759 2024-02-23T23:44:05.590848393Z [2024-02-23T23:44:05.590+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-23T23:42:00+00:00, map_index=-1, run_start_date=2024-02-23 23:44:04.400913+00:00, run_end_date=2024-02-23 23:44:05.177663+00:00, run_duration=0.77675, state=success, executor_state=success, try_number=1, max_tries=1, job_id=43, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:44:01.066369+00:00, queued_by_job_id=2, pid=766 2024-02-23T23:44:08.692509258Z [2024-02-23T23:44:08.692+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:44:08.692821130Z [2024-02-23T23:44:08.692+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:43:00+00:00, run_id=scheduled__2024-02-23T23:43:00+00:00, run_start_date=2024-02-23 23:44:01.005626+00:00, run_end_date=2024-02-23 23:44:08.692434+00:00, run_duration=7.686808, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:43:00+00:00, data_interval_end=2024-02-23 23:44:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-23T23:44:08.701801141Z [2024-02-23T23:44:08.701+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:44:00+00:00, run_after=2024-02-23T23:45:00+00:00 2024-02-23T23:44:08.710795479Z [2024-02-23T23:44:08.710+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:44:08.711080194Z [2024-02-23T23:44:08.710+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:43:00+00:00, run_id=scheduled__2024-02-23T23:43:00+00:00, run_start_date=2024-02-23 23:44:01.006711+00:00, run_end_date=2024-02-23 23:44:08.710721+00:00, run_duration=7.70401, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:43:00+00:00, data_interval_end=2024-02-23 23:44:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-23T23:44:08.722775043Z [2024-02-23T23:44:08.722+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:44:00+00:00, run_after=2024-02-23T23:45:00+00:00 2024-02-23T23:44:08.784731328Z [2024-02-23T23:44:08.783+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:43:00+00:00 exited with status success for try_number 1 2024-02-23T23:44:08.787677445Z [2024-02-23T23:44:08.787+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:43:00+00:00, map_index=-1, run_start_date=2024-02-23 23:44:06.509938+00:00, run_end_date=2024-02-23 23:44:08.103321+00:00, run_duration=1.593383, state=success, executor_state=success, try_number=1, max_tries=1, job_id=44, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:44:01.066369+00:00, queued_by_job_id=2, pid=783 2024-02-23T23:44:09.847880306Z [2024-02-23T23:44:09.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:43:00+00:00 exited with status success for try_number 1 2024-02-23T23:44:09.852129747Z [2024-02-23T23:44:09.851+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:43:00+00:00, map_index=-1, run_start_date=2024-02-23 23:44:06.602453+00:00, run_end_date=2024-02-23 23:44:08.647064+00:00, run_duration=2.044611, state=success, executor_state=success, try_number=1, max_tries=1, job_id=45, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:44:01.066369+00:00, queued_by_job_id=2, pid=784 2024-02-23T23:45:01.070014685Z [2024-02-23T23:45:01.069+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:45:00+00:00, run_after=2024-02-23T23:50:00+00:00 2024-02-23T23:45:01.092770143Z [2024-02-23T23:45:01.092+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:45:00+00:00, run_after=2024-02-23T23:46:00+00:00 2024-02-23T23:45:01.115261624Z [2024-02-23T23:45:01.114+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:45:00+00:00, run_after=2024-02-23T23:46:00+00:00 2024-02-23T23:45:01.127851215Z [2024-02-23T23:45:01.127+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:45:01.278348632Z [2024-02-23T23:45:01.277+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-23T23:45:01.278393704Z 2024-02-23T23:45:01.278399853Z 2024-02-23T23:45:01.278403816Z 2024-02-23T23:45:01.278407963Z 2024-02-23T23:45:01.278433189Z [2024-02-23T23:45:01.278+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:45:01.278459420Z [2024-02-23T23:45:01.278+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:45:01.278584321Z [2024-02-23T23:45:01.278+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-23T23:45:01.278688381Z [2024-02-23T23:45:01.278+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:45:01.279355310Z [2024-02-23T23:45:01.279+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:45:01.279368317Z 2024-02-23T23:45:01.279377933Z 2024-02-23T23:45:01.279381070Z 2024-02-23T23:45:01.279384399Z 2024-02-23T23:45:01.286433640Z [2024-02-23T23:45:01.285+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-23T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-23T23:45:01.287115042Z [2024-02-23T23:45:01.286+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T23:45:01.287121585Z [2024-02-23T23:45:01.286+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:45:01.288035427Z [2024-02-23T23:45:01.286+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T23:45:01.288052830Z [2024-02-23T23:45:01.287+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:45:01.288056596Z [2024-02-23T23:45:01.287+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T23:45:01.288641126Z [2024-02-23T23:45:01.288+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:45:01.288652309Z [2024-02-23T23:45:01.288+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T23:45:02.259202555Z [2024-02-23T23:45:02.256+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-23T23:40:00+00:00 exited with status queued for try_number 1 2024-02-23T23:45:02.259235092Z [2024-02-23T23:45:02.257+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:44:00+00:00 exited with status queued for try_number 1 2024-02-23T23:45:02.259239339Z [2024-02-23T23:45:02.257+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:44:00+00:00 exited with status queued for try_number 1 2024-02-23T23:45:02.259242849Z [2024-02-23T23:45:02.257+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:44:00+00:00 exited with status queued for try_number 1 2024-02-23T23:45:02.271211161Z [2024-02-23T23:45:02.269+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2414ec68-fa01-4a28-8b3f-786894c07829 2024-02-23T23:45:02.271235409Z [2024-02-23T23:45:02.269+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5ab503a-6f60-444f-991f-60e29ac92b6b 2024-02-23T23:45:02.271239212Z [2024-02-23T23:45:02.269+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e987812-82dc-4de3-9742-465c13bae4e1 2024-02-23T23:45:02.271243174Z [2024-02-23T23:45:02.269+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ad772cf-14db-4b21-8e63-2a4b9c1a6dec 2024-02-23T23:45:05.469417755Z [2024-02-23T23:45:05.468+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:45:05.469895503Z [2024-02-23T23:45:05.469+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-23 23:44:00+00:00, run_id=scheduled__2024-02-23T23:44:00+00:00, run_start_date=2024-02-23 23:45:01.148040+00:00, run_end_date=2024-02-23 23:45:05.469317+00:00, run_duration=4.321277, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:44:00+00:00, data_interval_end=2024-02-23 23:45:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-23T23:45:05.480440338Z [2024-02-23T23:45:05.479+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:45:00+00:00, run_after=2024-02-23T23:46:00+00:00 2024-02-23T23:45:05.594544138Z [2024-02-23T23:45:05.594+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:44:00+00:00 exited with status success for try_number 1 2024-02-23T23:45:05.615840156Z [2024-02-23T23:45:05.615+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:44:00+00:00, map_index=-1, run_start_date=2024-02-23 23:45:03.738992+00:00, run_end_date=2024-02-23 23:45:04.574026+00:00, run_duration=0.835034, state=success, executor_state=success, try_number=1, max_tries=1, job_id=46, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:45:01.282903+00:00, queued_by_job_id=2, pid=817 2024-02-23T23:45:07.239102887Z [2024-02-23T23:45:07.238+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-23T23:45:07.239138384Z 2024-02-23T23:45:07.239275824Z [2024-02-23T23:45:07.239+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:45:07.239943014Z [2024-02-23T23:45:07.239+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:45:07.239954585Z 2024-02-23T23:45:07.244066525Z [2024-02-23T23:45:07.243+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-23T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-23T23:45:07.245073967Z [2024-02-23T23:45:07.244+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-23T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T23:45:07.352247008Z [2024-02-23T23:45:07.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-23T23:40:00+00:00 exited with status queued for try_number 1 2024-02-23T23:45:07.352268593Z [2024-02-23T23:45:07.352+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-23T23:40:00+00:00 exited with status success for try_number 1 2024-02-23T23:45:07.357932050Z [2024-02-23T23:45:07.357+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3ee04770-eb57-4f2d-a46b-f91a4a1d21bd 2024-02-23T23:45:07.357997195Z [2024-02-23T23:45:07.357+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-23T23:40:00+00:00, map_index=-1, run_start_date=2024-02-23 23:45:06.618442+00:00, run_end_date=2024-02-23 23:45:07.120838+00:00, run_duration=0.502396, state=success, executor_state=success, try_number=1, max_tries=1, job_id=49, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:45:01.282903+00:00, queued_by_job_id=2, pid=848 2024-02-23T23:45:08.494443144Z [2024-02-23T23:45:08.494+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:45:08.494637739Z [2024-02-23T23:45:08.494+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:44:00+00:00, run_id=scheduled__2024-02-23T23:44:00+00:00, run_start_date=2024-02-23 23:45:01.145655+00:00, run_end_date=2024-02-23 23:45:08.494357+00:00, run_duration=7.348702, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:44:00+00:00, data_interval_end=2024-02-23 23:45:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-23T23:45:08.515507048Z [2024-02-23T23:45:08.515+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:45:00+00:00, run_after=2024-02-23T23:46:00+00:00 2024-02-23T23:45:08.523626457Z [2024-02-23T23:45:08.523+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:45:08.523817541Z [2024-02-23T23:45:08.523+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:44:00+00:00, run_id=scheduled__2024-02-23T23:44:00+00:00, run_start_date=2024-02-23 23:45:01.149886+00:00, run_end_date=2024-02-23 23:45:08.523554+00:00, run_duration=7.373668, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:44:00+00:00, data_interval_end=2024-02-23 23:45:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-23T23:45:08.536901020Z [2024-02-23T23:45:08.536+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:45:00+00:00, run_after=2024-02-23T23:46:00+00:00 2024-02-23T23:45:08.587107129Z [2024-02-23T23:45:08.586+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:44:00+00:00 exited with status success for try_number 1 2024-02-23T23:45:08.587412655Z [2024-02-23T23:45:08.586+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:44:00+00:00 exited with status success for try_number 1 2024-02-23T23:45:08.597397551Z [2024-02-23T23:45:08.596+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:44:00+00:00, map_index=-1, run_start_date=2024-02-23 23:45:06.396029+00:00, run_end_date=2024-02-23 23:45:08.147238+00:00, run_duration=1.751209, state=success, executor_state=success, try_number=1, max_tries=1, job_id=48, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:45:01.282903+00:00, queued_by_job_id=2, pid=842 2024-02-23T23:45:08.597902990Z [2024-02-23T23:45:08.597+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:44:00+00:00, map_index=-1, run_start_date=2024-02-23 23:45:05.925401+00:00, run_end_date=2024-02-23 23:45:07.776928+00:00, run_duration=1.851527, state=success, executor_state=success, try_number=1, max_tries=1, job_id=47, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:45:01.282903+00:00, queued_by_job_id=2, pid=831 2024-02-23T23:45:10.569126666Z [2024-02-23T23:45:10.568+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-23T23:45:10.569183578Z 2024-02-23T23:45:10.569187993Z [2024-02-23T23:45:10.568+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:45:10.569637370Z [2024-02-23T23:45:10.569+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:45:10.569651550Z 2024-02-23T23:45:10.571847791Z [2024-02-23T23:45:10.571+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-23T23:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-23T23:45:10.571936015Z [2024-02-23T23:45:10.571+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-23T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T23:45:10.621155353Z [2024-02-23T23:45:10.620+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-23T23:40:00+00:00 exited with status queued for try_number 1 2024-02-23T23:45:10.621505046Z [2024-02-23T23:45:10.621+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-23T23:40:00+00:00 exited with status success for try_number 1 2024-02-23T23:45:10.628890017Z [2024-02-23T23:45:10.628+0000] {scheduler_job.py:635} INFO - Setting external_id for to b70c4ec9-a6cd-44e6-bfb2-f314b87fdd9e 2024-02-23T23:45:10.629037509Z [2024-02-23T23:45:10.628+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-23T23:40:00+00:00, map_index=-1, run_start_date=2024-02-23 23:45:09.135925+00:00, run_end_date=2024-02-23 23:45:09.590353+00:00, run_duration=0.454428, state=success, executor_state=success, try_number=1, max_tries=1, job_id=50, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:45:07.241318+00:00, queued_by_job_id=2, pid=866 2024-02-23T23:45:13.985244926Z [2024-02-23T23:45:13.984+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-23T23:45:13.985286164Z 2024-02-23T23:45:13.985572892Z [2024-02-23T23:45:13.985+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:45:13.986425946Z [2024-02-23T23:45:13.986+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:45:13.986439547Z 2024-02-23T23:45:13.988587794Z [2024-02-23T23:45:13.988+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-23T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:45:13.988711163Z [2024-02-23T23:45:13.988+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-23T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T23:45:14.046668423Z [2024-02-23T23:45:14.046+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-23T23:40:00+00:00 exited with status queued for try_number 1 2024-02-23T23:45:14.046735846Z [2024-02-23T23:45:14.046+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-23T23:40:00+00:00 exited with status success for try_number 1 2024-02-23T23:45:14.051991812Z [2024-02-23T23:45:14.051+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-23T23:40:00+00:00, map_index=0, run_start_date=2024-02-23 23:45:12.491858+00:00, run_end_date=2024-02-23 23:45:12.929271+00:00, run_duration=0.437413, state=success, executor_state=success, try_number=1, max_tries=1, job_id=51, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:45:10.570014+00:00, queued_by_job_id=2, pid=874 2024-02-23T23:45:14.052096824Z [2024-02-23T23:45:14.051+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3467101f-ab9b-4edc-803f-f39e17889d3f 2024-02-23T23:45:16.153416892Z [2024-02-23T23:45:16.152+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:45:16.154078720Z [2024-02-23T23:45:16.153+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:40:00+00:00, run_id=scheduled__2024-02-23T23:40:00+00:00, run_start_date=2024-02-23 23:45:01.142847+00:00, run_end_date=2024-02-23 23:45:16.153313+00:00, run_duration=15.010466, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:40:00+00:00, data_interval_end=2024-02-23 23:45:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-23T23:45:16.164775121Z [2024-02-23T23:45:16.164+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:45:00+00:00, run_after=2024-02-23T23:50:00+00:00 2024-02-23T23:45:17.271037116Z [2024-02-23T23:45:17.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-23T23:40:00+00:00 exited with status success for try_number 1 2024-02-23T23:45:17.277933437Z [2024-02-23T23:45:17.277+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-23T23:40:00+00:00, map_index=-1, run_start_date=2024-02-23 23:45:15.722814+00:00, run_end_date=2024-02-23 23:45:16.097957+00:00, run_duration=0.375143, state=success, executor_state=success, try_number=1, max_tries=1, job_id=52, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:45:13.986831+00:00, queued_by_job_id=2, pid=882 2024-02-23T23:46:00.046967342Z [2024-02-23T23:46:00.046+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:46:00+00:00, run_after=2024-02-23T23:47:00+00:00 2024-02-23T23:46:00.060848510Z [2024-02-23T23:46:00.060+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:46:00.072039232Z [2024-02-23T23:46:00.071+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:46:00.099160463Z [2024-02-23T23:46:00.098+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:46:00+00:00, run_after=2024-02-23T23:47:00+00:00 2024-02-23T23:46:00.176793040Z [2024-02-23T23:46:00.176+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-23T23:46:00.176837921Z 2024-02-23T23:46:00.176844336Z 2024-02-23T23:46:00.176848974Z 2024-02-23T23:46:00.176853308Z 2024-02-23T23:46:00.177264759Z [2024-02-23T23:46:00.176+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-23T23:46:00.177549918Z [2024-02-23T23:46:00.177+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:46:00.177928448Z [2024-02-23T23:46:00.177+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-23T23:46:00.178121121Z [2024-02-23T23:46:00.177+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:46:00.178901355Z [2024-02-23T23:46:00.178+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:46:00.178920369Z 2024-02-23T23:46:00.178928544Z 2024-02-23T23:46:00.178936371Z 2024-02-23T23:46:00.178968708Z 2024-02-23T23:46:00.182484911Z [2024-02-23T23:46:00.182+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-23T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:46:00.182787158Z [2024-02-23T23:46:00.182+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T23:46:00.183194055Z [2024-02-23T23:46:00.182+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:46:00.183518670Z [2024-02-23T23:46:00.183+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T23:46:00.183877452Z [2024-02-23T23:46:00.183+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:46:00.184113431Z [2024-02-23T23:46:00.183+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T23:46:00.184453210Z [2024-02-23T23:46:00.184+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:46:00.184645721Z [2024-02-23T23:46:00.184+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T23:46:00.428715428Z [2024-02-23T23:46:00.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-23T23:44:00+00:00 exited with status queued for try_number 1 2024-02-23T23:46:00.431045275Z [2024-02-23T23:46:00.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:45:00+00:00 exited with status queued for try_number 1 2024-02-23T23:46:00.431259334Z [2024-02-23T23:46:00.430+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:45:00+00:00 exited with status queued for try_number 1 2024-02-23T23:46:00.431390712Z [2024-02-23T23:46:00.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:45:00+00:00 exited with status queued for try_number 1 2024-02-23T23:46:00.439878542Z [2024-02-23T23:46:00.439+0000] {scheduler_job.py:635} INFO - Setting external_id for to c15a3030-22e2-46f7-a42e-3a325e41c0d9 2024-02-23T23:46:00.440135820Z [2024-02-23T23:46:00.439+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a97078a-23b1-4090-bbe4-b2f876946bb6 2024-02-23T23:46:00.440237234Z [2024-02-23T23:46:00.440+0000] {scheduler_job.py:635} INFO - Setting external_id for to a690e08c-00e1-4e93-9db7-4e52ef9d406a 2024-02-23T23:46:00.440439558Z [2024-02-23T23:46:00.440+0000] {scheduler_job.py:635} INFO - Setting external_id for to 82eeebf3-a9fd-46d9-b47e-c5c6de76d0c8 2024-02-23T23:46:01.618472057Z [2024-02-23T23:46:01.618+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:46:01.618897451Z [2024-02-23T23:46:01.618+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-23 23:44:00+00:00, run_id=scheduled__2024-02-23T23:44:00+00:00, run_start_date=2024-02-23 23:46:00.111680+00:00, run_end_date=2024-02-23 23:46:01.618532+00:00, run_duration=1.506852, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:44:00+00:00, data_interval_end=2024-02-23 23:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-23T23:46:01.627566700Z [2024-02-23T23:46:01.627+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-23T23:46:00+00:00, run_after=2024-02-23T23:48:00+00:00 2024-02-23T23:46:01.659584148Z [2024-02-23T23:46:01.659+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:46:01.660038809Z [2024-02-23T23:46:01.659+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-23 23:45:00+00:00, run_id=scheduled__2024-02-23T23:45:00+00:00, run_start_date=2024-02-23 23:46:00.115639+00:00, run_end_date=2024-02-23 23:46:01.659666+00:00, run_duration=1.544027, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:45:00+00:00, data_interval_end=2024-02-23 23:46:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-23T23:46:01.673012993Z [2024-02-23T23:46:01.672+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:46:00+00:00, run_after=2024-02-23T23:47:00+00:00 2024-02-23T23:46:01.722223182Z [2024-02-23T23:46:01.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-23T23:44:00+00:00 exited with status success for try_number 1 2024-02-23T23:46:01.732383368Z [2024-02-23T23:46:01.730+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-23T23:44:00+00:00, map_index=-1, run_start_date=2024-02-23 23:46:01.021234+00:00, run_end_date=2024-02-23 23:46:01.411541+00:00, run_duration=0.390307, state=success, executor_state=success, try_number=1, max_tries=1, job_id=53, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:46:00.179890+00:00, queued_by_job_id=2, pid=905 2024-02-23T23:46:02.866015843Z [2024-02-23T23:46:02.865+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:45:00+00:00 exited with status success for try_number 1 2024-02-23T23:46:02.872211603Z [2024-02-23T23:46:02.871+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:45:00+00:00, map_index=-1, run_start_date=2024-02-23 23:46:01.069423+00:00, run_end_date=2024-02-23 23:46:01.572252+00:00, run_duration=0.502829, state=success, executor_state=success, try_number=1, max_tries=1, job_id=54, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:46:00.179890+00:00, queued_by_job_id=2, pid=906 2024-02-23T23:46:04.939350979Z [2024-02-23T23:46:04.938+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:46:04.939822957Z [2024-02-23T23:46:04.939+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:45:00+00:00, run_id=scheduled__2024-02-23T23:45:00+00:00, run_start_date=2024-02-23 23:46:00.113017+00:00, run_end_date=2024-02-23 23:46:04.939290+00:00, run_duration=4.826273, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:45:00+00:00, data_interval_end=2024-02-23 23:46:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-23T23:46:04.950275750Z [2024-02-23T23:46:04.949+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:46:00+00:00, run_after=2024-02-23T23:47:00+00:00 2024-02-23T23:46:04.958995305Z [2024-02-23T23:46:04.958+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:46:04.959300561Z [2024-02-23T23:46:04.958+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:45:00+00:00, run_id=scheduled__2024-02-23T23:45:00+00:00, run_start_date=2024-02-23 23:46:00.114212+00:00, run_end_date=2024-02-23 23:46:04.958857+00:00, run_duration=4.844645, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:45:00+00:00, data_interval_end=2024-02-23 23:46:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-23T23:46:04.973323604Z [2024-02-23T23:46:04.972+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:46:00+00:00, run_after=2024-02-23T23:47:00+00:00 2024-02-23T23:46:05.030520000Z [2024-02-23T23:46:05.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:45:00+00:00 exited with status success for try_number 1 2024-02-23T23:46:05.030767923Z [2024-02-23T23:46:05.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:45:00+00:00 exited with status success for try_number 1 2024-02-23T23:46:05.039331083Z [2024-02-23T23:46:05.038+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:45:00+00:00, map_index=-1, run_start_date=2024-02-23 23:46:02.294498+00:00, run_end_date=2024-02-23 23:46:04.233416+00:00, run_duration=1.938918, state=success, executor_state=success, try_number=1, max_tries=1, job_id=55, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:46:00.179890+00:00, queued_by_job_id=2, pid=929 2024-02-23T23:46:05.039687167Z [2024-02-23T23:46:05.039+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:45:00+00:00, map_index=-1, run_start_date=2024-02-23 23:46:02.304732+00:00, run_end_date=2024-02-23 23:46:04.802016+00:00, run_duration=2.497284, state=success, executor_state=success, try_number=1, max_tries=1, job_id=56, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:46:00.179890+00:00, queued_by_job_id=2, pid=930 2024-02-23T23:46:59.236410396Z [2024-02-23T23:46:59.235+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-23T23:47:00.272567358Z [2024-02-23T23:47:00.271+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:47:00+00:00, run_after=2024-02-23T23:48:00+00:00 2024-02-23T23:47:00.279862433Z [2024-02-23T23:47:00.279+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:47:00.293434278Z [2024-02-23T23:47:00.292+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:47:00+00:00, run_after=2024-02-23T23:48:00+00:00 2024-02-23T23:47:00.381564156Z [2024-02-23T23:47:00.381+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-23T23:47:00.381607029Z 2024-02-23T23:47:00.381616136Z 2024-02-23T23:47:00.381622908Z 2024-02-23T23:47:00.381632306Z [2024-02-23T23:47:00.381+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-23T23:47:00.382260959Z [2024-02-23T23:47:00.381+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:47:00.382278655Z [2024-02-23T23:47:00.382+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:47:00.383633070Z [2024-02-23T23:47:00.382+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:47:00.383647941Z 2024-02-23T23:47:00.383652971Z 2024-02-23T23:47:00.383657278Z 2024-02-23T23:47:00.387609959Z [2024-02-23T23:47:00.387+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:47:00.387830549Z [2024-02-23T23:47:00.387+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T23:47:00.388242600Z [2024-02-23T23:47:00.388+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:47:00.388490790Z [2024-02-23T23:47:00.388+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T23:47:00.389218884Z [2024-02-23T23:47:00.388+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:47:00.389250796Z [2024-02-23T23:47:00.388+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T23:47:00.580422145Z [2024-02-23T23:47:00.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:46:00+00:00 exited with status queued for try_number 1 2024-02-23T23:47:00.580664711Z [2024-02-23T23:47:00.580+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:46:00+00:00 exited with status queued for try_number 1 2024-02-23T23:47:00.580866544Z [2024-02-23T23:47:00.580+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:46:00+00:00 exited with status queued for try_number 1 2024-02-23T23:47:00.589718046Z [2024-02-23T23:47:00.589+0000] {scheduler_job.py:635} INFO - Setting external_id for to 38485965-dcee-4394-9bf6-7cef580f3fe6 2024-02-23T23:47:00.590050276Z [2024-02-23T23:47:00.589+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3b86c34-3dad-4715-95d2-933534e2259d 2024-02-23T23:47:00.590272679Z [2024-02-23T23:47:00.590+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea9f0953-a085-41ce-8295-7a66acebf0e4 2024-02-23T23:47:02.406702406Z [2024-02-23T23:47:02.406+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:47:02.407443092Z [2024-02-23T23:47:02.407+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-23 23:46:00+00:00, run_id=scheduled__2024-02-23T23:46:00+00:00, run_start_date=2024-02-23 23:47:00.302831+00:00, run_end_date=2024-02-23 23:47:02.406550+00:00, run_duration=2.103719, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:46:00+00:00, data_interval_end=2024-02-23 23:47:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-23T23:47:02.420999878Z [2024-02-23T23:47:02.420+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:47:00+00:00, run_after=2024-02-23T23:48:00+00:00 2024-02-23T23:47:02.499263231Z [2024-02-23T23:47:02.498+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:46:00+00:00 exited with status success for try_number 1 2024-02-23T23:47:02.509241246Z [2024-02-23T23:47:02.508+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:46:00+00:00, map_index=-1, run_start_date=2024-02-23 23:47:01.134294+00:00, run_end_date=2024-02-23 23:47:01.618562+00:00, run_duration=0.484268, state=success, executor_state=success, try_number=1, max_tries=1, job_id=57, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:47:00.383822+00:00, queued_by_job_id=2, pid=961 2024-02-23T23:47:04.054289069Z [2024-02-23T23:47:04.053+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:47:04.054742909Z [2024-02-23T23:47:04.054+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:46:00+00:00, run_id=scheduled__2024-02-23T23:46:00+00:00, run_start_date=2024-02-23 23:47:00.306201+00:00, run_end_date=2024-02-23 23:47:04.054144+00:00, run_duration=3.747943, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:46:00+00:00, data_interval_end=2024-02-23 23:47:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-23T23:47:04.066283054Z [2024-02-23T23:47:04.065+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:47:00+00:00, run_after=2024-02-23T23:48:00+00:00 2024-02-23T23:47:04.074156034Z [2024-02-23T23:47:04.073+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:47:04.074515444Z [2024-02-23T23:47:04.074+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:46:00+00:00, run_id=scheduled__2024-02-23T23:46:00+00:00, run_start_date=2024-02-23 23:47:00.304081+00:00, run_end_date=2024-02-23 23:47:04.073989+00:00, run_duration=3.769908, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:46:00+00:00, data_interval_end=2024-02-23 23:47:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-23T23:47:04.086078518Z [2024-02-23T23:47:04.085+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:47:00+00:00, run_after=2024-02-23T23:48:00+00:00 2024-02-23T23:47:04.128260895Z [2024-02-23T23:47:04.127+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:46:00+00:00 exited with status success for try_number 1 2024-02-23T23:47:04.138428829Z [2024-02-23T23:47:04.137+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:46:00+00:00, map_index=-1, run_start_date=2024-02-23 23:47:02.180964+00:00, run_end_date=2024-02-23 23:47:03.569908+00:00, run_duration=1.388944, state=success, executor_state=success, try_number=1, max_tries=1, job_id=58, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:47:00.383822+00:00, queued_by_job_id=2, pid=979 2024-02-23T23:47:05.210169295Z [2024-02-23T23:47:05.209+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:46:00+00:00 exited with status success for try_number 1 2024-02-23T23:47:05.216023791Z [2024-02-23T23:47:05.215+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:46:00+00:00, map_index=-1, run_start_date=2024-02-23 23:47:02.342987+00:00, run_end_date=2024-02-23 23:47:03.981406+00:00, run_duration=1.638419, state=success, executor_state=success, try_number=1, max_tries=1, job_id=59, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:47:00.383822+00:00, queued_by_job_id=2, pid=980 2024-02-23T23:48:00.324679058Z [2024-02-23T23:48:00.323+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:48:00.350671619Z [2024-02-23T23:48:00.350+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:48:00+00:00, run_after=2024-02-23T23:49:00+00:00 2024-02-23T23:48:00.370305819Z [2024-02-23T23:48:00.369+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:48:00+00:00, run_after=2024-02-23T23:49:00+00:00 2024-02-23T23:48:00.379449442Z [2024-02-23T23:48:00.379+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:48:00.448112548Z [2024-02-23T23:48:00.447+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-23T23:48:00.448140416Z 2024-02-23T23:48:00.448147416Z 2024-02-23T23:48:00.448150533Z 2024-02-23T23:48:00.448153520Z 2024-02-23T23:48:00.448335942Z [2024-02-23T23:48:00.447+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-23T23:48:00.448676839Z [2024-02-23T23:48:00.448+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:48:00.448705162Z [2024-02-23T23:48:00.448+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:48:00.448730855Z [2024-02-23T23:48:00.448+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-23T23:48:00.449381455Z [2024-02-23T23:48:00.449+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:48:00.449406318Z 2024-02-23T23:48:00.449414244Z 2024-02-23T23:48:00.449420987Z 2024-02-23T23:48:00.449427530Z 2024-02-23T23:48:00.453167184Z [2024-02-23T23:48:00.452+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-23T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:48:00.453448055Z [2024-02-23T23:48:00.453+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T23:48:00.453713555Z [2024-02-23T23:48:00.453+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:48:00.453959805Z [2024-02-23T23:48:00.453+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T23:48:00.454303071Z [2024-02-23T23:48:00.454+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:48:00.454484263Z [2024-02-23T23:48:00.454+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T23:48:00.454841175Z [2024-02-23T23:48:00.454+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:48:00.454998492Z [2024-02-23T23:48:00.454+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T23:48:00.815367136Z [2024-02-23T23:48:00.812+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-23T23:46:00+00:00 exited with status queued for try_number 1 2024-02-23T23:48:00.815626048Z [2024-02-23T23:48:00.815+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:47:00+00:00 exited with status queued for try_number 1 2024-02-23T23:48:00.815750907Z [2024-02-23T23:48:00.815+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:47:00+00:00 exited with status queued for try_number 1 2024-02-23T23:48:00.815873953Z [2024-02-23T23:48:00.815+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:47:00+00:00 exited with status queued for try_number 1 2024-02-23T23:48:00.825100956Z [2024-02-23T23:48:00.824+0000] {scheduler_job.py:635} INFO - Setting external_id for to 68518373-ff9d-406c-bdaf-13301a44ad76 2024-02-23T23:48:00.825255851Z [2024-02-23T23:48:00.825+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb27c96e-eb1a-4400-a5eb-19afd9694f15 2024-02-23T23:48:00.825423238Z [2024-02-23T23:48:00.825+0000] {scheduler_job.py:635} INFO - Setting external_id for to 95ee03b4-df46-40f6-9e99-ca185bc4cc17 2024-02-23T23:48:00.825616497Z [2024-02-23T23:48:00.825+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81c8ba5a-273a-46c0-be69-46104aa92d33 2024-02-23T23:48:01.987722090Z [2024-02-23T23:48:01.987+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:48:01.988155119Z [2024-02-23T23:48:01.987+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-23 23:46:00+00:00, run_id=scheduled__2024-02-23T23:46:00+00:00, run_start_date=2024-02-23 23:48:00.389750+00:00, run_end_date=2024-02-23 23:48:01.987665+00:00, run_duration=1.597915, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:46:00+00:00, data_interval_end=2024-02-23 23:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-23T23:48:01.995887163Z [2024-02-23T23:48:01.995+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-23T23:48:00+00:00, run_after=2024-02-23T23:50:00+00:00 2024-02-23T23:48:02.008762245Z [2024-02-23T23:48:02.008+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:48:02.009264241Z [2024-02-23T23:48:02.009+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-23 23:47:00+00:00, run_id=scheduled__2024-02-23T23:47:00+00:00, run_start_date=2024-02-23 23:48:00.392020+00:00, run_end_date=2024-02-23 23:48:02.008920+00:00, run_duration=1.6169, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:47:00+00:00, data_interval_end=2024-02-23 23:48:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-23T23:48:02.019865454Z [2024-02-23T23:48:02.019+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:48:00+00:00, run_after=2024-02-23T23:49:00+00:00 2024-02-23T23:48:02.064715585Z [2024-02-23T23:48:02.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:47:00+00:00 exited with status success for try_number 1 2024-02-23T23:48:02.072738452Z [2024-02-23T23:48:02.072+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:47:00+00:00, map_index=-1, run_start_date=2024-02-23 23:48:01.420765+00:00, run_end_date=2024-02-23 23:48:01.841990+00:00, run_duration=0.421225, state=success, executor_state=success, try_number=1, max_tries=1, job_id=60, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:48:00.450363+00:00, queued_by_job_id=2, pid=1014 2024-02-23T23:48:02.232091833Z [2024-02-23T23:48:02.231+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-23T23:46:00+00:00 exited with status success for try_number 1 2024-02-23T23:48:02.238916307Z [2024-02-23T23:48:02.238+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-23T23:46:00+00:00, map_index=-1, run_start_date=2024-02-23 23:48:01.565864+00:00, run_end_date=2024-02-23 23:48:01.925887+00:00, run_duration=0.360023, state=success, executor_state=success, try_number=1, max_tries=1, job_id=61, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:48:00.450363+00:00, queued_by_job_id=2, pid=1015 2024-02-23T23:48:04.343797361Z [2024-02-23T23:48:04.343+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:48:04.344334986Z [2024-02-23T23:48:04.344+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:47:00+00:00, run_id=scheduled__2024-02-23T23:47:00+00:00, run_start_date=2024-02-23 23:48:00.391024+00:00, run_end_date=2024-02-23 23:48:04.343920+00:00, run_duration=3.952896, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:47:00+00:00, data_interval_end=2024-02-23 23:48:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-23T23:48:04.354021959Z [2024-02-23T23:48:04.353+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:48:00+00:00, run_after=2024-02-23T23:49:00+00:00 2024-02-23T23:48:04.392028100Z [2024-02-23T23:48:04.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:47:00+00:00 exited with status success for try_number 1 2024-02-23T23:48:04.400279928Z [2024-02-23T23:48:04.399+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:47:00+00:00, map_index=-1, run_start_date=2024-02-23 23:48:02.491426+00:00, run_end_date=2024-02-23 23:48:04.079725+00:00, run_duration=1.588299, state=success, executor_state=success, try_number=1, max_tries=1, job_id=62, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:48:00.450363+00:00, queued_by_job_id=2, pid=1038 2024-02-23T23:48:05.448233141Z [2024-02-23T23:48:05.447+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:48:05.448622221Z [2024-02-23T23:48:05.448+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:47:00+00:00, run_id=scheduled__2024-02-23T23:47:00+00:00, run_start_date=2024-02-23 23:48:00.393031+00:00, run_end_date=2024-02-23 23:48:05.448269+00:00, run_duration=5.055238, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:47:00+00:00, data_interval_end=2024-02-23 23:48:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-23T23:48:05.457527546Z [2024-02-23T23:48:05.457+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:48:00+00:00, run_after=2024-02-23T23:49:00+00:00 2024-02-23T23:48:05.493386947Z [2024-02-23T23:48:05.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:47:00+00:00 exited with status success for try_number 1 2024-02-23T23:48:05.501095649Z [2024-02-23T23:48:05.500+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:47:00+00:00, map_index=-1, run_start_date=2024-02-23 23:48:02.617318+00:00, run_end_date=2024-02-23 23:48:04.863628+00:00, run_duration=2.24631, state=success, executor_state=success, try_number=1, max_tries=1, job_id=63, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:48:00.450363+00:00, queued_by_job_id=2, pid=1039 2024-02-23T23:49:00.231721749Z [2024-02-23T23:49:00.231+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:49:00+00:00, run_after=2024-02-23T23:50:00+00:00 2024-02-23T23:49:00.240991779Z [2024-02-23T23:49:00.240+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:49:00.253878179Z [2024-02-23T23:49:00.253+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:49:00+00:00, run_after=2024-02-23T23:50:00+00:00 2024-02-23T23:49:00.517763295Z [2024-02-23T23:49:00.517+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-23T23:49:00.517907390Z 2024-02-23T23:49:00.517920510Z 2024-02-23T23:49:00.517930106Z 2024-02-23T23:49:00.518380901Z [2024-02-23T23:49:00.517+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-23T23:49:00.518741210Z [2024-02-23T23:49:00.518+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:49:00.519054166Z [2024-02-23T23:49:00.518+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:49:00.520299236Z [2024-02-23T23:49:00.519+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:49:00.520325746Z 2024-02-23T23:49:00.520357455Z 2024-02-23T23:49:00.520366214Z 2024-02-23T23:49:00.526633771Z [2024-02-23T23:49:00.526+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:49:00.526891099Z [2024-02-23T23:49:00.526+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T23:49:00.527493353Z [2024-02-23T23:49:00.527+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:49:00.527655289Z [2024-02-23T23:49:00.527+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T23:49:00.528088888Z [2024-02-23T23:49:00.527+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:49:00.528270691Z [2024-02-23T23:49:00.528+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T23:49:00.821529214Z [2024-02-23T23:49:00.821+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:48:00+00:00 exited with status queued for try_number 1 2024-02-23T23:49:00.821732700Z [2024-02-23T23:49:00.821+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:48:00+00:00 exited with status queued for try_number 1 2024-02-23T23:49:00.821879822Z [2024-02-23T23:49:00.821+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:48:00+00:00 exited with status queued for try_number 1 2024-02-23T23:49:00.832861719Z [2024-02-23T23:49:00.832+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d6dffba-09ce-4fab-a48d-9a1b20a0cd15 2024-02-23T23:49:00.833252228Z [2024-02-23T23:49:00.832+0000] {scheduler_job.py:635} INFO - Setting external_id for to ef8a87e4-221c-4dfe-bab1-f5c6372da548 2024-02-23T23:49:00.833533524Z [2024-02-23T23:49:00.833+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb3f0445-803e-469d-baf7-80a7d2ba7948 2024-02-23T23:49:01.989421162Z [2024-02-23T23:49:01.988+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:49:01.989628892Z [2024-02-23T23:49:01.989+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-23 23:48:00+00:00, run_id=scheduled__2024-02-23T23:48:00+00:00, run_start_date=2024-02-23 23:49:00.262774+00:00, run_end_date=2024-02-23 23:49:01.989304+00:00, run_duration=1.72653, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:48:00+00:00, data_interval_end=2024-02-23 23:49:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-23T23:49:01.999911412Z [2024-02-23T23:49:01.999+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:49:00+00:00, run_after=2024-02-23T23:50:00+00:00 2024-02-23T23:49:02.059651647Z [2024-02-23T23:49:02.059+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:48:00+00:00 exited with status success for try_number 1 2024-02-23T23:49:02.068865487Z [2024-02-23T23:49:02.068+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:48:00+00:00, map_index=-1, run_start_date=2024-02-23 23:49:01.418066+00:00, run_end_date=2024-02-23 23:49:01.768595+00:00, run_duration=0.350529, state=success, executor_state=success, try_number=1, max_tries=1, job_id=64, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:49:00.522143+00:00, queued_by_job_id=2, pid=1071 2024-02-23T23:49:04.246486956Z [2024-02-23T23:49:04.246+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:49:04.247148921Z [2024-02-23T23:49:04.246+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:48:00+00:00, run_id=scheduled__2024-02-23T23:48:00+00:00, run_start_date=2024-02-23 23:49:00.264758+00:00, run_end_date=2024-02-23 23:49:04.246366+00:00, run_duration=3.981608, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:48:00+00:00, data_interval_end=2024-02-23 23:49:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-23T23:49:04.263095053Z [2024-02-23T23:49:04.262+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:49:00+00:00, run_after=2024-02-23T23:50:00+00:00 2024-02-23T23:49:04.312834058Z [2024-02-23T23:49:04.312+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:48:00+00:00 exited with status success for try_number 1 2024-02-23T23:49:04.319558334Z [2024-02-23T23:49:04.319+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:48:00+00:00, map_index=-1, run_start_date=2024-02-23 23:49:02.455405+00:00, run_end_date=2024-02-23 23:49:04.034030+00:00, run_duration=1.578625, state=success, executor_state=success, try_number=1, max_tries=1, job_id=65, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:49:00.522143+00:00, queued_by_job_id=2, pid=1089 2024-02-23T23:49:04.662509465Z [2024-02-23T23:49:04.662+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:49:04.662715320Z [2024-02-23T23:49:04.662+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:48:00+00:00, run_id=scheduled__2024-02-23T23:48:00+00:00, run_start_date=2024-02-23 23:49:00.263846+00:00, run_end_date=2024-02-23 23:49:04.662396+00:00, run_duration=4.39855, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:48:00+00:00, data_interval_end=2024-02-23 23:49:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-23T23:49:04.673043165Z [2024-02-23T23:49:04.672+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:49:00+00:00, run_after=2024-02-23T23:50:00+00:00 2024-02-23T23:49:05.807261832Z [2024-02-23T23:49:05.806+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:48:00+00:00 exited with status success for try_number 1 2024-02-23T23:49:05.816176531Z [2024-02-23T23:49:05.815+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:48:00+00:00, map_index=-1, run_start_date=2024-02-23 23:49:02.479525+00:00, run_end_date=2024-02-23 23:49:04.588484+00:00, run_duration=2.108959, state=success, executor_state=success, try_number=1, max_tries=1, job_id=66, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:49:00.522143+00:00, queued_by_job_id=2, pid=1090 2024-02-23T23:50:00.077019649Z [2024-02-23T23:50:00.076+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:50:00+00:00, run_after=2024-02-23T23:55:00+00:00 2024-02-23T23:50:00.104218160Z [2024-02-23T23:50:00.103+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:50:00+00:00, run_after=2024-02-23T23:51:00+00:00 2024-02-23T23:50:00.127119419Z [2024-02-23T23:50:00.126+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:50:00+00:00, run_after=2024-02-23T23:51:00+00:00 2024-02-23T23:50:00.137669292Z [2024-02-23T23:50:00.137+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:50:00.145267557Z [2024-02-23T23:50:00.145+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:50:00.244273328Z [2024-02-23T23:50:00.243+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-02-23T23:50:00.244312623Z 2024-02-23T23:50:00.244333245Z 2024-02-23T23:50:00.244338216Z 2024-02-23T23:50:00.244355210Z 2024-02-23T23:50:00.244358487Z 2024-02-23T23:50:00.244475094Z [2024-02-23T23:50:00.244+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:50:00.244728990Z [2024-02-23T23:50:00.244+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-23T23:50:00.244995773Z [2024-02-23T23:50:00.244+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:50:00.245333721Z [2024-02-23T23:50:00.245+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-23T23:50:00.245576324Z [2024-02-23T23:50:00.245+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:50:00.246981807Z [2024-02-23T23:50:00.246+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:50:00.246992793Z 2024-02-23T23:50:00.246997712Z 2024-02-23T23:50:00.247002543Z 2024-02-23T23:50:00.247006947Z 2024-02-23T23:50:00.247011786Z 2024-02-23T23:50:00.252847352Z [2024-02-23T23:50:00.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-23T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-23T23:50:00.252999948Z [2024-02-23T23:50:00.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T23:50:00.253434292Z [2024-02-23T23:50:00.253+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-23T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:50:00.253561050Z [2024-02-23T23:50:00.253+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T23:50:00.254047037Z [2024-02-23T23:50:00.253+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:50:00.254186395Z [2024-02-23T23:50:00.253+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T23:50:00.254560267Z [2024-02-23T23:50:00.254+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:50:00.254695899Z [2024-02-23T23:50:00.254+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T23:50:00.255076215Z [2024-02-23T23:50:00.254+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:50:00.255220747Z [2024-02-23T23:50:00.255+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T23:50:00.932177997Z [2024-02-23T23:50:00.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-23T23:45:00+00:00 exited with status queued for try_number 1 2024-02-23T23:50:00.932450613Z [2024-02-23T23:50:00.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-23T23:48:00+00:00 exited with status queued for try_number 1 2024-02-23T23:50:00.932620248Z [2024-02-23T23:50:00.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:49:00+00:00 exited with status queued for try_number 1 2024-02-23T23:50:00.932791677Z [2024-02-23T23:50:00.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:49:00+00:00 exited with status queued for try_number 1 2024-02-23T23:50:00.932937086Z [2024-02-23T23:50:00.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:49:00+00:00 exited with status queued for try_number 1 2024-02-23T23:50:00.942512079Z [2024-02-23T23:50:00.942+0000] {scheduler_job.py:635} INFO - Setting external_id for to f510c90d-1d5b-4cc4-ae8d-17a3935da72c 2024-02-23T23:50:00.942784775Z [2024-02-23T23:50:00.942+0000] {scheduler_job.py:635} INFO - Setting external_id for to e2bafd05-da1c-4537-8fbc-9e6d0d735071 2024-02-23T23:50:00.942991437Z [2024-02-23T23:50:00.942+0000] {scheduler_job.py:635} INFO - Setting external_id for to d1d93ccb-28e1-41d0-81f5-3fa87d98d112 2024-02-23T23:50:00.943184049Z [2024-02-23T23:50:00.943+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33612008-b3a2-4420-873a-1211851d6317 2024-02-23T23:50:00.943355444Z [2024-02-23T23:50:00.943+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7dbf2f67-7873-4042-98e5-063125f26df2 2024-02-23T23:50:02.234663096Z [2024-02-23T23:50:02.234+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:50:02.234925004Z [2024-02-23T23:50:02.234+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-23 23:49:00+00:00, run_id=scheduled__2024-02-23T23:49:00+00:00, run_start_date=2024-02-23 23:50:00.162080+00:00, run_end_date=2024-02-23 23:50:02.234581+00:00, run_duration=2.072501, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:49:00+00:00, data_interval_end=2024-02-23 23:50:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-23T23:50:02.266061674Z [2024-02-23T23:50:02.265+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:50:00+00:00, run_after=2024-02-23T23:51:00+00:00 2024-02-23T23:50:02.425911207Z [2024-02-23T23:50:02.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:49:00+00:00 exited with status success for try_number 1 2024-02-23T23:50:02.448334881Z [2024-02-23T23:50:02.447+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:49:00+00:00, map_index=-1, run_start_date=2024-02-23 23:50:01.198448+00:00, run_end_date=2024-02-23 23:50:01.806270+00:00, run_duration=0.607822, state=success, executor_state=success, try_number=1, max_tries=1, job_id=67, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:50:00.248995+00:00, queued_by_job_id=2, pid=1124 2024-02-23T23:50:03.589306165Z [2024-02-23T23:50:03.588+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:50:03.590413032Z [2024-02-23T23:50:03.589+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-23 23:48:00+00:00, run_id=scheduled__2024-02-23T23:48:00+00:00, run_start_date=2024-02-23 23:50:00.159812+00:00, run_end_date=2024-02-23 23:50:03.589708+00:00, run_duration=3.429896, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:48:00+00:00, data_interval_end=2024-02-23 23:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-23T23:50:03.610817810Z [2024-02-23T23:50:03.610+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-23T23:50:00+00:00, run_after=2024-02-23T23:52:00+00:00 2024-02-23T23:50:03.691679498Z [2024-02-23T23:50:03.691+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-23T23:50:03.691704174Z 2024-02-23T23:50:03.691867916Z [2024-02-23T23:50:03.691+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:50:03.692517429Z [2024-02-23T23:50:03.692+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:50:03.692523040Z 2024-02-23T23:50:03.695783807Z [2024-02-23T23:50:03.695+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-23T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-23T23:50:03.696060739Z [2024-02-23T23:50:03.695+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-23T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T23:50:03.816416774Z [2024-02-23T23:50:03.815+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-23T23:45:00+00:00 exited with status queued for try_number 1 2024-02-23T23:50:03.816655520Z [2024-02-23T23:50:03.816+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-23T23:45:00+00:00 exited with status success for try_number 1 2024-02-23T23:50:03.816871406Z [2024-02-23T23:50:03.816+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-23T23:48:00+00:00 exited with status success for try_number 1 2024-02-23T23:50:03.836941242Z [2024-02-23T23:50:03.836+0000] {scheduler_job.py:635} INFO - Setting external_id for to 92f5aec8-4b36-4425-933a-33bbe725c9ab 2024-02-23T23:50:03.838761685Z [2024-02-23T23:50:03.837+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-23T23:45:00+00:00, map_index=-1, run_start_date=2024-02-23 23:50:02.779992+00:00, run_end_date=2024-02-23 23:50:03.345020+00:00, run_duration=0.565028, state=success, executor_state=success, try_number=1, max_tries=1, job_id=69, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:50:00.248995+00:00, queued_by_job_id=2, pid=1144 2024-02-23T23:50:03.838780163Z [2024-02-23T23:50:03.837+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-23T23:48:00+00:00, map_index=-1, run_start_date=2024-02-23 23:50:01.617163+00:00, run_end_date=2024-02-23 23:50:02.269747+00:00, run_duration=0.652584, state=success, executor_state=success, try_number=1, max_tries=1, job_id=68, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:50:00.248995+00:00, queued_by_job_id=2, pid=1129 2024-02-23T23:50:06.140222144Z [2024-02-23T23:50:06.139+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:50:06.140466249Z [2024-02-23T23:50:06.140+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:49:00+00:00, run_id=scheduled__2024-02-23T23:49:00+00:00, run_start_date=2024-02-23 23:50:00.160929+00:00, run_end_date=2024-02-23 23:50:06.140077+00:00, run_duration=5.979148, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:49:00+00:00, data_interval_end=2024-02-23 23:50:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-23T23:50:06.151350487Z [2024-02-23T23:50:06.150+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:50:00+00:00, run_after=2024-02-23T23:51:00+00:00 2024-02-23T23:50:06.159796684Z [2024-02-23T23:50:06.159+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:50:06.160129256Z [2024-02-23T23:50:06.159+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:49:00+00:00, run_id=scheduled__2024-02-23T23:49:00+00:00, run_start_date=2024-02-23 23:50:00.163177+00:00, run_end_date=2024-02-23 23:50:06.159639+00:00, run_duration=5.996462, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:49:00+00:00, data_interval_end=2024-02-23 23:50:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-23T23:50:06.170331375Z [2024-02-23T23:50:06.169+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:50:00+00:00, run_after=2024-02-23T23:51:00+00:00 2024-02-23T23:50:06.202769750Z [2024-02-23T23:50:06.202+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-23T23:50:06.202804859Z 2024-02-23T23:50:06.202841465Z [2024-02-23T23:50:06.202+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:50:06.203460659Z [2024-02-23T23:50:06.203+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:50:06.203508909Z 2024-02-23T23:50:06.206130171Z [2024-02-23T23:50:06.205+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-23T23:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-23T23:50:06.206306216Z [2024-02-23T23:50:06.205+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-23T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T23:50:06.267573011Z [2024-02-23T23:50:06.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-23T23:45:00+00:00 exited with status queued for try_number 1 2024-02-23T23:50:06.267951572Z [2024-02-23T23:50:06.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:49:00+00:00 exited with status success for try_number 1 2024-02-23T23:50:06.268141311Z [2024-02-23T23:50:06.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:49:00+00:00 exited with status success for try_number 1 2024-02-23T23:50:06.268249188Z [2024-02-23T23:50:06.268+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-23T23:45:00+00:00 exited with status success for try_number 1 2024-02-23T23:50:06.280785550Z [2024-02-23T23:50:06.280+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:49:00+00:00, map_index=-1, run_start_date=2024-02-23 23:50:03.466155+00:00, run_end_date=2024-02-23 23:50:05.042898+00:00, run_duration=1.576743, state=success, executor_state=success, try_number=1, max_tries=1, job_id=71, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:50:00.248995+00:00, queued_by_job_id=2, pid=1161 2024-02-23T23:50:06.281139369Z [2024-02-23T23:50:06.280+0000] {scheduler_job.py:635} INFO - Setting external_id for to 818eab96-2de2-4156-b147-d953ea0ca71d 2024-02-23T23:50:06.281526754Z [2024-02-23T23:50:06.281+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-23T23:45:00+00:00, map_index=-1, run_start_date=2024-02-23 23:50:05.569623+00:00, run_end_date=2024-02-23 23:50:05.936224+00:00, run_duration=0.366601, state=success, executor_state=success, try_number=1, max_tries=1, job_id=72, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:50:03.693131+00:00, queued_by_job_id=2, pid=1179 2024-02-23T23:50:06.282203500Z [2024-02-23T23:50:06.281+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:49:00+00:00, map_index=-1, run_start_date=2024-02-23 23:50:03.209327+00:00, run_end_date=2024-02-23 23:50:04.964909+00:00, run_duration=1.755582, state=success, executor_state=success, try_number=1, max_tries=1, job_id=70, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:50:00.248995+00:00, queued_by_job_id=2, pid=1155 2024-02-23T23:50:09.166212167Z [2024-02-23T23:50:09.165+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-23T23:50:09.166238837Z 2024-02-23T23:50:09.166518386Z [2024-02-23T23:50:09.166+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:50:09.167443901Z [2024-02-23T23:50:09.167+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:50:09.167462855Z 2024-02-23T23:50:09.170493105Z [2024-02-23T23:50:09.170+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-23T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:50:09.170801548Z [2024-02-23T23:50:09.170+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-23T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T23:50:09.232759186Z [2024-02-23T23:50:09.232+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-23T23:45:00+00:00 exited with status queued for try_number 1 2024-02-23T23:50:09.233068668Z [2024-02-23T23:50:09.232+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-23T23:45:00+00:00 exited with status success for try_number 1 2024-02-23T23:50:09.241541873Z [2024-02-23T23:50:09.241+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-23T23:45:00+00:00, map_index=0, run_start_date=2024-02-23 23:50:08.023600+00:00, run_end_date=2024-02-23 23:50:08.427775+00:00, run_duration=0.404175, state=success, executor_state=success, try_number=1, max_tries=1, job_id=73, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:50:06.203782+00:00, queued_by_job_id=2, pid=1187 2024-02-23T23:50:09.242061842Z [2024-02-23T23:50:09.241+0000] {scheduler_job.py:635} INFO - Setting external_id for to c683191d-72c9-4d58-8ec2-2f3e67a6fd31 2024-02-23T23:50:11.480473467Z [2024-02-23T23:50:11.480+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:50:11.480958362Z [2024-02-23T23:50:11.480+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:45:00+00:00, run_id=scheduled__2024-02-23T23:45:00+00:00, run_start_date=2024-02-23 23:50:00.157684+00:00, run_end_date=2024-02-23 23:50:11.480339+00:00, run_duration=11.322655, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:45:00+00:00, data_interval_end=2024-02-23 23:50:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-23T23:50:11.488499093Z [2024-02-23T23:50:11.488+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:50:00+00:00, run_after=2024-02-23T23:55:00+00:00 2024-02-23T23:50:11.530226277Z [2024-02-23T23:50:11.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-23T23:45:00+00:00 exited with status success for try_number 1 2024-02-23T23:50:11.539380329Z [2024-02-23T23:50:11.538+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-23T23:45:00+00:00, map_index=-1, run_start_date=2024-02-23 23:50:10.805142+00:00, run_end_date=2024-02-23 23:50:11.208522+00:00, run_duration=0.40338, state=success, executor_state=success, try_number=1, max_tries=1, job_id=74, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:50:09.167980+00:00, queued_by_job_id=2, pid=1195 2024-02-23T23:51:00.995695538Z [2024-02-23T23:51:00.995+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:51:00+00:00, run_after=2024-02-23T23:52:00+00:00 2024-02-23T23:51:01.003346967Z [2024-02-23T23:51:01.003+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:51:01.017057743Z [2024-02-23T23:51:01.016+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:51:00+00:00, run_after=2024-02-23T23:52:00+00:00 2024-02-23T23:51:01.105218004Z [2024-02-23T23:51:01.104+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-23T23:51:01.105259255Z 2024-02-23T23:51:01.105263133Z 2024-02-23T23:51:01.105266315Z 2024-02-23T23:51:01.105420612Z [2024-02-23T23:51:01.105+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:51:01.105617696Z [2024-02-23T23:51:01.105+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:51:01.105832380Z [2024-02-23T23:51:01.105+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-23T23:51:01.106560294Z [2024-02-23T23:51:01.106+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:51:01.106574620Z 2024-02-23T23:51:01.106583395Z 2024-02-23T23:51:01.106587601Z 2024-02-23T23:51:01.110199881Z [2024-02-23T23:51:01.109+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:51:01.110784187Z [2024-02-23T23:51:01.110+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T23:51:01.111049652Z [2024-02-23T23:51:01.110+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:51:01.111098210Z [2024-02-23T23:51:01.110+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T23:51:01.111329671Z [2024-02-23T23:51:01.111+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:51:01.111341058Z [2024-02-23T23:51:01.111+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T23:51:01.797942995Z [2024-02-23T23:51:01.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:50:00+00:00 exited with status queued for try_number 1 2024-02-23T23:51:01.798580528Z [2024-02-23T23:51:01.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:50:00+00:00 exited with status queued for try_number 1 2024-02-23T23:51:01.798782955Z [2024-02-23T23:51:01.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:50:00+00:00 exited with status queued for try_number 1 2024-02-23T23:51:01.811565999Z [2024-02-23T23:51:01.808+0000] {scheduler_job.py:635} INFO - Setting external_id for to df30aea7-e1f7-4d26-a560-8a6d6599214a 2024-02-23T23:51:01.811590095Z [2024-02-23T23:51:01.809+0000] {scheduler_job.py:635} INFO - Setting external_id for to a1638356-93ca-45db-b275-ea34ac5c9610 2024-02-23T23:51:01.811593617Z [2024-02-23T23:51:01.809+0000] {scheduler_job.py:635} INFO - Setting external_id for to 94e2ba09-51a8-4510-90f7-148a3722ac82 2024-02-23T23:51:04.688099181Z [2024-02-23T23:51:04.687+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:51:04.688402997Z [2024-02-23T23:51:04.688+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-23 23:50:00+00:00, run_id=scheduled__2024-02-23T23:50:00+00:00, run_start_date=2024-02-23 23:51:01.031872+00:00, run_end_date=2024-02-23 23:51:04.688000+00:00, run_duration=3.656128, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:50:00+00:00, data_interval_end=2024-02-23 23:51:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-23T23:51:04.698924865Z [2024-02-23T23:51:04.698+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:51:00+00:00, run_after=2024-02-23T23:52:00+00:00 2024-02-23T23:51:04.773391584Z [2024-02-23T23:51:04.773+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:50:00+00:00 exited with status success for try_number 1 2024-02-23T23:51:04.785335737Z [2024-02-23T23:51:04.784+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:50:00+00:00, map_index=-1, run_start_date=2024-02-23 23:51:02.709401+00:00, run_end_date=2024-02-23 23:51:03.549662+00:00, run_duration=0.840261, state=success, executor_state=success, try_number=1, max_tries=1, job_id=75, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:51:01.107559+00:00, queued_by_job_id=2, pid=1216 2024-02-23T23:51:07.571857359Z [2024-02-23T23:51:07.571+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:51:07.574575658Z [2024-02-23T23:51:07.573+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:50:00+00:00, run_id=scheduled__2024-02-23T23:50:00+00:00, run_start_date=2024-02-23 23:51:01.028046+00:00, run_end_date=2024-02-23 23:51:07.571787+00:00, run_duration=6.543741, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:50:00+00:00, data_interval_end=2024-02-23 23:51:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-23T23:51:07.588207036Z [2024-02-23T23:51:07.587+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:51:00+00:00, run_after=2024-02-23T23:52:00+00:00 2024-02-23T23:51:07.622089217Z [2024-02-23T23:51:07.621+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:50:00+00:00 exited with status success for try_number 1 2024-02-23T23:51:07.626357989Z [2024-02-23T23:51:07.626+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:50:00+00:00, map_index=-1, run_start_date=2024-02-23 23:51:04.983239+00:00, run_end_date=2024-02-23 23:51:06.985071+00:00, run_duration=2.001832, state=success, executor_state=success, try_number=1, max_tries=1, job_id=77, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:51:01.107559+00:00, queued_by_job_id=2, pid=1235 2024-02-23T23:51:08.455482299Z [2024-02-23T23:51:08.454+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:51:08.455961574Z [2024-02-23T23:51:08.455+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:50:00+00:00, run_id=scheduled__2024-02-23T23:50:00+00:00, run_start_date=2024-02-23 23:51:01.030365+00:00, run_end_date=2024-02-23 23:51:08.455649+00:00, run_duration=7.425284, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:50:00+00:00, data_interval_end=2024-02-23 23:51:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-23T23:51:08.469002450Z [2024-02-23T23:51:08.468+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:51:00+00:00, run_after=2024-02-23T23:52:00+00:00 2024-02-23T23:51:08.513548847Z [2024-02-23T23:51:08.513+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:50:00+00:00 exited with status success for try_number 1 2024-02-23T23:51:08.517758741Z [2024-02-23T23:51:08.517+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:50:00+00:00, map_index=-1, run_start_date=2024-02-23 23:51:04.907866+00:00, run_end_date=2024-02-23 23:51:07.846585+00:00, run_duration=2.938719, state=success, executor_state=success, try_number=1, max_tries=1, job_id=76, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:51:01.107559+00:00, queued_by_job_id=2, pid=1234 2024-02-23T23:51:59.311918145Z [2024-02-23T23:51:59.311+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-23T23:52:00.346777125Z [2024-02-23T23:52:00.346+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:52:00.360290121Z [2024-02-23T23:52:00.359+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:52:00+00:00, run_after=2024-02-23T23:53:00+00:00 2024-02-23T23:52:00.371518187Z [2024-02-23T23:52:00.371+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:52:00+00:00, run_after=2024-02-23T23:53:00+00:00 2024-02-23T23:52:00.377375499Z [2024-02-23T23:52:00.376+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:52:00.515458675Z [2024-02-23T23:52:00.514+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-23T23:52:00.515503767Z 2024-02-23T23:52:00.515515078Z 2024-02-23T23:52:00.515523696Z 2024-02-23T23:52:00.515532482Z 2024-02-23T23:52:00.515572370Z [2024-02-23T23:52:00.515+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-23T23:52:00.515959416Z [2024-02-23T23:52:00.515+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:52:00.516091439Z [2024-02-23T23:52:00.515+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:52:00.516302086Z [2024-02-23T23:52:00.516+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-23T23:52:00.517860219Z [2024-02-23T23:52:00.517+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:52:00.517877867Z 2024-02-23T23:52:00.517884150Z 2024-02-23T23:52:00.517889390Z 2024-02-23T23:52:00.517908427Z 2024-02-23T23:52:00.525411512Z [2024-02-23T23:52:00.525+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-23T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:52:00.525546657Z [2024-02-23T23:52:00.525+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T23:52:00.525974379Z [2024-02-23T23:52:00.525+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:52:00.526127757Z [2024-02-23T23:52:00.525+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T23:52:00.526431593Z [2024-02-23T23:52:00.526+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:52:00.526569997Z [2024-02-23T23:52:00.526+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T23:52:00.526845710Z [2024-02-23T23:52:00.526+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:52:00.526992738Z [2024-02-23T23:52:00.526+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T23:52:00.976447061Z [2024-02-23T23:52:00.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-23T23:50:00+00:00 exited with status queued for try_number 1 2024-02-23T23:52:00.976495465Z [2024-02-23T23:52:00.976+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:51:00+00:00 exited with status queued for try_number 1 2024-02-23T23:52:00.976510334Z [2024-02-23T23:52:00.976+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:51:00+00:00 exited with status queued for try_number 1 2024-02-23T23:52:00.976514380Z [2024-02-23T23:52:00.976+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:51:00+00:00 exited with status queued for try_number 1 2024-02-23T23:52:00.996016280Z [2024-02-23T23:52:00.995+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb5e862a-ed66-4646-b7bd-d2373f1b9236 2024-02-23T23:52:00.996079473Z [2024-02-23T23:52:00.995+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9a9291d-cfad-4420-b28a-6111fa9eb1cc 2024-02-23T23:52:00.996193982Z [2024-02-23T23:52:00.995+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2901f1f8-1bcc-445b-991a-47f655aa387f 2024-02-23T23:52:00.996366396Z [2024-02-23T23:52:00.996+0000] {scheduler_job.py:635} INFO - Setting external_id for to 482271f8-362d-484f-b864-6522f554cfe5 2024-02-23T23:52:03.209219840Z [2024-02-23T23:52:03.208+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:52:03.210175544Z [2024-02-23T23:52:03.209+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-23 23:50:00+00:00, run_id=scheduled__2024-02-23T23:50:00+00:00, run_start_date=2024-02-23 23:52:00.386623+00:00, run_end_date=2024-02-23 23:52:03.209647+00:00, run_duration=2.823024, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:50:00+00:00, data_interval_end=2024-02-23 23:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-23T23:52:03.226584926Z [2024-02-23T23:52:03.226+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-23T23:52:00+00:00, run_after=2024-02-23T23:54:00+00:00 2024-02-23T23:52:03.338560496Z [2024-02-23T23:52:03.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-23T23:50:00+00:00 exited with status success for try_number 1 2024-02-23T23:52:03.349260948Z [2024-02-23T23:52:03.348+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-23T23:50:00+00:00, map_index=-1, run_start_date=2024-02-23 23:52:01.719239+00:00, run_end_date=2024-02-23 23:52:02.521223+00:00, run_duration=0.801984, state=success, executor_state=success, try_number=1, max_tries=1, job_id=78, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:52:00.520366+00:00, queued_by_job_id=2, pid=1263 2024-02-23T23:52:04.400855803Z [2024-02-23T23:52:04.400+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:52:04.401082560Z [2024-02-23T23:52:04.400+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-23 23:51:00+00:00, run_id=scheduled__2024-02-23T23:51:00+00:00, run_start_date=2024-02-23 23:52:00.387857+00:00, run_end_date=2024-02-23 23:52:04.400735+00:00, run_duration=4.012878, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:51:00+00:00, data_interval_end=2024-02-23 23:52:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-23T23:52:04.410536878Z [2024-02-23T23:52:04.410+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:52:00+00:00, run_after=2024-02-23T23:53:00+00:00 2024-02-23T23:52:04.476431592Z [2024-02-23T23:52:04.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:51:00+00:00 exited with status success for try_number 1 2024-02-23T23:52:04.487073078Z [2024-02-23T23:52:04.486+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:51:00+00:00, map_index=-1, run_start_date=2024-02-23 23:52:02.375543+00:00, run_end_date=2024-02-23 23:52:03.308434+00:00, run_duration=0.932891, state=success, executor_state=success, try_number=1, max_tries=1, job_id=79, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:52:00.520366+00:00, queued_by_job_id=2, pid=1273 2024-02-23T23:52:05.540053268Z [2024-02-23T23:52:05.539+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:52:05.540458253Z [2024-02-23T23:52:05.540+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:51:00+00:00, run_id=scheduled__2024-02-23T23:51:00+00:00, run_start_date=2024-02-23 23:52:00.388964+00:00, run_end_date=2024-02-23 23:52:05.540014+00:00, run_duration=5.15105, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:51:00+00:00, data_interval_end=2024-02-23 23:52:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-23T23:52:05.550504139Z [2024-02-23T23:52:05.550+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:52:00+00:00, run_after=2024-02-23T23:53:00+00:00 2024-02-23T23:52:05.586862480Z [2024-02-23T23:52:05.586+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:51:00+00:00 exited with status success for try_number 1 2024-02-23T23:52:05.592038437Z [2024-02-23T23:52:05.591+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:51:00+00:00, map_index=-1, run_start_date=2024-02-23 23:52:03.372182+00:00, run_end_date=2024-02-23 23:52:05.085134+00:00, run_duration=1.712952, state=success, executor_state=success, try_number=1, max_tries=1, job_id=80, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:52:00.520366+00:00, queued_by_job_id=2, pid=1287 2024-02-23T23:52:07.177275982Z [2024-02-23T23:52:07.176+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:52:07.177756752Z [2024-02-23T23:52:07.177+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:51:00+00:00, run_id=scheduled__2024-02-23T23:51:00+00:00, run_start_date=2024-02-23 23:52:00.390109+00:00, run_end_date=2024-02-23 23:52:07.177036+00:00, run_duration=6.786927, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:51:00+00:00, data_interval_end=2024-02-23 23:52:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-23T23:52:07.192968260Z [2024-02-23T23:52:07.192+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:52:00+00:00, run_after=2024-02-23T23:53:00+00:00 2024-02-23T23:52:07.254760776Z [2024-02-23T23:52:07.254+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:51:00+00:00 exited with status success for try_number 1 2024-02-23T23:52:07.264570068Z [2024-02-23T23:52:07.263+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:51:00+00:00, map_index=-1, run_start_date=2024-02-23 23:52:03.848921+00:00, run_end_date=2024-02-23 23:52:06.559916+00:00, run_duration=2.710995, state=success, executor_state=success, try_number=1, max_tries=1, job_id=81, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:52:00.520366+00:00, queued_by_job_id=2, pid=1298 2024-02-23T23:53:00.346565582Z [2024-02-23T23:53:00.345+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:53:00+00:00, run_after=2024-02-23T23:54:00+00:00 2024-02-23T23:53:00.358532558Z [2024-02-23T23:53:00.358+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:53:00.372839227Z [2024-02-23T23:53:00.372+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:53:00+00:00, run_after=2024-02-23T23:54:00+00:00 2024-02-23T23:53:00.466605591Z [2024-02-23T23:53:00.466+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-23T23:53:00.466636905Z 2024-02-23T23:53:00.466642737Z 2024-02-23T23:53:00.466647680Z 2024-02-23T23:53:00.467006930Z [2024-02-23T23:53:00.466+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:53:00.467336212Z [2024-02-23T23:53:00.467+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:53:00.467606217Z [2024-02-23T23:53:00.467+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-23T23:53:00.468741065Z [2024-02-23T23:53:00.468+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:53:00.468755330Z 2024-02-23T23:53:00.468760340Z 2024-02-23T23:53:00.468764924Z 2024-02-23T23:53:00.473236650Z [2024-02-23T23:53:00.472+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:53:00.473465541Z [2024-02-23T23:53:00.473+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T23:53:00.473846732Z [2024-02-23T23:53:00.473+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:53:00.474167731Z [2024-02-23T23:53:00.473+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T23:53:00.474695239Z [2024-02-23T23:53:00.474+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:53:00.474988684Z [2024-02-23T23:53:00.474+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T23:53:00.731690040Z [2024-02-23T23:53:00.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:52:00+00:00 exited with status queued for try_number 1 2024-02-23T23:53:00.731727461Z [2024-02-23T23:53:00.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:52:00+00:00 exited with status queued for try_number 1 2024-02-23T23:53:00.732022360Z [2024-02-23T23:53:00.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:52:00+00:00 exited with status queued for try_number 1 2024-02-23T23:53:00.743372787Z [2024-02-23T23:53:00.743+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8622bd75-5aaa-4ecf-a918-89b6aa66209a 2024-02-23T23:53:00.743563970Z [2024-02-23T23:53:00.743+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4cf52209-cf1e-4157-9426-6592ff754ab0 2024-02-23T23:53:00.743783825Z [2024-02-23T23:53:00.743+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4342154a-8af7-4a62-a51e-743bbd5037d0 2024-02-23T23:53:01.918470666Z [2024-02-23T23:53:01.917+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:53:01.918939516Z [2024-02-23T23:53:01.918+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-23 23:52:00+00:00, run_id=scheduled__2024-02-23T23:52:00+00:00, run_start_date=2024-02-23 23:53:00.389587+00:00, run_end_date=2024-02-23 23:53:01.918393+00:00, run_duration=1.528806, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:52:00+00:00, data_interval_end=2024-02-23 23:53:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-23T23:53:01.928870843Z [2024-02-23T23:53:01.928+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:53:00+00:00, run_after=2024-02-23T23:54:00+00:00 2024-02-23T23:53:01.998477790Z [2024-02-23T23:53:01.997+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:52:00+00:00 exited with status success for try_number 1 2024-02-23T23:53:02.018644812Z [2024-02-23T23:53:02.018+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:52:00+00:00, map_index=-1, run_start_date=2024-02-23 23:53:01.416307+00:00, run_end_date=2024-02-23 23:53:01.861549+00:00, run_duration=0.445242, state=success, executor_state=success, try_number=1, max_tries=1, job_id=82, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:53:00.470435+00:00, queued_by_job_id=2, pid=1325 2024-02-23T23:53:04.394050015Z [2024-02-23T23:53:04.393+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:53:04.394563079Z [2024-02-23T23:53:04.394+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:52:00+00:00, run_id=scheduled__2024-02-23T23:52:00+00:00, run_start_date=2024-02-23 23:53:00.386909+00:00, run_end_date=2024-02-23 23:53:04.393926+00:00, run_duration=4.007017, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:52:00+00:00, data_interval_end=2024-02-23 23:53:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-23T23:53:04.408136718Z [2024-02-23T23:53:04.407+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:53:00+00:00, run_after=2024-02-23T23:54:00+00:00 2024-02-23T23:53:04.463446937Z [2024-02-23T23:53:04.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:52:00+00:00 exited with status success for try_number 1 2024-02-23T23:53:04.470749440Z [2024-02-23T23:53:04.470+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:52:00+00:00, map_index=-1, run_start_date=2024-02-23 23:53:02.469656+00:00, run_end_date=2024-02-23 23:53:03.853509+00:00, run_duration=1.383853, state=success, executor_state=success, try_number=1, max_tries=1, job_id=83, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:53:00.470435+00:00, queued_by_job_id=2, pid=1343 2024-02-23T23:53:05.525363260Z [2024-02-23T23:53:05.524+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:53:05.525765313Z [2024-02-23T23:53:05.525+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:52:00+00:00, run_id=scheduled__2024-02-23T23:52:00+00:00, run_start_date=2024-02-23 23:53:00.388421+00:00, run_end_date=2024-02-23 23:53:05.525266+00:00, run_duration=5.136845, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:52:00+00:00, data_interval_end=2024-02-23 23:53:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-23T23:53:05.537736767Z [2024-02-23T23:53:05.537+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:53:00+00:00, run_after=2024-02-23T23:54:00+00:00 2024-02-23T23:53:05.567723201Z [2024-02-23T23:53:05.567+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:52:00+00:00 exited with status success for try_number 1 2024-02-23T23:53:05.573124783Z [2024-02-23T23:53:05.572+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:52:00+00:00, map_index=-1, run_start_date=2024-02-23 23:53:02.615021+00:00, run_end_date=2024-02-23 23:53:04.717438+00:00, run_duration=2.102417, state=success, executor_state=success, try_number=1, max_tries=1, job_id=84, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:53:00.470435+00:00, queued_by_job_id=2, pid=1344 2024-02-23T23:54:00.782711484Z [2024-02-23T23:54:00.782+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:54:00.808375380Z [2024-02-23T23:54:00.807+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:54:00+00:00, run_after=2024-02-23T23:55:00+00:00 2024-02-23T23:54:00.824247964Z [2024-02-23T23:54:00.823+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:54:00+00:00, run_after=2024-02-23T23:55:00+00:00 2024-02-23T23:54:00.833682473Z [2024-02-23T23:54:00.833+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:54:00.920277784Z [2024-02-23T23:54:00.919+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-23T23:54:00.920311398Z 2024-02-23T23:54:00.920318346Z 2024-02-23T23:54:00.920324370Z 2024-02-23T23:54:00.920331123Z 2024-02-23T23:54:00.920348227Z [2024-02-23T23:54:00.920+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-23T23:54:00.920523120Z [2024-02-23T23:54:00.920+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-23T23:54:00.920683454Z [2024-02-23T23:54:00.920+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:54:00.920836878Z [2024-02-23T23:54:00.920+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:54:00.921697199Z [2024-02-23T23:54:00.921+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:54:00.921716406Z 2024-02-23T23:54:00.921725214Z 2024-02-23T23:54:00.921755879Z 2024-02-23T23:54:00.921761783Z 2024-02-23T23:54:00.925977659Z [2024-02-23T23:54:00.925+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-23T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:54:00.926157885Z [2024-02-23T23:54:00.925+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T23:54:00.926425474Z [2024-02-23T23:54:00.926+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:54:00.926541256Z [2024-02-23T23:54:00.926+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T23:54:00.926750235Z [2024-02-23T23:54:00.926+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:54:00.926806978Z [2024-02-23T23:54:00.926+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T23:54:00.927032107Z [2024-02-23T23:54:00.926+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:54:00.927195863Z [2024-02-23T23:54:00.926+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T23:54:01.352456773Z [2024-02-23T23:54:01.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-23T23:52:00+00:00 exited with status queued for try_number 1 2024-02-23T23:54:01.352804381Z [2024-02-23T23:54:01.352+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:53:00+00:00 exited with status queued for try_number 1 2024-02-23T23:54:01.353001774Z [2024-02-23T23:54:01.352+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:53:00+00:00 exited with status queued for try_number 1 2024-02-23T23:54:01.353138018Z [2024-02-23T23:54:01.352+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:53:00+00:00 exited with status queued for try_number 1 2024-02-23T23:54:01.376889113Z [2024-02-23T23:54:01.376+0000] {scheduler_job.py:635} INFO - Setting external_id for to 12f33f35-fc48-4067-845f-a66f00ee0298 2024-02-23T23:54:01.377207547Z [2024-02-23T23:54:01.376+0000] {scheduler_job.py:635} INFO - Setting external_id for to 70b0c592-8c3f-4f4b-8bff-007dfa1cec59 2024-02-23T23:54:01.377620046Z [2024-02-23T23:54:01.377+0000] {scheduler_job.py:635} INFO - Setting external_id for to af532a1e-4613-4e8a-a9d5-cd2a768a99cd 2024-02-23T23:54:01.378112997Z [2024-02-23T23:54:01.377+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f9947c3-bac3-49d6-a7dc-2826d99f05bd 2024-02-23T23:54:02.299580438Z [2024-02-23T23:54:02.299+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:54:02.300465595Z [2024-02-23T23:54:02.300+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-23 23:53:00+00:00, run_id=scheduled__2024-02-23T23:53:00+00:00, run_start_date=2024-02-23 23:54:00.848315+00:00, run_end_date=2024-02-23 23:54:02.299585+00:00, run_duration=1.45127, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:53:00+00:00, data_interval_end=2024-02-23 23:54:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-23T23:54:02.314111713Z [2024-02-23T23:54:02.313+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:54:00+00:00, run_after=2024-02-23T23:55:00+00:00 2024-02-23T23:54:02.454618171Z [2024-02-23T23:54:02.453+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:53:00+00:00 exited with status success for try_number 1 2024-02-23T23:54:02.466955329Z [2024-02-23T23:54:02.466+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:53:00+00:00, map_index=-1, run_start_date=2024-02-23 23:54:01.709238+00:00, run_end_date=2024-02-23 23:54:02.101792+00:00, run_duration=0.392554, state=success, executor_state=success, try_number=1, max_tries=1, job_id=85, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:54:00.922712+00:00, queued_by_job_id=2, pid=1377 2024-02-23T23:54:02.876325722Z [2024-02-23T23:54:02.875+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:54:02.876904162Z [2024-02-23T23:54:02.876+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-23 23:52:00+00:00, run_id=scheduled__2024-02-23T23:52:00+00:00, run_start_date=2024-02-23 23:54:00.846870+00:00, run_end_date=2024-02-23 23:54:02.876223+00:00, run_duration=2.029353, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:52:00+00:00, data_interval_end=2024-02-23 23:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-23T23:54:02.890419402Z [2024-02-23T23:54:02.890+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-23T23:54:00+00:00, run_after=2024-02-23T23:56:00+00:00 2024-02-23T23:54:02.985645224Z [2024-02-23T23:54:02.985+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-23T23:52:00+00:00 exited with status success for try_number 1 2024-02-23T23:54:02.990746680Z [2024-02-23T23:54:02.990+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-23T23:52:00+00:00, map_index=-1, run_start_date=2024-02-23 23:54:01.903443+00:00, run_end_date=2024-02-23 23:54:02.277598+00:00, run_duration=0.374155, state=success, executor_state=success, try_number=1, max_tries=1, job_id=86, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:54:00.922712+00:00, queued_by_job_id=2, pid=1378 2024-02-23T23:54:06.207464851Z [2024-02-23T23:54:06.207+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:54:06.208034575Z [2024-02-23T23:54:06.207+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:53:00+00:00, run_id=scheduled__2024-02-23T23:53:00+00:00, run_start_date=2024-02-23 23:54:00.849583+00:00, run_end_date=2024-02-23 23:54:06.207330+00:00, run_duration=5.357747, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:53:00+00:00, data_interval_end=2024-02-23 23:54:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-23T23:54:06.222488220Z [2024-02-23T23:54:06.222+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:54:00+00:00, run_after=2024-02-23T23:55:00+00:00 2024-02-23T23:54:06.285392656Z [2024-02-23T23:54:06.285+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:53:00+00:00 exited with status success for try_number 1 2024-02-23T23:54:06.293289995Z [2024-02-23T23:54:06.292+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:53:00+00:00, map_index=-1, run_start_date=2024-02-23 23:54:03.358539+00:00, run_end_date=2024-02-23 23:54:05.722625+00:00, run_duration=2.364086, state=success, executor_state=success, try_number=1, max_tries=1, job_id=88, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:54:00.922712+00:00, queued_by_job_id=2, pid=1402 2024-02-23T23:54:07.337482126Z [2024-02-23T23:54:07.337+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:54:07.338340589Z [2024-02-23T23:54:07.337+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:53:00+00:00, run_id=scheduled__2024-02-23T23:53:00+00:00, run_start_date=2024-02-23 23:54:00.850925+00:00, run_end_date=2024-02-23 23:54:07.337373+00:00, run_duration=6.486448, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:53:00+00:00, data_interval_end=2024-02-23 23:54:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-23T23:54:07.347217248Z [2024-02-23T23:54:07.346+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:54:00+00:00, run_after=2024-02-23T23:55:00+00:00 2024-02-23T23:54:07.396049158Z [2024-02-23T23:54:07.395+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:53:00+00:00 exited with status success for try_number 1 2024-02-23T23:54:07.403589351Z [2024-02-23T23:54:07.403+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:53:00+00:00, map_index=-1, run_start_date=2024-02-23 23:54:03.120262+00:00, run_end_date=2024-02-23 23:54:06.243844+00:00, run_duration=3.123582, state=success, executor_state=success, try_number=1, max_tries=1, job_id=87, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:54:00.922712+00:00, queued_by_job_id=2, pid=1400 2024-02-23T23:55:00.151696122Z [2024-02-23T23:55:00.151+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:55:00+00:00, run_after=2024-02-24T00:00:00+00:00 2024-02-23T23:55:00.162882244Z [2024-02-23T23:55:00.162+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:55:00.181019344Z [2024-02-23T23:55:00.179+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:55:00+00:00, run_after=2024-02-23T23:56:00+00:00 2024-02-23T23:55:00.196641727Z [2024-02-23T23:55:00.196+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:55:00+00:00, run_after=2024-02-23T23:56:00+00:00 2024-02-23T23:55:00.269750350Z [2024-02-23T23:55:00.269+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-23T23:55:00.269792378Z 2024-02-23T23:55:00.269798150Z 2024-02-23T23:55:00.269801171Z 2024-02-23T23:55:00.269804309Z 2024-02-23T23:55:00.270028449Z [2024-02-23T23:55:00.269+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:55:00.270207643Z [2024-02-23T23:55:00.269+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:55:00.270371774Z [2024-02-23T23:55:00.270+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-23T23:55:00.270496680Z [2024-02-23T23:55:00.270+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:55:00.271103882Z [2024-02-23T23:55:00.270+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:55:00.271121733Z 2024-02-23T23:55:00.271127234Z 2024-02-23T23:55:00.271131675Z 2024-02-23T23:55:00.271135979Z 2024-02-23T23:55:00.274335412Z [2024-02-23T23:55:00.274+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-23T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-23T23:55:00.274517378Z [2024-02-23T23:55:00.274+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T23:55:00.274845379Z [2024-02-23T23:55:00.274+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:55:00.275004179Z [2024-02-23T23:55:00.274+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T23:55:00.275310695Z [2024-02-23T23:55:00.275+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:55:00.275494227Z [2024-02-23T23:55:00.275+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T23:55:00.275787000Z [2024-02-23T23:55:00.275+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:55:00.275811096Z [2024-02-23T23:55:00.275+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T23:55:00.529202069Z [2024-02-23T23:55:00.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-23T23:50:00+00:00 exited with status queued for try_number 1 2024-02-23T23:55:00.529240523Z [2024-02-23T23:55:00.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:54:00+00:00 exited with status queued for try_number 1 2024-02-23T23:55:00.529256041Z [2024-02-23T23:55:00.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:54:00+00:00 exited with status queued for try_number 1 2024-02-23T23:55:00.529328690Z [2024-02-23T23:55:00.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:54:00+00:00 exited with status queued for try_number 1 2024-02-23T23:55:00.537156838Z [2024-02-23T23:55:00.536+0000] {scheduler_job.py:635} INFO - Setting external_id for to e54f3c86-56e6-434f-83c9-3f24c3747120 2024-02-23T23:55:00.537208260Z [2024-02-23T23:55:00.537+0000] {scheduler_job.py:635} INFO - Setting external_id for to bdc72c51-9ef8-4fab-b645-fe0ddbd68be0 2024-02-23T23:55:00.537429164Z [2024-02-23T23:55:00.537+0000] {scheduler_job.py:635} INFO - Setting external_id for to 484b12c1-7db8-4aa0-86de-cbf8971cbc4c 2024-02-23T23:55:00.537534232Z [2024-02-23T23:55:00.537+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97fa297d-ebe1-4cc2-8027-d07b30765403 2024-02-23T23:55:01.766876362Z [2024-02-23T23:55:01.766+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:55:01.767261223Z [2024-02-23T23:55:01.767+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-23 23:54:00+00:00, run_id=scheduled__2024-02-23T23:54:00+00:00, run_start_date=2024-02-23 23:55:00.210615+00:00, run_end_date=2024-02-23 23:55:01.766832+00:00, run_duration=1.556217, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:54:00+00:00, data_interval_end=2024-02-23 23:55:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-23T23:55:01.784014502Z [2024-02-23T23:55:01.783+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:55:00+00:00, run_after=2024-02-23T23:56:00+00:00 2024-02-23T23:55:01.825406453Z [2024-02-23T23:55:01.825+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:54:00+00:00 exited with status success for try_number 1 2024-02-23T23:55:01.837882282Z [2024-02-23T23:55:01.837+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:54:00+00:00, map_index=-1, run_start_date=2024-02-23 23:55:01.120517+00:00, run_end_date=2024-02-23 23:55:01.547609+00:00, run_duration=0.427092, state=success, executor_state=success, try_number=1, max_tries=1, job_id=89, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:55:00.271770+00:00, queued_by_job_id=2, pid=1435 2024-02-23T23:55:03.747875724Z [2024-02-23T23:55:03.747+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-23T23:55:03.747939430Z 2024-02-23T23:55:03.747945514Z [2024-02-23T23:55:03.747+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:55:03.748333665Z [2024-02-23T23:55:03.748+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:55:03.748340312Z 2024-02-23T23:55:03.750780077Z [2024-02-23T23:55:03.750+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-23T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-23T23:55:03.750879708Z [2024-02-23T23:55:03.750+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-23T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T23:55:03.818632096Z [2024-02-23T23:55:03.818+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-23T23:50:00+00:00 exited with status queued for try_number 1 2024-02-23T23:55:03.818690393Z [2024-02-23T23:55:03.818+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-23T23:50:00+00:00 exited with status success for try_number 1 2024-02-23T23:55:03.824963775Z [2024-02-23T23:55:03.824+0000] {scheduler_job.py:635} INFO - Setting external_id for to 09f80ab3-ab68-43bc-87fb-206e254776a7 2024-02-23T23:55:03.825082710Z [2024-02-23T23:55:03.824+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-23T23:50:00+00:00, map_index=-1, run_start_date=2024-02-23 23:55:02.451422+00:00, run_end_date=2024-02-23 23:55:02.897554+00:00, run_duration=0.446132, state=success, executor_state=success, try_number=1, max_tries=1, job_id=92, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:55:00.271770+00:00, queued_by_job_id=2, pid=1461 2024-02-23T23:55:03.904039942Z [2024-02-23T23:55:03.903+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:55:03.904458824Z [2024-02-23T23:55:03.904+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:54:00+00:00, run_id=scheduled__2024-02-23T23:54:00+00:00, run_start_date=2024-02-23 23:55:00.209493+00:00, run_end_date=2024-02-23 23:55:03.903955+00:00, run_duration=3.694462, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:54:00+00:00, data_interval_end=2024-02-23 23:55:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-23T23:55:03.919399044Z [2024-02-23T23:55:03.918+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:55:00+00:00, run_after=2024-02-23T23:56:00+00:00 2024-02-23T23:55:05.043284221Z [2024-02-23T23:55:05.042+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:55:05.043840466Z [2024-02-23T23:55:05.043+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:54:00+00:00, run_id=scheduled__2024-02-23T23:54:00+00:00, run_start_date=2024-02-23 23:55:00.208447+00:00, run_end_date=2024-02-23 23:55:05.043157+00:00, run_duration=4.83471, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:54:00+00:00, data_interval_end=2024-02-23 23:55:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-23T23:55:05.054063136Z [2024-02-23T23:55:05.053+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:55:00+00:00, run_after=2024-02-23T23:56:00+00:00 2024-02-23T23:55:05.106694546Z [2024-02-23T23:55:05.106+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:54:00+00:00 exited with status success for try_number 1 2024-02-23T23:55:05.107123241Z [2024-02-23T23:55:05.106+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:54:00+00:00 exited with status success for try_number 1 2024-02-23T23:55:05.114645492Z [2024-02-23T23:55:05.114+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:54:00+00:00, map_index=-1, run_start_date=2024-02-23 23:55:02.318076+00:00, run_end_date=2024-02-23 23:55:03.763466+00:00, run_duration=1.44539, state=success, executor_state=success, try_number=1, max_tries=1, job_id=90, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:55:00.271770+00:00, queued_by_job_id=2, pid=1459 2024-02-23T23:55:05.115121690Z [2024-02-23T23:55:05.114+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:54:00+00:00, map_index=-1, run_start_date=2024-02-23 23:55:02.408986+00:00, run_end_date=2024-02-23 23:55:04.068900+00:00, run_duration=1.659914, state=success, executor_state=success, try_number=1, max_tries=1, job_id=91, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:55:00.271770+00:00, queued_by_job_id=2, pid=1460 2024-02-23T23:55:06.185689500Z [2024-02-23T23:55:06.185+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-23T23:55:06.185729918Z 2024-02-23T23:55:06.185738129Z [2024-02-23T23:55:06.185+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:55:06.186518618Z [2024-02-23T23:55:06.186+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:55:06.186540399Z 2024-02-23T23:55:06.189350141Z [2024-02-23T23:55:06.189+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-23T23:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-23T23:55:06.189483896Z [2024-02-23T23:55:06.189+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-23T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T23:55:06.241674624Z [2024-02-23T23:55:06.241+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-23T23:50:00+00:00 exited with status queued for try_number 1 2024-02-23T23:55:06.242083623Z [2024-02-23T23:55:06.241+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-23T23:50:00+00:00 exited with status success for try_number 1 2024-02-23T23:55:06.250582311Z [2024-02-23T23:55:06.250+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f24c10e-d1c1-4077-8aa5-dc8357f6dadd 2024-02-23T23:55:06.250891021Z [2024-02-23T23:55:06.250+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-23T23:50:00+00:00, map_index=-1, run_start_date=2024-02-23 23:55:05.478962+00:00, run_end_date=2024-02-23 23:55:05.834198+00:00, run_duration=0.355236, state=success, executor_state=success, try_number=1, max_tries=1, job_id=93, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:55:03.748623+00:00, queued_by_job_id=2, pid=1484 2024-02-23T23:55:08.740453642Z [2024-02-23T23:55:08.739+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-23T23:55:08.740499114Z 2024-02-23T23:55:08.740961497Z [2024-02-23T23:55:08.740+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:55:08.742449453Z [2024-02-23T23:55:08.742+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:55:08.742472845Z 2024-02-23T23:55:08.746714237Z [2024-02-23T23:55:08.746+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-23T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:55:08.747022116Z [2024-02-23T23:55:08.746+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-23T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T23:55:08.805738847Z [2024-02-23T23:55:08.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-23T23:50:00+00:00 exited with status queued for try_number 1 2024-02-23T23:55:08.806351268Z [2024-02-23T23:55:08.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-23T23:50:00+00:00 exited with status success for try_number 1 2024-02-23T23:55:08.818414618Z [2024-02-23T23:55:08.818+0000] {scheduler_job.py:635} INFO - Setting external_id for to 61d21e70-faaf-477c-9000-d50b623f911e 2024-02-23T23:55:08.818869620Z [2024-02-23T23:55:08.818+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-23T23:50:00+00:00, map_index=0, run_start_date=2024-02-23 23:55:07.836971+00:00, run_end_date=2024-02-23 23:55:08.165380+00:00, run_duration=0.328409, state=success, executor_state=success, try_number=1, max_tries=1, job_id=94, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:55:06.186871+00:00, queued_by_job_id=2, pid=1492 2024-02-23T23:55:11.694639273Z [2024-02-23T23:55:11.694+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:55:11.694870643Z [2024-02-23T23:55:11.694+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:50:00+00:00, run_id=scheduled__2024-02-23T23:50:00+00:00, run_start_date=2024-02-23 23:55:00.207288+00:00, run_end_date=2024-02-23 23:55:11.694522+00:00, run_duration=11.487234, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:50:00+00:00, data_interval_end=2024-02-23 23:55:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-23T23:55:11.701154813Z [2024-02-23T23:55:11.700+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:55:00+00:00, run_after=2024-02-24T00:00:00+00:00 2024-02-23T23:55:11.745185191Z [2024-02-23T23:55:11.744+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-23T23:50:00+00:00 exited with status success for try_number 1 2024-02-23T23:55:11.752498322Z [2024-02-23T23:55:11.752+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-23T23:50:00+00:00, map_index=-1, run_start_date=2024-02-23 23:55:10.449755+00:00, run_end_date=2024-02-23 23:55:10.810973+00:00, run_duration=0.361218, state=success, executor_state=success, try_number=1, max_tries=1, job_id=95, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:55:08.743326+00:00, queued_by_job_id=2, pid=1500 2024-02-23T23:56:00.727435780Z [2024-02-23T23:56:00.726+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:56:00+00:00, run_after=2024-02-23T23:57:00+00:00 2024-02-23T23:56:00.756190050Z [2024-02-23T23:56:00.755+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:56:00+00:00, run_after=2024-02-23T23:57:00+00:00 2024-02-23T23:56:00.765590155Z [2024-02-23T23:56:00.765+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:56:00.775549365Z [2024-02-23T23:56:00.775+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:56:00.887461974Z [2024-02-23T23:56:00.886+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-23T23:56:00.887519456Z 2024-02-23T23:56:00.887533354Z 2024-02-23T23:56:00.887542447Z 2024-02-23T23:56:00.887551039Z 2024-02-23T23:56:00.888084272Z [2024-02-23T23:56:00.887+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-23T23:56:00.888595619Z [2024-02-23T23:56:00.888+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:56:00.889168612Z [2024-02-23T23:56:00.888+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-23T23:56:00.889555283Z [2024-02-23T23:56:00.889+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:56:00.891117042Z [2024-02-23T23:56:00.890+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:56:00.891139471Z 2024-02-23T23:56:00.891148128Z 2024-02-23T23:56:00.891156116Z 2024-02-23T23:56:00.891164528Z 2024-02-23T23:56:00.899448804Z [2024-02-23T23:56:00.899+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-23T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:56:00.899499506Z [2024-02-23T23:56:00.899+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T23:56:00.899804790Z [2024-02-23T23:56:00.899+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:56:00.900049457Z [2024-02-23T23:56:00.899+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T23:56:00.900423480Z [2024-02-23T23:56:00.900+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:56:00.900577778Z [2024-02-23T23:56:00.900+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T23:56:00.900850635Z [2024-02-23T23:56:00.900+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:56:00.901060222Z [2024-02-23T23:56:00.900+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T23:56:01.365063371Z [2024-02-23T23:56:01.364+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-23T23:54:00+00:00 exited with status queued for try_number 1 2024-02-23T23:56:01.367953911Z [2024-02-23T23:56:01.364+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:55:00+00:00 exited with status queued for try_number 1 2024-02-23T23:56:01.368544963Z [2024-02-23T23:56:01.367+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:55:00+00:00 exited with status queued for try_number 1 2024-02-23T23:56:01.368978394Z [2024-02-23T23:56:01.368+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:55:00+00:00 exited with status queued for try_number 1 2024-02-23T23:56:01.390044194Z [2024-02-23T23:56:01.389+0000] {scheduler_job.py:635} INFO - Setting external_id for to 129e25ba-4a38-492d-9fc7-1e2ece975fcd 2024-02-23T23:56:01.390331833Z [2024-02-23T23:56:01.390+0000] {scheduler_job.py:635} INFO - Setting external_id for to bde347ac-e9e7-4368-9ce4-4ddc8528e9ab 2024-02-23T23:56:01.390547502Z [2024-02-23T23:56:01.390+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca85173e-e189-405b-84d7-fb3fb0e36c34 2024-02-23T23:56:01.390753019Z [2024-02-23T23:56:01.390+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37351696-a33b-4b36-8d43-b0c97818571f 2024-02-23T23:56:02.681472191Z [2024-02-23T23:56:02.681+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:56:02.682026651Z [2024-02-23T23:56:02.681+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-23 23:54:00+00:00, run_id=scheduled__2024-02-23T23:54:00+00:00, run_start_date=2024-02-23 23:56:00.792068+00:00, run_end_date=2024-02-23 23:56:02.681371+00:00, run_duration=1.889303, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:54:00+00:00, data_interval_end=2024-02-23 23:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-23T23:56:02.695718077Z [2024-02-23T23:56:02.693+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-23T23:56:00+00:00, run_after=2024-02-23T23:58:00+00:00 2024-02-23T23:56:02.713426011Z [2024-02-23T23:56:02.711+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:56:02.713454359Z [2024-02-23T23:56:02.712+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-23 23:55:00+00:00, run_id=scheduled__2024-02-23T23:55:00+00:00, run_start_date=2024-02-23 23:56:00.795214+00:00, run_end_date=2024-02-23 23:56:02.711942+00:00, run_duration=1.916728, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:55:00+00:00, data_interval_end=2024-02-23 23:56:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-23T23:56:02.725541117Z [2024-02-23T23:56:02.725+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:56:00+00:00, run_after=2024-02-23T23:57:00+00:00 2024-02-23T23:56:02.832826296Z [2024-02-23T23:56:02.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-23T23:54:00+00:00 exited with status success for try_number 1 2024-02-23T23:56:02.833257140Z [2024-02-23T23:56:02.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:55:00+00:00 exited with status success for try_number 1 2024-02-23T23:56:02.842727057Z [2024-02-23T23:56:02.842+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-23T23:54:00+00:00, map_index=-1, run_start_date=2024-02-23 23:56:01.940354+00:00, run_end_date=2024-02-23 23:56:02.388408+00:00, run_duration=0.448054, state=success, executor_state=success, try_number=1, max_tries=1, job_id=96, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:56:00.894078+00:00, queued_by_job_id=2, pid=1523 2024-02-23T23:56:02.843185678Z [2024-02-23T23:56:02.842+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:55:00+00:00, map_index=-1, run_start_date=2024-02-23 23:56:02.015885+00:00, run_end_date=2024-02-23 23:56:02.436545+00:00, run_duration=0.42066, state=success, executor_state=success, try_number=1, max_tries=1, job_id=97, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:56:00.894078+00:00, queued_by_job_id=2, pid=1524 2024-02-23T23:56:05.878742734Z [2024-02-23T23:56:05.878+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:56:05.879057451Z [2024-02-23T23:56:05.878+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:55:00+00:00, run_id=scheduled__2024-02-23T23:55:00+00:00, run_start_date=2024-02-23 23:56:00.793689+00:00, run_end_date=2024-02-23 23:56:05.878564+00:00, run_duration=5.084875, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:55:00+00:00, data_interval_end=2024-02-23 23:56:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-23T23:56:05.891045357Z [2024-02-23T23:56:05.890+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:56:00+00:00, run_after=2024-02-23T23:57:00+00:00 2024-02-23T23:56:05.904922630Z [2024-02-23T23:56:05.904+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:56:05.905453952Z [2024-02-23T23:56:05.905+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:55:00+00:00, run_id=scheduled__2024-02-23T23:55:00+00:00, run_start_date=2024-02-23 23:56:00.796517+00:00, run_end_date=2024-02-23 23:56:05.904850+00:00, run_duration=5.108333, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:55:00+00:00, data_interval_end=2024-02-23 23:56:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-23T23:56:05.918758028Z [2024-02-23T23:56:05.918+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:56:00+00:00, run_after=2024-02-23T23:57:00+00:00 2024-02-23T23:56:05.960952742Z [2024-02-23T23:56:05.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:55:00+00:00 exited with status success for try_number 1 2024-02-23T23:56:05.961406177Z [2024-02-23T23:56:05.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:55:00+00:00 exited with status success for try_number 1 2024-02-23T23:56:05.974681763Z [2024-02-23T23:56:05.973+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:55:00+00:00, map_index=-1, run_start_date=2024-02-23 23:56:03.294416+00:00, run_end_date=2024-02-23 23:56:05.238368+00:00, run_duration=1.943952, state=success, executor_state=success, try_number=1, max_tries=1, job_id=99, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:56:00.894078+00:00, queued_by_job_id=2, pid=1548 2024-02-23T23:56:05.975102803Z [2024-02-23T23:56:05.974+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:55:00+00:00, map_index=-1, run_start_date=2024-02-23 23:56:03.119354+00:00, run_end_date=2024-02-23 23:56:05.074705+00:00, run_duration=1.955351, state=success, executor_state=success, try_number=1, max_tries=1, job_id=98, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:56:00.894078+00:00, queued_by_job_id=2, pid=1547 2024-02-23T23:56:59.390884152Z [2024-02-23T23:56:59.390+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-23T23:57:00.446364244Z [2024-02-23T23:57:00.445+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:57:00+00:00, run_after=2024-02-23T23:58:00+00:00 2024-02-23T23:57:00.464663070Z [2024-02-23T23:57:00.464+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:57:00+00:00, run_after=2024-02-23T23:58:00+00:00 2024-02-23T23:57:00.473817602Z [2024-02-23T23:57:00.473+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:57:00.553754462Z [2024-02-23T23:57:00.553+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-23T23:57:00.553817526Z 2024-02-23T23:57:00.553822158Z 2024-02-23T23:57:00.553829477Z 2024-02-23T23:57:00.554130434Z [2024-02-23T23:57:00.553+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:57:00.554367744Z [2024-02-23T23:57:00.554+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:57:00.554568364Z [2024-02-23T23:57:00.554+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-23T23:57:00.555301312Z [2024-02-23T23:57:00.555+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:57:00.555315837Z 2024-02-23T23:57:00.555325048Z 2024-02-23T23:57:00.555375522Z 2024-02-23T23:57:00.558832097Z [2024-02-23T23:57:00.558+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:57:00.559120645Z [2024-02-23T23:57:00.558+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T23:57:00.559471974Z [2024-02-23T23:57:00.559+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:57:00.559692387Z [2024-02-23T23:57:00.559+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T23:57:00.560025881Z [2024-02-23T23:57:00.559+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:57:00.560239384Z [2024-02-23T23:57:00.559+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T23:57:00.795474024Z [2024-02-23T23:57:00.794+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:56:00+00:00 exited with status queued for try_number 1 2024-02-23T23:57:00.795617306Z [2024-02-23T23:57:00.795+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:56:00+00:00 exited with status queued for try_number 1 2024-02-23T23:57:00.795775847Z [2024-02-23T23:57:00.795+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:56:00+00:00 exited with status queued for try_number 1 2024-02-23T23:57:00.802757612Z [2024-02-23T23:57:00.802+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7238283e-77e5-420c-8046-1bb6bdd8a93d 2024-02-23T23:57:00.802982114Z [2024-02-23T23:57:00.802+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9105ed24-50b7-4998-89ac-9489d53b2bc0 2024-02-23T23:57:00.803174757Z [2024-02-23T23:57:00.803+0000] {scheduler_job.py:635} INFO - Setting external_id for to e7731caa-8c1b-4275-b032-f31a8827ae44 2024-02-23T23:57:02.915720346Z [2024-02-23T23:57:02.914+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:57:02.916460694Z [2024-02-23T23:57:02.916+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-23 23:56:00+00:00, run_id=scheduled__2024-02-23T23:56:00+00:00, run_start_date=2024-02-23 23:57:00.484605+00:00, run_end_date=2024-02-23 23:57:02.915845+00:00, run_duration=2.43124, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:56:00+00:00, data_interval_end=2024-02-23 23:57:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-23T23:57:02.933411376Z [2024-02-23T23:57:02.932+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:57:00+00:00, run_after=2024-02-23T23:58:00+00:00 2024-02-23T23:57:03.005517455Z [2024-02-23T23:57:03.005+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:56:00+00:00 exited with status success for try_number 1 2024-02-23T23:57:03.012913024Z [2024-02-23T23:57:03.012+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:56:00+00:00, map_index=-1, run_start_date=2024-02-23 23:57:01.471525+00:00, run_end_date=2024-02-23 23:57:01.930527+00:00, run_duration=0.459002, state=success, executor_state=success, try_number=1, max_tries=1, job_id=100, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:57:00.556218+00:00, queued_by_job_id=2, pid=1581 2024-02-23T23:57:04.080529359Z [2024-02-23T23:57:04.080+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:57:04.080913157Z [2024-02-23T23:57:04.080+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:56:00+00:00, run_id=scheduled__2024-02-23T23:56:00+00:00, run_start_date=2024-02-23 23:57:00.485898+00:00, run_end_date=2024-02-23 23:57:04.080419+00:00, run_duration=3.594521, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:56:00+00:00, data_interval_end=2024-02-23 23:57:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-23T23:57:04.095966075Z [2024-02-23T23:57:04.095+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:57:00+00:00, run_after=2024-02-23T23:58:00+00:00 2024-02-23T23:57:04.139397451Z [2024-02-23T23:57:04.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:56:00+00:00 exited with status success for try_number 1 2024-02-23T23:57:04.146345053Z [2024-02-23T23:57:04.145+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:56:00+00:00, map_index=-1, run_start_date=2024-02-23 23:57:02.414217+00:00, run_end_date=2024-02-23 23:57:03.820198+00:00, run_duration=1.405981, state=success, executor_state=success, try_number=1, max_tries=1, job_id=101, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:57:00.556218+00:00, queued_by_job_id=2, pid=1599 2024-02-23T23:57:05.204018658Z [2024-02-23T23:57:05.203+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:57:05.204371262Z [2024-02-23T23:57:05.204+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:56:00+00:00, run_id=scheduled__2024-02-23T23:56:00+00:00, run_start_date=2024-02-23 23:57:00.486976+00:00, run_end_date=2024-02-23 23:57:05.203885+00:00, run_duration=4.716909, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:56:00+00:00, data_interval_end=2024-02-23 23:57:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-23T23:57:05.219162089Z [2024-02-23T23:57:05.218+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:57:00+00:00, run_after=2024-02-23T23:58:00+00:00 2024-02-23T23:57:05.262096219Z [2024-02-23T23:57:05.261+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:56:00+00:00 exited with status success for try_number 1 2024-02-23T23:57:05.270440707Z [2024-02-23T23:57:05.269+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:56:00+00:00, map_index=-1, run_start_date=2024-02-23 23:57:02.510215+00:00, run_end_date=2024-02-23 23:57:04.308050+00:00, run_duration=1.797835, state=success, executor_state=success, try_number=1, max_tries=1, job_id=102, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:57:00.556218+00:00, queued_by_job_id=2, pid=1600 2024-02-23T23:58:00.869354568Z [2024-02-23T23:58:00.868+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:58:00+00:00, run_after=2024-02-23T23:59:00+00:00 2024-02-23T23:58:00.881489737Z [2024-02-23T23:58:00.880+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:58:00.892061411Z [2024-02-23T23:58:00.891+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:58:00.910123168Z [2024-02-23T23:58:00.909+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:58:00+00:00, run_after=2024-02-23T23:59:00+00:00 2024-02-23T23:58:01.032011236Z [2024-02-23T23:58:01.031+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-23T23:58:01.032034825Z 2024-02-23T23:58:01.032038880Z 2024-02-23T23:58:01.032056479Z 2024-02-23T23:58:01.032060306Z 2024-02-23T23:58:01.032094579Z [2024-02-23T23:58:01.031+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-23T23:58:01.032416980Z [2024-02-23T23:58:01.031+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:58:01.032629309Z [2024-02-23T23:58:01.032+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:58:01.032814644Z [2024-02-23T23:58:01.032+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-23T23:58:01.033497247Z [2024-02-23T23:58:01.033+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:58:01.033512734Z 2024-02-23T23:58:01.033518774Z 2024-02-23T23:58:01.033524006Z 2024-02-23T23:58:01.033529431Z 2024-02-23T23:58:01.038588114Z [2024-02-23T23:58:01.038+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-23T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:58:01.038603203Z [2024-02-23T23:58:01.038+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-23T23:58:01.039022861Z [2024-02-23T23:58:01.038+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:58:01.039682653Z [2024-02-23T23:58:01.038+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T23:58:01.040096685Z [2024-02-23T23:58:01.039+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:58:01.040225477Z [2024-02-23T23:58:01.039+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T23:58:01.040594890Z [2024-02-23T23:58:01.040+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:58:01.040845092Z [2024-02-23T23:58:01.040+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T23:58:01.544148945Z [2024-02-23T23:58:01.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-23T23:56:00+00:00 exited with status queued for try_number 1 2024-02-23T23:58:01.544177334Z [2024-02-23T23:58:01.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:57:00+00:00 exited with status queued for try_number 1 2024-02-23T23:58:01.544286998Z [2024-02-23T23:58:01.544+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:57:00+00:00 exited with status queued for try_number 1 2024-02-23T23:58:01.544442336Z [2024-02-23T23:58:01.544+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:57:00+00:00 exited with status queued for try_number 1 2024-02-23T23:58:01.561364111Z [2024-02-23T23:58:01.561+0000] {scheduler_job.py:635} INFO - Setting external_id for to 46155456-ff5d-402a-acf8-06ab16b3e9a9 2024-02-23T23:58:01.561620094Z [2024-02-23T23:58:01.561+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1921db5a-17bc-47fe-b641-e2994004a707 2024-02-23T23:58:01.561880721Z [2024-02-23T23:58:01.561+0000] {scheduler_job.py:635} INFO - Setting external_id for to 43d97297-13a5-469a-8383-62190f674018 2024-02-23T23:58:01.562135740Z [2024-02-23T23:58:01.561+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5798b540-23de-4023-a659-9313622c3fac 2024-02-23T23:58:03.076764386Z [2024-02-23T23:58:03.076+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:58:03.077271784Z [2024-02-23T23:58:03.077+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-23 23:56:00+00:00, run_id=scheduled__2024-02-23T23:56:00+00:00, run_start_date=2024-02-23 23:58:00.924176+00:00, run_end_date=2024-02-23 23:58:03.076667+00:00, run_duration=2.152491, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:56:00+00:00, data_interval_end=2024-02-23 23:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-23T23:58:03.085255804Z [2024-02-23T23:58:03.084+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-23T23:58:00+00:00, run_after=2024-02-24T00:00:00+00:00 2024-02-23T23:58:03.094468737Z [2024-02-23T23:58:03.094+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:58:03.094981076Z [2024-02-23T23:58:03.094+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-23 23:57:00+00:00, run_id=scheduled__2024-02-23T23:57:00+00:00, run_start_date=2024-02-23 23:58:00.928530+00:00, run_end_date=2024-02-23 23:58:03.094370+00:00, run_duration=2.16584, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:57:00+00:00, data_interval_end=2024-02-23 23:58:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-23T23:58:03.105788077Z [2024-02-23T23:58:03.105+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:58:00+00:00, run_after=2024-02-23T23:59:00+00:00 2024-02-23T23:58:03.170533186Z [2024-02-23T23:58:03.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-23T23:56:00+00:00 exited with status success for try_number 1 2024-02-23T23:58:03.170582469Z [2024-02-23T23:58:03.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:57:00+00:00 exited with status success for try_number 1 2024-02-23T23:58:03.180378792Z [2024-02-23T23:58:03.179+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-23T23:56:00+00:00, map_index=-1, run_start_date=2024-02-23 23:58:01.986934+00:00, run_end_date=2024-02-23 23:58:02.478458+00:00, run_duration=0.491524, state=success, executor_state=success, try_number=1, max_tries=1, job_id=104, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:58:01.035091+00:00, queued_by_job_id=2, pid=1634 2024-02-23T23:58:03.180577988Z [2024-02-23T23:58:03.180+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:57:00+00:00, map_index=-1, run_start_date=2024-02-23 23:58:01.915230+00:00, run_end_date=2024-02-23 23:58:02.431873+00:00, run_duration=0.516643, state=success, executor_state=success, try_number=1, max_tries=1, job_id=103, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:58:01.035091+00:00, queued_by_job_id=2, pid=1633 2024-02-23T23:58:05.354766418Z [2024-02-23T23:58:05.354+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:58:05.355130214Z [2024-02-23T23:58:05.354+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:57:00+00:00, run_id=scheduled__2024-02-23T23:57:00+00:00, run_start_date=2024-02-23 23:58:00.926027+00:00, run_end_date=2024-02-23 23:58:05.354612+00:00, run_duration=4.428585, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:57:00+00:00, data_interval_end=2024-02-23 23:58:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-23T23:58:05.369218501Z [2024-02-23T23:58:05.368+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:58:00+00:00, run_after=2024-02-23T23:59:00+00:00 2024-02-23T23:58:05.378989424Z [2024-02-23T23:58:05.378+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:58:05.379440807Z [2024-02-23T23:58:05.378+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:57:00+00:00, run_id=scheduled__2024-02-23T23:57:00+00:00, run_start_date=2024-02-23 23:58:00.927259+00:00, run_end_date=2024-02-23 23:58:05.378806+00:00, run_duration=4.451547, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:57:00+00:00, data_interval_end=2024-02-23 23:58:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-23T23:58:05.392127065Z [2024-02-23T23:58:05.391+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:58:00+00:00, run_after=2024-02-23T23:59:00+00:00 2024-02-23T23:58:05.426992444Z [2024-02-23T23:58:05.426+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:57:00+00:00 exited with status success for try_number 1 2024-02-23T23:58:05.427049344Z [2024-02-23T23:58:05.426+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:57:00+00:00 exited with status success for try_number 1 2024-02-23T23:58:05.433795594Z [2024-02-23T23:58:05.433+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:57:00+00:00, map_index=-1, run_start_date=2024-02-23 23:58:03.177697+00:00, run_end_date=2024-02-23 23:58:04.502539+00:00, run_duration=1.324842, state=success, executor_state=success, try_number=1, max_tries=1, job_id=105, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:58:01.035091+00:00, queued_by_job_id=2, pid=1657 2024-02-23T23:58:05.434122388Z [2024-02-23T23:58:05.433+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:57:00+00:00, map_index=-1, run_start_date=2024-02-23 23:58:03.298288+00:00, run_end_date=2024-02-23 23:58:05.021310+00:00, run_duration=1.723022, state=success, executor_state=success, try_number=1, max_tries=1, job_id=106, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:58:01.035091+00:00, queued_by_job_id=2, pid=1658 2024-02-23T23:58:54.805163478Z [2024-02-23T23:58:54.804+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 to 2024-02-23T23:55:00+00:00, run_after=2024-02-24T00:00:00+00:00 2024-02-23T23:58:54.861677844Z [2024-02-23T23:58:54.861+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-23T23:58:54.861702948Z 2024-02-23T23:58:54.861924943Z [2024-02-23T23:58:54.861+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 has 0/16 running and queued tasks 2024-02-23T23:58:54.862563664Z [2024-02-23T23:58:54.862+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:58:54.862577991Z 2024-02-23T23:58:54.864666608Z [2024-02-23T23:58:54.864+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-23T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-23T23:58:54.864866705Z [2024-02-23T23:58:54.864+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T23:58:54.943746577Z [2024-02-23T23:58:54.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.extract_metrics_from_vnfrs run_id=scheduled__2024-02-23T23:50:00+00:00 exited with status queued for try_number 1 2024-02-23T23:58:54.959025360Z [2024-02-23T23:58:54.958+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f8a4889-385a-491e-a436-424343648d5a 2024-02-23T23:58:57.223457952Z [2024-02-23T23:58:57.223+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-23T23:58:57.223496267Z 2024-02-23T23:58:57.223517034Z [2024-02-23T23:58:57.223+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 has 0/16 running and queued tasks 2024-02-23T23:58:57.224100199Z [2024-02-23T23:58:57.223+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:58:57.224113582Z 2024-02-23T23:58:57.227423159Z [2024-02-23T23:58:57.226+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', task_id='split_metrics', run_id='scheduled__2024-02-23T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-23T23:58:57.227673704Z [2024-02-23T23:58:57.227+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'split_metrics', 'scheduled__2024-02-23T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T23:58:57.288973911Z [2024-02-23T23:58:57.288+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.split_metrics run_id=scheduled__2024-02-23T23:50:00+00:00 exited with status queued for try_number 1 2024-02-23T23:58:57.289020181Z [2024-02-23T23:58:57.288+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.extract_metrics_from_vnfrs run_id=scheduled__2024-02-23T23:50:00+00:00 exited with status success for try_number 1 2024-02-23T23:58:57.295518805Z [2024-02-23T23:58:57.295+0000] {scheduler_job.py:635} INFO - Setting external_id for to 13735d9e-f98d-497c-80a4-a3e9c481e64a 2024-02-23T23:58:57.295849471Z [2024-02-23T23:58:57.295+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-23T23:50:00+00:00, map_index=-1, run_start_date=2024-02-23 23:58:56.496827+00:00, run_end_date=2024-02-23 23:58:56.868437+00:00, run_duration=0.37161, state=success, executor_state=success, try_number=1, max_tries=1, job_id=107, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:58:54.862862+00:00, queued_by_job_id=2, pid=1689 2024-02-23T23:58:59.855214331Z [2024-02-23T23:58:59.854+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-23T23:58:59.855277299Z 2024-02-23T23:58:59.855293915Z [2024-02-23T23:58:59.854+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 has 0/16 running and queued tasks 2024-02-23T23:58:59.855582290Z [2024-02-23T23:58:59.855+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:58:59.855639839Z 2024-02-23T23:58:59.857412182Z [2024-02-23T23:58:59.857+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', task_id='collect_metrics', run_id='scheduled__2024-02-23T23:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-23T23:58:59.857452364Z [2024-02-23T23:58:59.857+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'collect_metrics', 'scheduled__2024-02-23T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-23T23:58:59.936623444Z [2024-02-23T23:58:59.936+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.collect_metrics run_id=scheduled__2024-02-23T23:50:00+00:00 exited with status queued for try_number 1 2024-02-23T23:58:59.936702508Z [2024-02-23T23:58:59.936+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.split_metrics run_id=scheduled__2024-02-23T23:50:00+00:00 exited with status success for try_number 1 2024-02-23T23:58:59.945078019Z [2024-02-23T23:58:59.944+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8bea96db-a145-4bbc-95cf-f78329134b4b 2024-02-23T23:58:59.945309722Z [2024-02-23T23:58:59.945+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=split_metrics, run_id=scheduled__2024-02-23T23:50:00+00:00, map_index=-1, run_start_date=2024-02-23 23:58:58.776475+00:00, run_end_date=2024-02-23 23:58:59.135233+00:00, run_duration=0.358758, state=success, executor_state=success, try_number=1, max_tries=1, job_id=108, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:58:57.224548+00:00, queued_by_job_id=2, pid=1702 2024-02-23T23:59:01.091610397Z [2024-02-23T23:59:01.091+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99 to 2024-02-23T23:58:00+00:00, run_after=2024-02-23T23:59:00+00:00 2024-02-23T23:59:01.105564711Z [2024-02-23T23:59:01.105+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:59:00+00:00, run_after=2024-02-24T00:00:00+00:00 2024-02-23T23:59:01.116136133Z [2024-02-23T23:59:01.115+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:59:01.132297966Z [2024-02-23T23:59:01.131+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:59:00+00:00, run_after=2024-02-24T00:00:00+00:00 2024-02-23T23:59:01.252233350Z [2024-02-23T23:59:01.251+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-23T23:59:01.252278401Z 2024-02-23T23:59:01.252282396Z 2024-02-23T23:59:01.252285260Z 2024-02-23T23:59:01.252288048Z 2024-02-23T23:59:01.262185175Z [2024-02-23T23:59:01.252+0000] {scheduler_job.py:425} INFO - DAG vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99 has 0/16 running and queued tasks 2024-02-23T23:59:01.262459761Z [2024-02-23T23:59:01.262+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-23T23:59:01.262639862Z [2024-02-23T23:59:01.262+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:59:01.262819088Z [2024-02-23T23:59:01.262+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-23T23:59:01.263607549Z [2024-02-23T23:59:01.263+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:59:01.263618723Z 2024-02-23T23:59:01.263622455Z 2024-02-23T23:59:01.263625842Z 2024-02-23T23:59:01.263629080Z 2024-02-23T23:59:01.269261173Z [2024-02-23T23:59:01.268+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:59:01.269364455Z [2024-02-23T23:59:01.269+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T23:59:01.270006068Z [2024-02-23T23:59:01.269+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:59:01.270018791Z [2024-02-23T23:59:01.269+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-23T23:59:01.270108332Z [2024-02-23T23:59:01.269+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:59:01.270321947Z [2024-02-23T23:59:01.270+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T23:59:01.270584747Z [2024-02-23T23:59:01.270+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:59:01.271042575Z [2024-02-23T23:59:01.270+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T23:59:01.795079649Z [2024-02-23T23:59:01.794+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:57:00+00:00 exited with status queued for try_number 1 2024-02-23T23:59:01.795634079Z [2024-02-23T23:59:01.795+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:58:00+00:00 exited with status queued for try_number 1 2024-02-23T23:59:01.799660520Z [2024-02-23T23:59:01.799+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:58:00+00:00 exited with status queued for try_number 1 2024-02-23T23:59:01.799961178Z [2024-02-23T23:59:01.799+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:58:00+00:00 exited with status queued for try_number 1 2024-02-23T23:59:01.819316830Z [2024-02-23T23:59:01.818+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48e8f29f-dc89-4791-bbbf-dde683d9f8c9 2024-02-23T23:59:01.819665984Z [2024-02-23T23:59:01.819+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a69d4ab-bff1-48f9-a2fe-87fb8609e2f9 2024-02-23T23:59:01.819925708Z [2024-02-23T23:59:01.819+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17c3a1d7-82d1-4da1-b56d-fba8ba4d9191 2024-02-23T23:59:01.820169314Z [2024-02-23T23:59:01.820+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb60b137-c6be-4dfe-b7ef-ec6c70cd30c8 2024-02-23T23:59:01.896390455Z [2024-02-23T23:59:01.896+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99 to 2024-02-23T23:59:00+00:00, run_after=2024-02-24T00:00:00+00:00 2024-02-23T23:59:02.114926334Z [2024-02-23T23:59:02.114+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-23T23:59:02.114950566Z 2024-02-23T23:59:02.114971930Z [2024-02-23T23:59:02.114+0000] {scheduler_job.py:425} INFO - DAG vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99 has 1/16 running and queued tasks 2024-02-23T23:59:02.118665679Z [2024-02-23T23:59:02.118+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:59:02.118730247Z 2024-02-23T23:59:02.121284727Z [2024-02-23T23:59:02.120+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:59:02.121307797Z [2024-02-23T23:59:02.121+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-23T23:59:02.258741769Z [2024-02-23T23:59:02.258+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:58:00+00:00 exited with status queued for try_number 1 2024-02-23T23:59:02.275149326Z [2024-02-23T23:59:02.274+0000] {scheduler_job.py:635} INFO - Setting external_id for to ceac3e08-8a86-47bf-99ad-99bbb379fc9a 2024-02-23T23:59:02.988484581Z [2024-02-23T23:59:02.986+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-23T23:59:02.988514043Z 2024-02-23T23:59:02.988518216Z [2024-02-23T23:59:02.986+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 has 0/16 running and queued tasks 2024-02-23T23:59:02.988521845Z [2024-02-23T23:59:02.987+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:59:02.988529865Z 2024-02-23T23:59:02.992063408Z [2024-02-23T23:59:02.991+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', task_id='send_prometheus', run_id='scheduled__2024-02-23T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:59:02.992092818Z [2024-02-23T23:59:02.991+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'send_prometheus', 'scheduled__2024-02-23T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-23T23:59:03.071736706Z [2024-02-23T23:59:03.071+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.send_prometheus run_id=scheduled__2024-02-23T23:50:00+00:00 exited with status queued for try_number 1 2024-02-23T23:59:03.072098036Z [2024-02-23T23:59:03.071+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.collect_metrics run_id=scheduled__2024-02-23T23:50:00+00:00 exited with status success for try_number 1 2024-02-23T23:59:03.093903677Z [2024-02-23T23:59:03.093+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f60cb44-3524-4e7f-8ea5-6a0d3fce88be 2024-02-23T23:59:03.094287842Z [2024-02-23T23:59:03.094+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=collect_metrics, run_id=scheduled__2024-02-23T23:50:00+00:00, map_index=0, run_start_date=2024-02-23 23:59:01.782347+00:00, run_end_date=2024-02-23 23:59:02.395491+00:00, run_duration=0.613144, state=success, executor_state=success, try_number=1, max_tries=1, job_id=109, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:58:59.855665+00:00, queued_by_job_id=2, pid=1714 2024-02-23T23:59:03.177367954Z [2024-02-23T23:59:03.176+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-23T23:59:03.363162821Z [2024-02-23T23:59:03.362+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-23T23:59:03.363189653Z 2024-02-23T23:59:03.363491753Z [2024-02-23T23:59:03.363+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 has 0/16 running and queued tasks 2024-02-23T23:59:03.364225170Z [2024-02-23T23:59:03.364+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-23T23:59:03.364237246Z 2024-02-23T23:59:03.367980481Z [2024-02-23T23:59:03.367+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-23T23:59:03.370779410Z [2024-02-23T23:59:03.370+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-23T23:59:03.569246080Z [2024-02-23T23:59:03.568+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:58:00+00:00 exited with status queued for try_number 1 2024-02-23T23:59:03.580167885Z [2024-02-23T23:59:03.579+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c3a315d-ef84-49c8-89fa-4e39fd9aee16 2024-02-23T23:59:03.703494227Z [2024-02-23T23:59:03.703+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:59:03.703675651Z [2024-02-23T23:59:03.703+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-23 23:58:00+00:00, run_id=scheduled__2024-02-23T23:58:00+00:00, run_start_date=2024-02-23 23:59:01.145340+00:00, run_end_date=2024-02-23 23:59:03.703432+00:00, run_duration=2.558092, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:58:00+00:00, data_interval_end=2024-02-23 23:59:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-23T23:59:03.721025497Z [2024-02-23T23:59:03.720+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-23T23:59:00+00:00, run_after=2024-02-24T00:00:00+00:00 2024-02-23T23:59:03.857546494Z [2024-02-23T23:59:03.855+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:58:00+00:00 exited with status success for try_number 1 2024-02-23T23:59:03.869923383Z [2024-02-23T23:59:03.865+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:58:00+00:00, map_index=-1, run_start_date=2024-02-23 23:59:02.844635+00:00, run_end_date=2024-02-23 23:59:03.527947+00:00, run_duration=0.683312, state=success, executor_state=success, try_number=1, max_tries=1, job_id=110, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:59:01.264528+00:00, queued_by_job_id=2, pid=1722 2024-02-23T23:59:07.301338977Z [2024-02-23T23:59:07.300+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:59:07.301393633Z [2024-02-23T23:59:07.301+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99, execution_date=2024-02-23 23:50:00+00:00, run_id=scheduled__2024-02-23T23:50:00+00:00, run_start_date=2024-02-23 23:58:54.825737+00:00, run_end_date=2024-02-23 23:59:07.300917+00:00, run_duration=12.47518, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:50:00+00:00, data_interval_end=2024-02-23 23:55:00+00:00, dag_hash=ee72125b786422203fda616907506950 2024-02-23T23:59:07.309374533Z [2024-02-23T23:59:07.308+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 to 2024-02-23T23:55:00+00:00, run_after=2024-02-24T00:00:00+00:00 2024-02-23T23:59:07.376621696Z [2024-02-23T23:59:07.376+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.send_prometheus run_id=scheduled__2024-02-23T23:50:00+00:00 exited with status success for try_number 1 2024-02-23T23:59:07.391662244Z [2024-02-23T23:59:07.390+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=send_prometheus, run_id=scheduled__2024-02-23T23:50:00+00:00, map_index=-1, run_start_date=2024-02-23 23:59:06.095808+00:00, run_end_date=2024-02-23 23:59:06.437426+00:00, run_duration=0.341618, state=success, executor_state=success, try_number=1, max_tries=1, job_id=116, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:59:02.987608+00:00, queued_by_job_id=2, pid=1790 2024-02-23T23:59:08.188844484Z [2024-02-23T23:59:08.188+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:59:08.189125775Z [2024-02-23T23:59:08.188+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99, execution_date=2024-02-23 23:57:00+00:00, run_id=scheduled__2024-02-23T23:57:00+00:00, run_start_date=2024-02-23 23:59:01.142250+00:00, run_end_date=2024-02-23 23:59:08.188575+00:00, run_duration=7.046325, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:57:00+00:00, data_interval_end=2024-02-23 23:58:00+00:00, dag_hash=a6c60e86361ec5e1ca8caa2393de1e74 2024-02-23T23:59:08.205102518Z [2024-02-23T23:59:08.204+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99 to 2024-02-23T23:58:00+00:00, run_after=2024-02-23T23:59:00+00:00 2024-02-23T23:59:08.291467073Z [2024-02-23T23:59:08.291+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:57:00+00:00 exited with status success for try_number 1 2024-02-23T23:59:08.303276856Z [2024-02-23T23:59:08.302+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:57:00+00:00, map_index=-1, run_start_date=2024-02-23 23:59:04.504922+00:00, run_end_date=2024-02-23 23:59:07.957633+00:00, run_duration=3.452711, state=success, executor_state=success, try_number=1, max_tries=1, job_id=111, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:59:01.264528+00:00, queued_by_job_id=2, pid=1743 2024-02-23T23:59:09.364825569Z [2024-02-23T23:59:09.364+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99 to 2024-02-23T23:59:00+00:00, run_after=2024-02-24T00:00:00+00:00 2024-02-23T23:59:09.391690653Z [2024-02-23T23:59:09.391+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:59:09.392100759Z [2024-02-23T23:59:09.391+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:58:00+00:00, run_id=scheduled__2024-02-23T23:58:00+00:00, run_start_date=2024-02-23 23:59:01.143471+00:00, run_end_date=2024-02-23 23:59:09.391530+00:00, run_duration=8.248059, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:58:00+00:00, data_interval_end=2024-02-23 23:59:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-23T23:59:09.401064509Z [2024-02-23T23:59:09.400+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:59:00+00:00, run_after=2024-02-24T00:00:00+00:00 2024-02-23T23:59:09.407202359Z [2024-02-23T23:59:09.406+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:59:09.407294178Z [2024-02-23T23:59:09.406+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:58:00+00:00, run_id=scheduled__2024-02-23T23:58:00+00:00, run_start_date=2024-02-23 23:59:01.144460+00:00, run_end_date=2024-02-23 23:59:09.406797+00:00, run_duration=8.262337, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:58:00+00:00, data_interval_end=2024-02-23 23:59:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-23T23:59:09.414899653Z [2024-02-23T23:59:09.414+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-23T23:59:00+00:00, run_after=2024-02-24T00:00:00+00:00 2024-02-23T23:59:09.419875392Z [2024-02-23T23:59:09.419+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:59:09.420153122Z [2024-02-23T23:59:09.419+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99, execution_date=2024-02-23 23:58:00+00:00, run_id=scheduled__2024-02-23T23:58:00+00:00, run_start_date=2024-02-23 23:59:03.204113+00:00, run_end_date=2024-02-23 23:59:09.419750+00:00, run_duration=6.215637, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:58:00+00:00, data_interval_end=2024-02-23 23:59:00+00:00, dag_hash=eae4783770389de0b2ebbc0ed9593a4f 2024-02-23T23:59:09.429271501Z [2024-02-23T23:59:09.428+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 to 2024-02-23T23:59:00+00:00, run_after=2024-02-24T00:00:00+00:00 2024-02-23T23:59:09.435924830Z [2024-02-23T23:59:09.435+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-23T23:59:09.435959819Z [2024-02-23T23:59:09.435+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99, execution_date=2024-02-23 23:58:00+00:00, run_id=scheduled__2024-02-23T23:58:00+00:00, run_start_date=2024-02-23 23:59:01.929619+00:00, run_end_date=2024-02-23 23:59:09.435682+00:00, run_duration=7.506063, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:58:00+00:00, data_interval_end=2024-02-23 23:59:00+00:00, dag_hash=a6c60e86361ec5e1ca8caa2393de1e74 2024-02-23T23:59:09.445313525Z [2024-02-23T23:59:09.444+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99 to 2024-02-23T23:59:00+00:00, run_after=2024-02-24T00:00:00+00:00 2024-02-23T23:59:09.487020494Z [2024-02-23T23:59:09.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:58:00+00:00 exited with status success for try_number 1 2024-02-23T23:59:09.487055489Z [2024-02-23T23:59:09.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:58:00+00:00 exited with status success for try_number 1 2024-02-23T23:59:09.487155134Z [2024-02-23T23:59:09.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:58:00+00:00 exited with status success for try_number 1 2024-02-23T23:59:09.487387344Z [2024-02-23T23:59:09.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:58:00+00:00 exited with status success for try_number 1 2024-02-23T23:59:09.496993259Z [2024-02-23T23:59:09.496+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:58:00+00:00, map_index=-1, run_start_date=2024-02-23 23:59:04.536902+00:00, run_end_date=2024-02-23 23:59:08.304301+00:00, run_duration=3.767399, state=success, executor_state=success, try_number=1, max_tries=1, job_id=112, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:59:01.264528+00:00, queued_by_job_id=2, pid=1742 2024-02-23T23:59:09.497143240Z [2024-02-23T23:59:09.496+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:58:00+00:00, map_index=-1, run_start_date=2024-02-23 23:59:05.149484+00:00, run_end_date=2024-02-23 23:59:08.763541+00:00, run_duration=3.614057, state=success, executor_state=success, try_number=1, max_tries=1, job_id=113, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:59:01.264528+00:00, queued_by_job_id=2, pid=1762 2024-02-23T23:59:09.497337647Z [2024-02-23T23:59:09.497+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:58:00+00:00, map_index=-1, run_start_date=2024-02-23 23:59:05.909356+00:00, run_end_date=2024-02-23 23:59:08.927689+00:00, run_duration=3.018333, state=success, executor_state=success, try_number=1, max_tries=1, job_id=115, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:59:03.364713+00:00, queued_by_job_id=2, pid=1783 2024-02-23T23:59:09.497585588Z [2024-02-23T23:59:09.497+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:58:00+00:00, map_index=-1, run_start_date=2024-02-23 23:59:05.633488+00:00, run_end_date=2024-02-23 23:59:08.298937+00:00, run_duration=2.665449, state=success, executor_state=success, try_number=1, max_tries=1, job_id=114, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-23 23:59:02.118992+00:00, queued_by_job_id=2, pid=1773 2024-02-24T00:00:00.214373755Z [2024-02-24T00:00:00.213+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:00:00+00:00, run_after=2024-02-24T00:01:00+00:00 2024-02-24T00:00:00.237193679Z [2024-02-24T00:00:00.236+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:00:00+00:00, run_after=2024-02-24T00:01:00+00:00 2024-02-24T00:00:00.263905121Z [2024-02-24T00:00:00.263+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 to 2024-02-24T00:00:00+00:00, run_after=2024-02-24T00:05:00+00:00 2024-02-24T00:00:00.283608493Z [2024-02-24T00:00:00.283+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:00:00+00:00, run_after=2024-02-24T00:05:00+00:00 2024-02-24T00:00:00.291635050Z [2024-02-24T00:00:00.291+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:00:00.299576557Z [2024-02-24T00:00:00.299+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:00:00.311481570Z [2024-02-24T00:00:00.311+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99 to 2024-02-24T00:00:00+00:00, run_after=2024-02-24T00:01:00+00:00 2024-02-24T00:00:00.319627430Z [2024-02-24T00:00:00.319+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:00:00.441572587Z [2024-02-24T00:00:00.440+0000] {scheduler_job.py:360} INFO - 8 tasks up for execution: 2024-02-24T00:00:00.441616760Z 2024-02-24T00:00:00.441626353Z 2024-02-24T00:00:00.441636655Z 2024-02-24T00:00:00.441674547Z 2024-02-24T00:00:00.441683435Z 2024-02-24T00:00:00.441691905Z 2024-02-24T00:00:00.441700194Z 2024-02-24T00:00:00.441709136Z 2024-02-24T00:00:00.442012150Z [2024-02-24T00:00:00.441+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 has 0/16 running and queued tasks 2024-02-24T00:00:00.442475996Z [2024-02-24T00:00:00.442+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:00:00.442862112Z [2024-02-24T00:00:00.442+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T00:00:00.443228923Z [2024-02-24T00:00:00.442+0000] {scheduler_job.py:425} INFO - DAG vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99 has 0/16 running and queued tasks 2024-02-24T00:00:00.444060032Z [2024-02-24T00:00:00.443+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:00:00.444442284Z [2024-02-24T00:00:00.444+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 has 0/16 running and queued tasks 2024-02-24T00:00:00.444770333Z [2024-02-24T00:00:00.444+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:00:00.445985259Z [2024-02-24T00:00:00.445+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:00:00.447190572Z [2024-02-24T00:00:00.446+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:00:00.447210272Z 2024-02-24T00:00:00.447217119Z 2024-02-24T00:00:00.447227859Z 2024-02-24T00:00:00.447235274Z 2024-02-24T00:00:00.447241301Z 2024-02-24T00:00:00.447247370Z 2024-02-24T00:00:00.447253732Z 2024-02-24T00:00:00.447259801Z 2024-02-24T00:00:00.455381014Z [2024-02-24T00:00:00.455+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-23T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T00:00:00.455754447Z [2024-02-24T00:00:00.455+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:00:00.456191689Z [2024-02-24T00:00:00.455+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-23T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T00:00:00.456479381Z [2024-02-24T00:00:00.456+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:00:00.456917439Z [2024-02-24T00:00:00.456+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-23T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:00:00.457179907Z [2024-02-24T00:00:00.456+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T00:00:00.457587652Z [2024-02-24T00:00:00.457+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:00:00.458233179Z [2024-02-24T00:00:00.457+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:00:00.458550677Z [2024-02-24T00:00:00.458+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:00:00.458809957Z [2024-02-24T00:00:00.458+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:00:00.458999689Z [2024-02-24T00:00:00.458+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:00:00.459161942Z [2024-02-24T00:00:00.458+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:00:00.459423094Z [2024-02-24T00:00:00.459+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:00:00.459548442Z [2024-02-24T00:00:00.459+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:00:00.459751555Z [2024-02-24T00:00:00.459+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-23T23:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:00:00.459950113Z [2024-02-24T00:00:00.459+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:00:01.606487376Z [2024-02-24T00:00:01.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.extract_metrics_from_vnfrs run_id=scheduled__2024-02-23T23:55:00+00:00 exited with status queued for try_number 1 2024-02-24T00:00:01.606563519Z [2024-02-24T00:00:01.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-23T23:55:00+00:00 exited with status queued for try_number 1 2024-02-24T00:00:01.606594241Z [2024-02-24T00:00:01.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-23T23:58:00+00:00 exited with status queued for try_number 1 2024-02-24T00:00:01.606662449Z [2024-02-24T00:00:01.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:59:00+00:00 exited with status queued for try_number 1 2024-02-24T00:00:01.606736378Z [2024-02-24T00:00:01.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:59:00+00:00 exited with status queued for try_number 1 2024-02-24T00:00:01.606764600Z [2024-02-24T00:00:01.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:59:00+00:00 exited with status queued for try_number 1 2024-02-24T00:00:01.606849145Z [2024-02-24T00:00:01.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:59:00+00:00 exited with status queued for try_number 1 2024-02-24T00:00:01.606900597Z [2024-02-24T00:00:01.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:59:00+00:00 exited with status queued for try_number 1 2024-02-24T00:00:01.630841336Z [2024-02-24T00:00:01.630+0000] {scheduler_job.py:635} INFO - Setting external_id for to abcb65cf-66d0-4989-9042-1ae5c2e709f5 2024-02-24T00:00:01.630925966Z [2024-02-24T00:00:01.630+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e0e578f-87c7-4750-9a4b-14ebb587440b 2024-02-24T00:00:01.631041130Z [2024-02-24T00:00:01.630+0000] {scheduler_job.py:635} INFO - Setting external_id for to b7733de7-8e79-4bd6-a1cb-5dfff102b41f 2024-02-24T00:00:01.631428258Z [2024-02-24T00:00:01.631+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6053fae-4724-4000-b939-ed2b9117c831 2024-02-24T00:00:01.631438055Z [2024-02-24T00:00:01.631+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1fb18f6-a8c7-47d9-b440-6c4bcbb29174 2024-02-24T00:00:01.631441904Z [2024-02-24T00:00:01.631+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40541cf3-5e38-43a6-91cc-35e170ae9e2c 2024-02-24T00:00:01.631496643Z [2024-02-24T00:00:01.631+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9883bbf7-9688-4c35-a664-76c870cf3dcc 2024-02-24T00:00:01.631583507Z [2024-02-24T00:00:01.631+0000] {scheduler_job.py:635} INFO - Setting external_id for to 72243423-49a8-4f60-8ddb-a79d045b0bcd 2024-02-24T00:00:03.575473503Z [2024-02-24T00:00:03.575+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:00:03.575900448Z [2024-02-24T00:00:03.575+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-23 23:59:00+00:00, run_id=scheduled__2024-02-23T23:59:00+00:00, run_start_date=2024-02-24 00:00:00.337906+00:00, run_end_date=2024-02-24 00:00:03.575458+00:00, run_duration=3.237552, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:59:00+00:00, data_interval_end=2024-02-24 00:00:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:00:03.592246648Z [2024-02-24T00:00:03.591+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:00:00+00:00, run_after=2024-02-24T00:01:00+00:00 2024-02-24T00:00:03.883397384Z [2024-02-24T00:00:03.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:59:00+00:00 exited with status success for try_number 1 2024-02-24T00:00:03.900879237Z [2024-02-24T00:00:03.900+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:59:00+00:00, map_index=-1, run_start_date=2024-02-24 00:00:02.602151+00:00, run_end_date=2024-02-24 00:00:03.168060+00:00, run_duration=0.565909, state=success, executor_state=success, try_number=1, max_tries=1, job_id=117, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:00:00.449836+00:00, queued_by_job_id=2, pid=1822 2024-02-24T00:00:05.539772892Z [2024-02-24T00:00:05.539+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:00:05.540862323Z [2024-02-24T00:00:05.540+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-23 23:58:00+00:00, run_id=scheduled__2024-02-23T23:58:00+00:00, run_start_date=2024-02-24 00:00:00.335731+00:00, run_end_date=2024-02-24 00:00:05.540459+00:00, run_duration=5.204728, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:58:00+00:00, data_interval_end=2024-02-24 00:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T00:00:05.551632395Z [2024-02-24T00:00:05.551+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T00:00:00+00:00, run_after=2024-02-24T00:02:00+00:00 2024-02-24T00:00:05.675414884Z [2024-02-24T00:00:05.675+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T00:00:05.675446752Z 2024-02-24T00:00:05.675907027Z [2024-02-24T00:00:05.675+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:00:05.676873971Z [2024-02-24T00:00:05.676+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:00:05.676889521Z 2024-02-24T00:00:05.680204759Z [2024-02-24T00:00:05.679+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-23T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T00:00:05.680549972Z [2024-02-24T00:00:05.680+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-23T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:00:05.767852504Z [2024-02-24T00:00:05.767+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-23T23:55:00+00:00 exited with status queued for try_number 1 2024-02-24T00:00:05.768177172Z [2024-02-24T00:00:05.767+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-23T23:58:00+00:00 exited with status success for try_number 1 2024-02-24T00:00:05.783337754Z [2024-02-24T00:00:05.782+0000] {scheduler_job.py:635} INFO - Setting external_id for to 96a7acff-9746-4dd0-b4a3-6aabf7d21f36 2024-02-24T00:00:05.784276704Z [2024-02-24T00:00:05.783+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-23T23:58:00+00:00, map_index=-1, run_start_date=2024-02-24 00:00:03.479710+00:00, run_end_date=2024-02-24 00:00:04.223704+00:00, run_duration=0.743994, state=success, executor_state=success, try_number=1, max_tries=1, job_id=118, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:00:00.449836+00:00, queued_by_job_id=2, pid=1832 2024-02-24T00:00:05.952995380Z [2024-02-24T00:00:05.952+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-23T23:55:00+00:00 exited with status success for try_number 1 2024-02-24T00:00:05.958725843Z [2024-02-24T00:00:05.958+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-23T23:55:00+00:00, map_index=-1, run_start_date=2024-02-24 00:00:04.719182+00:00, run_end_date=2024-02-24 00:00:05.449749+00:00, run_duration=0.730567, state=success, executor_state=success, try_number=1, max_tries=1, job_id=119, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:00:00.449836+00:00, queued_by_job_id=2, pid=1854 2024-02-24T00:00:07.004221695Z [2024-02-24T00:00:07.003+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:00:07.004681646Z [2024-02-24T00:00:07.004+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99, execution_date=2024-02-23 23:59:00+00:00, run_id=scheduled__2024-02-23T23:59:00+00:00, run_start_date=2024-02-24 00:00:00.336662+00:00, run_end_date=2024-02-24 00:00:07.004344+00:00, run_duration=6.667682, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:59:00+00:00, data_interval_end=2024-02-24 00:00:00+00:00, dag_hash=a6c60e86361ec5e1ca8caa2393de1e74 2024-02-24T00:00:07.015603542Z [2024-02-24T00:00:07.015+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99 to 2024-02-24T00:00:00+00:00, run_after=2024-02-24T00:01:00+00:00 2024-02-24T00:00:07.082423132Z [2024-02-24T00:00:07.082+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T00:00:07.082448001Z 2024-02-24T00:00:07.082794685Z [2024-02-24T00:00:07.082+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 has 0/16 running and queued tasks 2024-02-24T00:00:07.083427878Z [2024-02-24T00:00:07.083+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:00:07.083440311Z 2024-02-24T00:00:07.085817880Z [2024-02-24T00:00:07.085+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', task_id='split_metrics', run_id='scheduled__2024-02-23T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T00:00:07.086121778Z [2024-02-24T00:00:07.085+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'split_metrics', 'scheduled__2024-02-23T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:00:07.131269003Z [2024-02-24T00:00:07.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.split_metrics run_id=scheduled__2024-02-23T23:55:00+00:00 exited with status queued for try_number 1 2024-02-24T00:00:07.131531454Z [2024-02-24T00:00:07.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.extract_metrics_from_vnfrs run_id=scheduled__2024-02-23T23:55:00+00:00 exited with status success for try_number 1 2024-02-24T00:00:07.131705109Z [2024-02-24T00:00:07.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:59:00+00:00 exited with status success for try_number 1 2024-02-24T00:00:07.138244942Z [2024-02-24T00:00:07.137+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:59:00+00:00, map_index=-1, run_start_date=2024-02-24 00:00:04.914257+00:00, run_end_date=2024-02-24 00:00:06.666219+00:00, run_duration=1.751962, state=success, executor_state=success, try_number=1, max_tries=1, job_id=121, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:00:00.449836+00:00, queued_by_job_id=2, pid=1857 2024-02-24T00:00:07.138613376Z [2024-02-24T00:00:07.138+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-23T23:55:00+00:00, map_index=-1, run_start_date=2024-02-24 00:00:05.541906+00:00, run_end_date=2024-02-24 00:00:06.126328+00:00, run_duration=0.584422, state=success, executor_state=success, try_number=1, max_tries=1, job_id=122, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:00:00.449836+00:00, queued_by_job_id=2, pid=1879 2024-02-24T00:00:07.138893849Z [2024-02-24T00:00:07.138+0000] {scheduler_job.py:635} INFO - Setting external_id for to 82436e2a-6fcc-4c02-a0f9-8b06df07ffa2 2024-02-24T00:00:08.002072720Z [2024-02-24T00:00:08.001+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:00:08.002377531Z [2024-02-24T00:00:08.002+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99, execution_date=2024-02-23 23:59:00+00:00, run_id=scheduled__2024-02-23T23:59:00+00:00, run_start_date=2024-02-24 00:00:00.338849+00:00, run_end_date=2024-02-24 00:00:08.002061+00:00, run_duration=7.663212, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:59:00+00:00, data_interval_end=2024-02-24 00:00:00+00:00, dag_hash=eae4783770389de0b2ebbc0ed9593a4f 2024-02-24T00:00:08.013859140Z [2024-02-24T00:00:08.012+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 to 2024-02-24T00:00:00+00:00, run_after=2024-02-24T00:01:00+00:00 2024-02-24T00:00:08.031958694Z [2024-02-24T00:00:08.031+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:00:08.034104331Z [2024-02-24T00:00:08.033+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:59:00+00:00, run_id=scheduled__2024-02-23T23:59:00+00:00, run_start_date=2024-02-24 00:00:00.341115+00:00, run_end_date=2024-02-24 00:00:08.033665+00:00, run_duration=7.69255, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:59:00+00:00, data_interval_end=2024-02-24 00:00:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:00:08.066498521Z [2024-02-24T00:00:08.065+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:00:00+00:00, run_after=2024-02-24T00:01:00+00:00 2024-02-24T00:00:08.075451224Z [2024-02-24T00:00:08.075+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:00:08.075782883Z [2024-02-24T00:00:08.075+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:59:00+00:00, run_id=scheduled__2024-02-23T23:59:00+00:00, run_start_date=2024-02-24 00:00:00.339960+00:00, run_end_date=2024-02-24 00:00:08.075352+00:00, run_duration=7.735392, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:59:00+00:00, data_interval_end=2024-02-24 00:00:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:00:08.087990212Z [2024-02-24T00:00:08.087+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:00:00+00:00, run_after=2024-02-24T00:01:00+00:00 2024-02-24T00:00:08.152157805Z [2024-02-24T00:00:08.151+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:59:00+00:00 exited with status success for try_number 1 2024-02-24T00:00:08.154319649Z [2024-02-24T00:00:08.152+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:59:00+00:00 exited with status success for try_number 1 2024-02-24T00:00:08.154891531Z [2024-02-24T00:00:08.154+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-23T23:59:00+00:00 exited with status success for try_number 1 2024-02-24T00:00:08.162316521Z [2024-02-24T00:00:08.161+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:59:00+00:00, map_index=-1, run_start_date=2024-02-24 00:00:05.719228+00:00, run_end_date=2024-02-24 00:00:07.883293+00:00, run_duration=2.164065, state=success, executor_state=success, try_number=1, max_tries=1, job_id=123, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:00:00.449836+00:00, queued_by_job_id=2, pid=1888 2024-02-24T00:00:08.162499290Z [2024-02-24T00:00:08.162+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:59:00+00:00, map_index=-1, run_start_date=2024-02-24 00:00:06.202244+00:00, run_end_date=2024-02-24 00:00:07.605039+00:00, run_duration=1.402795, state=success, executor_state=success, try_number=1, max_tries=1, job_id=124, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:00:00.449836+00:00, queued_by_job_id=2, pid=1896 2024-02-24T00:00:08.162727888Z [2024-02-24T00:00:08.162+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-23T23:59:00+00:00, map_index=-1, run_start_date=2024-02-24 00:00:04.813451+00:00, run_end_date=2024-02-24 00:00:07.241575+00:00, run_duration=2.428124, state=success, executor_state=success, try_number=1, max_tries=1, job_id=120, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:00:00.449836+00:00, queued_by_job_id=2, pid=1856 2024-02-24T00:00:09.230847214Z [2024-02-24T00:00:09.230+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T00:00:09.230876483Z 2024-02-24T00:00:09.231289594Z [2024-02-24T00:00:09.231+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:00:09.231895940Z [2024-02-24T00:00:09.231+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:00:09.231903495Z 2024-02-24T00:00:09.234328141Z [2024-02-24T00:00:09.234+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-23T23:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T00:00:09.234521843Z [2024-02-24T00:00:09.234+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-23T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T00:00:09.293472524Z [2024-02-24T00:00:09.293+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-23T23:55:00+00:00 exited with status queued for try_number 1 2024-02-24T00:00:09.293587975Z [2024-02-24T00:00:09.293+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-23T23:55:00+00:00 exited with status success for try_number 1 2024-02-24T00:00:09.307864009Z [2024-02-24T00:00:09.306+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0de98c9a-a25c-4764-a496-12649aea6704 2024-02-24T00:00:09.307909929Z [2024-02-24T00:00:09.306+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-23T23:55:00+00:00, map_index=-1, run_start_date=2024-02-24 00:00:07.823356+00:00, run_end_date=2024-02-24 00:00:08.195312+00:00, run_duration=0.371956, state=success, executor_state=success, try_number=1, max_tries=1, job_id=125, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:00:05.677629+00:00, queued_by_job_id=2, pid=1914 2024-02-24T00:00:09.387342595Z [2024-02-24T00:00:09.386+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T00:00:09.387368143Z 2024-02-24T00:00:09.388954051Z [2024-02-24T00:00:09.387+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 has 0/16 running and queued tasks 2024-02-24T00:00:09.389508639Z [2024-02-24T00:00:09.389+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:00:09.389517633Z 2024-02-24T00:00:09.391959318Z [2024-02-24T00:00:09.391+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', task_id='collect_metrics', run_id='scheduled__2024-02-23T23:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T00:00:09.392154850Z [2024-02-24T00:00:09.391+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'collect_metrics', 'scheduled__2024-02-23T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T00:00:09.441715536Z [2024-02-24T00:00:09.441+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.collect_metrics run_id=scheduled__2024-02-23T23:55:00+00:00 exited with status queued for try_number 1 2024-02-24T00:00:09.442724049Z [2024-02-24T00:00:09.441+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.split_metrics run_id=scheduled__2024-02-23T23:55:00+00:00 exited with status success for try_number 1 2024-02-24T00:00:09.450825055Z [2024-02-24T00:00:09.450+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f582800-bd12-4663-b763-3b979bf3df23 2024-02-24T00:00:09.451269141Z [2024-02-24T00:00:09.450+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=split_metrics, run_id=scheduled__2024-02-23T23:55:00+00:00, map_index=-1, run_start_date=2024-02-24 00:00:08.783023+00:00, run_end_date=2024-02-24 00:00:09.110287+00:00, run_duration=0.327264, state=success, executor_state=success, try_number=1, max_tries=1, job_id=126, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:00:07.083930+00:00, queued_by_job_id=2, pid=1921 2024-02-24T00:00:11.747772536Z [2024-02-24T00:00:11.747+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-02-24T00:00:11.747816766Z 2024-02-24T00:00:11.747834427Z 2024-02-24T00:00:11.747932321Z [2024-02-24T00:00:11.747+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 has 0/16 running and queued tasks 2024-02-24T00:00:11.748055196Z [2024-02-24T00:00:11.747+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:00:11.748849634Z [2024-02-24T00:00:11.748+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:00:11.748865287Z 2024-02-24T00:00:11.748871172Z 2024-02-24T00:00:11.752498454Z [2024-02-24T00:00:11.752+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', task_id='send_prometheus', run_id='scheduled__2024-02-23T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:00:11.752765190Z [2024-02-24T00:00:11.752+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'send_prometheus', 'scheduled__2024-02-23T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:00:11.753150357Z [2024-02-24T00:00:11.752+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-23T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:00:11.753682391Z [2024-02-24T00:00:11.753+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-23T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:00:11.913725278Z [2024-02-24T00:00:11.913+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.send_prometheus run_id=scheduled__2024-02-23T23:55:00+00:00 exited with status queued for try_number 1 2024-02-24T00:00:11.914071661Z [2024-02-24T00:00:11.913+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-23T23:55:00+00:00 exited with status queued for try_number 1 2024-02-24T00:00:11.914338972Z [2024-02-24T00:00:11.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-23T23:55:00+00:00 exited with status success for try_number 1 2024-02-24T00:00:11.914568448Z [2024-02-24T00:00:11.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.collect_metrics run_id=scheduled__2024-02-23T23:55:00+00:00 exited with status success for try_number 1 2024-02-24T00:00:11.924968269Z [2024-02-24T00:00:11.924+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=collect_metrics, run_id=scheduled__2024-02-23T23:55:00+00:00, map_index=0, run_start_date=2024-02-24 00:00:11.014643+00:00, run_end_date=2024-02-24 00:00:11.421390+00:00, run_duration=0.406747, state=success, executor_state=success, try_number=1, max_tries=1, job_id=128, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:00:09.389928+00:00, queued_by_job_id=2, pid=1937 2024-02-24T00:00:11.925372427Z [2024-02-24T00:00:11.925+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-23T23:55:00+00:00, map_index=0, run_start_date=2024-02-24 00:00:10.928568+00:00, run_end_date=2024-02-24 00:00:11.341069+00:00, run_duration=0.412501, state=success, executor_state=success, try_number=1, max_tries=1, job_id=127, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:00:09.232523+00:00, queued_by_job_id=2, pid=1936 2024-02-24T00:00:11.925704410Z [2024-02-24T00:00:11.925+0000] {scheduler_job.py:635} INFO - Setting external_id for to 264bb490-d156-445c-bb28-06386c8ce86d 2024-02-24T00:00:11.926045861Z [2024-02-24T00:00:11.925+0000] {scheduler_job.py:635} INFO - Setting external_id for to fadbaf0a-c9c9-4265-8dc1-a6cba98dd2ae 2024-02-24T00:00:13.962875430Z [2024-02-24T00:00:13.962+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:00:13.963209528Z [2024-02-24T00:00:13.962+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99, execution_date=2024-02-23 23:55:00+00:00, run_id=scheduled__2024-02-23T23:55:00+00:00, run_start_date=2024-02-24 00:00:00.333548+00:00, run_end_date=2024-02-24 00:00:13.962788+00:00, run_duration=13.62924, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:55:00+00:00, data_interval_end=2024-02-24 00:00:00+00:00, dag_hash=ee72125b786422203fda616907506950 2024-02-24T00:00:13.969878045Z [2024-02-24T00:00:13.969+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 to 2024-02-24T00:00:00+00:00, run_after=2024-02-24T00:05:00+00:00 2024-02-24T00:00:14.502822144Z [2024-02-24T00:00:14.502+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:00:14.503198857Z [2024-02-24T00:00:14.502+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-23 23:55:00+00:00, run_id=scheduled__2024-02-23T23:55:00+00:00, run_start_date=2024-02-24 00:00:00.334753+00:00, run_end_date=2024-02-24 00:00:14.502860+00:00, run_duration=14.168107, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-23 23:55:00+00:00, data_interval_end=2024-02-24 00:00:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T00:00:14.509354681Z [2024-02-24T00:00:14.509+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:00:00+00:00, run_after=2024-02-24T00:05:00+00:00 2024-02-24T00:00:14.539860047Z [2024-02-24T00:00:14.539+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.send_prometheus run_id=scheduled__2024-02-23T23:55:00+00:00 exited with status success for try_number 1 2024-02-24T00:00:14.540029476Z [2024-02-24T00:00:14.539+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-23T23:55:00+00:00 exited with status success for try_number 1 2024-02-24T00:00:14.546105747Z [2024-02-24T00:00:14.545+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-23T23:55:00+00:00, map_index=-1, run_start_date=2024-02-24 00:00:13.666929+00:00, run_end_date=2024-02-24 00:00:14.038495+00:00, run_duration=0.371566, state=success, executor_state=success, try_number=1, max_tries=1, job_id=130, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:00:11.749496+00:00, queued_by_job_id=2, pid=1953 2024-02-24T00:00:14.546454531Z [2024-02-24T00:00:14.546+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=send_prometheus, run_id=scheduled__2024-02-23T23:55:00+00:00, map_index=-1, run_start_date=2024-02-24 00:00:13.489884+00:00, run_end_date=2024-02-24 00:00:13.873433+00:00, run_duration=0.383549, state=success, executor_state=success, try_number=1, max_tries=1, job_id=129, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:00:11.749496+00:00, queued_by_job_id=2, pid=1952 2024-02-24T00:01:00.138052733Z [2024-02-24T00:01:00.137+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99 to 2024-02-24T00:01:00+00:00, run_after=2024-02-24T00:02:00+00:00 2024-02-24T00:01:00.150505829Z [2024-02-24T00:01:00.150+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:01:00+00:00, run_after=2024-02-24T00:02:00+00:00 2024-02-24T00:01:00.157963783Z [2024-02-24T00:01:00.157+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:01:00.166645061Z [2024-02-24T00:01:00.166+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:01:00.184325331Z [2024-02-24T00:01:00.183+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:01:00+00:00, run_after=2024-02-24T00:02:00+00:00 2024-02-24T00:01:00.284645214Z [2024-02-24T00:01:00.284+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-02-24T00:01:00.284698763Z 2024-02-24T00:01:00.284704861Z 2024-02-24T00:01:00.284709337Z 2024-02-24T00:01:00.284713649Z 2024-02-24T00:01:00.284717890Z 2024-02-24T00:01:00.284740159Z [2024-02-24T00:01:00.284+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:01:00.284891455Z [2024-02-24T00:01:00.284+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:01:00.284993136Z [2024-02-24T00:01:00.284+0000] {scheduler_job.py:425} INFO - DAG vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99 has 0/16 running and queued tasks 2024-02-24T00:01:00.285098898Z [2024-02-24T00:01:00.284+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 has 0/16 running and queued tasks 2024-02-24T00:01:00.285218717Z [2024-02-24T00:01:00.285+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:01:00.285834751Z [2024-02-24T00:01:00.285+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:01:00.285845383Z 2024-02-24T00:01:00.285849275Z 2024-02-24T00:01:00.285853372Z 2024-02-24T00:01:00.285857199Z 2024-02-24T00:01:00.285861179Z 2024-02-24T00:01:00.289577371Z [2024-02-24T00:01:00.289+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:01:00.289597032Z [2024-02-24T00:01:00.289+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:01:00.289855078Z [2024-02-24T00:01:00.289+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:01:00.290074679Z [2024-02-24T00:01:00.289+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:01:00.290316398Z [2024-02-24T00:01:00.290+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:01:00.290431562Z [2024-02-24T00:01:00.290+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:01:00.290688051Z [2024-02-24T00:01:00.290+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:01:00.290785238Z [2024-02-24T00:01:00.290+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:01:00.291025524Z [2024-02-24T00:01:00.290+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:01:00.291126331Z [2024-02-24T00:01:00.290+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:01:00.896207371Z [2024-02-24T00:01:00.895+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:00:00+00:00 exited with status queued for try_number 1 2024-02-24T00:01:00.897015652Z [2024-02-24T00:01:00.896+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:00:00+00:00 exited with status queued for try_number 1 2024-02-24T00:01:00.897032184Z [2024-02-24T00:01:00.896+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:00:00+00:00 exited with status queued for try_number 1 2024-02-24T00:01:00.897036013Z [2024-02-24T00:01:00.896+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:00:00+00:00 exited with status queued for try_number 1 2024-02-24T00:01:00.897180390Z [2024-02-24T00:01:00.896+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:00:00+00:00 exited with status queued for try_number 1 2024-02-24T00:01:00.911822149Z [2024-02-24T00:01:00.911+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d178913-d0f7-4d80-8b8a-c11560b1b0a1 2024-02-24T00:01:00.912335859Z [2024-02-24T00:01:00.912+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6099a35a-fec2-4257-8478-d5c751ad675b 2024-02-24T00:01:00.912615646Z [2024-02-24T00:01:00.912+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c487f49-2c0a-4c45-b1e9-113a3cb92c32 2024-02-24T00:01:00.913540681Z [2024-02-24T00:01:00.913+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30d3de31-cef7-4d4b-a19d-d041128c7083 2024-02-24T00:01:00.913842671Z [2024-02-24T00:01:00.913+0000] {scheduler_job.py:635} INFO - Setting external_id for to 997f108f-03ab-42da-8417-9ce28c8d4af0 2024-02-24T00:01:02.131955676Z [2024-02-24T00:01:02.129+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:01:02.131983639Z [2024-02-24T00:01:02.130+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:00:00+00:00, run_id=scheduled__2024-02-24T00:00:00+00:00, run_start_date=2024-02-24 00:01:00.199744+00:00, run_end_date=2024-02-24 00:01:02.129886+00:00, run_duration=1.930142, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:00:00+00:00, data_interval_end=2024-02-24 00:01:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:01:02.142953793Z [2024-02-24T00:01:02.142+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:01:00+00:00, run_after=2024-02-24T00:02:00+00:00 2024-02-24T00:01:02.293281030Z [2024-02-24T00:01:02.292+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:00:00+00:00 exited with status success for try_number 1 2024-02-24T00:01:02.311697116Z [2024-02-24T00:01:02.311+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:00:00+00:00, map_index=-1, run_start_date=2024-02-24 00:01:01.219952+00:00, run_end_date=2024-02-24 00:01:01.797315+00:00, run_duration=0.577363, state=success, executor_state=success, try_number=1, max_tries=1, job_id=131, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:01:00.286706+00:00, queued_by_job_id=2, pid=1977 2024-02-24T00:01:05.404332656Z [2024-02-24T00:01:05.403+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:01:05.404828484Z [2024-02-24T00:01:05.404+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99, execution_date=2024-02-24 00:00:00+00:00, run_id=scheduled__2024-02-24T00:00:00+00:00, run_start_date=2024-02-24 00:01:00.195053+00:00, run_end_date=2024-02-24 00:01:05.404274+00:00, run_duration=5.209221, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:00:00+00:00, data_interval_end=2024-02-24 00:01:00+00:00, dag_hash=a6c60e86361ec5e1ca8caa2393de1e74 2024-02-24T00:01:05.426877173Z [2024-02-24T00:01:05.426+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99 to 2024-02-24T00:01:00+00:00, run_after=2024-02-24T00:02:00+00:00 2024-02-24T00:01:05.437937323Z [2024-02-24T00:01:05.437+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:01:05.438448821Z [2024-02-24T00:01:05.438+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:00:00+00:00, run_id=scheduled__2024-02-24T00:00:00+00:00, run_start_date=2024-02-24 00:01:00.196532+00:00, run_end_date=2024-02-24 00:01:05.437861+00:00, run_duration=5.241329, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:00:00+00:00, data_interval_end=2024-02-24 00:01:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:01:05.455132639Z [2024-02-24T00:01:05.454+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:01:00+00:00, run_after=2024-02-24T00:02:00+00:00 2024-02-24T00:01:05.465649250Z [2024-02-24T00:01:05.465+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:01:05.466283711Z [2024-02-24T00:01:05.465+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99, execution_date=2024-02-24 00:00:00+00:00, run_id=scheduled__2024-02-24T00:00:00+00:00, run_start_date=2024-02-24 00:01:00.197582+00:00, run_end_date=2024-02-24 00:01:05.465569+00:00, run_duration=5.267987, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:00:00+00:00, data_interval_end=2024-02-24 00:01:00+00:00, dag_hash=eae4783770389de0b2ebbc0ed9593a4f 2024-02-24T00:01:05.484967779Z [2024-02-24T00:01:05.484+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 to 2024-02-24T00:01:00+00:00, run_after=2024-02-24T00:02:00+00:00 2024-02-24T00:01:05.496657185Z [2024-02-24T00:01:05.496+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:01:05.496964698Z [2024-02-24T00:01:05.496+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:00:00+00:00, run_id=scheduled__2024-02-24T00:00:00+00:00, run_start_date=2024-02-24 00:01:00.198633+00:00, run_end_date=2024-02-24 00:01:05.496524+00:00, run_duration=5.297891, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:00:00+00:00, data_interval_end=2024-02-24 00:01:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:01:05.508337265Z [2024-02-24T00:01:05.507+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:01:00+00:00, run_after=2024-02-24T00:02:00+00:00 2024-02-24T00:01:05.541707563Z [2024-02-24T00:01:05.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:00:00+00:00 exited with status success for try_number 1 2024-02-24T00:01:05.541819607Z [2024-02-24T00:01:05.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:00:00+00:00 exited with status success for try_number 1 2024-02-24T00:01:05.541858396Z [2024-02-24T00:01:05.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:00:00+00:00 exited with status success for try_number 1 2024-02-24T00:01:05.542119184Z [2024-02-24T00:01:05.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:00:00+00:00 exited with status success for try_number 1 2024-02-24T00:01:05.550674996Z [2024-02-24T00:01:05.550+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:00:00+00:00, map_index=-1, run_start_date=2024-02-24 00:01:02.872572+00:00, run_end_date=2024-02-24 00:01:05.004335+00:00, run_duration=2.131763, state=success, executor_state=success, try_number=1, max_tries=1, job_id=134, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:01:00.286706+00:00, queued_by_job_id=2, pid=2009 2024-02-24T00:01:05.551067801Z [2024-02-24T00:01:05.550+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:00:00+00:00, map_index=-1, run_start_date=2024-02-24 00:01:02.684006+00:00, run_end_date=2024-02-24 00:01:04.398049+00:00, run_duration=1.714043, state=success, executor_state=success, try_number=1, max_tries=1, job_id=133, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:01:00.286706+00:00, queued_by_job_id=2, pid=2007 2024-02-24T00:01:05.551383466Z [2024-02-24T00:01:05.551+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:00:00+00:00, map_index=-1, run_start_date=2024-02-24 00:01:03.054144+00:00, run_end_date=2024-02-24 00:01:05.171536+00:00, run_duration=2.117392, state=success, executor_state=success, try_number=1, max_tries=1, job_id=135, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:01:00.286706+00:00, queued_by_job_id=2, pid=2010 2024-02-24T00:01:05.551668846Z [2024-02-24T00:01:05.551+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:00:00+00:00, map_index=-1, run_start_date=2024-02-24 00:01:02.594517+00:00, run_end_date=2024-02-24 00:01:04.730990+00:00, run_duration=2.136473, state=success, executor_state=success, try_number=1, max_tries=1, job_id=132, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:01:00.286706+00:00, queued_by_job_id=2, pid=2005 2024-02-24T00:01:59.459471815Z [2024-02-24T00:01:59.458+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T00:02:00.521744620Z [2024-02-24T00:02:00.521+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:02:00+00:00, run_after=2024-02-24T00:03:00+00:00 2024-02-24T00:02:00.544368569Z [2024-02-24T00:02:00.542+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:02:00+00:00, run_after=2024-02-24T00:03:00+00:00 2024-02-24T00:02:00.554233674Z [2024-02-24T00:02:00.553+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:02:00.565548162Z [2024-02-24T00:02:00.564+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:02:00.572252386Z [2024-02-24T00:02:00.571+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:02:00.587847421Z [2024-02-24T00:02:00.586+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99 to 2024-02-24T00:02:00+00:00, run_after=2024-02-24T00:03:00+00:00 2024-02-24T00:02:00.700663035Z [2024-02-24T00:02:00.700+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-02-24T00:02:00.700740257Z 2024-02-24T00:02:00.700747862Z 2024-02-24T00:02:00.700753958Z 2024-02-24T00:02:00.700759918Z 2024-02-24T00:02:00.700765397Z 2024-02-24T00:02:00.700770972Z 2024-02-24T00:02:00.701426228Z [2024-02-24T00:02:00.700+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T00:02:00.701865842Z [2024-02-24T00:02:00.701+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:02:00.702365119Z [2024-02-24T00:02:00.701+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:02:00.702752007Z [2024-02-24T00:02:00.702+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 has 0/16 running and queued tasks 2024-02-24T00:02:00.703159970Z [2024-02-24T00:02:00.702+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:02:00.703514092Z [2024-02-24T00:02:00.703+0000] {scheduler_job.py:425} INFO - DAG vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99 has 0/16 running and queued tasks 2024-02-24T00:02:00.705142165Z [2024-02-24T00:02:00.704+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:02:00.705159862Z 2024-02-24T00:02:00.705191777Z 2024-02-24T00:02:00.705198172Z 2024-02-24T00:02:00.705204229Z 2024-02-24T00:02:00.705210847Z 2024-02-24T00:02:00.705217323Z 2024-02-24T00:02:00.711734887Z [2024-02-24T00:02:00.711+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:02:00.712023786Z [2024-02-24T00:02:00.711+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T00:02:00.712461190Z [2024-02-24T00:02:00.712+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:02:00.712764517Z [2024-02-24T00:02:00.712+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:02:00.713179195Z [2024-02-24T00:02:00.712+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:02:00.713418845Z [2024-02-24T00:02:00.713+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:02:00.713911788Z [2024-02-24T00:02:00.713+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:02:00.714214161Z [2024-02-24T00:02:00.713+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:02:00.714611189Z [2024-02-24T00:02:00.714+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:02:00.714900832Z [2024-02-24T00:02:00.714+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:02:00.715326849Z [2024-02-24T00:02:00.715+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:02:00.715529430Z [2024-02-24T00:02:00.715+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:02:01.467225977Z [2024-02-24T00:02:01.466+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:00:00+00:00 exited with status queued for try_number 1 2024-02-24T00:02:01.467314173Z [2024-02-24T00:02:01.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:01:00+00:00 exited with status queued for try_number 1 2024-02-24T00:02:01.467445994Z [2024-02-24T00:02:01.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:01:00+00:00 exited with status queued for try_number 1 2024-02-24T00:02:01.467557474Z [2024-02-24T00:02:01.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:01:00+00:00 exited with status queued for try_number 1 2024-02-24T00:02:01.467670724Z [2024-02-24T00:02:01.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:01:00+00:00 exited with status queued for try_number 1 2024-02-24T00:02:01.467776177Z [2024-02-24T00:02:01.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:01:00+00:00 exited with status queued for try_number 1 2024-02-24T00:02:01.491231552Z [2024-02-24T00:02:01.490+0000] {scheduler_job.py:635} INFO - Setting external_id for to a8cf8785-254f-4064-add3-e25dfde4fd91 2024-02-24T00:02:01.491536705Z [2024-02-24T00:02:01.491+0000] {scheduler_job.py:635} INFO - Setting external_id for to e3afd01b-28e3-450c-8ea1-3ffb59b60334 2024-02-24T00:02:01.491740454Z [2024-02-24T00:02:01.491+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15f81ab2-98c3-43fe-8073-b344d914cdf8 2024-02-24T00:02:01.491899623Z [2024-02-24T00:02:01.491+0000] {scheduler_job.py:635} INFO - Setting external_id for to 914b74e0-6ed6-4d6d-a720-1a3a2bec0274 2024-02-24T00:02:01.492069026Z [2024-02-24T00:02:01.491+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff85012f-5e2b-4e87-af59-cc7df2ba13d6 2024-02-24T00:02:01.492630199Z [2024-02-24T00:02:01.492+0000] {scheduler_job.py:635} INFO - Setting external_id for to 932b7dc6-df41-43b2-88bf-9e9556a448d1 2024-02-24T00:02:02.990913441Z [2024-02-24T00:02:02.990+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:02:02.991264614Z [2024-02-24T00:02:02.991+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:01:00+00:00, run_id=scheduled__2024-02-24T00:01:00+00:00, run_start_date=2024-02-24 00:02:00.604767+00:00, run_end_date=2024-02-24 00:02:02.990820+00:00, run_duration=2.386053, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:01:00+00:00, data_interval_end=2024-02-24 00:02:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:02:03.019938257Z [2024-02-24T00:02:03.019+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:02:00+00:00, run_after=2024-02-24T00:03:00+00:00 2024-02-24T00:02:03.265225497Z [2024-02-24T00:02:03.264+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:00:00+00:00 exited with status success for try_number 1 2024-02-24T00:02:03.265315251Z [2024-02-24T00:02:03.265+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:01:00+00:00 exited with status success for try_number 1 2024-02-24T00:02:03.279586765Z [2024-02-24T00:02:03.279+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T00:00:00+00:00, map_index=-1, run_start_date=2024-02-24 00:02:02.031100+00:00, run_end_date=2024-02-24 00:02:02.875620+00:00, run_duration=0.84452, state=success, executor_state=success, try_number=1, max_tries=1, job_id=137, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:02:00.707349+00:00, queued_by_job_id=2, pid=2057 2024-02-24T00:02:03.284306838Z [2024-02-24T00:02:03.283+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:01:00+00:00, map_index=-1, run_start_date=2024-02-24 00:02:01.742081+00:00, run_end_date=2024-02-24 00:02:02.435440+00:00, run_duration=0.693359, state=success, executor_state=success, try_number=1, max_tries=1, job_id=136, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:02:00.707349+00:00, queued_by_job_id=2, pid=2056 2024-02-24T00:02:04.095166583Z [2024-02-24T00:02:04.094+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:02:04.095629230Z [2024-02-24T00:02:04.095+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 00:00:00+00:00, run_id=scheduled__2024-02-24T00:00:00+00:00, run_start_date=2024-02-24 00:02:00.602299+00:00, run_end_date=2024-02-24 00:02:04.095079+00:00, run_duration=3.49278, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:00:00+00:00, data_interval_end=2024-02-24 00:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T00:02:04.105613214Z [2024-02-24T00:02:04.105+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T00:02:00+00:00, run_after=2024-02-24T00:04:00+00:00 2024-02-24T00:02:06.897896111Z [2024-02-24T00:02:06.897+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:02:06.898209709Z [2024-02-24T00:02:06.897+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:01:00+00:00, run_id=scheduled__2024-02-24T00:01:00+00:00, run_start_date=2024-02-24 00:02:00.603597+00:00, run_end_date=2024-02-24 00:02:06.897852+00:00, run_duration=6.294255, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:01:00+00:00, data_interval_end=2024-02-24 00:02:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:02:06.907270783Z [2024-02-24T00:02:06.906+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:02:00+00:00, run_after=2024-02-24T00:03:00+00:00 2024-02-24T00:02:06.913797159Z [2024-02-24T00:02:06.913+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:02:06.914071786Z [2024-02-24T00:02:06.913+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99, execution_date=2024-02-24 00:01:00+00:00, run_id=scheduled__2024-02-24T00:01:00+00:00, run_start_date=2024-02-24 00:02:00.611666+00:00, run_end_date=2024-02-24 00:02:06.913737+00:00, run_duration=6.302071, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:01:00+00:00, data_interval_end=2024-02-24 00:02:00+00:00, dag_hash=a6c60e86361ec5e1ca8caa2393de1e74 2024-02-24T00:02:06.922641957Z [2024-02-24T00:02:06.922+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99 to 2024-02-24T00:02:00+00:00, run_after=2024-02-24T00:03:00+00:00 2024-02-24T00:02:06.964790493Z [2024-02-24T00:02:06.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:01:00+00:00 exited with status success for try_number 1 2024-02-24T00:02:06.965115686Z [2024-02-24T00:02:06.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:01:00+00:00 exited with status success for try_number 1 2024-02-24T00:02:06.971183408Z [2024-02-24T00:02:06.970+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:01:00+00:00, map_index=-1, run_start_date=2024-02-24 00:02:04.552443+00:00, run_end_date=2024-02-24 00:02:06.794226+00:00, run_duration=2.241783, state=success, executor_state=success, try_number=1, max_tries=1, job_id=141, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:02:00.707349+00:00, queued_by_job_id=2, pid=2110 2024-02-24T00:02:06.971565171Z [2024-02-24T00:02:06.971+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:01:00+00:00, map_index=-1, run_start_date=2024-02-24 00:02:04.090571+00:00, run_end_date=2024-02-24 00:02:06.769424+00:00, run_duration=2.678853, state=success, executor_state=success, try_number=1, max_tries=1, job_id=139, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:02:00.707349+00:00, queued_by_job_id=2, pid=2088 2024-02-24T00:02:08.035846078Z [2024-02-24T00:02:08.035+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:02:08.036416259Z [2024-02-24T00:02:08.036+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:01:00+00:00, run_id=scheduled__2024-02-24T00:01:00+00:00, run_start_date=2024-02-24 00:02:00.610474+00:00, run_end_date=2024-02-24 00:02:08.035774+00:00, run_duration=7.4253, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:01:00+00:00, data_interval_end=2024-02-24 00:02:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:02:08.048825919Z [2024-02-24T00:02:08.048+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:02:00+00:00, run_after=2024-02-24T00:03:00+00:00 2024-02-24T00:02:08.056209373Z [2024-02-24T00:02:08.055+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:02:08.056566807Z [2024-02-24T00:02:08.056+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99, execution_date=2024-02-24 00:01:00+00:00, run_id=scheduled__2024-02-24T00:01:00+00:00, run_start_date=2024-02-24 00:02:00.605701+00:00, run_end_date=2024-02-24 00:02:08.056101+00:00, run_duration=7.4504, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:01:00+00:00, data_interval_end=2024-02-24 00:02:00+00:00, dag_hash=eae4783770389de0b2ebbc0ed9593a4f 2024-02-24T00:02:08.065872180Z [2024-02-24T00:02:08.065+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 to 2024-02-24T00:02:00+00:00, run_after=2024-02-24T00:03:00+00:00 2024-02-24T00:02:08.100354275Z [2024-02-24T00:02:08.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:01:00+00:00 exited with status success for try_number 1 2024-02-24T00:02:08.100488739Z [2024-02-24T00:02:08.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:01:00+00:00 exited with status success for try_number 1 2024-02-24T00:02:08.107401715Z [2024-02-24T00:02:08.107+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:01:00+00:00, map_index=-1, run_start_date=2024-02-24 00:02:04.143818+00:00, run_end_date=2024-02-24 00:02:07.460696+00:00, run_duration=3.316878, state=success, executor_state=success, try_number=1, max_tries=1, job_id=140, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:02:00.707349+00:00, queued_by_job_id=2, pid=2089 2024-02-24T00:02:08.107516168Z [2024-02-24T00:02:08.107+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:01:00+00:00, map_index=-1, run_start_date=2024-02-24 00:02:03.948823+00:00, run_end_date=2024-02-24 00:02:07.198904+00:00, run_duration=3.250081, state=success, executor_state=success, try_number=1, max_tries=1, job_id=138, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:02:00.707349+00:00, queued_by_job_id=2, pid=2087 2024-02-24T00:03:00.865997446Z [2024-02-24T00:03:00.865+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:03:00+00:00, run_after=2024-02-24T00:04:00+00:00 2024-02-24T00:03:00.887168443Z [2024-02-24T00:03:00.886+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99 to 2024-02-24T00:03:00+00:00, run_after=2024-02-24T00:04:00+00:00 2024-02-24T00:03:00.903112799Z [2024-02-24T00:03:00.902+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:03:00.925589371Z [2024-02-24T00:03:00.925+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:03:00+00:00, run_after=2024-02-24T00:04:00+00:00 2024-02-24T00:03:00.934808164Z [2024-02-24T00:03:00.934+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:03:01.022015319Z [2024-02-24T00:03:01.021+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-02-24T00:03:01.022043466Z 2024-02-24T00:03:01.022047698Z 2024-02-24T00:03:01.022051621Z 2024-02-24T00:03:01.022055414Z 2024-02-24T00:03:01.022059344Z 2024-02-24T00:03:01.022286840Z [2024-02-24T00:03:01.021+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 has 0/16 running and queued tasks 2024-02-24T00:03:01.022527789Z [2024-02-24T00:03:01.022+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:03:01.022788910Z [2024-02-24T00:03:01.022+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:03:01.023064755Z [2024-02-24T00:03:01.022+0000] {scheduler_job.py:425} INFO - DAG vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99 has 0/16 running and queued tasks 2024-02-24T00:03:01.023289318Z [2024-02-24T00:03:01.023+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:03:01.024109556Z [2024-02-24T00:03:01.023+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:03:01.024122628Z 2024-02-24T00:03:01.024126919Z 2024-02-24T00:03:01.024177606Z 2024-02-24T00:03:01.024182276Z 2024-02-24T00:03:01.024186061Z 2024-02-24T00:03:01.029224490Z [2024-02-24T00:03:01.028+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:03:01.029371254Z [2024-02-24T00:03:01.029+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:03:01.029729943Z [2024-02-24T00:03:01.029+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:03:01.030054675Z [2024-02-24T00:03:01.029+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:03:01.030319872Z [2024-02-24T00:03:01.030+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:03:01.030495524Z [2024-02-24T00:03:01.030+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:03:01.030811420Z [2024-02-24T00:03:01.030+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:03:01.031042066Z [2024-02-24T00:03:01.030+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:03:01.031349325Z [2024-02-24T00:03:01.031+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:03:01.031591422Z [2024-02-24T00:03:01.031+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:03:01.602752153Z [2024-02-24T00:03:01.602+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:02:00+00:00 exited with status queued for try_number 1 2024-02-24T00:03:01.602897899Z [2024-02-24T00:03:01.602+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:02:00+00:00 exited with status queued for try_number 1 2024-02-24T00:03:01.602927672Z [2024-02-24T00:03:01.602+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:02:00+00:00 exited with status queued for try_number 1 2024-02-24T00:03:01.602937219Z [2024-02-24T00:03:01.602+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:02:00+00:00 exited with status queued for try_number 1 2024-02-24T00:03:01.602945913Z [2024-02-24T00:03:01.602+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:02:00+00:00 exited with status queued for try_number 1 2024-02-24T00:03:01.613563409Z [2024-02-24T00:03:01.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc6c1a5f-eb7f-49a8-b24d-168f8f57ff71 2024-02-24T00:03:01.613679258Z [2024-02-24T00:03:01.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to dad06347-0a1a-4d15-90c6-37ead3c89f4e 2024-02-24T00:03:01.613741204Z [2024-02-24T00:03:01.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to 398248f7-aad3-4c3b-8b60-b32c65188134 2024-02-24T00:03:01.613965251Z [2024-02-24T00:03:01.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac5f3003-797c-4556-8daf-8054e0b0dc78 2024-02-24T00:03:01.617027346Z [2024-02-24T00:03:01.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1697fe7e-6334-414d-8e4c-1f2ff0385f98 2024-02-24T00:03:02.797965053Z [2024-02-24T00:03:02.797+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:03:02.798639455Z [2024-02-24T00:03:02.798+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:02:00+00:00, run_id=scheduled__2024-02-24T00:02:00+00:00, run_start_date=2024-02-24 00:03:00.947997+00:00, run_end_date=2024-02-24 00:03:02.798245+00:00, run_duration=1.850248, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:02:00+00:00, data_interval_end=2024-02-24 00:03:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:03:02.817289266Z [2024-02-24T00:03:02.816+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:03:00+00:00, run_after=2024-02-24T00:04:00+00:00 2024-02-24T00:03:02.929447781Z [2024-02-24T00:03:02.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:02:00+00:00 exited with status success for try_number 1 2024-02-24T00:03:02.940837745Z [2024-02-24T00:03:02.940+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:02:00+00:00, map_index=-1, run_start_date=2024-02-24 00:03:01.976682+00:00, run_end_date=2024-02-24 00:03:02.447033+00:00, run_duration=0.470351, state=success, executor_state=success, try_number=1, max_tries=1, job_id=142, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:03:01.025640+00:00, queued_by_job_id=2, pid=2139 2024-02-24T00:03:06.279949685Z [2024-02-24T00:03:06.279+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:03:06.280070925Z [2024-02-24T00:03:06.279+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:02:00+00:00, run_id=scheduled__2024-02-24T00:02:00+00:00, run_start_date=2024-02-24 00:03:00.949611+00:00, run_end_date=2024-02-24 00:03:06.279710+00:00, run_duration=5.330099, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:02:00+00:00, data_interval_end=2024-02-24 00:03:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:03:06.289490945Z [2024-02-24T00:03:06.289+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:03:00+00:00, run_after=2024-02-24T00:04:00+00:00 2024-02-24T00:03:06.298274306Z [2024-02-24T00:03:06.297+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:03:06.298467573Z [2024-02-24T00:03:06.298+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99, execution_date=2024-02-24 00:02:00+00:00, run_id=scheduled__2024-02-24T00:02:00+00:00, run_start_date=2024-02-24 00:03:00.951123+00:00, run_end_date=2024-02-24 00:03:06.298131+00:00, run_duration=5.347008, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:02:00+00:00, data_interval_end=2024-02-24 00:03:00+00:00, dag_hash=a6c60e86361ec5e1ca8caa2393de1e74 2024-02-24T00:03:06.308454353Z [2024-02-24T00:03:06.308+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99 to 2024-02-24T00:03:00+00:00, run_after=2024-02-24T00:04:00+00:00 2024-02-24T00:03:06.362998305Z [2024-02-24T00:03:06.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:02:00+00:00 exited with status success for try_number 1 2024-02-24T00:03:06.363069332Z [2024-02-24T00:03:06.362+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:02:00+00:00 exited with status success for try_number 1 2024-02-24T00:03:06.373173471Z [2024-02-24T00:03:06.372+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:02:00+00:00, map_index=-1, run_start_date=2024-02-24 00:03:03.597013+00:00, run_end_date=2024-02-24 00:03:05.407608+00:00, run_duration=1.810595, state=success, executor_state=success, try_number=1, max_tries=1, job_id=143, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:03:01.025640+00:00, queued_by_job_id=2, pid=2169 2024-02-24T00:03:06.375131531Z [2024-02-24T00:03:06.374+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:02:00+00:00, map_index=-1, run_start_date=2024-02-24 00:03:03.830955+00:00, run_end_date=2024-02-24 00:03:05.895668+00:00, run_duration=2.064713, state=success, executor_state=success, try_number=1, max_tries=1, job_id=145, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:03:01.025640+00:00, queued_by_job_id=2, pid=2172 2024-02-24T00:03:07.410084861Z [2024-02-24T00:03:07.409+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:03:07.410379054Z [2024-02-24T00:03:07.410+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:02:00+00:00, run_id=scheduled__2024-02-24T00:02:00+00:00, run_start_date=2024-02-24 00:03:00.952477+00:00, run_end_date=2024-02-24 00:03:07.409980+00:00, run_duration=6.457503, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:02:00+00:00, data_interval_end=2024-02-24 00:03:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:03:07.419240199Z [2024-02-24T00:03:07.418+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:03:00+00:00, run_after=2024-02-24T00:04:00+00:00 2024-02-24T00:03:07.425559112Z [2024-02-24T00:03:07.425+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:03:07.425752569Z [2024-02-24T00:03:07.425+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99, execution_date=2024-02-24 00:02:00+00:00, run_id=scheduled__2024-02-24T00:02:00+00:00, run_start_date=2024-02-24 00:03:00.953481+00:00, run_end_date=2024-02-24 00:03:07.425380+00:00, run_duration=6.471899, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:02:00+00:00, data_interval_end=2024-02-24 00:03:00+00:00, dag_hash=eae4783770389de0b2ebbc0ed9593a4f 2024-02-24T00:03:07.435511681Z [2024-02-24T00:03:07.435+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 to 2024-02-24T00:03:00+00:00, run_after=2024-02-24T00:04:00+00:00 2024-02-24T00:03:07.469858230Z [2024-02-24T00:03:07.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:02:00+00:00 exited with status success for try_number 1 2024-02-24T00:03:07.470098172Z [2024-02-24T00:03:07.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:02:00+00:00 exited with status success for try_number 1 2024-02-24T00:03:07.479337603Z [2024-02-24T00:03:07.478+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:02:00+00:00, map_index=-1, run_start_date=2024-02-24 00:03:03.710403+00:00, run_end_date=2024-02-24 00:03:06.336080+00:00, run_duration=2.625677, state=success, executor_state=success, try_number=1, max_tries=1, job_id=144, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:03:01.025640+00:00, queued_by_job_id=2, pid=2170 2024-02-24T00:03:07.479620218Z [2024-02-24T00:03:07.479+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:02:00+00:00, map_index=-1, run_start_date=2024-02-24 00:03:03.835877+00:00, run_end_date=2024-02-24 00:03:06.344603+00:00, run_duration=2.508726, state=success, executor_state=success, try_number=1, max_tries=1, job_id=146, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:03:01.025640+00:00, queued_by_job_id=2, pid=2171 2024-02-24T00:04:00.910754265Z [2024-02-24T00:04:00.909+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:04:00.935168940Z [2024-02-24T00:04:00.934+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99 to 2024-02-24T00:04:00+00:00, run_after=2024-02-24T00:05:00+00:00 2024-02-24T00:04:00.952560346Z [2024-02-24T00:04:00.952+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:04:00+00:00, run_after=2024-02-24T00:05:00+00:00 2024-02-24T00:04:00.967398875Z [2024-02-24T00:04:00.966+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:04:00+00:00, run_after=2024-02-24T00:05:00+00:00 2024-02-24T00:04:00.976290892Z [2024-02-24T00:04:00.975+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:04:00.985037421Z [2024-02-24T00:04:00.984+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:04:01.144457839Z [2024-02-24T00:04:01.143+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-02-24T00:04:01.144504455Z 2024-02-24T00:04:01.144515086Z 2024-02-24T00:04:01.144523237Z 2024-02-24T00:04:01.144531348Z 2024-02-24T00:04:01.144539932Z 2024-02-24T00:04:01.144548003Z 2024-02-24T00:04:01.144906345Z [2024-02-24T00:04:01.144+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T00:04:01.146596557Z [2024-02-24T00:04:01.145+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 has 0/16 running and queued tasks 2024-02-24T00:04:01.147037984Z [2024-02-24T00:04:01.146+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:04:01.147410069Z [2024-02-24T00:04:01.147+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:04:01.147765415Z [2024-02-24T00:04:01.147+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:04:01.148110167Z [2024-02-24T00:04:01.147+0000] {scheduler_job.py:425} INFO - DAG vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99 has 0/16 running and queued tasks 2024-02-24T00:04:01.150533574Z [2024-02-24T00:04:01.150+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:04:01.150544839Z 2024-02-24T00:04:01.150548571Z 2024-02-24T00:04:01.150552006Z 2024-02-24T00:04:01.150555457Z 2024-02-24T00:04:01.150558838Z 2024-02-24T00:04:01.150562913Z 2024-02-24T00:04:01.161552278Z [2024-02-24T00:04:01.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:04:01.162164500Z [2024-02-24T00:04:01.161+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T00:04:01.162718635Z [2024-02-24T00:04:01.162+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:04:01.163035609Z [2024-02-24T00:04:01.162+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:04:01.163498881Z [2024-02-24T00:04:01.163+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:04:01.163823365Z [2024-02-24T00:04:01.163+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:04:01.164310397Z [2024-02-24T00:04:01.164+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:04:01.164666779Z [2024-02-24T00:04:01.164+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:04:01.165140179Z [2024-02-24T00:04:01.164+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:04:01.165550788Z [2024-02-24T00:04:01.165+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:04:01.166384101Z [2024-02-24T00:04:01.166+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:04:01.166738895Z [2024-02-24T00:04:01.166+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:04:02.130966132Z [2024-02-24T00:04:02.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:02:00+00:00 exited with status queued for try_number 1 2024-02-24T00:04:02.131083805Z [2024-02-24T00:04:02.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:03:00+00:00 exited with status queued for try_number 1 2024-02-24T00:04:02.131278861Z [2024-02-24T00:04:02.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:03:00+00:00 exited with status queued for try_number 1 2024-02-24T00:04:02.131349861Z [2024-02-24T00:04:02.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:03:00+00:00 exited with status queued for try_number 1 2024-02-24T00:04:02.131506078Z [2024-02-24T00:04:02.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:03:00+00:00 exited with status queued for try_number 1 2024-02-24T00:04:02.131615933Z [2024-02-24T00:04:02.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:03:00+00:00 exited with status queued for try_number 1 2024-02-24T00:04:02.147374884Z [2024-02-24T00:04:02.146+0000] {scheduler_job.py:635} INFO - Setting external_id for to a2effb33-a33b-4bf2-a337-6954ea552bc6 2024-02-24T00:04:02.147671804Z [2024-02-24T00:04:02.147+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3ef7e141-6108-4ed9-ab9e-0b9ff4756f36 2024-02-24T00:04:02.147880528Z [2024-02-24T00:04:02.147+0000] {scheduler_job.py:635} INFO - Setting external_id for to 10a72d52-9a7d-4cbb-b5bb-9540a14b6697 2024-02-24T00:04:02.148130563Z [2024-02-24T00:04:02.147+0000] {scheduler_job.py:635} INFO - Setting external_id for to 000e2115-5bcc-4a52-bb5b-46a62f357b88 2024-02-24T00:04:02.148378495Z [2024-02-24T00:04:02.148+0000] {scheduler_job.py:635} INFO - Setting external_id for to b1ee131f-f89e-46aa-b7da-fcb15ea7f1f0 2024-02-24T00:04:02.148617249Z [2024-02-24T00:04:02.148+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c22c610-636e-4fd3-ac93-b22e7005fca0 2024-02-24T00:04:03.888409963Z [2024-02-24T00:04:03.888+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:04:03.889378816Z [2024-02-24T00:04:03.889+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:03:00+00:00, run_id=scheduled__2024-02-24T00:03:00+00:00, run_start_date=2024-02-24 00:04:00.998853+00:00, run_end_date=2024-02-24 00:04:03.888981+00:00, run_duration=2.890128, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:03:00+00:00, data_interval_end=2024-02-24 00:04:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:04:03.905324967Z [2024-02-24T00:04:03.905+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:04:00+00:00, run_after=2024-02-24T00:05:00+00:00 2024-02-24T00:04:03.923277408Z [2024-02-24T00:04:03.922+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:04:03.923491426Z [2024-02-24T00:04:03.923+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 00:02:00+00:00, run_id=scheduled__2024-02-24T00:02:00+00:00, run_start_date=2024-02-24 00:04:00.997472+00:00, run_end_date=2024-02-24 00:04:03.923138+00:00, run_duration=2.925666, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:02:00+00:00, data_interval_end=2024-02-24 00:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T00:04:03.933252182Z [2024-02-24T00:04:03.932+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T00:04:00+00:00, run_after=2024-02-24T00:06:00+00:00 2024-02-24T00:04:04.019283515Z [2024-02-24T00:04:04.018+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:02:00+00:00 exited with status success for try_number 1 2024-02-24T00:04:04.019314032Z [2024-02-24T00:04:04.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:03:00+00:00 exited with status success for try_number 1 2024-02-24T00:04:04.033024661Z [2024-02-24T00:04:04.032+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:03:00+00:00, map_index=-1, run_start_date=2024-02-24 00:04:03.238434+00:00, run_end_date=2024-02-24 00:04:03.708611+00:00, run_duration=0.470177, state=success, executor_state=success, try_number=1, max_tries=1, job_id=148, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:04:01.154001+00:00, queued_by_job_id=2, pid=2221 2024-02-24T00:04:04.033158839Z [2024-02-24T00:04:04.032+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T00:02:00+00:00, map_index=-1, run_start_date=2024-02-24 00:04:03.052592+00:00, run_end_date=2024-02-24 00:04:03.658750+00:00, run_duration=0.606158, state=success, executor_state=success, try_number=1, max_tries=1, job_id=147, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:04:01.154001+00:00, queued_by_job_id=2, pid=2220 2024-02-24T00:04:06.711706993Z [2024-02-24T00:04:06.711+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:04:06.712104399Z [2024-02-24T00:04:06.711+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:03:00+00:00, run_id=scheduled__2024-02-24T00:03:00+00:00, run_start_date=2024-02-24 00:04:01.000049+00:00, run_end_date=2024-02-24 00:04:06.711623+00:00, run_duration=5.711574, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:03:00+00:00, data_interval_end=2024-02-24 00:04:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:04:06.722369229Z [2024-02-24T00:04:06.722+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:04:00+00:00, run_after=2024-02-24T00:05:00+00:00 2024-02-24T00:04:07.834006983Z [2024-02-24T00:04:07.833+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:04:07.834582883Z [2024-02-24T00:04:07.834+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99, execution_date=2024-02-24 00:03:00+00:00, run_id=scheduled__2024-02-24T00:03:00+00:00, run_start_date=2024-02-24 00:04:01.005176+00:00, run_end_date=2024-02-24 00:04:07.833868+00:00, run_duration=6.828692, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:03:00+00:00, data_interval_end=2024-02-24 00:04:00+00:00, dag_hash=a6c60e86361ec5e1ca8caa2393de1e74 2024-02-24T00:04:07.846971453Z [2024-02-24T00:04:07.846+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99 to 2024-02-24T00:04:00+00:00, run_after=2024-02-24T00:05:00+00:00 2024-02-24T00:04:07.852799770Z [2024-02-24T00:04:07.852+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:04:07.853316572Z [2024-02-24T00:04:07.852+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99, execution_date=2024-02-24 00:03:00+00:00, run_id=scheduled__2024-02-24T00:03:00+00:00, run_start_date=2024-02-24 00:04:01.009407+00:00, run_end_date=2024-02-24 00:04:07.852705+00:00, run_duration=6.843298, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:03:00+00:00, data_interval_end=2024-02-24 00:04:00+00:00, dag_hash=eae4783770389de0b2ebbc0ed9593a4f 2024-02-24T00:04:07.861959235Z [2024-02-24T00:04:07.861+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 to 2024-02-24T00:04:00+00:00, run_after=2024-02-24T00:05:00+00:00 2024-02-24T00:04:07.909865442Z [2024-02-24T00:04:07.909+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:03:00+00:00 exited with status success for try_number 1 2024-02-24T00:04:07.910584688Z [2024-02-24T00:04:07.909+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:03:00+00:00 exited with status success for try_number 1 2024-02-24T00:04:07.910881980Z [2024-02-24T00:04:07.910+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:03:00+00:00 exited with status success for try_number 1 2024-02-24T00:04:07.921295420Z [2024-02-24T00:04:07.920+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:03:00+00:00, map_index=-1, run_start_date=2024-02-24 00:04:04.071655+00:00, run_end_date=2024-02-24 00:04:06.664996+00:00, run_duration=2.593341, state=success, executor_state=success, try_number=1, max_tries=1, job_id=149, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:04:01.154001+00:00, queued_by_job_id=2, pid=2243 2024-02-24T00:04:07.921590390Z [2024-02-24T00:04:07.921+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:03:00+00:00, map_index=-1, run_start_date=2024-02-24 00:04:04.583866+00:00, run_end_date=2024-02-24 00:04:06.696063+00:00, run_duration=2.112197, state=success, executor_state=success, try_number=1, max_tries=1, job_id=151, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:04:01.154001+00:00, queued_by_job_id=2, pid=2265 2024-02-24T00:04:07.921924285Z [2024-02-24T00:04:07.921+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:03:00+00:00, map_index=-1, run_start_date=2024-02-24 00:04:04.286244+00:00, run_end_date=2024-02-24 00:04:07.480342+00:00, run_duration=3.194098, state=success, executor_state=success, try_number=1, max_tries=1, job_id=150, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:04:01.154001+00:00, queued_by_job_id=2, pid=2249 2024-02-24T00:04:08.979850275Z [2024-02-24T00:04:08.979+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:04:08.980257132Z [2024-02-24T00:04:08.979+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:03:00+00:00, run_id=scheduled__2024-02-24T00:03:00+00:00, run_start_date=2024-02-24 00:04:01.008000+00:00, run_end_date=2024-02-24 00:04:08.979624+00:00, run_duration=7.971624, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:03:00+00:00, data_interval_end=2024-02-24 00:04:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:04:08.996038029Z [2024-02-24T00:04:08.995+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:04:00+00:00, run_after=2024-02-24T00:05:00+00:00 2024-02-24T00:04:09.047093464Z [2024-02-24T00:04:09.046+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:03:00+00:00 exited with status success for try_number 1 2024-02-24T00:04:09.058304181Z [2024-02-24T00:04:09.057+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:03:00+00:00, map_index=-1, run_start_date=2024-02-24 00:04:04.759910+00:00, run_end_date=2024-02-24 00:04:07.954938+00:00, run_duration=3.195028, state=success, executor_state=success, try_number=1, max_tries=1, job_id=152, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:04:01.154001+00:00, queued_by_job_id=2, pid=2266 2024-02-24T00:05:00.849024723Z [2024-02-24T00:05:00.848+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:05:00.865055782Z [2024-02-24T00:05:00.864+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 to 2024-02-24T00:05:00+00:00, run_after=2024-02-24T00:10:00+00:00 2024-02-24T00:05:00.887129195Z [2024-02-24T00:05:00.886+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:05:00+00:00, run_after=2024-02-24T00:10:00+00:00 2024-02-24T00:05:00.913889648Z [2024-02-24T00:05:00.913+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99 to 2024-02-24T00:05:00+00:00, run_after=2024-02-24T00:06:00+00:00 2024-02-24T00:05:00.930319961Z [2024-02-24T00:05:00.929+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:05:00+00:00, run_after=2024-02-24T00:06:00+00:00 2024-02-24T00:05:00.939681866Z [2024-02-24T00:05:00.939+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:05:00.952316016Z [2024-02-24T00:05:00.951+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:05:00+00:00, run_after=2024-02-24T00:06:00+00:00 2024-02-24T00:05:01.121733814Z [2024-02-24T00:05:01.121+0000] {scheduler_job.py:360} INFO - 7 tasks up for execution: 2024-02-24T00:05:01.121814223Z 2024-02-24T00:05:01.121824100Z 2024-02-24T00:05:01.121831439Z 2024-02-24T00:05:01.121836295Z 2024-02-24T00:05:01.121859388Z 2024-02-24T00:05:01.121864190Z 2024-02-24T00:05:01.121868943Z 2024-02-24T00:05:01.122001225Z [2024-02-24T00:05:01.121+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 has 0/16 running and queued tasks 2024-02-24T00:05:01.122225288Z [2024-02-24T00:05:01.121+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:05:01.122424929Z [2024-02-24T00:05:01.122+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 has 0/16 running and queued tasks 2024-02-24T00:05:01.122612852Z [2024-02-24T00:05:01.122+0000] {scheduler_job.py:425} INFO - DAG vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99 has 0/16 running and queued tasks 2024-02-24T00:05:01.122900457Z [2024-02-24T00:05:01.122+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:05:01.123124067Z [2024-02-24T00:05:01.122+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:05:01.123357586Z [2024-02-24T00:05:01.123+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:05:01.124254711Z [2024-02-24T00:05:01.124+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:05:01.124263937Z 2024-02-24T00:05:01.124267233Z 2024-02-24T00:05:01.124270280Z 2024-02-24T00:05:01.124273542Z 2024-02-24T00:05:01.124276781Z 2024-02-24T00:05:01.124279754Z 2024-02-24T00:05:01.124282929Z 2024-02-24T00:05:01.132555365Z [2024-02-24T00:05:01.132+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T00:05:01.132758238Z [2024-02-24T00:05:01.132+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:05:01.133254886Z [2024-02-24T00:05:01.132+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T00:05:01.133476332Z [2024-02-24T00:05:01.133+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:05:01.134088245Z [2024-02-24T00:05:01.133+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:05:01.134477379Z [2024-02-24T00:05:01.134+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:05:01.135058298Z [2024-02-24T00:05:01.134+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:05:01.135335040Z [2024-02-24T00:05:01.135+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:05:01.135786257Z [2024-02-24T00:05:01.135+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:05:01.136051513Z [2024-02-24T00:05:01.135+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:05:01.136524742Z [2024-02-24T00:05:01.136+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:05:01.136773908Z [2024-02-24T00:05:01.136+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:05:01.137190474Z [2024-02-24T00:05:01.136+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:05:01.137480658Z [2024-02-24T00:05:01.137+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:05:02.196077619Z [2024-02-24T00:05:02.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T00:00:00+00:00 exited with status queued for try_number 1 2024-02-24T00:05:02.196764927Z [2024-02-24T00:05:02.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T00:00:00+00:00 exited with status queued for try_number 1 2024-02-24T00:05:02.197325915Z [2024-02-24T00:05:02.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:04:00+00:00 exited with status queued for try_number 1 2024-02-24T00:05:02.197530571Z [2024-02-24T00:05:02.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:04:00+00:00 exited with status queued for try_number 1 2024-02-24T00:05:02.197722354Z [2024-02-24T00:05:02.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:04:00+00:00 exited with status queued for try_number 1 2024-02-24T00:05:02.198000247Z [2024-02-24T00:05:02.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:04:00+00:00 exited with status queued for try_number 1 2024-02-24T00:05:02.198210678Z [2024-02-24T00:05:02.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:04:00+00:00 exited with status queued for try_number 1 2024-02-24T00:05:02.231459285Z [2024-02-24T00:05:02.231+0000] {scheduler_job.py:635} INFO - Setting external_id for to 795decc4-5366-4f8b-bae4-ce112a1b2313 2024-02-24T00:05:02.231762519Z [2024-02-24T00:05:02.231+0000] {scheduler_job.py:635} INFO - Setting external_id for to 902d5704-71f8-4f90-b495-bf0848ed22e6 2024-02-24T00:05:02.232004096Z [2024-02-24T00:05:02.231+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d99b0dd-fbd5-42d0-b759-7f40b4e08d03 2024-02-24T00:05:02.232261046Z [2024-02-24T00:05:02.232+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5de045e3-b004-4da5-b995-43283377475e 2024-02-24T00:05:02.232492722Z [2024-02-24T00:05:02.232+0000] {scheduler_job.py:635} INFO - Setting external_id for to 01840df5-ef7b-414d-bf4f-36173b250930 2024-02-24T00:05:02.232713952Z [2024-02-24T00:05:02.232+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc22a7ef-4cd9-4948-9a27-46ab630f850b 2024-02-24T00:05:02.232981466Z [2024-02-24T00:05:02.232+0000] {scheduler_job.py:635} INFO - Setting external_id for to c7aa8930-8740-4d08-bdc0-fefee1d06868 2024-02-24T00:05:04.629824910Z [2024-02-24T00:05:04.629+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:05:04.630112384Z [2024-02-24T00:05:04.629+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:04:00+00:00, run_id=scheduled__2024-02-24T00:04:00+00:00, run_start_date=2024-02-24 00:05:00.976136+00:00, run_end_date=2024-02-24 00:05:04.629753+00:00, run_duration=3.653617, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:04:00+00:00, data_interval_end=2024-02-24 00:05:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:05:04.644010425Z [2024-02-24T00:05:04.643+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:05:00+00:00, run_after=2024-02-24T00:06:00+00:00 2024-02-24T00:05:04.832203976Z [2024-02-24T00:05:04.831+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:04:00+00:00 exited with status success for try_number 1 2024-02-24T00:05:04.844358028Z [2024-02-24T00:05:04.844+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:04:00+00:00, map_index=-1, run_start_date=2024-02-24 00:05:03.164339+00:00, run_end_date=2024-02-24 00:05:03.981391+00:00, run_duration=0.817052, state=success, executor_state=success, try_number=1, max_tries=1, job_id=153, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:05:01.126438+00:00, queued_by_job_id=2, pid=2304 2024-02-24T00:05:06.059603832Z [2024-02-24T00:05:06.059+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-02-24T00:05:06.059637006Z 2024-02-24T00:05:06.059642713Z 2024-02-24T00:05:06.059665317Z [2024-02-24T00:05:06.059+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 has 0/16 running and queued tasks 2024-02-24T00:05:06.059799162Z [2024-02-24T00:05:06.059+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:05:06.060436461Z [2024-02-24T00:05:06.060+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:05:06.060445460Z 2024-02-24T00:05:06.060449028Z 2024-02-24T00:05:06.063838230Z [2024-02-24T00:05:06.063+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', task_id='split_metrics', run_id='scheduled__2024-02-24T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T00:05:06.063977481Z [2024-02-24T00:05:06.063+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'split_metrics', 'scheduled__2024-02-24T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:05:06.064230328Z [2024-02-24T00:05:06.064+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T00:05:06.064337212Z [2024-02-24T00:05:06.064+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:05:06.208157429Z [2024-02-24T00:05:06.207+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.split_metrics run_id=scheduled__2024-02-24T00:00:00+00:00 exited with status queued for try_number 1 2024-02-24T00:05:06.208324439Z [2024-02-24T00:05:06.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T00:00:00+00:00 exited with status queued for try_number 1 2024-02-24T00:05:06.208475401Z [2024-02-24T00:05:06.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T00:00:00+00:00 exited with status success for try_number 1 2024-02-24T00:05:06.208584329Z [2024-02-24T00:05:06.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T00:00:00+00:00 exited with status success for try_number 1 2024-02-24T00:05:06.222954352Z [2024-02-24T00:05:06.222+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T00:00:00+00:00, map_index=-1, run_start_date=2024-02-24 00:05:04.304534+00:00, run_end_date=2024-02-24 00:05:04.974138+00:00, run_duration=0.669604, state=success, executor_state=success, try_number=1, max_tries=1, job_id=155, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:05:01.126438+00:00, queued_by_job_id=2, pid=2325 2024-02-24T00:05:06.223060801Z [2024-02-24T00:05:06.222+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T00:00:00+00:00, map_index=-1, run_start_date=2024-02-24 00:05:04.090452+00:00, run_end_date=2024-02-24 00:05:04.691265+00:00, run_duration=0.600813, state=success, executor_state=success, try_number=1, max_tries=1, job_id=154, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:05:01.126438+00:00, queued_by_job_id=2, pid=2324 2024-02-24T00:05:06.223277256Z [2024-02-24T00:05:06.223+0000] {scheduler_job.py:635} INFO - Setting external_id for to c56f59d1-1a99-4d3b-bd2d-9190faf9dec3 2024-02-24T00:05:06.223368213Z [2024-02-24T00:05:06.223+0000] {scheduler_job.py:635} INFO - Setting external_id for to e131313e-dfa4-4fd5-a29e-8af09efd0003 2024-02-24T00:05:07.406685356Z [2024-02-24T00:05:07.406+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:05:07.407175136Z [2024-02-24T00:05:07.406+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:04:00+00:00, run_id=scheduled__2024-02-24T00:04:00+00:00, run_start_date=2024-02-24 00:05:00.981423+00:00, run_end_date=2024-02-24 00:05:07.406560+00:00, run_duration=6.425137, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:04:00+00:00, data_interval_end=2024-02-24 00:05:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:05:07.417889976Z [2024-02-24T00:05:07.417+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:05:00+00:00, run_after=2024-02-24T00:06:00+00:00 2024-02-24T00:05:07.428169377Z [2024-02-24T00:05:07.427+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:05:07.428480996Z [2024-02-24T00:05:07.428+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:04:00+00:00, run_id=scheduled__2024-02-24T00:04:00+00:00, run_start_date=2024-02-24 00:05:00.979854+00:00, run_end_date=2024-02-24 00:05:07.428011+00:00, run_duration=6.448157, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:04:00+00:00, data_interval_end=2024-02-24 00:05:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:05:07.438640959Z [2024-02-24T00:05:07.438+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:05:00+00:00, run_after=2024-02-24T00:06:00+00:00 2024-02-24T00:05:07.450890659Z [2024-02-24T00:05:07.450+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:05:07.451222885Z [2024-02-24T00:05:07.450+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99, execution_date=2024-02-24 00:04:00+00:00, run_id=scheduled__2024-02-24T00:04:00+00:00, run_start_date=2024-02-24 00:05:00.974130+00:00, run_end_date=2024-02-24 00:05:07.450764+00:00, run_duration=6.476634, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:04:00+00:00, data_interval_end=2024-02-24 00:05:00+00:00, dag_hash=a6c60e86361ec5e1ca8caa2393de1e74 2024-02-24T00:05:07.464803689Z [2024-02-24T00:05:07.464+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99 to 2024-02-24T00:05:00+00:00, run_after=2024-02-24T00:06:00+00:00 2024-02-24T00:05:07.476671719Z [2024-02-24T00:05:07.476+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:05:07.477064608Z [2024-02-24T00:05:07.476+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99, execution_date=2024-02-24 00:04:00+00:00, run_id=scheduled__2024-02-24T00:04:00+00:00, run_start_date=2024-02-24 00:05:00.978103+00:00, run_end_date=2024-02-24 00:05:07.476567+00:00, run_duration=6.498464, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:04:00+00:00, data_interval_end=2024-02-24 00:05:00+00:00, dag_hash=eae4783770389de0b2ebbc0ed9593a4f 2024-02-24T00:05:07.487324916Z [2024-02-24T00:05:07.486+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 to 2024-02-24T00:05:00+00:00, run_after=2024-02-24T00:06:00+00:00 2024-02-24T00:05:07.572266302Z [2024-02-24T00:05:07.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:04:00+00:00 exited with status success for try_number 1 2024-02-24T00:05:07.572594431Z [2024-02-24T00:05:07.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:04:00+00:00 exited with status success for try_number 1 2024-02-24T00:05:07.573187403Z [2024-02-24T00:05:07.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:04:00+00:00 exited with status success for try_number 1 2024-02-24T00:05:07.573567954Z [2024-02-24T00:05:07.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:04:00+00:00 exited with status success for try_number 1 2024-02-24T00:05:07.588269096Z [2024-02-24T00:05:07.587+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:04:00+00:00, map_index=-1, run_start_date=2024-02-24 00:05:05.118530+00:00, run_end_date=2024-02-24 00:05:07.031833+00:00, run_duration=1.913303, state=success, executor_state=success, try_number=1, max_tries=1, job_id=158, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:05:01.126438+00:00, queued_by_job_id=2, pid=2358 2024-02-24T00:05:07.588698844Z [2024-02-24T00:05:07.588+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:04:00+00:00, map_index=-1, run_start_date=2024-02-24 00:05:05.296195+00:00, run_end_date=2024-02-24 00:05:06.927950+00:00, run_duration=1.631755, state=success, executor_state=success, try_number=1, max_tries=1, job_id=159, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:05:01.126438+00:00, queued_by_job_id=2, pid=2364 2024-02-24T00:05:07.589244711Z [2024-02-24T00:05:07.588+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:04:00+00:00, map_index=-1, run_start_date=2024-02-24 00:05:05.091735+00:00, run_end_date=2024-02-24 00:05:06.984919+00:00, run_duration=1.893184, state=success, executor_state=success, try_number=1, max_tries=1, job_id=157, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:05:01.126438+00:00, queued_by_job_id=2, pid=2357 2024-02-24T00:05:07.589631546Z [2024-02-24T00:05:07.589+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:04:00+00:00, map_index=-1, run_start_date=2024-02-24 00:05:04.852682+00:00, run_end_date=2024-02-24 00:05:06.462987+00:00, run_duration=1.610305, state=success, executor_state=success, try_number=1, max_tries=1, job_id=156, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:05:01.126438+00:00, queued_by_job_id=2, pid=2351 2024-02-24T00:05:08.690466182Z [2024-02-24T00:05:08.690+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-02-24T00:05:08.690499634Z 2024-02-24T00:05:08.690504987Z 2024-02-24T00:05:08.690875462Z [2024-02-24T00:05:08.690+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 has 0/16 running and queued tasks 2024-02-24T00:05:08.691110702Z [2024-02-24T00:05:08.690+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:05:08.691950280Z [2024-02-24T00:05:08.691+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:05:08.691965151Z 2024-02-24T00:05:08.691974531Z 2024-02-24T00:05:08.695978553Z [2024-02-24T00:05:08.695+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', task_id='collect_metrics', run_id='scheduled__2024-02-24T00:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T00:05:08.696367266Z [2024-02-24T00:05:08.695+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'collect_metrics', 'scheduled__2024-02-24T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T00:05:08.697097993Z [2024-02-24T00:05:08.696+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T00:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T00:05:08.697417314Z [2024-02-24T00:05:08.697+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T00:05:08.894130039Z [2024-02-24T00:05:08.893+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.collect_metrics run_id=scheduled__2024-02-24T00:00:00+00:00 exited with status queued for try_number 1 2024-02-24T00:05:08.894233602Z [2024-02-24T00:05:08.894+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T00:00:00+00:00 exited with status queued for try_number 1 2024-02-24T00:05:08.894401078Z [2024-02-24T00:05:08.894+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.split_metrics run_id=scheduled__2024-02-24T00:00:00+00:00 exited with status success for try_number 1 2024-02-24T00:05:08.894547225Z [2024-02-24T00:05:08.894+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T00:00:00+00:00 exited with status success for try_number 1 2024-02-24T00:05:08.904090466Z [2024-02-24T00:05:08.903+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=split_metrics, run_id=scheduled__2024-02-24T00:00:00+00:00, map_index=-1, run_start_date=2024-02-24 00:05:07.894351+00:00, run_end_date=2024-02-24 00:05:08.208016+00:00, run_duration=0.313665, state=success, executor_state=success, try_number=1, max_tries=1, job_id=161, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:05:06.061008+00:00, queued_by_job_id=2, pid=2395 2024-02-24T00:05:08.904464641Z [2024-02-24T00:05:08.904+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T00:00:00+00:00, map_index=-1, run_start_date=2024-02-24 00:05:07.838661+00:00, run_end_date=2024-02-24 00:05:08.179967+00:00, run_duration=0.341306, state=success, executor_state=success, try_number=1, max_tries=1, job_id=160, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:05:06.061008+00:00, queued_by_job_id=2, pid=2394 2024-02-24T00:05:08.905363205Z [2024-02-24T00:05:08.904+0000] {scheduler_job.py:635} INFO - Setting external_id for to b32105f5-e84a-4696-8ac0-a258061a9516 2024-02-24T00:05:08.906098748Z [2024-02-24T00:05:08.905+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1735ec69-d62f-44e8-826c-0bc562725a0f 2024-02-24T00:05:11.166541047Z [2024-02-24T00:05:11.166+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-02-24T00:05:11.166567751Z 2024-02-24T00:05:11.166571372Z 2024-02-24T00:05:11.166713913Z [2024-02-24T00:05:11.166+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 has 0/16 running and queued tasks 2024-02-24T00:05:11.166854422Z [2024-02-24T00:05:11.166+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:05:11.167529725Z [2024-02-24T00:05:11.167+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:05:11.167538647Z 2024-02-24T00:05:11.167541833Z 2024-02-24T00:05:11.170208354Z [2024-02-24T00:05:11.169+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', task_id='send_prometheus', run_id='scheduled__2024-02-24T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:05:11.170344761Z [2024-02-24T00:05:11.170+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'send_prometheus', 'scheduled__2024-02-24T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:05:11.170633917Z [2024-02-24T00:05:11.170+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:05:11.170771694Z [2024-02-24T00:05:11.170+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:05:11.386282021Z [2024-02-24T00:05:11.385+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.send_prometheus run_id=scheduled__2024-02-24T00:00:00+00:00 exited with status queued for try_number 1 2024-02-24T00:05:11.386449934Z [2024-02-24T00:05:11.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T00:00:00+00:00 exited with status queued for try_number 1 2024-02-24T00:05:11.386599244Z [2024-02-24T00:05:11.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.collect_metrics run_id=scheduled__2024-02-24T00:00:00+00:00 exited with status success for try_number 1 2024-02-24T00:05:11.386788441Z [2024-02-24T00:05:11.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T00:00:00+00:00 exited with status success for try_number 1 2024-02-24T00:05:11.395509113Z [2024-02-24T00:05:11.395+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d1e1529-7b1b-4c2f-84d0-ccc73c2c1bca 2024-02-24T00:05:11.395762311Z [2024-02-24T00:05:11.395+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T00:00:00+00:00, map_index=0, run_start_date=2024-02-24 00:05:10.344971+00:00, run_end_date=2024-02-24 00:05:10.679281+00:00, run_duration=0.33431, state=success, executor_state=success, try_number=1, max_tries=1, job_id=162, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:05:08.692715+00:00, queued_by_job_id=2, pid=2410 2024-02-24T00:05:11.396029130Z [2024-02-24T00:05:11.395+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=collect_metrics, run_id=scheduled__2024-02-24T00:00:00+00:00, map_index=0, run_start_date=2024-02-24 00:05:10.358897+00:00, run_end_date=2024-02-24 00:05:10.737145+00:00, run_duration=0.378248, state=success, executor_state=success, try_number=1, max_tries=1, job_id=163, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:05:08.692715+00:00, queued_by_job_id=2, pid=2411 2024-02-24T00:05:11.396228996Z [2024-02-24T00:05:11.396+0000] {scheduler_job.py:635} INFO - Setting external_id for to 01f8106a-29eb-4c45-885e-3288774047c0 2024-02-24T00:05:13.627612193Z [2024-02-24T00:05:13.626+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:05:13.627673369Z [2024-02-24T00:05:13.626+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99, execution_date=2024-02-24 00:00:00+00:00, run_id=scheduled__2024-02-24T00:00:00+00:00, run_start_date=2024-02-24 00:05:00.971563+00:00, run_end_date=2024-02-24 00:05:13.626395+00:00, run_duration=12.654832, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:00:00+00:00, data_interval_end=2024-02-24 00:05:00+00:00, dag_hash=ee72125b786422203fda616907506950 2024-02-24T00:05:13.633988651Z [2024-02-24T00:05:13.633+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 to 2024-02-24T00:05:00+00:00, run_after=2024-02-24T00:10:00+00:00 2024-02-24T00:05:13.640826976Z [2024-02-24T00:05:13.640+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:05:13.640905787Z [2024-02-24T00:05:13.640+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:00:00+00:00, run_id=scheduled__2024-02-24T00:00:00+00:00, run_start_date=2024-02-24 00:05:00.969079+00:00, run_end_date=2024-02-24 00:05:13.640671+00:00, run_duration=12.671592, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:00:00+00:00, data_interval_end=2024-02-24 00:05:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T00:05:13.647210959Z [2024-02-24T00:05:13.646+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:05:00+00:00, run_after=2024-02-24T00:10:00+00:00 2024-02-24T00:05:13.674625743Z [2024-02-24T00:05:13.674+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.send_prometheus run_id=scheduled__2024-02-24T00:00:00+00:00 exited with status success for try_number 1 2024-02-24T00:05:13.675007846Z [2024-02-24T00:05:13.674+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T00:00:00+00:00 exited with status success for try_number 1 2024-02-24T00:05:13.690456924Z [2024-02-24T00:05:13.689+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=send_prometheus, run_id=scheduled__2024-02-24T00:00:00+00:00, map_index=-1, run_start_date=2024-02-24 00:05:12.908687+00:00, run_end_date=2024-02-24 00:05:13.255716+00:00, run_duration=0.347029, state=success, executor_state=success, try_number=1, max_tries=1, job_id=164, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:05:11.167999+00:00, queued_by_job_id=2, pid=2426 2024-02-24T00:05:13.693158162Z [2024-02-24T00:05:13.692+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T00:00:00+00:00, map_index=-1, run_start_date=2024-02-24 00:05:13.071529+00:00, run_end_date=2024-02-24 00:05:13.456031+00:00, run_duration=0.384502, state=success, executor_state=success, try_number=1, max_tries=1, job_id=165, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:05:11.167999+00:00, queued_by_job_id=2, pid=2427 2024-02-24T00:06:00.729562026Z [2024-02-24T00:06:00.728+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:06:00.752002566Z [2024-02-24T00:06:00.751+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99 to 2024-02-24T00:06:00+00:00, run_after=2024-02-24T00:07:00+00:00 2024-02-24T00:06:00.766321029Z [2024-02-24T00:06:00.765+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:06:00.779588284Z [2024-02-24T00:06:00.779+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:06:00.800219527Z [2024-02-24T00:06:00.799+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:06:00+00:00, run_after=2024-02-24T00:07:00+00:00 2024-02-24T00:06:00.818905490Z [2024-02-24T00:06:00.818+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:06:00+00:00, run_after=2024-02-24T00:07:00+00:00 2024-02-24T00:06:00.917267854Z [2024-02-24T00:06:00.916+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-02-24T00:06:00.917295610Z 2024-02-24T00:06:00.917300836Z 2024-02-24T00:06:00.917304612Z 2024-02-24T00:06:00.917308191Z 2024-02-24T00:06:00.917311795Z 2024-02-24T00:06:00.917315234Z 2024-02-24T00:06:00.917341267Z [2024-02-24T00:06:00.917+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T00:06:00.917355781Z [2024-02-24T00:06:00.917+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:06:00.917359656Z [2024-02-24T00:06:00.917+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:06:00.917464013Z [2024-02-24T00:06:00.917+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 has 0/16 running and queued tasks 2024-02-24T00:06:00.917515894Z [2024-02-24T00:06:00.917+0000] {scheduler_job.py:425} INFO - DAG vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99 has 0/16 running and queued tasks 2024-02-24T00:06:00.917630114Z [2024-02-24T00:06:00.917+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:06:00.918355890Z [2024-02-24T00:06:00.918+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:06:00.918391326Z 2024-02-24T00:06:00.918422750Z 2024-02-24T00:06:00.918433273Z 2024-02-24T00:06:00.918442689Z 2024-02-24T00:06:00.918452945Z 2024-02-24T00:06:00.918462621Z 2024-02-24T00:06:00.922897552Z [2024-02-24T00:06:00.922+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:06:00.922935988Z [2024-02-24T00:06:00.922+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T00:06:00.923059351Z [2024-02-24T00:06:00.922+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:06:00.923073536Z [2024-02-24T00:06:00.922+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:06:00.923700575Z [2024-02-24T00:06:00.923+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:06:00.923726482Z [2024-02-24T00:06:00.923+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:06:00.923732449Z [2024-02-24T00:06:00.923+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:06:00.923736840Z [2024-02-24T00:06:00.923+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:06:00.923773071Z [2024-02-24T00:06:00.923+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:06:00.923778151Z [2024-02-24T00:06:00.923+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:06:00.923947920Z [2024-02-24T00:06:00.923+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:06:00.924044409Z [2024-02-24T00:06:00.923+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:06:01.546342045Z [2024-02-24T00:06:01.545+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:04:00+00:00 exited with status queued for try_number 1 2024-02-24T00:06:01.546843248Z [2024-02-24T00:06:01.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:05:00+00:00 exited with status queued for try_number 1 2024-02-24T00:06:01.546999339Z [2024-02-24T00:06:01.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:05:00+00:00 exited with status queued for try_number 1 2024-02-24T00:06:01.547124475Z [2024-02-24T00:06:01.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:05:00+00:00 exited with status queued for try_number 1 2024-02-24T00:06:01.547253484Z [2024-02-24T00:06:01.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:05:00+00:00 exited with status queued for try_number 1 2024-02-24T00:06:01.547392715Z [2024-02-24T00:06:01.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:05:00+00:00 exited with status queued for try_number 1 2024-02-24T00:06:01.566895994Z [2024-02-24T00:06:01.566+0000] {scheduler_job.py:635} INFO - Setting external_id for to 914111c9-65a0-4f31-a890-cc373a47b824 2024-02-24T00:06:01.567182869Z [2024-02-24T00:06:01.567+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e76d51f-5131-4a1e-9b23-07fab7ba7435 2024-02-24T00:06:01.567432332Z [2024-02-24T00:06:01.567+0000] {scheduler_job.py:635} INFO - Setting external_id for to de08f9a3-f56a-49de-89e4-d038aedce17e 2024-02-24T00:06:01.567634794Z [2024-02-24T00:06:01.567+0000] {scheduler_job.py:635} INFO - Setting external_id for to 42be071c-b238-4b64-9dad-fd7da3b95a3e 2024-02-24T00:06:01.567865413Z [2024-02-24T00:06:01.567+0000] {scheduler_job.py:635} INFO - Setting external_id for to d17b1f8c-f8cc-463a-98b2-638aa24b5cdb 2024-02-24T00:06:01.568038803Z [2024-02-24T00:06:01.567+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0c23b00e-f65f-429f-8afb-1621856567bf 2024-02-24T00:06:02.975876702Z [2024-02-24T00:06:02.975+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:06:02.978615093Z [2024-02-24T00:06:02.975+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 00:04:00+00:00, run_id=scheduled__2024-02-24T00:04:00+00:00, run_start_date=2024-02-24 00:06:00.833187+00:00, run_end_date=2024-02-24 00:06:02.975772+00:00, run_duration=2.142585, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:04:00+00:00, data_interval_end=2024-02-24 00:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T00:06:02.991964338Z [2024-02-24T00:06:02.991+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T00:06:00+00:00, run_after=2024-02-24T00:08:00+00:00 2024-02-24T00:06:03.047964396Z [2024-02-24T00:06:03.047+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:06:03.048147473Z [2024-02-24T00:06:03.047+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:05:00+00:00, run_id=scheduled__2024-02-24T00:05:00+00:00, run_start_date=2024-02-24 00:06:00.834489+00:00, run_end_date=2024-02-24 00:06:03.047877+00:00, run_duration=2.213388, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:05:00+00:00, data_interval_end=2024-02-24 00:06:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:06:03.060038062Z [2024-02-24T00:06:03.059+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:06:00+00:00, run_after=2024-02-24T00:07:00+00:00 2024-02-24T00:06:03.122724265Z [2024-02-24T00:06:03.122+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:04:00+00:00 exited with status success for try_number 1 2024-02-24T00:06:03.159845833Z [2024-02-24T00:06:03.159+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T00:04:00+00:00, map_index=-1, run_start_date=2024-02-24 00:06:02.038623+00:00, run_end_date=2024-02-24 00:06:02.749083+00:00, run_duration=0.71046, state=success, executor_state=success, try_number=1, max_tries=1, job_id=166, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:06:00.919296+00:00, queued_by_job_id=2, pid=2453 2024-02-24T00:06:04.279088970Z [2024-02-24T00:06:04.278+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:05:00+00:00 exited with status success for try_number 1 2024-02-24T00:06:04.279473043Z [2024-02-24T00:06:04.279+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:05:00+00:00 exited with status failed for try_number 1 2024-02-24T00:06:04.279862940Z [2024-02-24T00:06:04.279+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:05:00+00:00 exited with status failed for try_number 1 2024-02-24T00:06:04.288156501Z [2024-02-24T00:06:04.287+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:05:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:06:00.919296+00:00, queued_by_job_id=2, pid=None 2024-02-24T00:06:04.288600194Z [2024-02-24T00:06:04.288+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-24T00:06:04.290969221Z [2024-02-24T00:06:04.290+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-24T00:06:04.305115227Z [2024-02-24T00:06:04.304+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240224T000500, start_date=, end_date=20240224T000604 2024-02-24T00:06:04.321149760Z [2024-02-24T00:06:04.320+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:05:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:06:00.919296+00:00, queued_by_job_id=2, pid=None 2024-02-24T00:06:04.321418181Z [2024-02-24T00:06:04.321+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-24T00:06:04.323875004Z [2024-02-24T00:06:04.323+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-24T00:06:04.378129623Z [2024-02-24T00:06:04.376+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240224T000500, start_date=, end_date=20240224T000604 2024-02-24T00:06:04.398027169Z [2024-02-24T00:06:04.396+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:05:00+00:00, map_index=-1, run_start_date=2024-02-24 00:06:02.260819+00:00, run_end_date=2024-02-24 00:06:02.979825+00:00, run_duration=0.719006, state=success, executor_state=success, try_number=1, max_tries=1, job_id=167, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:06:00.919296+00:00, queued_by_job_id=2, pid=2454 2024-02-24T00:06:06.706330064Z [2024-02-24T00:06:06.705+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:06:06.707223060Z [2024-02-24T00:06:06.706+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:05:00+00:00, run_id=scheduled__2024-02-24T00:05:00+00:00, run_start_date=2024-02-24 00:06:00.835538+00:00, run_end_date=2024-02-24 00:06:06.706560+00:00, run_duration=5.871022, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:05:00+00:00, data_interval_end=2024-02-24 00:06:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:06:06.720927224Z [2024-02-24T00:06:06.720+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:06:00+00:00, run_after=2024-02-24T00:07:00+00:00 2024-02-24T00:06:06.803135750Z [2024-02-24T00:06:06.802+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:05:00+00:00 exited with status success for try_number 1 2024-02-24T00:06:06.811519202Z [2024-02-24T00:06:06.811+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:05:00+00:00, map_index=-1, run_start_date=2024-02-24 00:06:03.765370+00:00, run_end_date=2024-02-24 00:06:06.544614+00:00, run_duration=2.779244, state=success, executor_state=success, try_number=1, max_tries=1, job_id=168, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:06:00.919296+00:00, queued_by_job_id=2, pid=2489 2024-02-24T00:06:09.036243778Z [2024-02-24T00:06:09.035+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:06:09.037008456Z [2024-02-24T00:06:09.036+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:05:00+00:00, run_id=scheduled__2024-02-24T00:05:00+00:00, run_start_date=2024-02-24 00:06:00.837728+00:00, run_end_date=2024-02-24 00:06:09.036392+00:00, run_duration=8.198664, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:05:00+00:00, data_interval_end=2024-02-24 00:06:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:06:09.051511279Z [2024-02-24T00:06:09.051+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:06:00+00:00, run_after=2024-02-24T00:07:00+00:00 2024-02-24T00:06:09.133653089Z [2024-02-24T00:06:09.133+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:05:00+00:00 exited with status success for try_number 1 2024-02-24T00:06:09.144494642Z [2024-02-24T00:06:09.143+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:05:00+00:00, map_index=-1, run_start_date=2024-02-24 00:06:03.937875+00:00, run_end_date=2024-02-24 00:06:08.085531+00:00, run_duration=4.147656, state=success, executor_state=success, try_number=1, max_tries=1, job_id=169, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:06:00.919296+00:00, queued_by_job_id=2, pid=2500 2024-02-24T00:06:15.185480438Z [2024-02-24T00:06:15.184+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-02-24T00:06:15.185538947Z 2024-02-24T00:06:15.185549887Z 2024-02-24T00:06:15.185653148Z [2024-02-24T00:06:15.185+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 has 0/16 running and queued tasks 2024-02-24T00:06:15.185761907Z [2024-02-24T00:06:15.185+0000] {scheduler_job.py:425} INFO - DAG vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99 has 0/16 running and queued tasks 2024-02-24T00:06:15.187220439Z [2024-02-24T00:06:15.186+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:06:15.187246023Z 2024-02-24T00:06:15.187254697Z 2024-02-24T00:06:15.194578802Z [2024-02-24T00:06:15.193+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:05:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:06:15.194687596Z [2024-02-24T00:06:15.194+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:06:15.195399953Z [2024-02-24T00:06:15.194+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:05:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:06:15.195696442Z [2024-02-24T00:06:15.195+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:06:15.359757225Z [2024-02-24T00:06:15.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:05:00+00:00 exited with status queued for try_number 2 2024-02-24T00:06:15.359995836Z [2024-02-24T00:06:15.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:05:00+00:00 exited with status queued for try_number 2 2024-02-24T00:06:15.366898210Z [2024-02-24T00:06:15.366+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6d0736b3-f6a5-450d-b8c5-10ab6daa534b 2024-02-24T00:06:15.367309398Z [2024-02-24T00:06:15.367+0000] {scheduler_job.py:635} INFO - Setting external_id for to acddc740-e7be-4304-b28a-24d3af2f437a 2024-02-24T00:06:16.985746171Z [2024-02-24T00:06:16.985+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:05:00+00:00 exited with status failed for try_number 2 2024-02-24T00:06:16.986562740Z [2024-02-24T00:06:16.985+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:05:00+00:00 exited with status failed for try_number 2 2024-02-24T00:06:16.998422638Z [2024-02-24T00:06:16.997+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:05:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-02-24 00:06:04.293390+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:06:15.188252+00:00, queued_by_job_id=2, pid=None 2024-02-24T00:06:16.999093878Z [2024-02-24T00:06:16.998+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-24T00:06:17.005053453Z [2024-02-24T00:06:17.004+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-24T00:06:17.026358113Z [2024-02-24T00:06:17.025+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240224T000500, start_date=, end_date=20240224T000617 2024-02-24T00:06:17.043354869Z [2024-02-24T00:06:17.042+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:05:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-02-24 00:06:04.330881+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:06:15.188252+00:00, queued_by_job_id=2, pid=None 2024-02-24T00:06:17.044407868Z [2024-02-24T00:06:17.043+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-24T00:06:17.048780826Z [2024-02-24T00:06:17.048+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-24T00:06:17.066631668Z [2024-02-24T00:06:17.066+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240224T000500, start_date=, end_date=20240224T000617 2024-02-24T00:06:18.139490212Z [2024-02-24T00:06:18.138+0000] {dagrun.py:586} ERROR - Marking run failed 2024-02-24T00:06:18.139874016Z [2024-02-24T00:06:18.139+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99, execution_date=2024-02-24 00:05:00+00:00, run_id=scheduled__2024-02-24T00:05:00+00:00, run_start_date=2024-02-24 00:06:00.838790+00:00, run_end_date=2024-02-24 00:06:18.139143+00:00, run_duration=17.300353, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:05:00+00:00, data_interval_end=2024-02-24 00:06:00+00:00, dag_hash=eae4783770389de0b2ebbc0ed9593a4f 2024-02-24T00:06:18.150970087Z [2024-02-24T00:06:18.150+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 to 2024-02-24T00:06:00+00:00, run_after=2024-02-24T00:07:00+00:00 2024-02-24T00:06:18.160238173Z [2024-02-24T00:06:18.159+0000] {dagrun.py:586} ERROR - Marking run failed 2024-02-24T00:06:18.160318661Z [2024-02-24T00:06:18.159+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99, execution_date=2024-02-24 00:05:00+00:00, run_id=scheduled__2024-02-24T00:05:00+00:00, run_start_date=2024-02-24 00:06:00.836639+00:00, run_end_date=2024-02-24 00:06:18.159915+00:00, run_duration=17.323276, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:05:00+00:00, data_interval_end=2024-02-24 00:06:00+00:00, dag_hash=a6c60e86361ec5e1ca8caa2393de1e74 2024-02-24T00:06:18.171232351Z [2024-02-24T00:06:18.170+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99 to 2024-02-24T00:06:00+00:00, run_after=2024-02-24T00:07:00+00:00 2024-02-24T00:06:59.532497838Z [2024-02-24T00:06:59.532+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T00:07:00.578729941Z [2024-02-24T00:07:00.578+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:07:00.607756221Z [2024-02-24T00:07:00.607+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:07:00+00:00, run_after=2024-02-24T00:08:00+00:00 2024-02-24T00:07:00.617477506Z [2024-02-24T00:07:00.617+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:07:00.629569670Z [2024-02-24T00:07:00.629+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:07:00+00:00, run_after=2024-02-24T00:08:00+00:00 2024-02-24T00:07:00.641439772Z [2024-02-24T00:07:00.641+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99 to 2024-02-24T00:07:00+00:00, run_after=2024-02-24T00:08:00+00:00 2024-02-24T00:07:00.767901054Z [2024-02-24T00:07:00.767+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-02-24T00:07:00.767939446Z 2024-02-24T00:07:00.767946863Z 2024-02-24T00:07:00.767954164Z 2024-02-24T00:07:00.767960925Z 2024-02-24T00:07:00.767967687Z 2024-02-24T00:07:00.768267495Z [2024-02-24T00:07:00.767+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:07:00.768557213Z [2024-02-24T00:07:00.768+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:07:00.768790569Z [2024-02-24T00:07:00.768+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99 has 0/16 running and queued tasks 2024-02-24T00:07:00.769032084Z [2024-02-24T00:07:00.768+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:07:00.769237359Z [2024-02-24T00:07:00.769+0000] {scheduler_job.py:425} INFO - DAG vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99 has 0/16 running and queued tasks 2024-02-24T00:07:00.770617710Z [2024-02-24T00:07:00.770+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:07:00.770638516Z 2024-02-24T00:07:00.770644508Z 2024-02-24T00:07:00.770649419Z 2024-02-24T00:07:00.770654825Z 2024-02-24T00:07:00.770659923Z 2024-02-24T00:07:00.776396255Z [2024-02-24T00:07:00.776+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:07:00.776720403Z [2024-02-24T00:07:00.776+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:07:00.777200260Z [2024-02-24T00:07:00.776+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:07:00.777468090Z [2024-02-24T00:07:00.777+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:07:00.777824180Z [2024-02-24T00:07:00.777+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:07:00.778089001Z [2024-02-24T00:07:00.777+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:07:00.778494608Z [2024-02-24T00:07:00.778+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:07:00.778682303Z [2024-02-24T00:07:00.778+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:07:00.779027770Z [2024-02-24T00:07:00.778+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:07:00.779269532Z [2024-02-24T00:07:00.778+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:07:01.490884510Z [2024-02-24T00:07:01.490+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:06:00+00:00 exited with status queued for try_number 1 2024-02-24T00:07:01.490946390Z [2024-02-24T00:07:01.490+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:06:00+00:00 exited with status queued for try_number 1 2024-02-24T00:07:01.490998254Z [2024-02-24T00:07:01.490+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:06:00+00:00 exited with status queued for try_number 1 2024-02-24T00:07:01.491033551Z [2024-02-24T00:07:01.490+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:06:00+00:00 exited with status queued for try_number 1 2024-02-24T00:07:01.491097086Z [2024-02-24T00:07:01.491+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:06:00+00:00 exited with status queued for try_number 1 2024-02-24T00:07:01.508862810Z [2024-02-24T00:07:01.508+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a6915ca-9415-44fc-8f8f-b31194e9d74c 2024-02-24T00:07:01.508892899Z [2024-02-24T00:07:01.508+0000] {scheduler_job.py:635} INFO - Setting external_id for to 880e412a-7526-4a37-a70a-119a0c9d1c20 2024-02-24T00:07:01.509013792Z [2024-02-24T00:07:01.508+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35e2c5aa-9c2a-410e-a8b8-6859711448fe 2024-02-24T00:07:01.509105172Z [2024-02-24T00:07:01.508+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5ec7ae1-efa2-4f82-9d4c-f02af03c1b32 2024-02-24T00:07:01.509210762Z [2024-02-24T00:07:01.509+0000] {scheduler_job.py:635} INFO - Setting external_id for to 02a5c51d-4f3d-4a02-888c-676c29cd54d9 2024-02-24T00:07:02.830074623Z [2024-02-24T00:07:02.829+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:07:02.831663940Z [2024-02-24T00:07:02.830+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:06:00+00:00, run_id=scheduled__2024-02-24T00:06:00+00:00, run_start_date=2024-02-24 00:07:00.654378+00:00, run_end_date=2024-02-24 00:07:02.830027+00:00, run_duration=2.175649, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:06:00+00:00, data_interval_end=2024-02-24 00:07:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:07:02.853728310Z [2024-02-24T00:07:02.853+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:07:00+00:00, run_after=2024-02-24T00:08:00+00:00 2024-02-24T00:07:02.918791016Z [2024-02-24T00:07:02.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:06:00+00:00 exited with status success for try_number 1 2024-02-24T00:07:02.924798899Z [2024-02-24T00:07:02.924+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:06:00+00:00, map_index=-1, run_start_date=2024-02-24 00:07:01.873836+00:00, run_end_date=2024-02-24 00:07:02.313471+00:00, run_duration=0.439635, state=success, executor_state=success, try_number=1, max_tries=1, job_id=170, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:07:00.772204+00:00, queued_by_job_id=2, pid=2558 2024-02-24T00:07:04.091600407Z [2024-02-24T00:07:04.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:06:00+00:00 exited with status failed for try_number 1 2024-02-24T00:07:04.091863852Z [2024-02-24T00:07:04.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:06:00+00:00 exited with status failed for try_number 1 2024-02-24T00:07:04.100636748Z [2024-02-24T00:07:04.100+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:06:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:07:00.772204+00:00, queued_by_job_id=2, pid=None 2024-02-24T00:07:04.101100621Z [2024-02-24T00:07:04.100+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-24T00:07:04.104126332Z [2024-02-24T00:07:04.103+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-24T00:07:04.119537207Z [2024-02-24T00:07:04.119+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240224T000600, start_date=, end_date=20240224T000704 2024-02-24T00:07:04.129737618Z [2024-02-24T00:07:04.129+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:06:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:07:00.772204+00:00, queued_by_job_id=2, pid=None 2024-02-24T00:07:04.130313103Z [2024-02-24T00:07:04.130+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-24T00:07:04.132933479Z [2024-02-24T00:07:04.132+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-24T00:07:04.160259754Z [2024-02-24T00:07:04.159+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240224T000600, start_date=, end_date=20240224T000704 2024-02-24T00:07:05.096325241Z [2024-02-24T00:07:05.095+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:07:05.096867257Z [2024-02-24T00:07:05.096+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:06:00+00:00, run_id=scheduled__2024-02-24T00:06:00+00:00, run_start_date=2024-02-24 00:07:00.656259+00:00, run_end_date=2024-02-24 00:07:05.096165+00:00, run_duration=4.439906, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:06:00+00:00, data_interval_end=2024-02-24 00:07:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:07:05.108773980Z [2024-02-24T00:07:05.108+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:07:00+00:00, run_after=2024-02-24T00:08:00+00:00 2024-02-24T00:07:06.248127174Z [2024-02-24T00:07:06.247+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:07:06.248585658Z [2024-02-24T00:07:06.248+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:06:00+00:00, run_id=scheduled__2024-02-24T00:06:00+00:00, run_start_date=2024-02-24 00:07:00.659182+00:00, run_end_date=2024-02-24 00:07:06.247996+00:00, run_duration=5.588814, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:06:00+00:00, data_interval_end=2024-02-24 00:07:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:07:06.263439473Z [2024-02-24T00:07:06.262+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:07:00+00:00, run_after=2024-02-24T00:08:00+00:00 2024-02-24T00:07:06.315627772Z [2024-02-24T00:07:06.315+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:06:00+00:00 exited with status success for try_number 1 2024-02-24T00:07:06.315682222Z [2024-02-24T00:07:06.315+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:06:00+00:00 exited with status success for try_number 1 2024-02-24T00:07:06.323559652Z [2024-02-24T00:07:06.323+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:06:00+00:00, map_index=-1, run_start_date=2024-02-24 00:07:03.462429+00:00, run_end_date=2024-02-24 00:07:05.032046+00:00, run_duration=1.569617, state=success, executor_state=success, try_number=1, max_tries=1, job_id=172, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:07:00.772204+00:00, queued_by_job_id=2, pid=2599 2024-02-24T00:07:06.323694751Z [2024-02-24T00:07:06.323+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:06:00+00:00, map_index=-1, run_start_date=2024-02-24 00:07:03.378590+00:00, run_end_date=2024-02-24 00:07:05.351096+00:00, run_duration=1.972506, state=success, executor_state=success, try_number=1, max_tries=1, job_id=171, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:07:00.772204+00:00, queued_by_job_id=2, pid=2598 2024-02-24T00:08:00.798854402Z [2024-02-24T00:08:00.798+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:08:00.826960290Z [2024-02-24T00:08:00.826+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:08:00+00:00, run_after=2024-02-24T00:09:00+00:00 2024-02-24T00:08:00.843445413Z [2024-02-24T00:08:00.843+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:08:00+00:00, run_after=2024-02-24T00:09:00+00:00 2024-02-24T00:08:00.850997908Z [2024-02-24T00:08:00.850+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:08:00.923213198Z [2024-02-24T00:08:00.922+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T00:08:00.923243214Z 2024-02-24T00:08:00.923249552Z 2024-02-24T00:08:00.923252871Z 2024-02-24T00:08:00.923255844Z 2024-02-24T00:08:00.923569188Z [2024-02-24T00:08:00.923+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T00:08:00.923780106Z [2024-02-24T00:08:00.923+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:08:00.924012670Z [2024-02-24T00:08:00.923+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:08:00.924667015Z [2024-02-24T00:08:00.924+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:08:00.925229315Z [2024-02-24T00:08:00.925+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:08:00.925241072Z 2024-02-24T00:08:00.925244918Z 2024-02-24T00:08:00.925248319Z 2024-02-24T00:08:00.925251636Z 2024-02-24T00:08:00.929239718Z [2024-02-24T00:08:00.928+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:08:00.929369515Z [2024-02-24T00:08:00.929+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T00:08:00.929756453Z [2024-02-24T00:08:00.929+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:08:00.929996035Z [2024-02-24T00:08:00.929+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:08:00.930252674Z [2024-02-24T00:08:00.930+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:08:00.930411786Z [2024-02-24T00:08:00.930+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:08:00.930630287Z [2024-02-24T00:08:00.930+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:08:00.930864444Z [2024-02-24T00:08:00.930+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:08:01.347961359Z [2024-02-24T00:08:01.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:06:00+00:00 exited with status queued for try_number 1 2024-02-24T00:08:01.348215810Z [2024-02-24T00:08:01.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:07:00+00:00 exited with status queued for try_number 1 2024-02-24T00:08:01.348391093Z [2024-02-24T00:08:01.348+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:07:00+00:00 exited with status queued for try_number 1 2024-02-24T00:08:01.348557027Z [2024-02-24T00:08:01.348+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:07:00+00:00 exited with status queued for try_number 1 2024-02-24T00:08:01.357181574Z [2024-02-24T00:08:01.356+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2a79351f-2fe7-48c5-b027-ec25d3e2d71e 2024-02-24T00:08:01.357423111Z [2024-02-24T00:08:01.357+0000] {scheduler_job.py:635} INFO - Setting external_id for to a98582b4-8a68-47e0-bb23-b43ea94d3093 2024-02-24T00:08:01.357632125Z [2024-02-24T00:08:01.357+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9824f8ed-e8fa-491d-ba5b-023bb3a1a572 2024-02-24T00:08:01.357868195Z [2024-02-24T00:08:01.357+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22790e60-e930-4c1a-80be-4f5daf6adbe5 2024-02-24T00:08:02.598679923Z [2024-02-24T00:08:02.598+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:08:02.599069669Z [2024-02-24T00:08:02.598+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 00:06:00+00:00, run_id=scheduled__2024-02-24T00:06:00+00:00, run_start_date=2024-02-24 00:08:00.863042+00:00, run_end_date=2024-02-24 00:08:02.598723+00:00, run_duration=1.735681, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:06:00+00:00, data_interval_end=2024-02-24 00:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T00:08:02.609764099Z [2024-02-24T00:08:02.609+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T00:08:00+00:00, run_after=2024-02-24T00:10:00+00:00 2024-02-24T00:08:02.757688373Z [2024-02-24T00:08:02.757+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:06:00+00:00 exited with status success for try_number 1 2024-02-24T00:08:02.772678399Z [2024-02-24T00:08:02.772+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T00:06:00+00:00, map_index=-1, run_start_date=2024-02-24 00:08:01.788199+00:00, run_end_date=2024-02-24 00:08:02.135022+00:00, run_duration=0.346823, state=success, executor_state=success, try_number=1, max_tries=1, job_id=173, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:08:00.926066+00:00, queued_by_job_id=2, pid=2627 2024-02-24T00:08:03.759836922Z [2024-02-24T00:08:03.759+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:08:03.760225269Z [2024-02-24T00:08:03.759+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:07:00+00:00, run_id=scheduled__2024-02-24T00:07:00+00:00, run_start_date=2024-02-24 00:08:00.864320+00:00, run_end_date=2024-02-24 00:08:03.759777+00:00, run_duration=2.895457, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:07:00+00:00, data_interval_end=2024-02-24 00:08:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:08:03.770048758Z [2024-02-24T00:08:03.769+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:08:00+00:00, run_after=2024-02-24T00:09:00+00:00 2024-02-24T00:08:03.833646518Z [2024-02-24T00:08:03.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:07:00+00:00 exited with status success for try_number 1 2024-02-24T00:08:03.838917716Z [2024-02-24T00:08:03.838+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:07:00+00:00, map_index=-1, run_start_date=2024-02-24 00:08:02.595525+00:00, run_end_date=2024-02-24 00:08:03.155959+00:00, run_duration=0.560434, state=success, executor_state=success, try_number=1, max_tries=1, job_id=174, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:08:00.926066+00:00, queued_by_job_id=2, pid=2640 2024-02-24T00:08:04.926172597Z [2024-02-24T00:08:04.925+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:08:04.926731302Z [2024-02-24T00:08:04.926+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:07:00+00:00, run_id=scheduled__2024-02-24T00:07:00+00:00, run_start_date=2024-02-24 00:08:00.865449+00:00, run_end_date=2024-02-24 00:08:04.926284+00:00, run_duration=4.060835, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:07:00+00:00, data_interval_end=2024-02-24 00:08:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:08:04.938847252Z [2024-02-24T00:08:04.938+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:08:00+00:00, run_after=2024-02-24T00:09:00+00:00 2024-02-24T00:08:05.225670332Z [2024-02-24T00:08:05.224+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:08:05.226537937Z [2024-02-24T00:08:05.226+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:07:00+00:00, run_id=scheduled__2024-02-24T00:07:00+00:00, run_start_date=2024-02-24 00:08:00.866686+00:00, run_end_date=2024-02-24 00:08:05.225453+00:00, run_duration=4.358767, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:07:00+00:00, data_interval_end=2024-02-24 00:08:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:08:05.242796487Z [2024-02-24T00:08:05.242+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:08:00+00:00, run_after=2024-02-24T00:09:00+00:00 2024-02-24T00:08:05.283706691Z [2024-02-24T00:08:05.283+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:07:00+00:00 exited with status success for try_number 1 2024-02-24T00:08:05.284179842Z [2024-02-24T00:08:05.283+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:07:00+00:00 exited with status success for try_number 1 2024-02-24T00:08:05.299065825Z [2024-02-24T00:08:05.298+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:07:00+00:00, map_index=-1, run_start_date=2024-02-24 00:08:03.314528+00:00, run_end_date=2024-02-24 00:08:04.887214+00:00, run_duration=1.572686, state=success, executor_state=success, try_number=1, max_tries=1, job_id=176, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:08:00.926066+00:00, queued_by_job_id=2, pid=2657 2024-02-24T00:08:05.299982194Z [2024-02-24T00:08:05.299+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:07:00+00:00, map_index=-1, run_start_date=2024-02-24 00:08:03.284662+00:00, run_end_date=2024-02-24 00:08:05.055737+00:00, run_duration=1.771075, state=success, executor_state=success, try_number=1, max_tries=1, job_id=175, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:08:00.926066+00:00, queued_by_job_id=2, pid=2656 2024-02-24T00:09:00.765348963Z [2024-02-24T00:09:00.764+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:09:00+00:00, run_after=2024-02-24T00:10:00+00:00 2024-02-24T00:09:00.782525177Z [2024-02-24T00:09:00.782+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:09:00+00:00, run_after=2024-02-24T00:10:00+00:00 2024-02-24T00:09:00.791777619Z [2024-02-24T00:09:00.791+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:09:00.869153778Z [2024-02-24T00:09:00.868+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T00:09:00.869193757Z 2024-02-24T00:09:00.869197604Z 2024-02-24T00:09:00.869200795Z 2024-02-24T00:09:00.869537792Z [2024-02-24T00:09:00.869+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:09:00.869973428Z [2024-02-24T00:09:00.869+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:09:00.870356677Z [2024-02-24T00:09:00.870+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:09:00.871794001Z [2024-02-24T00:09:00.871+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:09:00.871801037Z 2024-02-24T00:09:00.871804513Z 2024-02-24T00:09:00.871807475Z 2024-02-24T00:09:00.877151091Z [2024-02-24T00:09:00.876+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:09:00.877433529Z [2024-02-24T00:09:00.877+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:09:00.877883427Z [2024-02-24T00:09:00.877+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:09:00.878260158Z [2024-02-24T00:09:00.877+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:09:00.878634453Z [2024-02-24T00:09:00.878+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:09:00.878951146Z [2024-02-24T00:09:00.878+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:09:01.151906743Z [2024-02-24T00:09:01.151+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:08:00+00:00 exited with status queued for try_number 1 2024-02-24T00:09:01.152118308Z [2024-02-24T00:09:01.151+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:08:00+00:00 exited with status queued for try_number 1 2024-02-24T00:09:01.152283897Z [2024-02-24T00:09:01.152+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:08:00+00:00 exited with status queued for try_number 1 2024-02-24T00:09:01.160822696Z [2024-02-24T00:09:01.160+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9238bde-0434-4cc3-8fd8-977a6e7bd22d 2024-02-24T00:09:01.161121489Z [2024-02-24T00:09:01.160+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6400c059-5870-4e70-8c32-8abe1749b9da 2024-02-24T00:09:01.161336852Z [2024-02-24T00:09:01.161+0000] {scheduler_job.py:635} INFO - Setting external_id for to d66a3438-354d-4e8f-b2b1-b8e85aa514da 2024-02-24T00:09:02.488987011Z [2024-02-24T00:09:02.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:08:00+00:00 exited with status success for try_number 1 2024-02-24T00:09:02.501598170Z [2024-02-24T00:09:02.501+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:08:00+00:00, map_index=-1, run_start_date=2024-02-24 00:09:01.875592+00:00, run_end_date=2024-02-24 00:09:02.329342+00:00, run_duration=0.45375, state=success, executor_state=success, try_number=1, max_tries=1, job_id=177, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:09:00.873480+00:00, queued_by_job_id=2, pid=2689 2024-02-24T00:09:03.594392293Z [2024-02-24T00:09:03.593+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:09:03.594813541Z [2024-02-24T00:09:03.594+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:08:00+00:00, run_id=scheduled__2024-02-24T00:08:00+00:00, run_start_date=2024-02-24 00:09:00.805491+00:00, run_end_date=2024-02-24 00:09:03.594323+00:00, run_duration=2.788832, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:08:00+00:00, data_interval_end=2024-02-24 00:09:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:09:03.607921939Z [2024-02-24T00:09:03.607+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:09:00+00:00, run_after=2024-02-24T00:10:00+00:00 2024-02-24T00:09:06.461849345Z [2024-02-24T00:09:06.461+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:09:06.462176743Z [2024-02-24T00:09:06.461+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:08:00+00:00, run_id=scheduled__2024-02-24T00:08:00+00:00, run_start_date=2024-02-24 00:09:00.807349+00:00, run_end_date=2024-02-24 00:09:06.461641+00:00, run_duration=5.654292, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:08:00+00:00, data_interval_end=2024-02-24 00:09:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:09:06.475361156Z [2024-02-24T00:09:06.474+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:09:00+00:00, run_after=2024-02-24T00:10:00+00:00 2024-02-24T00:09:06.484568767Z [2024-02-24T00:09:06.484+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:09:06.484626427Z [2024-02-24T00:09:06.484+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:08:00+00:00, run_id=scheduled__2024-02-24T00:08:00+00:00, run_start_date=2024-02-24 00:09:00.808635+00:00, run_end_date=2024-02-24 00:09:06.484403+00:00, run_duration=5.675768, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:08:00+00:00, data_interval_end=2024-02-24 00:09:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:09:06.494366313Z [2024-02-24T00:09:06.493+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:09:00+00:00, run_after=2024-02-24T00:10:00+00:00 2024-02-24T00:09:06.527298819Z [2024-02-24T00:09:06.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:08:00+00:00 exited with status success for try_number 1 2024-02-24T00:09:06.527348853Z [2024-02-24T00:09:06.527+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:08:00+00:00 exited with status success for try_number 1 2024-02-24T00:09:06.538995192Z [2024-02-24T00:09:06.538+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:08:00+00:00, map_index=-1, run_start_date=2024-02-24 00:09:03.161872+00:00, run_end_date=2024-02-24 00:09:05.698847+00:00, run_duration=2.536975, state=success, executor_state=success, try_number=1, max_tries=1, job_id=179, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:09:00.873480+00:00, queued_by_job_id=2, pid=2708 2024-02-24T00:09:06.539081358Z [2024-02-24T00:09:06.538+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:08:00+00:00, map_index=-1, run_start_date=2024-02-24 00:09:03.129527+00:00, run_end_date=2024-02-24 00:09:06.130691+00:00, run_duration=3.001164, state=success, executor_state=success, try_number=1, max_tries=1, job_id=178, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:09:00.873480+00:00, queued_by_job_id=2, pid=2707 2024-02-24T00:10:00.418204227Z [2024-02-24T00:10:00.417+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:10:00.436022740Z [2024-02-24T00:10:00.435+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:10:00.456439932Z [2024-02-24T00:10:00.456+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:10:00+00:00, run_after=2024-02-24T00:11:00+00:00 2024-02-24T00:10:00.471268035Z [2024-02-24T00:10:00.470+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:10:00+00:00, run_after=2024-02-24T00:15:00+00:00 2024-02-24T00:10:00.489602660Z [2024-02-24T00:10:00.489+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:10:00+00:00, run_after=2024-02-24T00:11:00+00:00 2024-02-24T00:10:00.610705907Z [2024-02-24T00:10:00.610+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-02-24T00:10:00.610732996Z 2024-02-24T00:10:00.610790188Z 2024-02-24T00:10:00.610796734Z 2024-02-24T00:10:00.610801716Z 2024-02-24T00:10:00.610806753Z 2024-02-24T00:10:00.610811730Z [2024-02-24T00:10:00.610+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:10:00.610830944Z [2024-02-24T00:10:00.610+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T00:10:00.610884948Z [2024-02-24T00:10:00.610+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:10:00.610964509Z [2024-02-24T00:10:00.610+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:10:00.611024519Z [2024-02-24T00:10:00.610+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:10:00.611944961Z [2024-02-24T00:10:00.611+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:10:00.611956685Z 2024-02-24T00:10:00.611960484Z 2024-02-24T00:10:00.611964192Z 2024-02-24T00:10:00.611967220Z 2024-02-24T00:10:00.611970840Z 2024-02-24T00:10:00.616251889Z [2024-02-24T00:10:00.616+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T00:10:00.616336391Z [2024-02-24T00:10:00.616+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:10:00.616509845Z [2024-02-24T00:10:00.616+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:10:00.616578930Z [2024-02-24T00:10:00.616+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T00:10:00.616735595Z [2024-02-24T00:10:00.616+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:10:00.616831226Z [2024-02-24T00:10:00.616+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:10:00.616981705Z [2024-02-24T00:10:00.616+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:10:00.617057943Z [2024-02-24T00:10:00.616+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:10:00.617239116Z [2024-02-24T00:10:00.617+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:10:00.617313850Z [2024-02-24T00:10:00.617+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:10:01.293980731Z [2024-02-24T00:10:01.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T00:05:00+00:00 exited with status queued for try_number 1 2024-02-24T00:10:01.294023813Z [2024-02-24T00:10:01.285+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:08:00+00:00 exited with status queued for try_number 1 2024-02-24T00:10:01.294028132Z [2024-02-24T00:10:01.285+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:09:00+00:00 exited with status queued for try_number 1 2024-02-24T00:10:01.294031467Z [2024-02-24T00:10:01.285+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:09:00+00:00 exited with status queued for try_number 1 2024-02-24T00:10:01.294043329Z [2024-02-24T00:10:01.285+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:09:00+00:00 exited with status queued for try_number 1 2024-02-24T00:10:01.346314518Z [2024-02-24T00:10:01.323+0000] {scheduler_job.py:635} INFO - Setting external_id for to 26c469f3-becc-4fdd-830e-375d1431bec9 2024-02-24T00:10:01.348246024Z [2024-02-24T00:10:01.347+0000] {scheduler_job.py:635} INFO - Setting external_id for to d8e82fc9-6f52-4268-832d-6a6fce0ac0f4 2024-02-24T00:10:01.354555025Z [2024-02-24T00:10:01.354+0000] {scheduler_job.py:635} INFO - Setting external_id for to 06c53678-6a7c-407e-bc78-7d417352d455 2024-02-24T00:10:01.355187096Z [2024-02-24T00:10:01.354+0000] {scheduler_job.py:635} INFO - Setting external_id for to a7a440bb-e7cd-4e9d-b16b-d8977945148b 2024-02-24T00:10:01.355619236Z [2024-02-24T00:10:01.355+0000] {scheduler_job.py:635} INFO - Setting external_id for to a5d9da92-055a-4f00-9a48-2e307ce42405 2024-02-24T00:10:02.931564571Z [2024-02-24T00:10:02.931+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:10:02.931751405Z [2024-02-24T00:10:02.931+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 00:08:00+00:00, run_id=scheduled__2024-02-24T00:08:00+00:00, run_start_date=2024-02-24 00:10:00.510046+00:00, run_end_date=2024-02-24 00:10:02.931447+00:00, run_duration=2.421401, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:08:00+00:00, data_interval_end=2024-02-24 00:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T00:10:02.954828289Z [2024-02-24T00:10:02.954+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T00:10:00+00:00, run_after=2024-02-24T00:12:00+00:00 2024-02-24T00:10:03.024279571Z [2024-02-24T00:10:03.023+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:10:03.024697921Z [2024-02-24T00:10:03.024+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:09:00+00:00, run_id=scheduled__2024-02-24T00:09:00+00:00, run_start_date=2024-02-24 00:10:00.513699+00:00, run_end_date=2024-02-24 00:10:03.024170+00:00, run_duration=2.510471, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:09:00+00:00, data_interval_end=2024-02-24 00:10:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:10:03.048502795Z [2024-02-24T00:10:03.047+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:10:00+00:00, run_after=2024-02-24T00:11:00+00:00 2024-02-24T00:10:03.095922031Z [2024-02-24T00:10:03.095+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:08:00+00:00 exited with status success for try_number 1 2024-02-24T00:10:03.096028507Z [2024-02-24T00:10:03.095+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:09:00+00:00 exited with status success for try_number 1 2024-02-24T00:10:03.106442865Z [2024-02-24T00:10:03.105+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:09:00+00:00, map_index=-1, run_start_date=2024-02-24 00:10:02.023846+00:00, run_end_date=2024-02-24 00:10:02.494955+00:00, run_duration=0.471109, state=success, executor_state=success, try_number=1, max_tries=1, job_id=181, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:10:00.613121+00:00, queued_by_job_id=2, pid=2745 2024-02-24T00:10:03.106810976Z [2024-02-24T00:10:03.106+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T00:08:00+00:00, map_index=-1, run_start_date=2024-02-24 00:10:02.006930+00:00, run_end_date=2024-02-24 00:10:02.617409+00:00, run_duration=0.610479, state=success, executor_state=success, try_number=1, max_tries=1, job_id=180, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:10:00.613121+00:00, queued_by_job_id=2, pid=2744 2024-02-24T00:10:05.253089623Z [2024-02-24T00:10:05.252+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:10:05.253245622Z [2024-02-24T00:10:05.252+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:09:00+00:00, run_id=scheduled__2024-02-24T00:09:00+00:00, run_start_date=2024-02-24 00:10:00.515686+00:00, run_end_date=2024-02-24 00:10:05.252844+00:00, run_duration=4.737158, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:09:00+00:00, data_interval_end=2024-02-24 00:10:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:10:05.262116341Z [2024-02-24T00:10:05.261+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:10:00+00:00, run_after=2024-02-24T00:11:00+00:00 2024-02-24T00:10:05.297712180Z [2024-02-24T00:10:05.297+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T00:10:05.297748470Z 2024-02-24T00:10:05.298405456Z [2024-02-24T00:10:05.298+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:10:05.300475775Z [2024-02-24T00:10:05.299+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:10:05.300494523Z 2024-02-24T00:10:05.306289698Z [2024-02-24T00:10:05.305+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T00:10:05.306777050Z [2024-02-24T00:10:05.306+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:10:05.373473571Z [2024-02-24T00:10:05.373+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T00:05:00+00:00 exited with status queued for try_number 1 2024-02-24T00:10:05.373760393Z [2024-02-24T00:10:05.373+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T00:05:00+00:00 exited with status success for try_number 1 2024-02-24T00:10:05.374148335Z [2024-02-24T00:10:05.373+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:09:00+00:00 exited with status success for try_number 1 2024-02-24T00:10:05.382049437Z [2024-02-24T00:10:05.381+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e8a5f68-5f54-4f3e-b1e3-a9b17879f003 2024-02-24T00:10:05.382422224Z [2024-02-24T00:10:05.382+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T00:05:00+00:00, map_index=-1, run_start_date=2024-02-24 00:10:03.958321+00:00, run_end_date=2024-02-24 00:10:04.377173+00:00, run_duration=0.418852, state=success, executor_state=success, try_number=1, max_tries=1, job_id=183, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:10:00.613121+00:00, queued_by_job_id=2, pid=2774 2024-02-24T00:10:05.382738050Z [2024-02-24T00:10:05.382+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:09:00+00:00, map_index=-1, run_start_date=2024-02-24 00:10:03.190156+00:00, run_end_date=2024-02-24 00:10:04.818646+00:00, run_duration=1.62849, state=success, executor_state=success, try_number=1, max_tries=1, job_id=182, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:10:00.613121+00:00, queued_by_job_id=2, pid=2762 2024-02-24T00:10:06.480606862Z [2024-02-24T00:10:06.480+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:10:06.481027829Z [2024-02-24T00:10:06.480+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:09:00+00:00, run_id=scheduled__2024-02-24T00:09:00+00:00, run_start_date=2024-02-24 00:10:00.517297+00:00, run_end_date=2024-02-24 00:10:06.480449+00:00, run_duration=5.963152, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:09:00+00:00, data_interval_end=2024-02-24 00:10:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:10:06.490047764Z [2024-02-24T00:10:06.489+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:10:00+00:00, run_after=2024-02-24T00:11:00+00:00 2024-02-24T00:10:06.541538892Z [2024-02-24T00:10:06.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:09:00+00:00 exited with status success for try_number 1 2024-02-24T00:10:06.550706986Z [2024-02-24T00:10:06.550+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:09:00+00:00, map_index=-1, run_start_date=2024-02-24 00:10:04.438387+00:00, run_end_date=2024-02-24 00:10:06.066915+00:00, run_duration=1.628528, state=success, executor_state=success, try_number=1, max_tries=1, job_id=184, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:10:00.613121+00:00, queued_by_job_id=2, pid=2785 2024-02-24T00:10:07.640697740Z [2024-02-24T00:10:07.639+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T00:10:07.640728674Z 2024-02-24T00:10:07.640930908Z [2024-02-24T00:10:07.640+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:10:07.641583704Z [2024-02-24T00:10:07.641+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:10:07.641591583Z 2024-02-24T00:10:07.644230933Z [2024-02-24T00:10:07.643+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T00:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T00:10:07.644434978Z [2024-02-24T00:10:07.644+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T00:10:07.701276140Z [2024-02-24T00:10:07.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T00:05:00+00:00 exited with status queued for try_number 1 2024-02-24T00:10:07.709476470Z [2024-02-24T00:10:07.709+0000] {scheduler_job.py:635} INFO - Setting external_id for to c842c687-2539-4d50-ae6d-622fbdaab39c 2024-02-24T00:10:07.791490274Z [2024-02-24T00:10:07.790+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T00:05:00+00:00 exited with status success for try_number 1 2024-02-24T00:10:07.799867975Z [2024-02-24T00:10:07.799+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T00:05:00+00:00, map_index=-1, run_start_date=2024-02-24 00:10:07.044277+00:00, run_end_date=2024-02-24 00:10:07.467971+00:00, run_duration=0.423694, state=success, executor_state=success, try_number=1, max_tries=1, job_id=185, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:10:05.301677+00:00, queued_by_job_id=2, pid=2798 2024-02-24T00:10:10.569397326Z [2024-02-24T00:10:10.568+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T00:10:10.569441944Z 2024-02-24T00:10:10.569764663Z [2024-02-24T00:10:10.569+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:10:10.571363930Z [2024-02-24T00:10:10.570+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:10:10.571388966Z 2024-02-24T00:10:10.575686094Z [2024-02-24T00:10:10.575+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:10:10.576007783Z [2024-02-24T00:10:10.575+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:10:10.638090670Z [2024-02-24T00:10:10.637+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T00:05:00+00:00 exited with status queued for try_number 1 2024-02-24T00:10:10.638246845Z [2024-02-24T00:10:10.637+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T00:05:00+00:00 exited with status success for try_number 1 2024-02-24T00:10:10.646484065Z [2024-02-24T00:10:10.646+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe60a163-49d6-42a1-b883-04e785be043d 2024-02-24T00:10:10.646922524Z [2024-02-24T00:10:10.646+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T00:05:00+00:00, map_index=0, run_start_date=2024-02-24 00:10:09.306497+00:00, run_end_date=2024-02-24 00:10:09.705804+00:00, run_duration=0.399307, state=success, executor_state=success, try_number=1, max_tries=1, job_id=186, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:10:07.642072+00:00, queued_by_job_id=2, pid=2806 2024-02-24T00:10:13.867271714Z [2024-02-24T00:10:13.866+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:10:13.867574744Z [2024-02-24T00:10:13.867+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:05:00+00:00, run_id=scheduled__2024-02-24T00:05:00+00:00, run_start_date=2024-02-24 00:10:00.507071+00:00, run_end_date=2024-02-24 00:10:13.867232+00:00, run_duration=13.360161, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:05:00+00:00, data_interval_end=2024-02-24 00:10:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T00:10:13.873688086Z [2024-02-24T00:10:13.873+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:10:00+00:00, run_after=2024-02-24T00:15:00+00:00 2024-02-24T00:10:13.921627247Z [2024-02-24T00:10:13.920+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T00:05:00+00:00 exited with status success for try_number 1 2024-02-24T00:10:13.930810040Z [2024-02-24T00:10:13.930+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T00:05:00+00:00, map_index=-1, run_start_date=2024-02-24 00:10:12.336336+00:00, run_end_date=2024-02-24 00:10:12.822060+00:00, run_duration=0.485724, state=success, executor_state=success, try_number=1, max_tries=1, job_id=187, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:10:10.571921+00:00, queued_by_job_id=2, pid=2814 2024-02-24T00:11:00.844731888Z [2024-02-24T00:11:00.844+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:11:00.864024467Z [2024-02-24T00:11:00.863+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:11:00+00:00, run_after=2024-02-24T00:12:00+00:00 2024-02-24T00:11:00.886419133Z [2024-02-24T00:11:00.885+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:11:00+00:00, run_after=2024-02-24T00:12:00+00:00 2024-02-24T00:11:00.987758518Z [2024-02-24T00:11:00.987+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T00:11:00.987807950Z 2024-02-24T00:11:00.987818738Z 2024-02-24T00:11:00.987827803Z 2024-02-24T00:11:00.988019299Z [2024-02-24T00:11:00.987+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:11:00.988371829Z [2024-02-24T00:11:00.988+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:11:00.988663760Z [2024-02-24T00:11:00.988+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:11:00.989731485Z [2024-02-24T00:11:00.989+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:11:00.989747205Z 2024-02-24T00:11:00.989753188Z 2024-02-24T00:11:00.989758345Z 2024-02-24T00:11:00.993412075Z [2024-02-24T00:11:00.993+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:11:00.993613662Z [2024-02-24T00:11:00.993+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:11:00.994025093Z [2024-02-24T00:11:00.993+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:11:00.994226528Z [2024-02-24T00:11:00.994+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:11:00.994519166Z [2024-02-24T00:11:00.994+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:11:00.994694757Z [2024-02-24T00:11:00.994+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:11:01.415645990Z [2024-02-24T00:11:01.414+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:10:00+00:00 exited with status queued for try_number 1 2024-02-24T00:11:01.418741761Z [2024-02-24T00:11:01.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:10:00+00:00 exited with status queued for try_number 1 2024-02-24T00:11:01.418903511Z [2024-02-24T00:11:01.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:10:00+00:00 exited with status queued for try_number 1 2024-02-24T00:11:01.429847599Z [2024-02-24T00:11:01.429+0000] {scheduler_job.py:635} INFO - Setting external_id for to 07860ae8-b654-4068-a539-5f324ef58853 2024-02-24T00:11:01.430238034Z [2024-02-24T00:11:01.429+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7077179a-14ec-451f-80b8-9d8b519271f4 2024-02-24T00:11:01.430540813Z [2024-02-24T00:11:01.430+0000] {scheduler_job.py:635} INFO - Setting external_id for to ecadbf8d-fae3-47c0-8d2c-358140783d13 2024-02-24T00:11:02.452960838Z [2024-02-24T00:11:02.451+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:11:02.457982250Z [2024-02-24T00:11:02.453+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:10:00+00:00, run_id=scheduled__2024-02-24T00:10:00+00:00, run_start_date=2024-02-24 00:11:00.908281+00:00, run_end_date=2024-02-24 00:11:02.452949+00:00, run_duration=1.544668, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:10:00+00:00, data_interval_end=2024-02-24 00:11:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:11:02.474035015Z [2024-02-24T00:11:02.473+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:11:00+00:00, run_after=2024-02-24T00:12:00+00:00 2024-02-24T00:11:02.510821274Z [2024-02-24T00:11:02.510+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:10:00+00:00 exited with status success for try_number 1 2024-02-24T00:11:02.524338954Z [2024-02-24T00:11:02.523+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:10:00+00:00, map_index=-1, run_start_date=2024-02-24 00:11:01.799190+00:00, run_end_date=2024-02-24 00:11:02.233117+00:00, run_duration=0.433927, state=success, executor_state=success, try_number=1, max_tries=1, job_id=188, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:11:00.990678+00:00, queued_by_job_id=2, pid=2837 2024-02-24T00:11:05.517623645Z [2024-02-24T00:11:05.516+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:11:05.517872749Z [2024-02-24T00:11:05.517+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:10:00+00:00, run_id=scheduled__2024-02-24T00:10:00+00:00, run_start_date=2024-02-24 00:11:00.910172+00:00, run_end_date=2024-02-24 00:11:05.517144+00:00, run_duration=4.606972, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:10:00+00:00, data_interval_end=2024-02-24 00:11:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:11:05.527966374Z [2024-02-24T00:11:05.527+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:11:00+00:00, run_after=2024-02-24T00:12:00+00:00 2024-02-24T00:11:05.574075335Z [2024-02-24T00:11:05.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:10:00+00:00 exited with status success for try_number 1 2024-02-24T00:11:05.580910288Z [2024-02-24T00:11:05.580+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:10:00+00:00, map_index=-1, run_start_date=2024-02-24 00:11:03.079315+00:00, run_end_date=2024-02-24 00:11:05.168213+00:00, run_duration=2.088898, state=success, executor_state=success, try_number=1, max_tries=1, job_id=189, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:11:00.990678+00:00, queued_by_job_id=2, pid=2855 2024-02-24T00:11:06.637004055Z [2024-02-24T00:11:06.636+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:11:06.637269267Z [2024-02-24T00:11:06.637+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:10:00+00:00, run_id=scheduled__2024-02-24T00:10:00+00:00, run_start_date=2024-02-24 00:11:00.911848+00:00, run_end_date=2024-02-24 00:11:06.636836+00:00, run_duration=5.724988, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:10:00+00:00, data_interval_end=2024-02-24 00:11:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:11:06.649190420Z [2024-02-24T00:11:06.648+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:11:00+00:00, run_after=2024-02-24T00:12:00+00:00 2024-02-24T00:11:06.682773881Z [2024-02-24T00:11:06.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:10:00+00:00 exited with status success for try_number 1 2024-02-24T00:11:06.690719113Z [2024-02-24T00:11:06.690+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:10:00+00:00, map_index=-1, run_start_date=2024-02-24 00:11:03.205111+00:00, run_end_date=2024-02-24 00:11:06.434320+00:00, run_duration=3.229209, state=success, executor_state=success, try_number=1, max_tries=1, job_id=190, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:11:00.990678+00:00, queued_by_job_id=2, pid=2856 2024-02-24T00:11:59.617388833Z [2024-02-24T00:11:59.616+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T00:12:00.667195293Z [2024-02-24T00:12:00.666+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:12:00.690398305Z [2024-02-24T00:12:00.689+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:12:00+00:00, run_after=2024-02-24T00:13:00+00:00 2024-02-24T00:12:00.706601402Z [2024-02-24T00:12:00.706+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:12:00+00:00, run_after=2024-02-24T00:13:00+00:00 2024-02-24T00:12:00.716989619Z [2024-02-24T00:12:00.716+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:12:00.820517813Z [2024-02-24T00:12:00.819+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T00:12:00.820598842Z 2024-02-24T00:12:00.820611806Z 2024-02-24T00:12:00.820620898Z 2024-02-24T00:12:00.820629399Z 2024-02-24T00:12:00.820638976Z [2024-02-24T00:12:00.820+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T00:12:00.820844588Z [2024-02-24T00:12:00.820+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:12:00.820894371Z [2024-02-24T00:12:00.820+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:12:00.820921077Z [2024-02-24T00:12:00.820+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:12:00.821690257Z [2024-02-24T00:12:00.821+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:12:00.821735602Z 2024-02-24T00:12:00.821747081Z 2024-02-24T00:12:00.821755624Z 2024-02-24T00:12:00.821765259Z 2024-02-24T00:12:00.827927532Z [2024-02-24T00:12:00.827+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:12:00.828064003Z [2024-02-24T00:12:00.827+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T00:12:00.828315205Z [2024-02-24T00:12:00.828+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:12:00.828345395Z [2024-02-24T00:12:00.828+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:12:00.828665251Z [2024-02-24T00:12:00.828+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:12:00.828826264Z [2024-02-24T00:12:00.828+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:12:00.829036129Z [2024-02-24T00:12:00.828+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:12:00.829101161Z [2024-02-24T00:12:00.828+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:12:01.475125160Z [2024-02-24T00:12:01.474+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:10:00+00:00 exited with status queued for try_number 1 2024-02-24T00:12:01.476690392Z [2024-02-24T00:12:01.476+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:11:00+00:00 exited with status queued for try_number 1 2024-02-24T00:12:01.476865390Z [2024-02-24T00:12:01.476+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:11:00+00:00 exited with status queued for try_number 1 2024-02-24T00:12:01.477036720Z [2024-02-24T00:12:01.476+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:11:00+00:00 exited with status queued for try_number 1 2024-02-24T00:12:01.494455172Z [2024-02-24T00:12:01.494+0000] {scheduler_job.py:635} INFO - Setting external_id for to f6c4ec8b-39eb-4c3a-af42-7d8b557442a9 2024-02-24T00:12:01.494688563Z [2024-02-24T00:12:01.494+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f9493df-0e96-404f-8083-8fab401e4775 2024-02-24T00:12:01.494874421Z [2024-02-24T00:12:01.494+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d97a098-4b25-483f-96a6-d13e32a14fa2 2024-02-24T00:12:01.495098534Z [2024-02-24T00:12:01.494+0000] {scheduler_job.py:635} INFO - Setting external_id for to af0c42a8-1104-4dab-84a0-bf4a77b05a60 2024-02-24T00:12:02.656059155Z [2024-02-24T00:12:02.650+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:12:02.656417579Z [2024-02-24T00:12:02.651+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 00:10:00+00:00, run_id=scheduled__2024-02-24T00:10:00+00:00, run_start_date=2024-02-24 00:12:00.737085+00:00, run_end_date=2024-02-24 00:12:02.650984+00:00, run_duration=1.913899, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:10:00+00:00, data_interval_end=2024-02-24 00:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T00:12:02.667897652Z [2024-02-24T00:12:02.666+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T00:12:00+00:00, run_after=2024-02-24T00:14:00+00:00 2024-02-24T00:12:02.701455129Z [2024-02-24T00:12:02.693+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:12:02.701486793Z [2024-02-24T00:12:02.696+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:11:00+00:00, run_id=scheduled__2024-02-24T00:11:00+00:00, run_start_date=2024-02-24 00:12:00.739205+00:00, run_end_date=2024-02-24 00:12:02.696739+00:00, run_duration=1.957534, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:11:00+00:00, data_interval_end=2024-02-24 00:12:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:12:02.723222205Z [2024-02-24T00:12:02.721+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:12:00+00:00, run_after=2024-02-24T00:13:00+00:00 2024-02-24T00:12:02.826862726Z [2024-02-24T00:12:02.826+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:10:00+00:00 exited with status success for try_number 1 2024-02-24T00:12:02.826954109Z [2024-02-24T00:12:02.826+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:11:00+00:00 exited with status success for try_number 1 2024-02-24T00:12:02.837328326Z [2024-02-24T00:12:02.836+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T00:10:00+00:00, map_index=-1, run_start_date=2024-02-24 00:12:01.744768+00:00, run_end_date=2024-02-24 00:12:02.269322+00:00, run_duration=0.524554, state=success, executor_state=success, try_number=1, max_tries=1, job_id=191, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:12:00.822975+00:00, queued_by_job_id=2, pid=2890 2024-02-24T00:12:02.837809341Z [2024-02-24T00:12:02.837+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:11:00+00:00, map_index=-1, run_start_date=2024-02-24 00:12:01.950314+00:00, run_end_date=2024-02-24 00:12:02.500882+00:00, run_duration=0.550568, state=success, executor_state=success, try_number=1, max_tries=1, job_id=192, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:12:00.822975+00:00, queued_by_job_id=2, pid=2891 2024-02-24T00:12:05.605456303Z [2024-02-24T00:12:05.604+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:12:05.605630121Z [2024-02-24T00:12:05.605+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:11:00+00:00, run_id=scheduled__2024-02-24T00:11:00+00:00, run_start_date=2024-02-24 00:12:00.741574+00:00, run_end_date=2024-02-24 00:12:05.605218+00:00, run_duration=4.863644, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:11:00+00:00, data_interval_end=2024-02-24 00:12:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:12:05.614989329Z [2024-02-24T00:12:05.614+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:12:00+00:00, run_after=2024-02-24T00:13:00+00:00 2024-02-24T00:12:05.661059177Z [2024-02-24T00:12:05.660+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:11:00+00:00 exited with status success for try_number 1 2024-02-24T00:12:05.668126484Z [2024-02-24T00:12:05.667+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:11:00+00:00, map_index=-1, run_start_date=2024-02-24 00:12:03.084586+00:00, run_end_date=2024-02-24 00:12:04.571173+00:00, run_duration=1.486587, state=success, executor_state=success, try_number=1, max_tries=1, job_id=193, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:12:00.822975+00:00, queued_by_job_id=2, pid=2914 2024-02-24T00:12:06.717109819Z [2024-02-24T00:12:06.716+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:12:06.717506504Z [2024-02-24T00:12:06.717+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:11:00+00:00, run_id=scheduled__2024-02-24T00:11:00+00:00, run_start_date=2024-02-24 00:12:00.743256+00:00, run_end_date=2024-02-24 00:12:06.716996+00:00, run_duration=5.97374, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:11:00+00:00, data_interval_end=2024-02-24 00:12:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:12:06.727993465Z [2024-02-24T00:12:06.727+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:12:00+00:00, run_after=2024-02-24T00:13:00+00:00 2024-02-24T00:12:06.779429249Z [2024-02-24T00:12:06.776+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:11:00+00:00 exited with status success for try_number 1 2024-02-24T00:12:06.787593622Z [2024-02-24T00:12:06.786+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:11:00+00:00, map_index=-1, run_start_date=2024-02-24 00:12:03.225257+00:00, run_end_date=2024-02-24 00:12:06.207461+00:00, run_duration=2.982204, state=success, executor_state=success, try_number=1, max_tries=1, job_id=194, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:12:00.822975+00:00, queued_by_job_id=2, pid=2915 2024-02-24T00:13:00.622333417Z [2024-02-24T00:13:00.621+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:13:00+00:00, run_after=2024-02-24T00:14:00+00:00 2024-02-24T00:13:00.633119995Z [2024-02-24T00:13:00.632+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:13:00.646471842Z [2024-02-24T00:13:00.646+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:13:00+00:00, run_after=2024-02-24T00:14:00+00:00 2024-02-24T00:13:00.730670547Z [2024-02-24T00:13:00.729+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T00:13:00.730704015Z 2024-02-24T00:13:00.730710084Z 2024-02-24T00:13:00.730714830Z 2024-02-24T00:13:00.731790114Z [2024-02-24T00:13:00.730+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:13:00.732973936Z [2024-02-24T00:13:00.732+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:13:00.733576282Z [2024-02-24T00:13:00.733+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:13:00.737041832Z [2024-02-24T00:13:00.736+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:13:00.737068707Z 2024-02-24T00:13:00.737098180Z 2024-02-24T00:13:00.737104388Z 2024-02-24T00:13:00.742151994Z [2024-02-24T00:13:00.741+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:13:00.742514021Z [2024-02-24T00:13:00.742+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:13:00.742997146Z [2024-02-24T00:13:00.742+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:13:00.743341324Z [2024-02-24T00:13:00.743+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:13:00.743914114Z [2024-02-24T00:13:00.743+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:13:00.744216505Z [2024-02-24T00:13:00.744+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:13:00.986310508Z [2024-02-24T00:13:00.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:12:00+00:00 exited with status queued for try_number 1 2024-02-24T00:13:00.986609836Z [2024-02-24T00:13:00.986+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:12:00+00:00 exited with status queued for try_number 1 2024-02-24T00:13:00.986784117Z [2024-02-24T00:13:00.986+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:12:00+00:00 exited with status queued for try_number 1 2024-02-24T00:13:00.999796263Z [2024-02-24T00:13:00.999+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2dcd62d0-fa54-4ad0-ba2d-d334ca837a13 2024-02-24T00:13:00.999953068Z [2024-02-24T00:13:00.999+0000] {scheduler_job.py:635} INFO - Setting external_id for to f5ee4c5a-55db-43d1-a31c-5ac2d1b52f19 2024-02-24T00:13:01.000406839Z [2024-02-24T00:13:01.000+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff671cf0-3c07-417f-b722-4244bd668527 2024-02-24T00:13:02.192272657Z [2024-02-24T00:13:02.191+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:13:02.192679331Z [2024-02-24T00:13:02.192+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:12:00+00:00, run_id=scheduled__2024-02-24T00:12:00+00:00, run_start_date=2024-02-24 00:13:00.656748+00:00, run_end_date=2024-02-24 00:13:02.192308+00:00, run_duration=1.53556, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:12:00+00:00, data_interval_end=2024-02-24 00:13:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:13:02.204092376Z [2024-02-24T00:13:02.203+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:13:00+00:00, run_after=2024-02-24T00:14:00+00:00 2024-02-24T00:13:02.240259891Z [2024-02-24T00:13:02.239+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:12:00+00:00 exited with status success for try_number 1 2024-02-24T00:13:02.246868059Z [2024-02-24T00:13:02.246+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:12:00+00:00, map_index=-1, run_start_date=2024-02-24 00:13:01.597372+00:00, run_end_date=2024-02-24 00:13:02.078810+00:00, run_duration=0.481438, state=success, executor_state=success, try_number=1, max_tries=1, job_id=195, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:13:00.738164+00:00, queued_by_job_id=2, pid=2947 2024-02-24T00:13:04.384447649Z [2024-02-24T00:13:04.383+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:13:04.384544196Z [2024-02-24T00:13:04.384+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:12:00+00:00, run_id=scheduled__2024-02-24T00:12:00+00:00, run_start_date=2024-02-24 00:13:00.658017+00:00, run_end_date=2024-02-24 00:13:04.384244+00:00, run_duration=3.726227, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:12:00+00:00, data_interval_end=2024-02-24 00:13:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:13:04.394100857Z [2024-02-24T00:13:04.393+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:13:00+00:00, run_after=2024-02-24T00:14:00+00:00 2024-02-24T00:13:04.445289698Z [2024-02-24T00:13:04.444+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:12:00+00:00 exited with status success for try_number 1 2024-02-24T00:13:04.455304599Z [2024-02-24T00:13:04.454+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:12:00+00:00, map_index=-1, run_start_date=2024-02-24 00:13:02.728960+00:00, run_end_date=2024-02-24 00:13:04.223642+00:00, run_duration=1.494682, state=success, executor_state=success, try_number=1, max_tries=1, job_id=196, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:13:00.738164+00:00, queued_by_job_id=2, pid=2965 2024-02-24T00:13:05.528059149Z [2024-02-24T00:13:05.527+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:13:05.528291503Z [2024-02-24T00:13:05.528+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:12:00+00:00, run_id=scheduled__2024-02-24T00:12:00+00:00, run_start_date=2024-02-24 00:13:00.659117+00:00, run_end_date=2024-02-24 00:13:05.527944+00:00, run_duration=4.868827, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:12:00+00:00, data_interval_end=2024-02-24 00:13:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:13:05.540964448Z [2024-02-24T00:13:05.540+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:13:00+00:00, run_after=2024-02-24T00:14:00+00:00 2024-02-24T00:13:05.573411328Z [2024-02-24T00:13:05.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:12:00+00:00 exited with status success for try_number 1 2024-02-24T00:13:05.579834064Z [2024-02-24T00:13:05.579+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:12:00+00:00, map_index=-1, run_start_date=2024-02-24 00:13:02.757293+00:00, run_end_date=2024-02-24 00:13:04.872339+00:00, run_duration=2.115046, state=success, executor_state=success, try_number=1, max_tries=1, job_id=197, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:13:00.738164+00:00, queued_by_job_id=2, pid=2966 2024-02-24T00:14:00.109238549Z [2024-02-24T00:14:00.108+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:14:00.120304633Z [2024-02-24T00:14:00.119+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:14:00+00:00, run_after=2024-02-24T00:15:00+00:00 2024-02-24T00:14:00.141914595Z [2024-02-24T00:14:00.141+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:14:00+00:00, run_after=2024-02-24T00:15:00+00:00 2024-02-24T00:14:00.147657276Z [2024-02-24T00:14:00.147+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:14:00.245008782Z [2024-02-24T00:14:00.244+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T00:14:00.245029847Z 2024-02-24T00:14:00.245036302Z 2024-02-24T00:14:00.245039478Z 2024-02-24T00:14:00.245043054Z 2024-02-24T00:14:00.245319914Z [2024-02-24T00:14:00.245+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T00:14:00.245619443Z [2024-02-24T00:14:00.245+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:14:00.246068362Z [2024-02-24T00:14:00.245+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:14:00.246303845Z [2024-02-24T00:14:00.246+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:14:00.247479435Z [2024-02-24T00:14:00.247+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:14:00.247490142Z 2024-02-24T00:14:00.247518507Z 2024-02-24T00:14:00.247522792Z 2024-02-24T00:14:00.247537398Z 2024-02-24T00:14:00.252796977Z [2024-02-24T00:14:00.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:14:00.253059409Z [2024-02-24T00:14:00.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T00:14:00.253465426Z [2024-02-24T00:14:00.253+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:14:00.253665460Z [2024-02-24T00:14:00.253+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:14:00.254142872Z [2024-02-24T00:14:00.253+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:14:00.254474704Z [2024-02-24T00:14:00.254+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:14:00.254870764Z [2024-02-24T00:14:00.254+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:14:00.255151026Z [2024-02-24T00:14:00.254+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:14:00.496741504Z [2024-02-24T00:14:00.496+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:12:00+00:00 exited with status queued for try_number 1 2024-02-24T00:14:00.499804632Z [2024-02-24T00:14:00.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:13:00+00:00 exited with status queued for try_number 1 2024-02-24T00:14:00.499992242Z [2024-02-24T00:14:00.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:13:00+00:00 exited with status queued for try_number 1 2024-02-24T00:14:00.500188501Z [2024-02-24T00:14:00.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:13:00+00:00 exited with status queued for try_number 1 2024-02-24T00:14:00.511101892Z [2024-02-24T00:14:00.510+0000] {scheduler_job.py:635} INFO - Setting external_id for to 00000b2c-ad90-4e76-ab90-0ae766e72b1e 2024-02-24T00:14:00.511519950Z [2024-02-24T00:14:00.511+0000] {scheduler_job.py:635} INFO - Setting external_id for to f16b4eb5-8b6c-4dfb-9398-cea140e83df0 2024-02-24T00:14:00.511712522Z [2024-02-24T00:14:00.511+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c1779b9-a415-43bc-a79a-161b94025618 2024-02-24T00:14:00.511902279Z [2024-02-24T00:14:00.511+0000] {scheduler_job.py:635} INFO - Setting external_id for to 086d9240-dbd4-43ba-ae28-c90f6cbbe0b2 2024-02-24T00:14:01.749653823Z [2024-02-24T00:14:01.749+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:14:01.750144533Z [2024-02-24T00:14:01.749+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 00:12:00+00:00, run_id=scheduled__2024-02-24T00:12:00+00:00, run_start_date=2024-02-24 00:14:00.157205+00:00, run_end_date=2024-02-24 00:14:01.749744+00:00, run_duration=1.592539, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:12:00+00:00, data_interval_end=2024-02-24 00:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T00:14:01.761253094Z [2024-02-24T00:14:01.760+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T00:14:00+00:00, run_after=2024-02-24T00:16:00+00:00 2024-02-24T00:14:01.775318153Z [2024-02-24T00:14:01.774+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:14:01.775786016Z [2024-02-24T00:14:01.775+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:13:00+00:00, run_id=scheduled__2024-02-24T00:13:00+00:00, run_start_date=2024-02-24 00:14:00.160656+00:00, run_end_date=2024-02-24 00:14:01.775466+00:00, run_duration=1.61481, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:13:00+00:00, data_interval_end=2024-02-24 00:14:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:14:01.799031614Z [2024-02-24T00:14:01.798+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:14:00+00:00, run_after=2024-02-24T00:15:00+00:00 2024-02-24T00:14:01.843861663Z [2024-02-24T00:14:01.843+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:12:00+00:00 exited with status success for try_number 1 2024-02-24T00:14:01.844169923Z [2024-02-24T00:14:01.843+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:13:00+00:00 exited with status success for try_number 1 2024-02-24T00:14:01.859162327Z [2024-02-24T00:14:01.858+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T00:12:00+00:00, map_index=-1, run_start_date=2024-02-24 00:14:00.973246+00:00, run_end_date=2024-02-24 00:14:01.411765+00:00, run_duration=0.438519, state=success, executor_state=success, try_number=1, max_tries=1, job_id=198, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:14:00.249107+00:00, queued_by_job_id=2, pid=2999 2024-02-24T00:14:01.859592296Z [2024-02-24T00:14:01.859+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:13:00+00:00, map_index=-1, run_start_date=2024-02-24 00:14:01.168427+00:00, run_end_date=2024-02-24 00:14:01.631548+00:00, run_duration=0.463121, state=success, executor_state=success, try_number=1, max_tries=1, job_id=199, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:14:00.249107+00:00, queued_by_job_id=2, pid=3000 2024-02-24T00:14:04.011900782Z [2024-02-24T00:14:04.011+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:14:04.012422193Z [2024-02-24T00:14:04.012+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:13:00+00:00, run_id=scheduled__2024-02-24T00:13:00+00:00, run_start_date=2024-02-24 00:14:00.165115+00:00, run_end_date=2024-02-24 00:14:04.011793+00:00, run_duration=3.846678, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:13:00+00:00, data_interval_end=2024-02-24 00:14:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:14:04.022252502Z [2024-02-24T00:14:04.021+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:14:00+00:00, run_after=2024-02-24T00:15:00+00:00 2024-02-24T00:14:04.030119233Z [2024-02-24T00:14:04.029+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:14:04.030426737Z [2024-02-24T00:14:04.030+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:13:00+00:00, run_id=scheduled__2024-02-24T00:13:00+00:00, run_start_date=2024-02-24 00:14:00.162996+00:00, run_end_date=2024-02-24 00:14:04.030028+00:00, run_duration=3.867032, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:13:00+00:00, data_interval_end=2024-02-24 00:14:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:14:04.040375333Z [2024-02-24T00:14:04.040+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:14:00+00:00, run_after=2024-02-24T00:15:00+00:00 2024-02-24T00:14:04.070808081Z [2024-02-24T00:14:04.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:13:00+00:00 exited with status success for try_number 1 2024-02-24T00:14:04.071143986Z [2024-02-24T00:14:04.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:13:00+00:00 exited with status success for try_number 1 2024-02-24T00:14:04.078973324Z [2024-02-24T00:14:04.078+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:13:00+00:00, map_index=-1, run_start_date=2024-02-24 00:14:02.184650+00:00, run_end_date=2024-02-24 00:14:03.807498+00:00, run_duration=1.622848, state=success, executor_state=success, try_number=1, max_tries=1, job_id=200, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:14:00.249107+00:00, queued_by_job_id=2, pid=3023 2024-02-24T00:14:04.079271069Z [2024-02-24T00:14:04.078+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:13:00+00:00, map_index=-1, run_start_date=2024-02-24 00:14:02.471315+00:00, run_end_date=2024-02-24 00:14:03.877061+00:00, run_duration=1.405746, state=success, executor_state=success, try_number=1, max_tries=1, job_id=201, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:14:00.249107+00:00, queued_by_job_id=2, pid=3029 2024-02-24T00:15:00.057516981Z [2024-02-24T00:15:00.056+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:15:00+00:00, run_after=2024-02-24T00:16:00+00:00 2024-02-24T00:15:00.067833911Z [2024-02-24T00:15:00.067+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:15:00.082605236Z [2024-02-24T00:15:00.082+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:15:00+00:00, run_after=2024-02-24T00:16:00+00:00 2024-02-24T00:15:00.098314958Z [2024-02-24T00:15:00.097+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:15:00+00:00, run_after=2024-02-24T00:20:00+00:00 2024-02-24T00:15:00.198312503Z [2024-02-24T00:15:00.197+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T00:15:00.198343775Z 2024-02-24T00:15:00.198352858Z 2024-02-24T00:15:00.198357174Z 2024-02-24T00:15:00.198361471Z 2024-02-24T00:15:00.198681840Z [2024-02-24T00:15:00.198+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:15:00.198954958Z [2024-02-24T00:15:00.198+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:15:00.199240493Z [2024-02-24T00:15:00.199+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:15:00.199459334Z [2024-02-24T00:15:00.199+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:15:00.200225441Z [2024-02-24T00:15:00.199+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:15:00.200239452Z 2024-02-24T00:15:00.200247387Z 2024-02-24T00:15:00.200279781Z 2024-02-24T00:15:00.200287311Z 2024-02-24T00:15:00.205114707Z [2024-02-24T00:15:00.204+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T00:15:00.205163794Z [2024-02-24T00:15:00.204+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:15:00.205436304Z [2024-02-24T00:15:00.205+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:15:00.205588688Z [2024-02-24T00:15:00.205+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:15:00.205946351Z [2024-02-24T00:15:00.205+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:15:00.206136565Z [2024-02-24T00:15:00.205+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:15:00.206413392Z [2024-02-24T00:15:00.206+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:15:00.206526986Z [2024-02-24T00:15:00.206+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:15:00.547965389Z [2024-02-24T00:15:00.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T00:10:00+00:00 exited with status queued for try_number 1 2024-02-24T00:15:00.547991263Z [2024-02-24T00:15:00.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:14:00+00:00 exited with status queued for try_number 1 2024-02-24T00:15:00.548093543Z [2024-02-24T00:15:00.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:14:00+00:00 exited with status queued for try_number 1 2024-02-24T00:15:00.548213853Z [2024-02-24T00:15:00.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:14:00+00:00 exited with status queued for try_number 1 2024-02-24T00:15:00.556269531Z [2024-02-24T00:15:00.555+0000] {scheduler_job.py:635} INFO - Setting external_id for to e3be86a9-be97-4379-ba8e-3c7edaea8b0b 2024-02-24T00:15:00.556536510Z [2024-02-24T00:15:00.556+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad1d8c2d-acd4-47dd-8ff4-35926b06708c 2024-02-24T00:15:00.556730671Z [2024-02-24T00:15:00.556+0000] {scheduler_job.py:635} INFO - Setting external_id for to 85d5a130-8084-4d01-bb39-b3cfeda47142 2024-02-24T00:15:00.556939462Z [2024-02-24T00:15:00.556+0000] {scheduler_job.py:635} INFO - Setting external_id for to 686a3bd8-2bff-46a8-889e-5c6560abc60e 2024-02-24T00:15:02.734253431Z [2024-02-24T00:15:02.727+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:15:02.735220865Z [2024-02-24T00:15:02.734+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:14:00+00:00, run_id=scheduled__2024-02-24T00:14:00+00:00, run_start_date=2024-02-24 00:15:00.113217+00:00, run_end_date=2024-02-24 00:15:02.734730+00:00, run_duration=2.621513, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:14:00+00:00, data_interval_end=2024-02-24 00:15:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:15:02.753465478Z [2024-02-24T00:15:02.753+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:15:00+00:00, run_after=2024-02-24T00:16:00+00:00 2024-02-24T00:15:02.858434692Z [2024-02-24T00:15:02.858+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:14:00+00:00 exited with status success for try_number 1 2024-02-24T00:15:02.869454916Z [2024-02-24T00:15:02.868+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:14:00+00:00, map_index=-1, run_start_date=2024-02-24 00:15:01.240341+00:00, run_end_date=2024-02-24 00:15:01.713996+00:00, run_duration=0.473655, state=success, executor_state=success, try_number=1, max_tries=1, job_id=202, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:15:00.201453+00:00, queued_by_job_id=2, pid=3057 2024-02-24T00:15:03.929318988Z [2024-02-24T00:15:03.928+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:15:03.929678265Z [2024-02-24T00:15:03.929+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:14:00+00:00, run_id=scheduled__2024-02-24T00:14:00+00:00, run_start_date=2024-02-24 00:15:00.114827+00:00, run_end_date=2024-02-24 00:15:03.929133+00:00, run_duration=3.814306, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:14:00+00:00, data_interval_end=2024-02-24 00:15:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:15:03.940149478Z [2024-02-24T00:15:03.939+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:15:00+00:00, run_after=2024-02-24T00:16:00+00:00 2024-02-24T00:15:03.983699465Z [2024-02-24T00:15:03.983+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T00:15:03.983739393Z 2024-02-24T00:15:03.983747842Z [2024-02-24T00:15:03.983+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:15:03.984283681Z [2024-02-24T00:15:03.984+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:15:03.984305410Z 2024-02-24T00:15:03.986988055Z [2024-02-24T00:15:03.986+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T00:15:03.987024454Z [2024-02-24T00:15:03.986+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:15:04.057454982Z [2024-02-24T00:15:04.057+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T00:10:00+00:00 exited with status queued for try_number 1 2024-02-24T00:15:04.057490876Z [2024-02-24T00:15:04.057+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T00:10:00+00:00 exited with status success for try_number 1 2024-02-24T00:15:04.057511574Z [2024-02-24T00:15:04.057+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:14:00+00:00 exited with status success for try_number 1 2024-02-24T00:15:04.067112121Z [2024-02-24T00:15:04.066+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:14:00+00:00, map_index=-1, run_start_date=2024-02-24 00:15:02.263300+00:00, run_end_date=2024-02-24 00:15:03.598919+00:00, run_duration=1.335619, state=success, executor_state=success, try_number=1, max_tries=1, job_id=203, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:15:00.201453+00:00, queued_by_job_id=2, pid=3081 2024-02-24T00:15:04.067156640Z [2024-02-24T00:15:04.067+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0379279d-6802-495b-8ae4-88caba666cd7 2024-02-24T00:15:04.067346748Z [2024-02-24T00:15:04.067+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T00:10:00+00:00, map_index=-1, run_start_date=2024-02-24 00:15:02.387664+00:00, run_end_date=2024-02-24 00:15:02.880296+00:00, run_duration=0.492632, state=success, executor_state=success, try_number=1, max_tries=1, job_id=204, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:15:00.201453+00:00, queued_by_job_id=2, pid=3082 2024-02-24T00:15:05.209047665Z [2024-02-24T00:15:05.208+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:15:05.209192609Z [2024-02-24T00:15:05.208+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:14:00+00:00, run_id=scheduled__2024-02-24T00:14:00+00:00, run_start_date=2024-02-24 00:15:00.116205+00:00, run_end_date=2024-02-24 00:15:05.208878+00:00, run_duration=5.092673, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:14:00+00:00, data_interval_end=2024-02-24 00:15:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:15:05.218662106Z [2024-02-24T00:15:05.218+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:15:00+00:00, run_after=2024-02-24T00:16:00+00:00 2024-02-24T00:15:05.271801715Z [2024-02-24T00:15:05.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:14:00+00:00 exited with status success for try_number 1 2024-02-24T00:15:05.279406637Z [2024-02-24T00:15:05.278+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:14:00+00:00, map_index=-1, run_start_date=2024-02-24 00:15:02.473030+00:00, run_end_date=2024-02-24 00:15:04.194639+00:00, run_duration=1.721609, state=success, executor_state=success, try_number=1, max_tries=1, job_id=205, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:15:00.201453+00:00, queued_by_job_id=2, pid=3083 2024-02-24T00:15:06.682862901Z [2024-02-24T00:15:06.682+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T00:15:06.682908879Z 2024-02-24T00:15:06.683167902Z [2024-02-24T00:15:06.682+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:15:06.683904234Z [2024-02-24T00:15:06.683+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:15:06.683921185Z 2024-02-24T00:15:06.686596745Z [2024-02-24T00:15:06.686+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T00:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T00:15:06.686704326Z [2024-02-24T00:15:06.686+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T00:15:06.751605150Z [2024-02-24T00:15:06.751+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T00:10:00+00:00 exited with status queued for try_number 1 2024-02-24T00:15:06.751833163Z [2024-02-24T00:15:06.751+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T00:10:00+00:00 exited with status success for try_number 1 2024-02-24T00:15:06.758893697Z [2024-02-24T00:15:06.758+0000] {scheduler_job.py:635} INFO - Setting external_id for to 79b2f9a9-bc18-40d8-93ce-c100ae82aa94 2024-02-24T00:15:06.759261237Z [2024-02-24T00:15:06.758+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T00:10:00+00:00, map_index=-1, run_start_date=2024-02-24 00:15:05.633732+00:00, run_end_date=2024-02-24 00:15:05.979480+00:00, run_duration=0.345748, state=success, executor_state=success, try_number=1, max_tries=1, job_id=206, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:15:03.984583+00:00, queued_by_job_id=2, pid=3106 2024-02-24T00:15:09.012796977Z [2024-02-24T00:15:09.012+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T00:15:09.012839210Z 2024-02-24T00:15:09.012847495Z [2024-02-24T00:15:09.012+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:15:09.013554744Z [2024-02-24T00:15:09.013+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:15:09.013577656Z 2024-02-24T00:15:09.016610486Z [2024-02-24T00:15:09.016+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:15:09.016642314Z [2024-02-24T00:15:09.016+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:15:09.065546605Z [2024-02-24T00:15:09.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T00:10:00+00:00 exited with status queued for try_number 1 2024-02-24T00:15:09.065970545Z [2024-02-24T00:15:09.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T00:10:00+00:00 exited with status success for try_number 1 2024-02-24T00:15:09.077483401Z [2024-02-24T00:15:09.077+0000] {scheduler_job.py:635} INFO - Setting external_id for to 712db18c-cafd-4b30-b31e-766137c673dc 2024-02-24T00:15:09.078021961Z [2024-02-24T00:15:09.077+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T00:10:00+00:00, map_index=0, run_start_date=2024-02-24 00:15:08.323290+00:00, run_end_date=2024-02-24 00:15:08.655103+00:00, run_duration=0.331813, state=success, executor_state=success, try_number=1, max_tries=1, job_id=207, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:15:06.684293+00:00, queued_by_job_id=2, pid=3114 2024-02-24T00:15:11.713413229Z [2024-02-24T00:15:11.712+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:15:11.713843771Z [2024-02-24T00:15:11.713+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:10:00+00:00, run_id=scheduled__2024-02-24T00:10:00+00:00, run_start_date=2024-02-24 00:15:00.111613+00:00, run_end_date=2024-02-24 00:15:11.713243+00:00, run_duration=11.60163, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:10:00+00:00, data_interval_end=2024-02-24 00:15:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T00:15:11.727122470Z [2024-02-24T00:15:11.726+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:15:00+00:00, run_after=2024-02-24T00:20:00+00:00 2024-02-24T00:15:11.761749645Z [2024-02-24T00:15:11.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T00:10:00+00:00 exited with status success for try_number 1 2024-02-24T00:15:11.768012548Z [2024-02-24T00:15:11.767+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T00:10:00+00:00, map_index=-1, run_start_date=2024-02-24 00:15:10.566549+00:00, run_end_date=2024-02-24 00:15:10.891013+00:00, run_duration=0.324464, state=success, executor_state=success, try_number=1, max_tries=1, job_id=208, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:15:09.014116+00:00, queued_by_job_id=2, pid=3122 2024-02-24T00:16:00.628687899Z [2024-02-24T00:16:00.624+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:16:00.640417568Z [2024-02-24T00:16:00.640+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:16:00+00:00, run_after=2024-02-24T00:17:00+00:00 2024-02-24T00:16:00.662072246Z [2024-02-24T00:16:00.661+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:16:00+00:00, run_after=2024-02-24T00:17:00+00:00 2024-02-24T00:16:00.671788558Z [2024-02-24T00:16:00.671+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:16:00.749723118Z [2024-02-24T00:16:00.749+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T00:16:00.749822860Z 2024-02-24T00:16:00.749829585Z 2024-02-24T00:16:00.749832856Z 2024-02-24T00:16:00.749836380Z 2024-02-24T00:16:00.750110002Z [2024-02-24T00:16:00.749+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T00:16:00.750356827Z [2024-02-24T00:16:00.750+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:16:00.750521667Z [2024-02-24T00:16:00.750+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:16:00.750614123Z [2024-02-24T00:16:00.750+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:16:00.751222622Z [2024-02-24T00:16:00.751+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:16:00.751233591Z 2024-02-24T00:16:00.751239282Z 2024-02-24T00:16:00.751244625Z 2024-02-24T00:16:00.751250010Z 2024-02-24T00:16:00.754802665Z [2024-02-24T00:16:00.754+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:16:00.755045514Z [2024-02-24T00:16:00.754+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T00:16:00.755397911Z [2024-02-24T00:16:00.755+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:16:00.755686158Z [2024-02-24T00:16:00.755+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:16:00.756116190Z [2024-02-24T00:16:00.755+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:16:00.756351311Z [2024-02-24T00:16:00.756+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:16:00.756662152Z [2024-02-24T00:16:00.756+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:16:00.756861167Z [2024-02-24T00:16:00.756+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:16:01.258492349Z [2024-02-24T00:16:01.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:14:00+00:00 exited with status queued for try_number 1 2024-02-24T00:16:01.258758726Z [2024-02-24T00:16:01.258+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:15:00+00:00 exited with status queued for try_number 1 2024-02-24T00:16:01.263802789Z [2024-02-24T00:16:01.261+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:15:00+00:00 exited with status queued for try_number 1 2024-02-24T00:16:01.263830830Z [2024-02-24T00:16:01.262+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:15:00+00:00 exited with status queued for try_number 1 2024-02-24T00:16:01.282471012Z [2024-02-24T00:16:01.280+0000] {scheduler_job.py:635} INFO - Setting external_id for to e85866a8-1f47-4ffe-9f9b-e9b9092d1f69 2024-02-24T00:16:01.282492523Z [2024-02-24T00:16:01.281+0000] {scheduler_job.py:635} INFO - Setting external_id for to e14fff4f-19b9-4f20-9e59-a2922fe86566 2024-02-24T00:16:01.282496661Z [2024-02-24T00:16:01.281+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3aff8eee-cd26-4e8c-98dc-655537cf83f6 2024-02-24T00:16:01.282500551Z [2024-02-24T00:16:01.281+0000] {scheduler_job.py:635} INFO - Setting external_id for to b4150870-23f0-41c3-bcd3-4ca3aba942bc 2024-02-24T00:16:04.070869671Z [2024-02-24T00:16:04.070+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:16:04.072187670Z [2024-02-24T00:16:04.071+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 00:14:00+00:00, run_id=scheduled__2024-02-24T00:14:00+00:00, run_start_date=2024-02-24 00:16:00.682510+00:00, run_end_date=2024-02-24 00:16:04.070782+00:00, run_duration=3.388272, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:14:00+00:00, data_interval_end=2024-02-24 00:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T00:16:04.081736408Z [2024-02-24T00:16:04.081+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T00:16:00+00:00, run_after=2024-02-24T00:18:00+00:00 2024-02-24T00:16:04.102586746Z [2024-02-24T00:16:04.102+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:16:04.103022291Z [2024-02-24T00:16:04.102+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:15:00+00:00, run_id=scheduled__2024-02-24T00:15:00+00:00, run_start_date=2024-02-24 00:16:00.683830+00:00, run_end_date=2024-02-24 00:16:04.102512+00:00, run_duration=3.418682, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:15:00+00:00, data_interval_end=2024-02-24 00:16:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:16:04.113401409Z [2024-02-24T00:16:04.113+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:16:00+00:00, run_after=2024-02-24T00:17:00+00:00 2024-02-24T00:16:04.214720090Z [2024-02-24T00:16:04.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:14:00+00:00 exited with status success for try_number 1 2024-02-24T00:16:04.214939992Z [2024-02-24T00:16:04.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:15:00+00:00 exited with status success for try_number 1 2024-02-24T00:16:04.228268919Z [2024-02-24T00:16:04.227+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T00:14:00+00:00, map_index=-1, run_start_date=2024-02-24 00:16:02.484091+00:00, run_end_date=2024-02-24 00:16:03.307186+00:00, run_duration=0.823095, state=success, executor_state=success, try_number=1, max_tries=1, job_id=210, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:16:00.752044+00:00, queued_by_job_id=2, pid=3145 2024-02-24T00:16:04.234470556Z [2024-02-24T00:16:04.234+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:15:00+00:00, map_index=-1, run_start_date=2024-02-24 00:16:02.435577+00:00, run_end_date=2024-02-24 00:16:03.586855+00:00, run_duration=1.151278, state=success, executor_state=success, try_number=1, max_tries=1, job_id=209, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:16:00.752044+00:00, queued_by_job_id=2, pid=3146 2024-02-24T00:16:07.104053373Z [2024-02-24T00:16:07.103+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:16:07.104240717Z [2024-02-24T00:16:07.104+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:15:00+00:00, run_id=scheduled__2024-02-24T00:15:00+00:00, run_start_date=2024-02-24 00:16:00.685967+00:00, run_end_date=2024-02-24 00:16:07.103937+00:00, run_duration=6.41797, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:15:00+00:00, data_interval_end=2024-02-24 00:16:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:16:07.113113112Z [2024-02-24T00:16:07.112+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:16:00+00:00, run_after=2024-02-24T00:17:00+00:00 2024-02-24T00:16:07.119885420Z [2024-02-24T00:16:07.119+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:16:07.120112757Z [2024-02-24T00:16:07.119+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:15:00+00:00, run_id=scheduled__2024-02-24T00:15:00+00:00, run_start_date=2024-02-24 00:16:00.684905+00:00, run_end_date=2024-02-24 00:16:07.119774+00:00, run_duration=6.434869, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:15:00+00:00, data_interval_end=2024-02-24 00:16:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:16:07.129674414Z [2024-02-24T00:16:07.129+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:16:00+00:00, run_after=2024-02-24T00:17:00+00:00 2024-02-24T00:16:07.165040517Z [2024-02-24T00:16:07.163+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:15:00+00:00 exited with status success for try_number 1 2024-02-24T00:16:07.168853324Z [2024-02-24T00:16:07.168+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:15:00+00:00, map_index=-1, run_start_date=2024-02-24 00:16:04.776604+00:00, run_end_date=2024-02-24 00:16:06.078670+00:00, run_duration=1.302066, state=success, executor_state=success, try_number=1, max_tries=1, job_id=211, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:16:00.752044+00:00, queued_by_job_id=2, pid=3169 2024-02-24T00:16:08.015346719Z [2024-02-24T00:16:08.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:15:00+00:00 exited with status success for try_number 1 2024-02-24T00:16:08.021369879Z [2024-02-24T00:16:08.021+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:15:00+00:00, map_index=-1, run_start_date=2024-02-24 00:16:04.912637+00:00, run_end_date=2024-02-24 00:16:07.016702+00:00, run_duration=2.104065, state=success, executor_state=success, try_number=1, max_tries=1, job_id=212, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:16:00.752044+00:00, queued_by_job_id=2, pid=3170 2024-02-24T00:16:59.718349546Z [2024-02-24T00:16:59.717+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T00:17:00.771278965Z [2024-02-24T00:17:00.770+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:17:00+00:00, run_after=2024-02-24T00:18:00+00:00 2024-02-24T00:17:00.778772175Z [2024-02-24T00:17:00.778+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:17:00.790992870Z [2024-02-24T00:17:00.790+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:17:00+00:00, run_after=2024-02-24T00:18:00+00:00 2024-02-24T00:17:00.852265219Z [2024-02-24T00:17:00.851+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T00:17:00.852298107Z 2024-02-24T00:17:00.852382768Z 2024-02-24T00:17:00.852388767Z 2024-02-24T00:17:00.852428899Z [2024-02-24T00:17:00.852+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:17:00.852532060Z [2024-02-24T00:17:00.852+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:17:00.852666577Z [2024-02-24T00:17:00.852+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:17:00.853485968Z [2024-02-24T00:17:00.853+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:17:00.853515373Z 2024-02-24T00:17:00.853519056Z 2024-02-24T00:17:00.853522328Z 2024-02-24T00:17:00.857818241Z [2024-02-24T00:17:00.857+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:17:00.858129796Z [2024-02-24T00:17:00.857+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:17:00.858520750Z [2024-02-24T00:17:00.858+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:17:00.858667274Z [2024-02-24T00:17:00.858+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:17:00.858884044Z [2024-02-24T00:17:00.858+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:17:00.859031698Z [2024-02-24T00:17:00.858+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:17:01.182771422Z [2024-02-24T00:17:01.182+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:16:00+00:00 exited with status queued for try_number 1 2024-02-24T00:17:01.184252987Z [2024-02-24T00:17:01.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:16:00+00:00 exited with status queued for try_number 1 2024-02-24T00:17:01.184372217Z [2024-02-24T00:17:01.184+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:16:00+00:00 exited with status queued for try_number 1 2024-02-24T00:17:01.202972534Z [2024-02-24T00:17:01.200+0000] {scheduler_job.py:635} INFO - Setting external_id for to 481ba2ea-29dc-4fb8-9104-4858fad0456f 2024-02-24T00:17:01.203931104Z [2024-02-24T00:17:01.203+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20264d20-2c5d-423f-b0ec-21386f9f402a 2024-02-24T00:17:01.204236431Z [2024-02-24T00:17:01.204+0000] {scheduler_job.py:635} INFO - Setting external_id for to 163d09a7-a1eb-4345-92d1-b13976c509a3 2024-02-24T00:17:02.918049511Z [2024-02-24T00:17:02.917+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:17:02.918377347Z [2024-02-24T00:17:02.918+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:16:00+00:00, run_id=scheduled__2024-02-24T00:16:00+00:00, run_start_date=2024-02-24 00:17:00.801535+00:00, run_end_date=2024-02-24 00:17:02.918021+00:00, run_duration=2.116486, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:16:00+00:00, data_interval_end=2024-02-24 00:17:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:17:02.930257409Z [2024-02-24T00:17:02.929+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:17:00+00:00, run_after=2024-02-24T00:18:00+00:00 2024-02-24T00:17:02.962494056Z [2024-02-24T00:17:02.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:16:00+00:00 exited with status success for try_number 1 2024-02-24T00:17:02.967992969Z [2024-02-24T00:17:02.967+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:16:00+00:00, map_index=-1, run_start_date=2024-02-24 00:17:02.097435+00:00, run_end_date=2024-02-24 00:17:02.498244+00:00, run_duration=0.400809, state=success, executor_state=success, try_number=1, max_tries=1, job_id=213, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:17:00.855114+00:00, queued_by_job_id=2, pid=3203 2024-02-24T00:17:06.088932550Z [2024-02-24T00:17:06.088+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:17:06.089421448Z [2024-02-24T00:17:06.088+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:16:00+00:00, run_id=scheduled__2024-02-24T00:16:00+00:00, run_start_date=2024-02-24 00:17:00.802970+00:00, run_end_date=2024-02-24 00:17:06.088766+00:00, run_duration=5.285796, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:16:00+00:00, data_interval_end=2024-02-24 00:17:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:17:06.099965884Z [2024-02-24T00:17:06.099+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:17:00+00:00, run_after=2024-02-24T00:18:00+00:00 2024-02-24T00:17:06.107091638Z [2024-02-24T00:17:06.106+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:17:06.107440861Z [2024-02-24T00:17:06.107+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:16:00+00:00, run_id=scheduled__2024-02-24T00:16:00+00:00, run_start_date=2024-02-24 00:17:00.804149+00:00, run_end_date=2024-02-24 00:17:06.106995+00:00, run_duration=5.302846, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:16:00+00:00, data_interval_end=2024-02-24 00:17:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:17:06.117311328Z [2024-02-24T00:17:06.116+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:17:00+00:00, run_after=2024-02-24T00:18:00+00:00 2024-02-24T00:17:06.149614411Z [2024-02-24T00:17:06.149+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:16:00+00:00 exited with status success for try_number 1 2024-02-24T00:17:06.149947353Z [2024-02-24T00:17:06.149+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:16:00+00:00 exited with status success for try_number 1 2024-02-24T00:17:06.158030555Z [2024-02-24T00:17:06.157+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:16:00+00:00, map_index=-1, run_start_date=2024-02-24 00:17:03.515567+00:00, run_end_date=2024-02-24 00:17:05.150282+00:00, run_duration=1.634715, state=success, executor_state=success, try_number=1, max_tries=1, job_id=215, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:17:00.855114+00:00, queued_by_job_id=2, pid=3227 2024-02-24T00:17:06.158711707Z [2024-02-24T00:17:06.158+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:16:00+00:00, map_index=-1, run_start_date=2024-02-24 00:17:03.082724+00:00, run_end_date=2024-02-24 00:17:05.143917+00:00, run_duration=2.061193, state=success, executor_state=success, try_number=1, max_tries=1, job_id=214, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:17:00.855114+00:00, queued_by_job_id=2, pid=3216 2024-02-24T00:18:00.888946331Z [2024-02-24T00:18:00.887+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:18:00.915440158Z [2024-02-24T00:18:00.914+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:18:00+00:00, run_after=2024-02-24T00:19:00+00:00 2024-02-24T00:18:00.930927411Z [2024-02-24T00:18:00.930+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:18:00+00:00, run_after=2024-02-24T00:19:00+00:00 2024-02-24T00:18:00.940640238Z [2024-02-24T00:18:00.940+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:18:01.050904391Z [2024-02-24T00:18:01.050+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T00:18:01.050931472Z 2024-02-24T00:18:01.050936243Z 2024-02-24T00:18:01.050939460Z 2024-02-24T00:18:01.050954011Z 2024-02-24T00:18:01.051193279Z [2024-02-24T00:18:01.051+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T00:18:01.051412562Z [2024-02-24T00:18:01.051+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:18:01.051714854Z [2024-02-24T00:18:01.051+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:18:01.052129537Z [2024-02-24T00:18:01.051+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:18:01.052975504Z [2024-02-24T00:18:01.052+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:18:01.052985921Z 2024-02-24T00:18:01.052991041Z 2024-02-24T00:18:01.052995947Z 2024-02-24T00:18:01.053000246Z 2024-02-24T00:18:01.057926275Z [2024-02-24T00:18:01.057+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:18:01.058181445Z [2024-02-24T00:18:01.057+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T00:18:01.058578581Z [2024-02-24T00:18:01.058+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:18:01.058820573Z [2024-02-24T00:18:01.058+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:18:01.059160351Z [2024-02-24T00:18:01.058+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:18:01.059409211Z [2024-02-24T00:18:01.059+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:18:01.059757164Z [2024-02-24T00:18:01.059+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:18:01.059981442Z [2024-02-24T00:18:01.059+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:18:01.541810426Z [2024-02-24T00:18:01.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:16:00+00:00 exited with status queued for try_number 1 2024-02-24T00:18:01.542260451Z [2024-02-24T00:18:01.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:17:00+00:00 exited with status queued for try_number 1 2024-02-24T00:18:01.542538532Z [2024-02-24T00:18:01.542+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:17:00+00:00 exited with status queued for try_number 1 2024-02-24T00:18:01.542704557Z [2024-02-24T00:18:01.542+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:17:00+00:00 exited with status queued for try_number 1 2024-02-24T00:18:01.565074436Z [2024-02-24T00:18:01.564+0000] {scheduler_job.py:635} INFO - Setting external_id for to c4ebee02-31bb-47ae-8474-1b1925ffa2c3 2024-02-24T00:18:01.565294122Z [2024-02-24T00:18:01.565+0000] {scheduler_job.py:635} INFO - Setting external_id for to b8c72414-4ac8-4cd5-bb7c-8b60c88b2449 2024-02-24T00:18:01.565416870Z [2024-02-24T00:18:01.565+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60f7fa3a-1397-469c-8a43-71540283b9f1 2024-02-24T00:18:01.565552658Z [2024-02-24T00:18:01.565+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa730b07-e713-49df-bf55-b360c2c5f07b 2024-02-24T00:18:03.388927689Z [2024-02-24T00:18:03.388+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:18:03.389393305Z [2024-02-24T00:18:03.389+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 00:16:00+00:00, run_id=scheduled__2024-02-24T00:16:00+00:00, run_start_date=2024-02-24 00:18:00.960572+00:00, run_end_date=2024-02-24 00:18:03.388841+00:00, run_duration=2.428269, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:16:00+00:00, data_interval_end=2024-02-24 00:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T00:18:03.397501385Z [2024-02-24T00:18:03.397+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T00:18:00+00:00, run_after=2024-02-24T00:20:00+00:00 2024-02-24T00:18:03.420199072Z [2024-02-24T00:18:03.419+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:18:03.420597665Z [2024-02-24T00:18:03.420+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:17:00+00:00, run_id=scheduled__2024-02-24T00:17:00+00:00, run_start_date=2024-02-24 00:18:00.964075+00:00, run_end_date=2024-02-24 00:18:03.420107+00:00, run_duration=2.456032, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:17:00+00:00, data_interval_end=2024-02-24 00:18:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:18:03.431850263Z [2024-02-24T00:18:03.431+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:18:00+00:00, run_after=2024-02-24T00:19:00+00:00 2024-02-24T00:18:03.478205914Z [2024-02-24T00:18:03.477+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:16:00+00:00 exited with status success for try_number 1 2024-02-24T00:18:03.478461302Z [2024-02-24T00:18:03.478+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:17:00+00:00 exited with status success for try_number 1 2024-02-24T00:18:03.489565834Z [2024-02-24T00:18:03.489+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T00:16:00+00:00, map_index=-1, run_start_date=2024-02-24 00:18:01.883325+00:00, run_end_date=2024-02-24 00:18:02.438328+00:00, run_duration=0.555003, state=success, executor_state=success, try_number=1, max_tries=1, job_id=216, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:18:01.054312+00:00, queued_by_job_id=2, pid=3256 2024-02-24T00:18:03.489904057Z [2024-02-24T00:18:03.489+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:17:00+00:00, map_index=-1, run_start_date=2024-02-24 00:18:02.162110+00:00, run_end_date=2024-02-24 00:18:02.642904+00:00, run_duration=0.480794, state=success, executor_state=success, try_number=1, max_tries=1, job_id=217, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:18:01.054312+00:00, queued_by_job_id=2, pid=3257 2024-02-24T00:18:06.011147776Z [2024-02-24T00:18:06.010+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:18:06.011487741Z [2024-02-24T00:18:06.011+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:17:00+00:00, run_id=scheduled__2024-02-24T00:17:00+00:00, run_start_date=2024-02-24 00:18:00.966750+00:00, run_end_date=2024-02-24 00:18:06.010993+00:00, run_duration=5.044243, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:17:00+00:00, data_interval_end=2024-02-24 00:18:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:18:06.023443896Z [2024-02-24T00:18:06.022+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:18:00+00:00, run_after=2024-02-24T00:19:00+00:00 2024-02-24T00:18:06.083375774Z [2024-02-24T00:18:06.082+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:17:00+00:00 exited with status success for try_number 1 2024-02-24T00:18:06.103148077Z [2024-02-24T00:18:06.102+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:17:00+00:00, map_index=-1, run_start_date=2024-02-24 00:18:03.376603+00:00, run_end_date=2024-02-24 00:18:05.441616+00:00, run_duration=2.065013, state=success, executor_state=success, try_number=1, max_tries=1, job_id=218, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:18:01.054312+00:00, queued_by_job_id=2, pid=3280 2024-02-24T00:18:06.247271895Z [2024-02-24T00:18:06.246+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:18:06.253965413Z [2024-02-24T00:18:06.252+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:17:00+00:00, run_id=scheduled__2024-02-24T00:17:00+00:00, run_start_date=2024-02-24 00:18:00.969093+00:00, run_end_date=2024-02-24 00:18:06.252155+00:00, run_duration=5.283062, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:17:00+00:00, data_interval_end=2024-02-24 00:18:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:18:06.263890643Z [2024-02-24T00:18:06.263+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:18:00+00:00, run_after=2024-02-24T00:19:00+00:00 2024-02-24T00:18:06.298605680Z [2024-02-24T00:18:06.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:17:00+00:00 exited with status success for try_number 1 2024-02-24T00:18:06.304786132Z [2024-02-24T00:18:06.304+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:17:00+00:00, map_index=-1, run_start_date=2024-02-24 00:18:03.455980+00:00, run_end_date=2024-02-24 00:18:06.131055+00:00, run_duration=2.675075, state=success, executor_state=success, try_number=1, max_tries=1, job_id=219, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:18:01.054312+00:00, queued_by_job_id=2, pid=3281 2024-02-24T00:19:00.029539860Z [2024-02-24T00:19:00.029+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:19:00+00:00, run_after=2024-02-24T00:20:00+00:00 2024-02-24T00:19:00.037660466Z [2024-02-24T00:19:00.037+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:19:00.048005414Z [2024-02-24T00:19:00.047+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:19:00+00:00, run_after=2024-02-24T00:20:00+00:00 2024-02-24T00:19:00.098883518Z [2024-02-24T00:19:00.098+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T00:19:00.098942260Z 2024-02-24T00:19:00.098964495Z 2024-02-24T00:19:00.098970915Z 2024-02-24T00:19:00.099387684Z [2024-02-24T00:19:00.099+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:19:00.099459941Z [2024-02-24T00:19:00.099+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:19:00.099661288Z [2024-02-24T00:19:00.099+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:19:00.100238082Z [2024-02-24T00:19:00.099+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:19:00.100288466Z 2024-02-24T00:19:00.100298541Z 2024-02-24T00:19:00.100306358Z 2024-02-24T00:19:00.110470405Z [2024-02-24T00:19:00.110+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:19:00.110569123Z [2024-02-24T00:19:00.110+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:19:00.110846924Z [2024-02-24T00:19:00.110+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:19:00.110937418Z [2024-02-24T00:19:00.110+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:19:00.111297797Z [2024-02-24T00:19:00.110+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:19:00.111320359Z [2024-02-24T00:19:00.111+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:19:00.364315549Z [2024-02-24T00:19:00.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:18:00+00:00 exited with status queued for try_number 1 2024-02-24T00:19:00.367023033Z [2024-02-24T00:19:00.364+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:18:00+00:00 exited with status queued for try_number 1 2024-02-24T00:19:00.367184082Z [2024-02-24T00:19:00.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:18:00+00:00 exited with status queued for try_number 1 2024-02-24T00:19:00.377394976Z [2024-02-24T00:19:00.377+0000] {scheduler_job.py:635} INFO - Setting external_id for to fd7df7b9-fdc0-4b13-90e0-edcb66046bc4 2024-02-24T00:19:00.377611944Z [2024-02-24T00:19:00.377+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ff8f3fe-7955-493d-ac08-c6dca84c49e9 2024-02-24T00:19:00.377973568Z [2024-02-24T00:19:00.377+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd8de86d-cd35-4d69-8b33-4883464eb459 2024-02-24T00:19:01.888148078Z [2024-02-24T00:19:01.887+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:19:01.888536501Z [2024-02-24T00:19:01.888+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:18:00+00:00, run_id=scheduled__2024-02-24T00:18:00+00:00, run_start_date=2024-02-24 00:19:00.057199+00:00, run_end_date=2024-02-24 00:19:01.887986+00:00, run_duration=1.830787, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:18:00+00:00, data_interval_end=2024-02-24 00:19:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:19:01.899719977Z [2024-02-24T00:19:01.899+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:19:00+00:00, run_after=2024-02-24T00:20:00+00:00 2024-02-24T00:19:01.956314082Z [2024-02-24T00:19:01.955+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:18:00+00:00 exited with status success for try_number 1 2024-02-24T00:19:01.963690789Z [2024-02-24T00:19:01.963+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:18:00+00:00, map_index=-1, run_start_date=2024-02-24 00:19:00.842645+00:00, run_end_date=2024-02-24 00:19:01.399678+00:00, run_duration=0.557033, state=success, executor_state=success, try_number=1, max_tries=1, job_id=220, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:19:00.100795+00:00, queued_by_job_id=2, pid=3314 2024-02-24T00:19:03.835366952Z [2024-02-24T00:19:03.834+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:19:03.835752470Z [2024-02-24T00:19:03.835+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:18:00+00:00, run_id=scheduled__2024-02-24T00:18:00+00:00, run_start_date=2024-02-24 00:19:00.058382+00:00, run_end_date=2024-02-24 00:19:03.835261+00:00, run_duration=3.776879, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:18:00+00:00, data_interval_end=2024-02-24 00:19:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:19:03.859440200Z [2024-02-24T00:19:03.859+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:19:00+00:00, run_after=2024-02-24T00:20:00+00:00 2024-02-24T00:19:03.914136536Z [2024-02-24T00:19:03.913+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:18:00+00:00 exited with status success for try_number 1 2024-02-24T00:19:03.919205551Z [2024-02-24T00:19:03.918+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:18:00+00:00, map_index=-1, run_start_date=2024-02-24 00:19:01.989933+00:00, run_end_date=2024-02-24 00:19:03.312843+00:00, run_duration=1.32291, state=success, executor_state=success, try_number=1, max_tries=1, job_id=221, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:19:00.100795+00:00, queued_by_job_id=2, pid=3327 2024-02-24T00:19:04.977567334Z [2024-02-24T00:19:04.976+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:19:04.977895143Z [2024-02-24T00:19:04.977+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:18:00+00:00, run_id=scheduled__2024-02-24T00:18:00+00:00, run_start_date=2024-02-24 00:19:00.059347+00:00, run_end_date=2024-02-24 00:19:04.977399+00:00, run_duration=4.918052, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:18:00+00:00, data_interval_end=2024-02-24 00:19:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:19:04.989170888Z [2024-02-24T00:19:04.988+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:19:00+00:00, run_after=2024-02-24T00:20:00+00:00 2024-02-24T00:19:05.025140935Z [2024-02-24T00:19:05.024+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:18:00+00:00 exited with status success for try_number 1 2024-02-24T00:19:05.035093108Z [2024-02-24T00:19:05.034+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:18:00+00:00, map_index=-1, run_start_date=2024-02-24 00:19:02.345180+00:00, run_end_date=2024-02-24 00:19:04.687919+00:00, run_duration=2.342739, state=success, executor_state=success, try_number=1, max_tries=1, job_id=222, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:19:00.100795+00:00, queued_by_job_id=2, pid=3338 2024-02-24T00:20:00.299546204Z [2024-02-24T00:20:00.299+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:20:00.309739669Z [2024-02-24T00:20:00.309+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:20:00.328113363Z [2024-02-24T00:20:00.327+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:20:00+00:00, run_after=2024-02-24T00:21:00+00:00 2024-02-24T00:20:00.342768322Z [2024-02-24T00:20:00.342+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:20:00+00:00, run_after=2024-02-24T00:21:00+00:00 2024-02-24T00:20:00.359807667Z [2024-02-24T00:20:00.359+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:20:00+00:00, run_after=2024-02-24T00:25:00+00:00 2024-02-24T00:20:00.487545677Z [2024-02-24T00:20:00.487+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-02-24T00:20:00.487586950Z 2024-02-24T00:20:00.487597993Z 2024-02-24T00:20:00.487608690Z 2024-02-24T00:20:00.487618721Z 2024-02-24T00:20:00.487628774Z 2024-02-24T00:20:00.488036934Z [2024-02-24T00:20:00.487+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:20:00.488495937Z [2024-02-24T00:20:00.488+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T00:20:00.488931409Z [2024-02-24T00:20:00.488+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:20:00.489186719Z [2024-02-24T00:20:00.489+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:20:00.489403100Z [2024-02-24T00:20:00.489+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:20:00.490470589Z [2024-02-24T00:20:00.490+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:20:00.490483197Z 2024-02-24T00:20:00.490486824Z 2024-02-24T00:20:00.490490602Z 2024-02-24T00:20:00.490493753Z 2024-02-24T00:20:00.490497200Z 2024-02-24T00:20:00.494751859Z [2024-02-24T00:20:00.494+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T00:20:00.495160570Z [2024-02-24T00:20:00.494+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:20:00.495221379Z [2024-02-24T00:20:00.495+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:20:00.495423139Z [2024-02-24T00:20:00.495+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T00:20:00.495752169Z [2024-02-24T00:20:00.495+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:20:00.495885552Z [2024-02-24T00:20:00.495+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:20:00.496167593Z [2024-02-24T00:20:00.496+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:20:00.496303930Z [2024-02-24T00:20:00.496+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:20:00.496641303Z [2024-02-24T00:20:00.496+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:20:00.496802659Z [2024-02-24T00:20:00.496+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:20:00.915691857Z [2024-02-24T00:20:00.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T00:15:00+00:00 exited with status queued for try_number 1 2024-02-24T00:20:00.915722499Z [2024-02-24T00:20:00.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:18:00+00:00 exited with status queued for try_number 1 2024-02-24T00:20:00.915754950Z [2024-02-24T00:20:00.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:19:00+00:00 exited with status queued for try_number 1 2024-02-24T00:20:00.915810271Z [2024-02-24T00:20:00.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:19:00+00:00 exited with status queued for try_number 1 2024-02-24T00:20:00.915882719Z [2024-02-24T00:20:00.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:19:00+00:00 exited with status queued for try_number 1 2024-02-24T00:20:00.924503920Z [2024-02-24T00:20:00.924+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4bd16d20-34b4-45d9-8c40-82b76f476e29 2024-02-24T00:20:00.924580737Z [2024-02-24T00:20:00.924+0000] {scheduler_job.py:635} INFO - Setting external_id for to b1cf57df-2eed-4d95-aff2-b398fe7a7af7 2024-02-24T00:20:00.924699870Z [2024-02-24T00:20:00.924+0000] {scheduler_job.py:635} INFO - Setting external_id for to d2803106-41d5-4b0c-9fd5-fe1a03ea4366 2024-02-24T00:20:00.924802528Z [2024-02-24T00:20:00.924+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7aa5a67a-25ff-4023-8706-2693c15a2ee0 2024-02-24T00:20:00.924899363Z [2024-02-24T00:20:00.924+0000] {scheduler_job.py:635} INFO - Setting external_id for to 296cd8db-c937-4512-b1d0-5be535f140eb 2024-02-24T00:20:02.905411391Z [2024-02-24T00:20:02.904+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:20:02.905602728Z [2024-02-24T00:20:02.905+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 00:18:00+00:00, run_id=scheduled__2024-02-24T00:18:00+00:00, run_start_date=2024-02-24 00:20:00.375194+00:00, run_end_date=2024-02-24 00:20:02.905236+00:00, run_duration=2.530042, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:18:00+00:00, data_interval_end=2024-02-24 00:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T00:20:02.918552124Z [2024-02-24T00:20:02.918+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T00:20:00+00:00, run_after=2024-02-24T00:22:00+00:00 2024-02-24T00:20:02.935274944Z [2024-02-24T00:20:02.934+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:20:02.935503597Z [2024-02-24T00:20:02.935+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:19:00+00:00, run_id=scheduled__2024-02-24T00:19:00+00:00, run_start_date=2024-02-24 00:20:00.376437+00:00, run_end_date=2024-02-24 00:20:02.935192+00:00, run_duration=2.558755, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:19:00+00:00, data_interval_end=2024-02-24 00:20:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:20:02.952298397Z [2024-02-24T00:20:02.951+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:20:00+00:00, run_after=2024-02-24T00:21:00+00:00 2024-02-24T00:20:03.088121274Z [2024-02-24T00:20:03.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:18:00+00:00 exited with status success for try_number 1 2024-02-24T00:20:03.088166617Z [2024-02-24T00:20:03.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:19:00+00:00 exited with status success for try_number 1 2024-02-24T00:20:03.095738385Z [2024-02-24T00:20:03.095+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T00:18:00+00:00, map_index=-1, run_start_date=2024-02-24 00:20:01.474299+00:00, run_end_date=2024-02-24 00:20:01.870744+00:00, run_duration=0.396445, state=success, executor_state=success, try_number=1, max_tries=1, job_id=223, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:20:00.491573+00:00, queued_by_job_id=2, pid=3362 2024-02-24T00:20:03.096221903Z [2024-02-24T00:20:03.095+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:19:00+00:00, map_index=-1, run_start_date=2024-02-24 00:20:01.815427+00:00, run_end_date=2024-02-24 00:20:02.222147+00:00, run_duration=0.40672, state=success, executor_state=success, try_number=1, max_tries=1, job_id=224, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:20:00.491573+00:00, queued_by_job_id=2, pid=3373 2024-02-24T00:20:04.390453489Z [2024-02-24T00:20:04.389+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T00:20:04.390490756Z 2024-02-24T00:20:04.390638909Z [2024-02-24T00:20:04.390+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:20:04.391448299Z [2024-02-24T00:20:04.391+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:20:04.391464741Z 2024-02-24T00:20:04.395922109Z [2024-02-24T00:20:04.395+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T00:20:04.395972510Z [2024-02-24T00:20:04.395+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:20:04.480714378Z [2024-02-24T00:20:04.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T00:15:00+00:00 exited with status queued for try_number 1 2024-02-24T00:20:04.481830666Z [2024-02-24T00:20:04.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T00:15:00+00:00 exited with status success for try_number 1 2024-02-24T00:20:04.490323620Z [2024-02-24T00:20:04.489+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5bc8cee3-7364-4797-9c16-e3a396bbcd39 2024-02-24T00:20:04.490770165Z [2024-02-24T00:20:04.490+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T00:15:00+00:00, map_index=-1, run_start_date=2024-02-24 00:20:03.249555+00:00, run_end_date=2024-02-24 00:20:03.933397+00:00, run_duration=0.683842, state=success, executor_state=success, try_number=1, max_tries=1, job_id=225, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:20:00.491573+00:00, queued_by_job_id=2, pid=3397 2024-02-24T00:20:05.652442375Z [2024-02-24T00:20:05.651+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:20:05.652738945Z [2024-02-24T00:20:05.652+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:19:00+00:00, run_id=scheduled__2024-02-24T00:19:00+00:00, run_start_date=2024-02-24 00:20:00.377583+00:00, run_end_date=2024-02-24 00:20:05.652348+00:00, run_duration=5.274765, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:19:00+00:00, data_interval_end=2024-02-24 00:20:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:20:05.665115235Z [2024-02-24T00:20:05.664+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:20:00+00:00, run_after=2024-02-24T00:21:00+00:00 2024-02-24T00:20:05.737765435Z [2024-02-24T00:20:05.737+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:19:00+00:00 exited with status success for try_number 1 2024-02-24T00:20:05.746367339Z [2024-02-24T00:20:05.745+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:19:00+00:00, map_index=-1, run_start_date=2024-02-24 00:20:03.499740+00:00, run_end_date=2024-02-24 00:20:05.082051+00:00, run_duration=1.582311, state=success, executor_state=success, try_number=1, max_tries=1, job_id=226, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:20:00.491573+00:00, queued_by_job_id=2, pid=3399 2024-02-24T00:20:06.428289712Z [2024-02-24T00:20:06.427+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:20:06.428648422Z [2024-02-24T00:20:06.428+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:19:00+00:00, run_id=scheduled__2024-02-24T00:19:00+00:00, run_start_date=2024-02-24 00:20:00.378748+00:00, run_end_date=2024-02-24 00:20:06.428207+00:00, run_duration=6.049459, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:19:00+00:00, data_interval_end=2024-02-24 00:20:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:20:06.439106310Z [2024-02-24T00:20:06.438+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:20:00+00:00, run_after=2024-02-24T00:21:00+00:00 2024-02-24T00:20:06.495681651Z [2024-02-24T00:20:06.495+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:19:00+00:00 exited with status success for try_number 1 2024-02-24T00:20:06.506261569Z [2024-02-24T00:20:06.505+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:19:00+00:00, map_index=-1, run_start_date=2024-02-24 00:20:03.457122+00:00, run_end_date=2024-02-24 00:20:05.936167+00:00, run_duration=2.479045, state=success, executor_state=success, try_number=1, max_tries=1, job_id=227, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:20:00.491573+00:00, queued_by_job_id=2, pid=3398 2024-02-24T00:20:06.907044798Z [2024-02-24T00:20:06.906+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T00:20:06.907069294Z 2024-02-24T00:20:06.908285092Z [2024-02-24T00:20:06.907+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:20:06.909819624Z [2024-02-24T00:20:06.909+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:20:06.909837811Z 2024-02-24T00:20:06.914420622Z [2024-02-24T00:20:06.914+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T00:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T00:20:06.914765527Z [2024-02-24T00:20:06.914+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T00:20:06.971762955Z [2024-02-24T00:20:06.971+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T00:15:00+00:00 exited with status queued for try_number 1 2024-02-24T00:20:06.971930911Z [2024-02-24T00:20:06.971+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T00:15:00+00:00 exited with status success for try_number 1 2024-02-24T00:20:06.978327790Z [2024-02-24T00:20:06.977+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31525931-ee52-4d1e-9eed-9d65b114e597 2024-02-24T00:20:06.978598467Z [2024-02-24T00:20:06.978+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T00:15:00+00:00, map_index=-1, run_start_date=2024-02-24 00:20:06.187452+00:00, run_end_date=2024-02-24 00:20:06.593519+00:00, run_duration=0.406067, state=success, executor_state=success, try_number=1, max_tries=1, job_id=228, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:20:04.393126+00:00, queued_by_job_id=2, pid=3422 2024-02-24T00:20:09.314455963Z [2024-02-24T00:20:09.313+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T00:20:09.314484272Z 2024-02-24T00:20:09.314601582Z [2024-02-24T00:20:09.314+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:20:09.315678795Z [2024-02-24T00:20:09.315+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:20:09.315690392Z 2024-02-24T00:20:09.320200977Z [2024-02-24T00:20:09.319+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:20:09.320405695Z [2024-02-24T00:20:09.320+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:20:09.380876370Z [2024-02-24T00:20:09.380+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T00:15:00+00:00 exited with status queued for try_number 1 2024-02-24T00:20:09.381305493Z [2024-02-24T00:20:09.380+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T00:15:00+00:00 exited with status success for try_number 1 2024-02-24T00:20:09.389026925Z [2024-02-24T00:20:09.388+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6f40d9b-0ea9-4872-875b-8b4c551ac3df 2024-02-24T00:20:09.389203439Z [2024-02-24T00:20:09.388+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T00:15:00+00:00, map_index=0, run_start_date=2024-02-24 00:20:08.493432+00:00, run_end_date=2024-02-24 00:20:08.872680+00:00, run_duration=0.379248, state=success, executor_state=success, try_number=1, max_tries=1, job_id=229, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:20:06.910690+00:00, queued_by_job_id=2, pid=3430 2024-02-24T00:20:11.633907425Z [2024-02-24T00:20:11.632+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:20:11.634412029Z [2024-02-24T00:20:11.634+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:15:00+00:00, run_id=scheduled__2024-02-24T00:15:00+00:00, run_start_date=2024-02-24 00:20:00.373295+00:00, run_end_date=2024-02-24 00:20:11.633870+00:00, run_duration=11.260575, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:15:00+00:00, data_interval_end=2024-02-24 00:20:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T00:20:11.650239590Z [2024-02-24T00:20:11.649+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:20:00+00:00, run_after=2024-02-24T00:25:00+00:00 2024-02-24T00:20:11.691140879Z [2024-02-24T00:20:11.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T00:15:00+00:00 exited with status success for try_number 1 2024-02-24T00:20:11.701419409Z [2024-02-24T00:20:11.700+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T00:15:00+00:00, map_index=-1, run_start_date=2024-02-24 00:20:11.077913+00:00, run_end_date=2024-02-24 00:20:11.492377+00:00, run_duration=0.414464, state=success, executor_state=success, try_number=1, max_tries=1, job_id=230, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:20:09.316379+00:00, queued_by_job_id=2, pid=3438 2024-02-24T00:21:00.598015936Z [2024-02-24T00:21:00.594+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:21:00+00:00, run_after=2024-02-24T00:22:00+00:00 2024-02-24T00:21:00.609875587Z [2024-02-24T00:21:00.609+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:21:00.623985773Z [2024-02-24T00:21:00.623+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:21:00+00:00, run_after=2024-02-24T00:22:00+00:00 2024-02-24T00:21:00.710473601Z [2024-02-24T00:21:00.710+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T00:21:00.710510419Z 2024-02-24T00:21:00.710517733Z 2024-02-24T00:21:00.710523640Z 2024-02-24T00:21:00.710540862Z [2024-02-24T00:21:00.710+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:21:00.710787193Z [2024-02-24T00:21:00.710+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:21:00.711009921Z [2024-02-24T00:21:00.710+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:21:00.711636970Z [2024-02-24T00:21:00.711+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:21:00.711648890Z 2024-02-24T00:21:00.711652646Z 2024-02-24T00:21:00.711655968Z 2024-02-24T00:21:00.715124486Z [2024-02-24T00:21:00.714+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:21:00.718316976Z [2024-02-24T00:21:00.715+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:21:00.718907802Z [2024-02-24T00:21:00.718+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:21:00.719645593Z [2024-02-24T00:21:00.719+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:21:00.721117778Z [2024-02-24T00:21:00.720+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:21:00.721489844Z [2024-02-24T00:21:00.721+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:21:01.048647613Z [2024-02-24T00:21:01.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:20:00+00:00 exited with status queued for try_number 1 2024-02-24T00:21:01.048784910Z [2024-02-24T00:21:01.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:20:00+00:00 exited with status queued for try_number 1 2024-02-24T00:21:01.048916612Z [2024-02-24T00:21:01.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:20:00+00:00 exited with status queued for try_number 1 2024-02-24T00:21:01.060152965Z [2024-02-24T00:21:01.059+0000] {scheduler_job.py:635} INFO - Setting external_id for to 42a75c19-6e0b-4c25-80e4-433ac92d02b6 2024-02-24T00:21:01.060321988Z [2024-02-24T00:21:01.060+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4362caeb-d6d7-4f3c-94c0-7c5bae839f14 2024-02-24T00:21:01.060590651Z [2024-02-24T00:21:01.060+0000] {scheduler_job.py:635} INFO - Setting external_id for to cbcf1534-2dbb-4e13-8be6-c31393552026 2024-02-24T00:21:02.244941755Z [2024-02-24T00:21:02.244+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:21:02.245126720Z [2024-02-24T00:21:02.244+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:20:00+00:00, run_id=scheduled__2024-02-24T00:20:00+00:00, run_start_date=2024-02-24 00:21:00.638385+00:00, run_end_date=2024-02-24 00:21:02.244759+00:00, run_duration=1.606374, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:20:00+00:00, data_interval_end=2024-02-24 00:21:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:21:02.255681928Z [2024-02-24T00:21:02.255+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:21:00+00:00, run_after=2024-02-24T00:22:00+00:00 2024-02-24T00:21:02.881817604Z [2024-02-24T00:21:02.881+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:20:00+00:00 exited with status success for try_number 1 2024-02-24T00:21:02.890065403Z [2024-02-24T00:21:02.889+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:20:00+00:00, map_index=-1, run_start_date=2024-02-24 00:21:01.708455+00:00, run_end_date=2024-02-24 00:21:02.187638+00:00, run_duration=0.479183, state=success, executor_state=success, try_number=1, max_tries=1, job_id=231, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:21:00.712371+00:00, queued_by_job_id=2, pid=3459 2024-02-24T00:21:05.999050095Z [2024-02-24T00:21:05.998+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:21:05.999238270Z [2024-02-24T00:21:05.998+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:20:00+00:00, run_id=scheduled__2024-02-24T00:20:00+00:00, run_start_date=2024-02-24 00:21:00.641362+00:00, run_end_date=2024-02-24 00:21:05.998861+00:00, run_duration=5.357499, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:20:00+00:00, data_interval_end=2024-02-24 00:21:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:21:06.020886013Z [2024-02-24T00:21:06.020+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:21:00+00:00, run_after=2024-02-24T00:22:00+00:00 2024-02-24T00:21:06.040357448Z [2024-02-24T00:21:06.033+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:21:06.041970146Z [2024-02-24T00:21:06.041+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:20:00+00:00, run_id=scheduled__2024-02-24T00:20:00+00:00, run_start_date=2024-02-24 00:21:00.639749+00:00, run_end_date=2024-02-24 00:21:06.040502+00:00, run_duration=5.400753, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:20:00+00:00, data_interval_end=2024-02-24 00:21:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:21:06.059105451Z [2024-02-24T00:21:06.058+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:21:00+00:00, run_after=2024-02-24T00:22:00+00:00 2024-02-24T00:21:06.116129517Z [2024-02-24T00:21:06.115+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:20:00+00:00 exited with status success for try_number 1 2024-02-24T00:21:06.116250260Z [2024-02-24T00:21:06.115+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:20:00+00:00 exited with status success for try_number 1 2024-02-24T00:21:06.127097803Z [2024-02-24T00:21:06.126+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:20:00+00:00, map_index=-1, run_start_date=2024-02-24 00:21:02.799347+00:00, run_end_date=2024-02-24 00:21:04.967841+00:00, run_duration=2.168494, state=success, executor_state=success, try_number=1, max_tries=1, job_id=232, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:21:00.712371+00:00, queued_by_job_id=2, pid=3477 2024-02-24T00:21:06.127325010Z [2024-02-24T00:21:06.127+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:20:00+00:00, map_index=-1, run_start_date=2024-02-24 00:21:02.874812+00:00, run_end_date=2024-02-24 00:21:05.485216+00:00, run_duration=2.610404, state=success, executor_state=success, try_number=1, max_tries=1, job_id=233, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:21:00.712371+00:00, queued_by_job_id=2, pid=3478 2024-02-24T00:21:59.806462729Z [2024-02-24T00:21:59.805+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T00:22:00.860271231Z [2024-02-24T00:22:00.859+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:22:00+00:00, run_after=2024-02-24T00:23:00+00:00 2024-02-24T00:22:00.872435466Z [2024-02-24T00:22:00.871+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:22:00.883121681Z [2024-02-24T00:22:00.882+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:22:00.902815262Z [2024-02-24T00:22:00.902+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:22:00+00:00, run_after=2024-02-24T00:23:00+00:00 2024-02-24T00:22:01.006647625Z [2024-02-24T00:22:01.006+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T00:22:01.006677617Z 2024-02-24T00:22:01.006684014Z 2024-02-24T00:22:01.006689639Z 2024-02-24T00:22:01.006695283Z 2024-02-24T00:22:01.006958554Z [2024-02-24T00:22:01.006+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T00:22:01.007272732Z [2024-02-24T00:22:01.007+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:22:01.007641844Z [2024-02-24T00:22:01.007+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:22:01.008074670Z [2024-02-24T00:22:01.007+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:22:01.009182537Z [2024-02-24T00:22:01.008+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:22:01.009194731Z 2024-02-24T00:22:01.009221257Z 2024-02-24T00:22:01.009226548Z 2024-02-24T00:22:01.009231229Z 2024-02-24T00:22:01.015391975Z [2024-02-24T00:22:01.015+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:22:01.015669392Z [2024-02-24T00:22:01.015+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T00:22:01.016029154Z [2024-02-24T00:22:01.015+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:22:01.016223142Z [2024-02-24T00:22:01.016+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:22:01.016532054Z [2024-02-24T00:22:01.016+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:22:01.016746498Z [2024-02-24T00:22:01.016+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:22:01.017043685Z [2024-02-24T00:22:01.016+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:22:01.017230383Z [2024-02-24T00:22:01.017+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:22:01.451170487Z [2024-02-24T00:22:01.450+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:20:00+00:00 exited with status queued for try_number 1 2024-02-24T00:22:01.453938649Z [2024-02-24T00:22:01.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:21:00+00:00 exited with status queued for try_number 1 2024-02-24T00:22:01.454100484Z [2024-02-24T00:22:01.453+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:21:00+00:00 exited with status queued for try_number 1 2024-02-24T00:22:01.454278166Z [2024-02-24T00:22:01.454+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:21:00+00:00 exited with status queued for try_number 1 2024-02-24T00:22:01.463384041Z [2024-02-24T00:22:01.463+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5168d665-72d4-4030-ab0f-0f9052b3eab4 2024-02-24T00:22:01.463695176Z [2024-02-24T00:22:01.463+0000] {scheduler_job.py:635} INFO - Setting external_id for to d302694b-2f8b-44e8-b0de-537951060c79 2024-02-24T00:22:01.463862180Z [2024-02-24T00:22:01.463+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe573c35-8bd9-4e56-ba89-b96bc779539f 2024-02-24T00:22:01.464041800Z [2024-02-24T00:22:01.463+0000] {scheduler_job.py:635} INFO - Setting external_id for to c952b209-e96d-4b4d-ae1c-2461e8c7875c 2024-02-24T00:22:02.657880023Z [2024-02-24T00:22:02.643+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:22:02.657908078Z [2024-02-24T00:22:02.644+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 00:20:00+00:00, run_id=scheduled__2024-02-24T00:20:00+00:00, run_start_date=2024-02-24 00:22:00.924573+00:00, run_end_date=2024-02-24 00:22:02.644146+00:00, run_duration=1.719573, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:20:00+00:00, data_interval_end=2024-02-24 00:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T00:22:02.694428388Z [2024-02-24T00:22:02.694+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T00:22:00+00:00, run_after=2024-02-24T00:24:00+00:00 2024-02-24T00:22:02.866621160Z [2024-02-24T00:22:02.866+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:20:00+00:00 exited with status success for try_number 1 2024-02-24T00:22:02.874826591Z [2024-02-24T00:22:02.873+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T00:20:00+00:00, map_index=-1, run_start_date=2024-02-24 00:22:02.078650+00:00, run_end_date=2024-02-24 00:22:02.474328+00:00, run_duration=0.395678, state=success, executor_state=success, try_number=1, max_tries=1, job_id=234, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:22:01.010971+00:00, queued_by_job_id=2, pid=3512 2024-02-24T00:22:03.843114702Z [2024-02-24T00:22:03.842+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:22:03.843648610Z [2024-02-24T00:22:03.843+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:21:00+00:00, run_id=scheduled__2024-02-24T00:21:00+00:00, run_start_date=2024-02-24 00:22:00.927071+00:00, run_end_date=2024-02-24 00:22:03.843315+00:00, run_duration=2.916244, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:21:00+00:00, data_interval_end=2024-02-24 00:22:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:22:03.855169018Z [2024-02-24T00:22:03.854+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:22:00+00:00, run_after=2024-02-24T00:23:00+00:00 2024-02-24T00:22:03.907075262Z [2024-02-24T00:22:03.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:21:00+00:00 exited with status success for try_number 1 2024-02-24T00:22:03.912294256Z [2024-02-24T00:22:03.911+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:21:00+00:00, map_index=-1, run_start_date=2024-02-24 00:22:02.150224+00:00, run_end_date=2024-02-24 00:22:02.735548+00:00, run_duration=0.585324, state=success, executor_state=success, try_number=1, max_tries=1, job_id=235, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:22:01.010971+00:00, queued_by_job_id=2, pid=3513 2024-02-24T00:22:05.371284272Z [2024-02-24T00:22:05.370+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:22:05.371733822Z [2024-02-24T00:22:05.371+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:21:00+00:00, run_id=scheduled__2024-02-24T00:21:00+00:00, run_start_date=2024-02-24 00:22:00.931166+00:00, run_end_date=2024-02-24 00:22:05.371288+00:00, run_duration=4.440122, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:21:00+00:00, data_interval_end=2024-02-24 00:22:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:22:05.387069750Z [2024-02-24T00:22:05.386+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:22:00+00:00, run_after=2024-02-24T00:23:00+00:00 2024-02-24T00:22:05.396455785Z [2024-02-24T00:22:05.396+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:22:05.396757282Z [2024-02-24T00:22:05.396+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:21:00+00:00, run_id=scheduled__2024-02-24T00:21:00+00:00, run_start_date=2024-02-24 00:22:00.929174+00:00, run_end_date=2024-02-24 00:22:05.396408+00:00, run_duration=4.467234, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:21:00+00:00, data_interval_end=2024-02-24 00:22:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:22:05.407319565Z [2024-02-24T00:22:05.406+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:22:00+00:00, run_after=2024-02-24T00:23:00+00:00 2024-02-24T00:22:05.444552391Z [2024-02-24T00:22:05.444+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:21:00+00:00 exited with status success for try_number 1 2024-02-24T00:22:05.444691117Z [2024-02-24T00:22:05.444+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:21:00+00:00 exited with status success for try_number 1 2024-02-24T00:22:05.454394620Z [2024-02-24T00:22:05.453+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:21:00+00:00, map_index=-1, run_start_date=2024-02-24 00:22:03.407227+00:00, run_end_date=2024-02-24 00:22:05.137343+00:00, run_duration=1.730116, state=success, executor_state=success, try_number=1, max_tries=1, job_id=237, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:22:01.010971+00:00, queued_by_job_id=2, pid=3536 2024-02-24T00:22:05.454708645Z [2024-02-24T00:22:05.454+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:21:00+00:00, map_index=-1, run_start_date=2024-02-24 00:22:03.403815+00:00, run_end_date=2024-02-24 00:22:04.894884+00:00, run_duration=1.491069, state=success, executor_state=success, try_number=1, max_tries=1, job_id=236, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:22:01.010971+00:00, queued_by_job_id=2, pid=3537 2024-02-24T00:23:00.758572376Z [2024-02-24T00:23:00.757+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:23:00+00:00, run_after=2024-02-24T00:24:00+00:00 2024-02-24T00:23:00.767425104Z [2024-02-24T00:23:00.767+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:23:00.780451414Z [2024-02-24T00:23:00.780+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:23:00+00:00, run_after=2024-02-24T00:24:00+00:00 2024-02-24T00:23:00.875693407Z [2024-02-24T00:23:00.875+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T00:23:00.875732912Z 2024-02-24T00:23:00.875742772Z 2024-02-24T00:23:00.875753163Z 2024-02-24T00:23:00.876159751Z [2024-02-24T00:23:00.875+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:23:00.876464051Z [2024-02-24T00:23:00.876+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:23:00.876715623Z [2024-02-24T00:23:00.876+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:23:00.877583229Z [2024-02-24T00:23:00.877+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:23:00.877598410Z 2024-02-24T00:23:00.877603504Z 2024-02-24T00:23:00.877608163Z 2024-02-24T00:23:00.882629859Z [2024-02-24T00:23:00.882+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:23:00.882929560Z [2024-02-24T00:23:00.882+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:23:00.883336646Z [2024-02-24T00:23:00.883+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:23:00.883630503Z [2024-02-24T00:23:00.883+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:23:00.884059595Z [2024-02-24T00:23:00.883+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:23:00.884332628Z [2024-02-24T00:23:00.884+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:23:01.146766307Z [2024-02-24T00:23:01.143+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:22:00+00:00 exited with status queued for try_number 1 2024-02-24T00:23:01.147020384Z [2024-02-24T00:23:01.146+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:22:00+00:00 exited with status queued for try_number 1 2024-02-24T00:23:01.147195016Z [2024-02-24T00:23:01.146+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:22:00+00:00 exited with status queued for try_number 1 2024-02-24T00:23:01.158834045Z [2024-02-24T00:23:01.158+0000] {scheduler_job.py:635} INFO - Setting external_id for to 649e3a0b-65f4-44da-9ae6-f9c72f9d964b 2024-02-24T00:23:01.159170310Z [2024-02-24T00:23:01.158+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9532231f-4eaf-450e-a266-d717ca5262fc 2024-02-24T00:23:01.159401730Z [2024-02-24T00:23:01.159+0000] {scheduler_job.py:635} INFO - Setting external_id for to 167fa109-57bc-439e-8794-a5d1e65c0f29 2024-02-24T00:23:02.385938289Z [2024-02-24T00:23:02.381+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:23:02.385962812Z [2024-02-24T00:23:02.381+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:22:00+00:00, run_id=scheduled__2024-02-24T00:22:00+00:00, run_start_date=2024-02-24 00:23:00.790973+00:00, run_end_date=2024-02-24 00:23:02.381411+00:00, run_duration=1.590438, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:22:00+00:00, data_interval_end=2024-02-24 00:23:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:23:02.394055896Z [2024-02-24T00:23:02.392+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:23:00+00:00, run_after=2024-02-24T00:24:00+00:00 2024-02-24T00:23:02.482432869Z [2024-02-24T00:23:02.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:22:00+00:00 exited with status success for try_number 1 2024-02-24T00:23:02.488996701Z [2024-02-24T00:23:02.488+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:22:00+00:00, map_index=-1, run_start_date=2024-02-24 00:23:01.881396+00:00, run_end_date=2024-02-24 00:23:02.319207+00:00, run_duration=0.437811, state=success, executor_state=success, try_number=1, max_tries=1, job_id=238, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:23:00.878609+00:00, queued_by_job_id=2, pid=3569 2024-02-24T00:23:04.761220316Z [2024-02-24T00:23:04.760+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:23:04.762020301Z [2024-02-24T00:23:04.761+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:22:00+00:00, run_id=scheduled__2024-02-24T00:22:00+00:00, run_start_date=2024-02-24 00:23:00.792181+00:00, run_end_date=2024-02-24 00:23:04.761053+00:00, run_duration=3.968872, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:22:00+00:00, data_interval_end=2024-02-24 00:23:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:23:04.777335210Z [2024-02-24T00:23:04.776+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:23:00+00:00, run_after=2024-02-24T00:24:00+00:00 2024-02-24T00:23:04.831779363Z [2024-02-24T00:23:04.831+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:22:00+00:00 exited with status success for try_number 1 2024-02-24T00:23:04.844010468Z [2024-02-24T00:23:04.843+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:22:00+00:00, map_index=-1, run_start_date=2024-02-24 00:23:02.758617+00:00, run_end_date=2024-02-24 00:23:04.522610+00:00, run_duration=1.763993, state=success, executor_state=success, try_number=1, max_tries=1, job_id=239, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:23:00.878609+00:00, queued_by_job_id=2, pid=3587 2024-02-24T00:23:05.906007855Z [2024-02-24T00:23:05.905+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:23:05.906275160Z [2024-02-24T00:23:05.906+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:22:00+00:00, run_id=scheduled__2024-02-24T00:22:00+00:00, run_start_date=2024-02-24 00:23:00.793223+00:00, run_end_date=2024-02-24 00:23:05.905888+00:00, run_duration=5.112665, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:22:00+00:00, data_interval_end=2024-02-24 00:23:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:23:05.914661863Z [2024-02-24T00:23:05.914+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:23:00+00:00, run_after=2024-02-24T00:24:00+00:00 2024-02-24T00:23:05.948372503Z [2024-02-24T00:23:05.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:22:00+00:00 exited with status success for try_number 1 2024-02-24T00:23:05.957248815Z [2024-02-24T00:23:05.956+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:22:00+00:00, map_index=-1, run_start_date=2024-02-24 00:23:02.838376+00:00, run_end_date=2024-02-24 00:23:05.085417+00:00, run_duration=2.247041, state=success, executor_state=success, try_number=1, max_tries=1, job_id=240, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:23:00.878609+00:00, queued_by_job_id=2, pid=3588 2024-02-24T00:24:00.414093602Z [2024-02-24T00:24:00.413+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:24:00+00:00, run_after=2024-02-24T00:25:00+00:00 2024-02-24T00:24:00.421473704Z [2024-02-24T00:24:00.421+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:24:00.441101525Z [2024-02-24T00:24:00.440+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:24:00+00:00, run_after=2024-02-24T00:25:00+00:00 2024-02-24T00:24:00.451015402Z [2024-02-24T00:24:00.450+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:24:00.541387647Z [2024-02-24T00:24:00.540+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T00:24:00.541426954Z 2024-02-24T00:24:00.541466153Z 2024-02-24T00:24:00.541475751Z 2024-02-24T00:24:00.541484285Z 2024-02-24T00:24:00.541521864Z [2024-02-24T00:24:00.541+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T00:24:00.541817765Z [2024-02-24T00:24:00.541+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:24:00.541947874Z [2024-02-24T00:24:00.541+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:24:00.542175224Z [2024-02-24T00:24:00.541+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:24:00.542975923Z [2024-02-24T00:24:00.542+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:24:00.542991715Z 2024-02-24T00:24:00.542998294Z 2024-02-24T00:24:00.543004090Z 2024-02-24T00:24:00.543010078Z 2024-02-24T00:24:00.548034350Z [2024-02-24T00:24:00.547+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:24:00.548206353Z [2024-02-24T00:24:00.547+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T00:24:00.548571281Z [2024-02-24T00:24:00.548+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:24:00.548619772Z [2024-02-24T00:24:00.548+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:24:00.548976259Z [2024-02-24T00:24:00.548+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:24:00.549009922Z [2024-02-24T00:24:00.548+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:24:00.549398753Z [2024-02-24T00:24:00.549+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:24:00.549438486Z [2024-02-24T00:24:00.549+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:24:00.997910753Z [2024-02-24T00:24:00.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:22:00+00:00 exited with status queued for try_number 1 2024-02-24T00:24:00.999091379Z [2024-02-24T00:24:00.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:23:00+00:00 exited with status queued for try_number 1 2024-02-24T00:24:00.999887435Z [2024-02-24T00:24:00.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:23:00+00:00 exited with status queued for try_number 1 2024-02-24T00:24:01.018449196Z [2024-02-24T00:24:01.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:23:00+00:00 exited with status queued for try_number 1 2024-02-24T00:24:01.039395576Z [2024-02-24T00:24:01.039+0000] {scheduler_job.py:635} INFO - Setting external_id for to e84d98bc-5f38-40ff-b5cb-da887338551f 2024-02-24T00:24:01.039760285Z [2024-02-24T00:24:01.039+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b31486a-beb1-4f92-a69f-6992738f4ba0 2024-02-24T00:24:01.040010158Z [2024-02-24T00:24:01.039+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6680045e-6dca-4c40-8d72-fcf26dd706f9 2024-02-24T00:24:01.040251561Z [2024-02-24T00:24:01.040+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca58f240-79cd-4215-8690-7d080e8e198f 2024-02-24T00:24:02.373963607Z [2024-02-24T00:24:02.368+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:24:02.373990911Z [2024-02-24T00:24:02.373+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 00:22:00+00:00, run_id=scheduled__2024-02-24T00:22:00+00:00, run_start_date=2024-02-24 00:24:00.462208+00:00, run_end_date=2024-02-24 00:24:02.368384+00:00, run_duration=1.906176, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:22:00+00:00, data_interval_end=2024-02-24 00:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T00:24:02.384649441Z [2024-02-24T00:24:02.384+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T00:24:00+00:00, run_after=2024-02-24T00:26:00+00:00 2024-02-24T00:24:02.401948756Z [2024-02-24T00:24:02.401+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:24:02.402176535Z [2024-02-24T00:24:02.401+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:23:00+00:00, run_id=scheduled__2024-02-24T00:23:00+00:00, run_start_date=2024-02-24 00:24:00.463602+00:00, run_end_date=2024-02-24 00:24:02.401882+00:00, run_duration=1.93828, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:23:00+00:00, data_interval_end=2024-02-24 00:24:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:24:02.414726719Z [2024-02-24T00:24:02.414+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:24:00+00:00, run_after=2024-02-24T00:25:00+00:00 2024-02-24T00:24:02.514682866Z [2024-02-24T00:24:02.512+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:22:00+00:00 exited with status success for try_number 1 2024-02-24T00:24:02.865359540Z [2024-02-24T00:24:02.864+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T00:22:00+00:00, map_index=-1, run_start_date=2024-02-24 00:24:01.420383+00:00, run_end_date=2024-02-24 00:24:01.793176+00:00, run_duration=0.372793, state=success, executor_state=success, try_number=1, max_tries=1, job_id=241, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:24:00.544397+00:00, queued_by_job_id=2, pid=3618 2024-02-24T00:24:03.978805252Z [2024-02-24T00:24:03.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:23:00+00:00 exited with status success for try_number 1 2024-02-24T00:24:03.988207145Z [2024-02-24T00:24:03.987+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:23:00+00:00, map_index=-1, run_start_date=2024-02-24 00:24:01.773185+00:00, run_end_date=2024-02-24 00:24:02.277980+00:00, run_duration=0.504795, state=success, executor_state=success, try_number=1, max_tries=1, job_id=242, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:24:00.544397+00:00, queued_by_job_id=2, pid=3627 2024-02-24T00:24:06.138643279Z [2024-02-24T00:24:06.138+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:24:06.139196983Z [2024-02-24T00:24:06.138+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:23:00+00:00, run_id=scheduled__2024-02-24T00:23:00+00:00, run_start_date=2024-02-24 00:24:00.464899+00:00, run_end_date=2024-02-24 00:24:06.138487+00:00, run_duration=5.673588, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:23:00+00:00, data_interval_end=2024-02-24 00:24:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:24:06.151612504Z [2024-02-24T00:24:06.151+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:24:00+00:00, run_after=2024-02-24T00:25:00+00:00 2024-02-24T00:24:06.160543645Z [2024-02-24T00:24:06.160+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:24:06.160888632Z [2024-02-24T00:24:06.160+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:23:00+00:00, run_id=scheduled__2024-02-24T00:23:00+00:00, run_start_date=2024-02-24 00:24:00.466408+00:00, run_end_date=2024-02-24 00:24:06.160396+00:00, run_duration=5.693988, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:23:00+00:00, data_interval_end=2024-02-24 00:24:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:24:06.175650831Z [2024-02-24T00:24:06.175+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:24:00+00:00, run_after=2024-02-24T00:25:00+00:00 2024-02-24T00:24:06.222294811Z [2024-02-24T00:24:06.221+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:23:00+00:00 exited with status success for try_number 1 2024-02-24T00:24:06.222495832Z [2024-02-24T00:24:06.222+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:23:00+00:00 exited with status success for try_number 1 2024-02-24T00:24:06.232569701Z [2024-02-24T00:24:06.232+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:23:00+00:00, map_index=-1, run_start_date=2024-02-24 00:24:03.117107+00:00, run_end_date=2024-02-24 00:24:05.142774+00:00, run_duration=2.025667, state=success, executor_state=success, try_number=1, max_tries=1, job_id=244, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:24:00.544397+00:00, queued_by_job_id=2, pid=3646 2024-02-24T00:24:06.232931101Z [2024-02-24T00:24:06.232+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:23:00+00:00, map_index=-1, run_start_date=2024-02-24 00:24:02.907800+00:00, run_end_date=2024-02-24 00:24:05.077741+00:00, run_duration=2.169941, state=success, executor_state=success, try_number=1, max_tries=1, job_id=243, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:24:00.544397+00:00, queued_by_job_id=2, pid=3645 2024-02-24T00:25:00.671525169Z [2024-02-24T00:25:00.671+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:25:00+00:00, run_after=2024-02-24T00:26:00+00:00 2024-02-24T00:25:00.689495300Z [2024-02-24T00:25:00.689+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:25:00+00:00, run_after=2024-02-24T00:30:00+00:00 2024-02-24T00:25:00.704258380Z [2024-02-24T00:25:00.703+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:25:00.722630303Z [2024-02-24T00:25:00.722+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:25:00+00:00, run_after=2024-02-24T00:26:00+00:00 2024-02-24T00:25:00.796429197Z [2024-02-24T00:25:00.796+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T00:25:00.796478282Z 2024-02-24T00:25:00.796484611Z 2024-02-24T00:25:00.796489106Z 2024-02-24T00:25:00.796493811Z 2024-02-24T00:25:00.796563322Z [2024-02-24T00:25:00.796+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:25:00.796717509Z [2024-02-24T00:25:00.796+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:25:00.796949018Z [2024-02-24T00:25:00.796+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:25:00.797246736Z [2024-02-24T00:25:00.797+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:25:00.797901810Z [2024-02-24T00:25:00.797+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:25:00.797930460Z 2024-02-24T00:25:00.797934332Z 2024-02-24T00:25:00.797938134Z 2024-02-24T00:25:00.797942075Z 2024-02-24T00:25:00.803765679Z [2024-02-24T00:25:00.803+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T00:25:00.803939269Z [2024-02-24T00:25:00.803+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:25:00.804168429Z [2024-02-24T00:25:00.804+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:25:00.804317103Z [2024-02-24T00:25:00.804+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:25:00.804515226Z [2024-02-24T00:25:00.804+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:25:00.804663119Z [2024-02-24T00:25:00.804+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:25:00.804895126Z [2024-02-24T00:25:00.804+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:25:00.805012947Z [2024-02-24T00:25:00.804+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:25:01.100861061Z [2024-02-24T00:25:01.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T00:20:00+00:00 exited with status queued for try_number 1 2024-02-24T00:25:01.102905350Z [2024-02-24T00:25:01.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:24:00+00:00 exited with status queued for try_number 1 2024-02-24T00:25:01.102993322Z [2024-02-24T00:25:01.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:24:00+00:00 exited with status queued for try_number 1 2024-02-24T00:25:01.103116170Z [2024-02-24T00:25:01.103+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:24:00+00:00 exited with status queued for try_number 1 2024-02-24T00:25:01.110864074Z [2024-02-24T00:25:01.110+0000] {scheduler_job.py:635} INFO - Setting external_id for to d86754ed-1ca6-40cb-b1f2-3528189b0c56 2024-02-24T00:25:01.111080187Z [2024-02-24T00:25:01.110+0000] {scheduler_job.py:635} INFO - Setting external_id for to 01f77385-12e2-48cf-9fe2-7216f69f870c 2024-02-24T00:25:01.111252235Z [2024-02-24T00:25:01.111+0000] {scheduler_job.py:635} INFO - Setting external_id for to af1a8b59-529e-4a0c-8132-bd33a83fa141 2024-02-24T00:25:01.111396203Z [2024-02-24T00:25:01.111+0000] {scheduler_job.py:635} INFO - Setting external_id for to d40a3120-0e29-4347-8cc2-00fa24f35873 2024-02-24T00:25:03.493866644Z [2024-02-24T00:25:03.492+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:25:03.493889558Z [2024-02-24T00:25:03.493+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:24:00+00:00, run_id=scheduled__2024-02-24T00:24:00+00:00, run_start_date=2024-02-24 00:25:00.736471+00:00, run_end_date=2024-02-24 00:25:03.493148+00:00, run_duration=2.756677, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:24:00+00:00, data_interval_end=2024-02-24 00:25:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:25:03.513338997Z [2024-02-24T00:25:03.512+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:25:00+00:00, run_after=2024-02-24T00:26:00+00:00 2024-02-24T00:25:03.643986982Z [2024-02-24T00:25:03.643+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T00:25:03.644009269Z 2024-02-24T00:25:03.644301084Z [2024-02-24T00:25:03.643+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:25:03.645269398Z [2024-02-24T00:25:03.645+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:25:03.645283492Z 2024-02-24T00:25:03.649393563Z [2024-02-24T00:25:03.648+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T00:25:03.650590814Z [2024-02-24T00:25:03.649+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:25:03.734015056Z [2024-02-24T00:25:03.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T00:20:00+00:00 exited with status queued for try_number 1 2024-02-24T00:25:03.734024024Z [2024-02-24T00:25:03.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:24:00+00:00 exited with status success for try_number 1 2024-02-24T00:25:03.739184568Z [2024-02-24T00:25:03.738+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:24:00+00:00, map_index=-1, run_start_date=2024-02-24 00:25:01.899839+00:00, run_end_date=2024-02-24 00:25:02.314693+00:00, run_duration=0.414854, state=success, executor_state=success, try_number=1, max_tries=1, job_id=245, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:25:00.800147+00:00, queued_by_job_id=2, pid=3679 2024-02-24T00:25:03.739421602Z [2024-02-24T00:25:03.739+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c9037fd-65fb-42b1-94ca-22333596c402 2024-02-24T00:25:03.841604135Z [2024-02-24T00:25:03.840+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T00:20:00+00:00 exited with status success for try_number 1 2024-02-24T00:25:03.846990863Z [2024-02-24T00:25:03.846+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T00:20:00+00:00, map_index=-1, run_start_date=2024-02-24 00:25:03.039727+00:00, run_end_date=2024-02-24 00:25:03.437737+00:00, run_duration=0.39801, state=success, executor_state=success, try_number=1, max_tries=1, job_id=246, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:25:00.800147+00:00, queued_by_job_id=2, pid=3703 2024-02-24T00:25:04.904025747Z [2024-02-24T00:25:04.903+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:25:04.904444530Z [2024-02-24T00:25:04.904+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:24:00+00:00, run_id=scheduled__2024-02-24T00:24:00+00:00, run_start_date=2024-02-24 00:25:00.737456+00:00, run_end_date=2024-02-24 00:25:04.904017+00:00, run_duration=4.166561, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:24:00+00:00, data_interval_end=2024-02-24 00:25:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:25:04.921880392Z [2024-02-24T00:25:04.921+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:25:00+00:00, run_after=2024-02-24T00:26:00+00:00 2024-02-24T00:25:05.006300398Z [2024-02-24T00:25:05.005+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:24:00+00:00 exited with status success for try_number 1 2024-02-24T00:25:05.015002886Z [2024-02-24T00:25:05.014+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:24:00+00:00, map_index=-1, run_start_date=2024-02-24 00:25:03.140749+00:00, run_end_date=2024-02-24 00:25:04.484347+00:00, run_duration=1.343598, state=success, executor_state=success, try_number=1, max_tries=1, job_id=247, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:25:00.800147+00:00, queued_by_job_id=2, pid=3704 2024-02-24T00:25:05.498354875Z [2024-02-24T00:25:05.497+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:25:05.498748424Z [2024-02-24T00:25:05.498+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:24:00+00:00, run_id=scheduled__2024-02-24T00:24:00+00:00, run_start_date=2024-02-24 00:25:00.738502+00:00, run_end_date=2024-02-24 00:25:05.498252+00:00, run_duration=4.75975, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:24:00+00:00, data_interval_end=2024-02-24 00:25:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:25:05.509465656Z [2024-02-24T00:25:05.509+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:25:00+00:00, run_after=2024-02-24T00:26:00+00:00 2024-02-24T00:25:05.555368297Z [2024-02-24T00:25:05.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:24:00+00:00 exited with status success for try_number 1 2024-02-24T00:25:05.561942773Z [2024-02-24T00:25:05.561+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:24:00+00:00, map_index=-1, run_start_date=2024-02-24 00:25:03.162881+00:00, run_end_date=2024-02-24 00:25:04.915032+00:00, run_duration=1.752151, state=success, executor_state=success, try_number=1, max_tries=1, job_id=248, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:25:00.800147+00:00, queued_by_job_id=2, pid=3705 2024-02-24T00:25:06.680697642Z [2024-02-24T00:25:06.679+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T00:25:06.680786552Z 2024-02-24T00:25:06.680896088Z [2024-02-24T00:25:06.680+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:25:06.682211910Z [2024-02-24T00:25:06.681+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:25:06.682264632Z 2024-02-24T00:25:06.687088847Z [2024-02-24T00:25:06.686+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T00:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T00:25:06.687396425Z [2024-02-24T00:25:06.686+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T00:25:06.762911761Z [2024-02-24T00:25:06.762+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T00:20:00+00:00 exited with status queued for try_number 1 2024-02-24T00:25:06.763243459Z [2024-02-24T00:25:06.762+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T00:20:00+00:00 exited with status success for try_number 1 2024-02-24T00:25:06.771608077Z [2024-02-24T00:25:06.770+0000] {scheduler_job.py:635} INFO - Setting external_id for to 457a96ef-5945-40de-ab8f-b7e94d9ea5ff 2024-02-24T00:25:06.772017184Z [2024-02-24T00:25:06.771+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T00:20:00+00:00, map_index=-1, run_start_date=2024-02-24 00:25:05.442272+00:00, run_end_date=2024-02-24 00:25:05.764505+00:00, run_duration=0.322233, state=success, executor_state=success, try_number=1, max_tries=1, job_id=249, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:25:03.646031+00:00, queued_by_job_id=2, pid=3728 2024-02-24T00:25:09.693369990Z [2024-02-24T00:25:09.692+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T00:25:09.693424781Z 2024-02-24T00:25:09.693446140Z [2024-02-24T00:25:09.693+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:25:09.694769886Z [2024-02-24T00:25:09.694+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:25:09.694797544Z 2024-02-24T00:25:09.699140365Z [2024-02-24T00:25:09.698+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:25:09.699409161Z [2024-02-24T00:25:09.698+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:25:09.772688724Z [2024-02-24T00:25:09.772+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T00:20:00+00:00 exited with status queued for try_number 1 2024-02-24T00:25:09.772982670Z [2024-02-24T00:25:09.772+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T00:20:00+00:00 exited with status success for try_number 1 2024-02-24T00:25:09.783611928Z [2024-02-24T00:25:09.783+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62c2b03f-1c40-499b-a80a-c48bb69a8d22 2024-02-24T00:25:09.784138626Z [2024-02-24T00:25:09.783+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T00:20:00+00:00, map_index=0, run_start_date=2024-02-24 00:25:08.703690+00:00, run_end_date=2024-02-24 00:25:09.074096+00:00, run_duration=0.370406, state=success, executor_state=success, try_number=1, max_tries=1, job_id=250, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:25:06.683007+00:00, queued_by_job_id=2, pid=3736 2024-02-24T00:25:12.015603714Z [2024-02-24T00:25:12.014+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:25:12.016356657Z [2024-02-24T00:25:12.015+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:20:00+00:00, run_id=scheduled__2024-02-24T00:20:00+00:00, run_start_date=2024-02-24 00:25:00.735264+00:00, run_end_date=2024-02-24 00:25:12.015698+00:00, run_duration=11.280434, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:20:00+00:00, data_interval_end=2024-02-24 00:25:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T00:25:12.027230814Z [2024-02-24T00:25:12.026+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:25:00+00:00, run_after=2024-02-24T00:30:00+00:00 2024-02-24T00:25:12.074011159Z [2024-02-24T00:25:12.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T00:20:00+00:00 exited with status success for try_number 1 2024-02-24T00:25:12.081810866Z [2024-02-24T00:25:12.081+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T00:20:00+00:00, map_index=-1, run_start_date=2024-02-24 00:25:11.374562+00:00, run_end_date=2024-02-24 00:25:11.779309+00:00, run_duration=0.404747, state=success, executor_state=success, try_number=1, max_tries=1, job_id=251, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:25:09.695513+00:00, queued_by_job_id=2, pid=3744 2024-02-24T00:26:00.951072631Z [2024-02-24T00:26:00.950+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:26:00.965337630Z [2024-02-24T00:26:00.964+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:26:00+00:00, run_after=2024-02-24T00:27:00+00:00 2024-02-24T00:26:00.973692121Z [2024-02-24T00:26:00.973+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:26:01.002000871Z [2024-02-24T00:26:01.001+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:26:00+00:00, run_after=2024-02-24T00:27:00+00:00 2024-02-24T00:26:01.127837039Z [2024-02-24T00:26:01.127+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T00:26:01.127859887Z 2024-02-24T00:26:01.127866428Z 2024-02-24T00:26:01.127871238Z 2024-02-24T00:26:01.127876305Z 2024-02-24T00:26:01.129997086Z [2024-02-24T00:26:01.128+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T00:26:01.130758839Z [2024-02-24T00:26:01.130+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:26:01.131250261Z [2024-02-24T00:26:01.130+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:26:01.131984800Z [2024-02-24T00:26:01.131+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:26:01.133156832Z [2024-02-24T00:26:01.132+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:26:01.133168927Z 2024-02-24T00:26:01.133172582Z 2024-02-24T00:26:01.133175838Z 2024-02-24T00:26:01.133179086Z 2024-02-24T00:26:01.139505958Z [2024-02-24T00:26:01.139+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:26:01.139811810Z [2024-02-24T00:26:01.139+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T00:26:01.140181530Z [2024-02-24T00:26:01.140+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:26:01.141158566Z [2024-02-24T00:26:01.140+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:26:01.141410418Z [2024-02-24T00:26:01.141+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:26:01.141916089Z [2024-02-24T00:26:01.141+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:26:01.142070547Z [2024-02-24T00:26:01.141+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:26:01.142355907Z [2024-02-24T00:26:01.142+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:26:01.570708314Z [2024-02-24T00:26:01.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:24:00+00:00 exited with status queued for try_number 1 2024-02-24T00:26:01.570977716Z [2024-02-24T00:26:01.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:25:00+00:00 exited with status queued for try_number 1 2024-02-24T00:26:01.571247201Z [2024-02-24T00:26:01.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:25:00+00:00 exited with status queued for try_number 1 2024-02-24T00:26:01.571523817Z [2024-02-24T00:26:01.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:25:00+00:00 exited with status queued for try_number 1 2024-02-24T00:26:01.585865846Z [2024-02-24T00:26:01.585+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3fcf7d70-e3dc-4084-afbc-ef9265be7917 2024-02-24T00:26:01.589636046Z [2024-02-24T00:26:01.589+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31aa938d-895b-4505-9f67-c84178749acc 2024-02-24T00:26:01.590471437Z [2024-02-24T00:26:01.590+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8d119e2b-8626-456a-bb54-de8fbff85ece 2024-02-24T00:26:01.590760570Z [2024-02-24T00:26:01.590+0000] {scheduler_job.py:635} INFO - Setting external_id for to f86e155d-cbb6-4c37-b83f-9d68bb1397a6 2024-02-24T00:26:03.487142522Z [2024-02-24T00:26:03.486+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:26:03.498965705Z [2024-02-24T00:26:03.494+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:25:00+00:00, run_id=scheduled__2024-02-24T00:25:00+00:00, run_start_date=2024-02-24 00:26:01.023264+00:00, run_end_date=2024-02-24 00:26:03.493961+00:00, run_duration=2.470697, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:25:00+00:00, data_interval_end=2024-02-24 00:26:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:26:03.531544267Z [2024-02-24T00:26:03.531+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:26:00+00:00, run_after=2024-02-24T00:27:00+00:00 2024-02-24T00:26:03.694545907Z [2024-02-24T00:26:03.693+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:25:00+00:00 exited with status success for try_number 1 2024-02-24T00:26:03.708225306Z [2024-02-24T00:26:03.707+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:25:00+00:00, map_index=-1, run_start_date=2024-02-24 00:26:02.461707+00:00, run_end_date=2024-02-24 00:26:03.195887+00:00, run_duration=0.73418, state=success, executor_state=success, try_number=1, max_tries=1, job_id=252, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:26:01.134831+00:00, queued_by_job_id=2, pid=3767 2024-02-24T00:26:04.796448149Z [2024-02-24T00:26:04.796+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:26:04.802420327Z [2024-02-24T00:26:04.802+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 00:24:00+00:00, run_id=scheduled__2024-02-24T00:24:00+00:00, run_start_date=2024-02-24 00:26:01.021098+00:00, run_end_date=2024-02-24 00:26:04.801920+00:00, run_duration=3.780822, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:24:00+00:00, data_interval_end=2024-02-24 00:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T00:26:04.822437705Z [2024-02-24T00:26:04.822+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T00:26:00+00:00, run_after=2024-02-24T00:28:00+00:00 2024-02-24T00:26:04.953409242Z [2024-02-24T00:26:04.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:24:00+00:00 exited with status success for try_number 1 2024-02-24T00:26:04.960374729Z [2024-02-24T00:26:04.960+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T00:24:00+00:00, map_index=-1, run_start_date=2024-02-24 00:26:03.105145+00:00, run_end_date=2024-02-24 00:26:03.803774+00:00, run_duration=0.698629, state=success, executor_state=success, try_number=1, max_tries=1, job_id=253, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:26:01.134831+00:00, queued_by_job_id=2, pid=3774 2024-02-24T00:26:06.945470443Z [2024-02-24T00:26:06.944+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:26:06.946762021Z [2024-02-24T00:26:06.945+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:25:00+00:00, run_id=scheduled__2024-02-24T00:25:00+00:00, run_start_date=2024-02-24 00:26:01.033739+00:00, run_end_date=2024-02-24 00:26:06.945641+00:00, run_duration=5.911902, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:25:00+00:00, data_interval_end=2024-02-24 00:26:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:26:06.971295646Z [2024-02-24T00:26:06.970+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:26:00+00:00, run_after=2024-02-24T00:27:00+00:00 2024-02-24T00:26:06.984630795Z [2024-02-24T00:26:06.984+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:26:06.985345105Z [2024-02-24T00:26:06.985+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:25:00+00:00, run_id=scheduled__2024-02-24T00:25:00+00:00, run_start_date=2024-02-24 00:26:01.025101+00:00, run_end_date=2024-02-24 00:26:06.984908+00:00, run_duration=5.959807, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:25:00+00:00, data_interval_end=2024-02-24 00:26:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:26:07.002192045Z [2024-02-24T00:26:07.001+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:26:00+00:00, run_after=2024-02-24T00:27:00+00:00 2024-02-24T00:26:07.036292805Z [2024-02-24T00:26:07.035+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:25:00+00:00 exited with status success for try_number 1 2024-02-24T00:26:07.036337645Z [2024-02-24T00:26:07.036+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:25:00+00:00 exited with status success for try_number 1 2024-02-24T00:26:07.042717570Z [2024-02-24T00:26:07.042+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:25:00+00:00, map_index=-1, run_start_date=2024-02-24 00:26:04.354015+00:00, run_end_date=2024-02-24 00:26:06.662893+00:00, run_duration=2.308878, state=success, executor_state=success, try_number=1, max_tries=1, job_id=255, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:26:01.134831+00:00, queued_by_job_id=2, pid=3791 2024-02-24T00:26:07.042971553Z [2024-02-24T00:26:07.042+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:25:00+00:00, map_index=-1, run_start_date=2024-02-24 00:26:04.360719+00:00, run_end_date=2024-02-24 00:26:06.177281+00:00, run_duration=1.816562, state=success, executor_state=success, try_number=1, max_tries=1, job_id=254, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:26:01.134831+00:00, queued_by_job_id=2, pid=3792 2024-02-24T00:26:59.872209999Z [2024-02-24T00:26:59.871+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T00:27:00.155459337Z [2024-02-24T00:27:00.155+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:27:00+00:00, run_after=2024-02-24T00:28:00+00:00 2024-02-24T00:27:00.165306649Z [2024-02-24T00:27:00.164+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:27:00.178902081Z [2024-02-24T00:27:00.178+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:27:00+00:00, run_after=2024-02-24T00:28:00+00:00 2024-02-24T00:27:00.263345148Z [2024-02-24T00:27:00.262+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T00:27:00.263417076Z 2024-02-24T00:27:00.263427400Z 2024-02-24T00:27:00.263434326Z 2024-02-24T00:27:00.263465314Z [2024-02-24T00:27:00.263+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:27:00.263832101Z [2024-02-24T00:27:00.263+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:27:00.264103791Z [2024-02-24T00:27:00.263+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:27:00.264899921Z [2024-02-24T00:27:00.264+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:27:00.264914436Z 2024-02-24T00:27:00.264919533Z 2024-02-24T00:27:00.264924003Z 2024-02-24T00:27:00.269100545Z [2024-02-24T00:27:00.268+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:27:00.269334696Z [2024-02-24T00:27:00.269+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:27:00.269757441Z [2024-02-24T00:27:00.269+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:27:00.270348393Z [2024-02-24T00:27:00.270+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:27:00.270780711Z [2024-02-24T00:27:00.270+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:27:00.270872007Z [2024-02-24T00:27:00.270+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:27:00.482549401Z [2024-02-24T00:27:00.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:26:00+00:00 exited with status queued for try_number 1 2024-02-24T00:27:00.482688618Z [2024-02-24T00:27:00.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:26:00+00:00 exited with status queued for try_number 1 2024-02-24T00:27:00.482766751Z [2024-02-24T00:27:00.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:26:00+00:00 exited with status queued for try_number 1 2024-02-24T00:27:00.489843850Z [2024-02-24T00:27:00.489+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab4d59f7-2588-4333-a5ac-d2403b338fa8 2024-02-24T00:27:00.490067990Z [2024-02-24T00:27:00.489+0000] {scheduler_job.py:635} INFO - Setting external_id for to d0b52c2a-647e-448a-be45-33af3e568a7d 2024-02-24T00:27:00.490226322Z [2024-02-24T00:27:00.490+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3afa29b8-6982-4243-bdec-d4f6fb21eef2 2024-02-24T00:27:01.649091992Z [2024-02-24T00:27:01.648+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:27:01.651730845Z [2024-02-24T00:27:01.651+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:26:00+00:00, run_id=scheduled__2024-02-24T00:26:00+00:00, run_start_date=2024-02-24 00:27:00.191659+00:00, run_end_date=2024-02-24 00:27:01.648880+00:00, run_duration=1.457221, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:26:00+00:00, data_interval_end=2024-02-24 00:27:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:27:01.671521280Z [2024-02-24T00:27:01.671+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:27:00+00:00, run_after=2024-02-24T00:28:00+00:00 2024-02-24T00:27:01.787812017Z [2024-02-24T00:27:01.787+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:26:00+00:00 exited with status success for try_number 1 2024-02-24T00:27:01.798404883Z [2024-02-24T00:27:01.797+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:26:00+00:00, map_index=-1, run_start_date=2024-02-24 00:27:01.037895+00:00, run_end_date=2024-02-24 00:27:01.512005+00:00, run_duration=0.47411, state=success, executor_state=success, try_number=1, max_tries=1, job_id=256, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:27:00.265842+00:00, queued_by_job_id=2, pid=3823 2024-02-24T00:27:04.631545742Z [2024-02-24T00:27:04.630+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:27:04.632278807Z [2024-02-24T00:27:04.631+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:26:00+00:00, run_id=scheduled__2024-02-24T00:26:00+00:00, run_start_date=2024-02-24 00:27:00.194860+00:00, run_end_date=2024-02-24 00:27:04.631752+00:00, run_duration=4.436892, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:26:00+00:00, data_interval_end=2024-02-24 00:27:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:27:04.647657769Z [2024-02-24T00:27:04.647+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:27:00+00:00, run_after=2024-02-24T00:28:00+00:00 2024-02-24T00:27:04.659718272Z [2024-02-24T00:27:04.659+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:27:04.660736207Z [2024-02-24T00:27:04.660+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:26:00+00:00, run_id=scheduled__2024-02-24T00:26:00+00:00, run_start_date=2024-02-24 00:27:00.193125+00:00, run_end_date=2024-02-24 00:27:04.660158+00:00, run_duration=4.467033, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:26:00+00:00, data_interval_end=2024-02-24 00:27:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:27:04.677820223Z [2024-02-24T00:27:04.677+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:27:00+00:00, run_after=2024-02-24T00:28:00+00:00 2024-02-24T00:27:04.721860010Z [2024-02-24T00:27:04.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:26:00+00:00 exited with status success for try_number 1 2024-02-24T00:27:04.722149092Z [2024-02-24T00:27:04.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:26:00+00:00 exited with status success for try_number 1 2024-02-24T00:27:04.731001504Z [2024-02-24T00:27:04.730+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:26:00+00:00, map_index=-1, run_start_date=2024-02-24 00:27:02.234174+00:00, run_end_date=2024-02-24 00:27:04.142193+00:00, run_duration=1.908019, state=success, executor_state=success, try_number=1, max_tries=1, job_id=257, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:27:00.265842+00:00, queued_by_job_id=2, pid=3840 2024-02-24T00:27:04.731424197Z [2024-02-24T00:27:04.731+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:26:00+00:00, map_index=-1, run_start_date=2024-02-24 00:27:02.560001+00:00, run_end_date=2024-02-24 00:27:03.984133+00:00, run_duration=1.424132, state=success, executor_state=success, try_number=1, max_tries=1, job_id=258, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:27:00.265842+00:00, queued_by_job_id=2, pid=3842 2024-02-24T00:28:00.552697815Z [2024-02-24T00:28:00.552+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:28:00+00:00, run_after=2024-02-24T00:29:00+00:00 2024-02-24T00:28:00.573176023Z [2024-02-24T00:28:00.572+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:28:00+00:00, run_after=2024-02-24T00:29:00+00:00 2024-02-24T00:28:00.584030547Z [2024-02-24T00:28:00.583+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:28:00.595058678Z [2024-02-24T00:28:00.594+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:28:00.722021867Z [2024-02-24T00:28:00.721+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T00:28:00.722073662Z 2024-02-24T00:28:00.722082443Z 2024-02-24T00:28:00.722089702Z 2024-02-24T00:28:00.722096407Z 2024-02-24T00:28:00.722402474Z [2024-02-24T00:28:00.721+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T00:28:00.722810808Z [2024-02-24T00:28:00.722+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:28:00.723145579Z [2024-02-24T00:28:00.722+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:28:00.723525998Z [2024-02-24T00:28:00.723+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:28:00.724539040Z [2024-02-24T00:28:00.724+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:28:00.724555835Z 2024-02-24T00:28:00.724561674Z 2024-02-24T00:28:00.724566909Z 2024-02-24T00:28:00.724572206Z 2024-02-24T00:28:00.730255479Z [2024-02-24T00:28:00.729+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:28:00.730690589Z [2024-02-24T00:28:00.730+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T00:28:00.731332475Z [2024-02-24T00:28:00.731+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:28:00.736841288Z [2024-02-24T00:28:00.731+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:28:00.737247281Z [2024-02-24T00:28:00.737+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:28:00.737532028Z [2024-02-24T00:28:00.737+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:28:00.737919493Z [2024-02-24T00:28:00.737+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:28:00.738298955Z [2024-02-24T00:28:00.737+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:28:01.269084749Z [2024-02-24T00:28:01.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:26:00+00:00 exited with status queued for try_number 1 2024-02-24T00:28:01.269114854Z [2024-02-24T00:28:01.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:27:00+00:00 exited with status queued for try_number 1 2024-02-24T00:28:01.269118995Z [2024-02-24T00:28:01.268+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:27:00+00:00 exited with status queued for try_number 1 2024-02-24T00:28:01.269122335Z [2024-02-24T00:28:01.268+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:27:00+00:00 exited with status queued for try_number 1 2024-02-24T00:28:01.289900698Z [2024-02-24T00:28:01.285+0000] {scheduler_job.py:635} INFO - Setting external_id for to 32562288-cbcb-4d79-8579-b2002fd82fa4 2024-02-24T00:28:01.289923724Z [2024-02-24T00:28:01.285+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9121dca3-85ba-4cdd-a6b5-6667fd01bec0 2024-02-24T00:28:01.289927690Z [2024-02-24T00:28:01.285+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80192177-18fc-458d-9b04-ef7113ad56c8 2024-02-24T00:28:01.289944438Z [2024-02-24T00:28:01.285+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9fb1980-e3da-4238-b17b-f9b9107cc933 2024-02-24T00:28:02.568804347Z [2024-02-24T00:28:02.568+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:28:02.569756808Z [2024-02-24T00:28:02.569+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 00:26:00+00:00, run_id=scheduled__2024-02-24T00:26:00+00:00, run_start_date=2024-02-24 00:28:00.612432+00:00, run_end_date=2024-02-24 00:28:02.568966+00:00, run_duration=1.956534, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:26:00+00:00, data_interval_end=2024-02-24 00:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T00:28:02.582325816Z [2024-02-24T00:28:02.581+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T00:28:00+00:00, run_after=2024-02-24T00:30:00+00:00 2024-02-24T00:28:02.612509018Z [2024-02-24T00:28:02.611+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:28:02.613193781Z [2024-02-24T00:28:02.612+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:27:00+00:00, run_id=scheduled__2024-02-24T00:27:00+00:00, run_start_date=2024-02-24 00:28:00.613842+00:00, run_end_date=2024-02-24 00:28:02.612663+00:00, run_duration=1.998821, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:27:00+00:00, data_interval_end=2024-02-24 00:28:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:28:02.633945326Z [2024-02-24T00:28:02.632+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:28:00+00:00, run_after=2024-02-24T00:29:00+00:00 2024-02-24T00:28:02.726662182Z [2024-02-24T00:28:02.725+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:26:00+00:00 exited with status success for try_number 1 2024-02-24T00:28:02.726689009Z [2024-02-24T00:28:02.725+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:27:00+00:00 exited with status success for try_number 1 2024-02-24T00:28:02.737888070Z [2024-02-24T00:28:02.736+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T00:26:00+00:00, map_index=-1, run_start_date=2024-02-24 00:28:01.678998+00:00, run_end_date=2024-02-24 00:28:02.058762+00:00, run_duration=0.379764, state=success, executor_state=success, try_number=1, max_tries=1, job_id=260, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:28:00.726008+00:00, queued_by_job_id=2, pid=3875 2024-02-24T00:28:02.737906634Z [2024-02-24T00:28:02.737+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:27:00+00:00, map_index=-1, run_start_date=2024-02-24 00:28:01.617913+00:00, run_end_date=2024-02-24 00:28:02.074849+00:00, run_duration=0.456936, state=success, executor_state=success, try_number=1, max_tries=1, job_id=259, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:28:00.726008+00:00, queued_by_job_id=2, pid=3874 2024-02-24T00:28:05.986137973Z [2024-02-24T00:28:05.985+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:28:05.986273907Z [2024-02-24T00:28:05.986+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:27:00+00:00, run_id=scheduled__2024-02-24T00:27:00+00:00, run_start_date=2024-02-24 00:28:00.615357+00:00, run_end_date=2024-02-24 00:28:05.985984+00:00, run_duration=5.370627, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:27:00+00:00, data_interval_end=2024-02-24 00:28:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:28:05.995785263Z [2024-02-24T00:28:05.995+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:28:00+00:00, run_after=2024-02-24T00:29:00+00:00 2024-02-24T00:28:06.006892340Z [2024-02-24T00:28:06.006+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:28:06.007217972Z [2024-02-24T00:28:06.006+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:27:00+00:00, run_id=scheduled__2024-02-24T00:27:00+00:00, run_start_date=2024-02-24 00:28:00.616863+00:00, run_end_date=2024-02-24 00:28:06.006704+00:00, run_duration=5.389841, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:27:00+00:00, data_interval_end=2024-02-24 00:28:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:28:06.020760892Z [2024-02-24T00:28:06.020+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:28:00+00:00, run_after=2024-02-24T00:29:00+00:00 2024-02-24T00:28:06.061421810Z [2024-02-24T00:28:06.060+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:27:00+00:00 exited with status success for try_number 1 2024-02-24T00:28:06.061473815Z [2024-02-24T00:28:06.061+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:27:00+00:00 exited with status success for try_number 1 2024-02-24T00:28:06.067107921Z [2024-02-24T00:28:06.066+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:27:00+00:00, map_index=-1, run_start_date=2024-02-24 00:28:03.127203+00:00, run_end_date=2024-02-24 00:28:05.867113+00:00, run_duration=2.73991, state=success, executor_state=success, try_number=1, max_tries=1, job_id=262, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:28:00.726008+00:00, queued_by_job_id=2, pid=3899 2024-02-24T00:28:06.067172479Z [2024-02-24T00:28:06.066+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:27:00+00:00, map_index=-1, run_start_date=2024-02-24 00:28:02.986528+00:00, run_end_date=2024-02-24 00:28:05.856861+00:00, run_duration=2.870333, state=success, executor_state=success, try_number=1, max_tries=1, job_id=261, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:28:00.726008+00:00, queued_by_job_id=2, pid=3898 2024-02-24T00:29:00.373016591Z [2024-02-24T00:29:00.372+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:29:00.395022180Z [2024-02-24T00:29:00.394+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:29:00+00:00, run_after=2024-02-24T00:30:00+00:00 2024-02-24T00:29:00.407383806Z [2024-02-24T00:29:00.407+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:29:00+00:00, run_after=2024-02-24T00:30:00+00:00 2024-02-24T00:29:00.472314255Z [2024-02-24T00:29:00.471+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T00:29:00.472349226Z 2024-02-24T00:29:00.472357039Z 2024-02-24T00:29:00.472363143Z 2024-02-24T00:29:00.472524916Z [2024-02-24T00:29:00.472+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:29:00.472925103Z [2024-02-24T00:29:00.472+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:29:00.472971322Z [2024-02-24T00:29:00.472+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:29:00.473980720Z [2024-02-24T00:29:00.473+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:29:00.473999326Z 2024-02-24T00:29:00.474005451Z 2024-02-24T00:29:00.474011115Z 2024-02-24T00:29:00.478206449Z [2024-02-24T00:29:00.477+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:29:00.478426819Z [2024-02-24T00:29:00.478+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:29:00.478764719Z [2024-02-24T00:29:00.478+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:29:00.478996681Z [2024-02-24T00:29:00.478+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:29:00.479304319Z [2024-02-24T00:29:00.479+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:29:00.479474371Z [2024-02-24T00:29:00.479+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:29:00.685350115Z [2024-02-24T00:29:00.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:28:00+00:00 exited with status queued for try_number 1 2024-02-24T00:29:00.685622316Z [2024-02-24T00:29:00.685+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:28:00+00:00 exited with status queued for try_number 1 2024-02-24T00:29:00.685912329Z [2024-02-24T00:29:00.685+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:28:00+00:00 exited with status queued for try_number 1 2024-02-24T00:29:00.694155727Z [2024-02-24T00:29:00.693+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f355066-dd91-499b-a584-acab34def0a8 2024-02-24T00:29:00.694386750Z [2024-02-24T00:29:00.694+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5081a3d-9974-4d60-b1a3-2cea5bb46578 2024-02-24T00:29:00.694571475Z [2024-02-24T00:29:00.694+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5af4b4ce-1bfd-4f0f-b018-4f1fc07f30a7 2024-02-24T00:29:02.239695504Z [2024-02-24T00:29:02.239+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:29:02.240231546Z [2024-02-24T00:29:02.239+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:28:00+00:00, run_id=scheduled__2024-02-24T00:28:00+00:00, run_start_date=2024-02-24 00:29:00.420023+00:00, run_end_date=2024-02-24 00:29:02.239626+00:00, run_duration=1.819603, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:28:00+00:00, data_interval_end=2024-02-24 00:29:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:29:02.259512606Z [2024-02-24T00:29:02.259+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:29:00+00:00, run_after=2024-02-24T00:30:00+00:00 2024-02-24T00:29:02.332065620Z [2024-02-24T00:29:02.331+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:28:00+00:00 exited with status success for try_number 1 2024-02-24T00:29:02.344284834Z [2024-02-24T00:29:02.343+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:28:00+00:00, map_index=-1, run_start_date=2024-02-24 00:29:01.231006+00:00, run_end_date=2024-02-24 00:29:01.741595+00:00, run_duration=0.510589, state=success, executor_state=success, try_number=1, max_tries=1, job_id=263, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:29:00.474835+00:00, queued_by_job_id=2, pid=3932 2024-02-24T00:29:04.544271421Z [2024-02-24T00:29:04.543+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:29:04.545280223Z [2024-02-24T00:29:04.544+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:28:00+00:00, run_id=scheduled__2024-02-24T00:28:00+00:00, run_start_date=2024-02-24 00:29:00.422941+00:00, run_end_date=2024-02-24 00:29:04.544401+00:00, run_duration=4.12146, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:28:00+00:00, data_interval_end=2024-02-24 00:29:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:29:04.556293630Z [2024-02-24T00:29:04.555+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:29:00+00:00, run_after=2024-02-24T00:30:00+00:00 2024-02-24T00:29:04.565492411Z [2024-02-24T00:29:04.565+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:29:04.566554566Z [2024-02-24T00:29:04.565+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:28:00+00:00, run_id=scheduled__2024-02-24T00:28:00+00:00, run_start_date=2024-02-24 00:29:00.421363+00:00, run_end_date=2024-02-24 00:29:04.565601+00:00, run_duration=4.144238, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:28:00+00:00, data_interval_end=2024-02-24 00:29:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:29:04.584272768Z [2024-02-24T00:29:04.583+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:29:00+00:00, run_after=2024-02-24T00:30:00+00:00 2024-02-24T00:29:04.629327878Z [2024-02-24T00:29:04.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:28:00+00:00 exited with status success for try_number 1 2024-02-24T00:29:04.629708350Z [2024-02-24T00:29:04.629+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:28:00+00:00 exited with status success for try_number 1 2024-02-24T00:29:04.639398278Z [2024-02-24T00:29:04.638+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:28:00+00:00, map_index=-1, run_start_date=2024-02-24 00:29:02.340353+00:00, run_end_date=2024-02-24 00:29:04.141337+00:00, run_duration=1.800984, state=success, executor_state=success, try_number=1, max_tries=1, job_id=265, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:29:00.474835+00:00, queued_by_job_id=2, pid=3951 2024-02-24T00:29:04.639995476Z [2024-02-24T00:29:04.639+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:28:00+00:00, map_index=-1, run_start_date=2024-02-24 00:29:02.295157+00:00, run_end_date=2024-02-24 00:29:03.782288+00:00, run_duration=1.487131, state=success, executor_state=success, try_number=1, max_tries=1, job_id=264, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:29:00.474835+00:00, queued_by_job_id=2, pid=3950 2024-02-24T00:30:00.345955344Z [2024-02-24T00:30:00.345+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:30:00+00:00, run_after=2024-02-24T00:31:00+00:00 2024-02-24T00:30:00.358755652Z [2024-02-24T00:30:00.358+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:30:00.370211149Z [2024-02-24T00:30:00.369+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:30:00.390869504Z [2024-02-24T00:30:00.390+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:30:00+00:00, run_after=2024-02-24T00:31:00+00:00 2024-02-24T00:30:00.402383049Z [2024-02-24T00:30:00.401+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:30:00+00:00, run_after=2024-02-24T00:35:00+00:00 2024-02-24T00:30:00.514580054Z [2024-02-24T00:30:00.514+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-02-24T00:30:00.514619795Z 2024-02-24T00:30:00.514626675Z 2024-02-24T00:30:00.514633211Z 2024-02-24T00:30:00.514639078Z 2024-02-24T00:30:00.514645021Z 2024-02-24T00:30:00.514809955Z [2024-02-24T00:30:00.514+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:30:00.514977947Z [2024-02-24T00:30:00.514+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T00:30:00.515206158Z [2024-02-24T00:30:00.515+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:30:00.515347756Z [2024-02-24T00:30:00.515+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:30:00.515595472Z [2024-02-24T00:30:00.515+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:30:00.516493794Z [2024-02-24T00:30:00.516+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:30:00.516519975Z 2024-02-24T00:30:00.516524004Z 2024-02-24T00:30:00.516527283Z 2024-02-24T00:30:00.516530478Z 2024-02-24T00:30:00.516533470Z 2024-02-24T00:30:00.522042746Z [2024-02-24T00:30:00.521+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T00:30:00.522335583Z [2024-02-24T00:30:00.522+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:30:00.522798256Z [2024-02-24T00:30:00.522+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:30:00.523150856Z [2024-02-24T00:30:00.522+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T00:30:00.523540022Z [2024-02-24T00:30:00.523+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:30:00.523798771Z [2024-02-24T00:30:00.523+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:30:00.524254652Z [2024-02-24T00:30:00.524+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:30:00.525146318Z [2024-02-24T00:30:00.524+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:30:00.525587729Z [2024-02-24T00:30:00.525+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:30:00.525935908Z [2024-02-24T00:30:00.525+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:30:00.975158129Z [2024-02-24T00:30:00.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T00:25:00+00:00 exited with status queued for try_number 1 2024-02-24T00:30:00.975338590Z [2024-02-24T00:30:00.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:28:00+00:00 exited with status queued for try_number 1 2024-02-24T00:30:00.975499055Z [2024-02-24T00:30:00.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:29:00+00:00 exited with status queued for try_number 1 2024-02-24T00:30:00.975601914Z [2024-02-24T00:30:00.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:29:00+00:00 exited with status queued for try_number 1 2024-02-24T00:30:00.975722865Z [2024-02-24T00:30:00.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:29:00+00:00 exited with status queued for try_number 1 2024-02-24T00:30:00.999573566Z [2024-02-24T00:30:00.999+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad74a24f-b5fc-4a43-b414-f558081d9fff 2024-02-24T00:30:00.999714457Z [2024-02-24T00:30:00.999+0000] {scheduler_job.py:635} INFO - Setting external_id for to edada86e-fec2-4a4d-8bbd-db92f0bfef03 2024-02-24T00:30:00.999952699Z [2024-02-24T00:30:00.999+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b1dba4f-5a40-45d1-addb-664f4b741798 2024-02-24T00:30:01.000186338Z [2024-02-24T00:30:01.000+0000] {scheduler_job.py:635} INFO - Setting external_id for to d6a4abb9-a02b-46a2-9f95-43f5d921ebf8 2024-02-24T00:30:01.000369838Z [2024-02-24T00:30:01.000+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ddde855-9ad0-4bc7-bda9-8c1782713a5e 2024-02-24T00:30:03.252075173Z [2024-02-24T00:30:03.251+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:30:03.252411652Z [2024-02-24T00:30:03.252+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:29:00+00:00, run_id=scheduled__2024-02-24T00:29:00+00:00, run_start_date=2024-02-24 00:30:00.418638+00:00, run_end_date=2024-02-24 00:30:03.251926+00:00, run_duration=2.833288, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:29:00+00:00, data_interval_end=2024-02-24 00:30:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:30:03.264547418Z [2024-02-24T00:30:03.264+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:30:00+00:00, run_after=2024-02-24T00:31:00+00:00 2024-02-24T00:30:03.283876905Z [2024-02-24T00:30:03.283+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:30:03.284121238Z [2024-02-24T00:30:03.283+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 00:28:00+00:00, run_id=scheduled__2024-02-24T00:28:00+00:00, run_start_date=2024-02-24 00:30:00.416034+00:00, run_end_date=2024-02-24 00:30:03.283823+00:00, run_duration=2.867789, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:28:00+00:00, data_interval_end=2024-02-24 00:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T00:30:03.293276163Z [2024-02-24T00:30:03.292+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T00:30:00+00:00, run_after=2024-02-24T00:32:00+00:00 2024-02-24T00:30:03.352789821Z [2024-02-24T00:30:03.352+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:28:00+00:00 exited with status success for try_number 1 2024-02-24T00:30:03.353039097Z [2024-02-24T00:30:03.352+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:29:00+00:00 exited with status success for try_number 1 2024-02-24T00:30:03.366498118Z [2024-02-24T00:30:03.366+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T00:28:00+00:00, map_index=-1, run_start_date=2024-02-24 00:30:01.620597+00:00, run_end_date=2024-02-24 00:30:02.024373+00:00, run_duration=0.403776, state=success, executor_state=success, try_number=1, max_tries=1, job_id=266, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:30:00.518273+00:00, queued_by_job_id=2, pid=3985 2024-02-24T00:30:03.366789540Z [2024-02-24T00:30:03.366+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:29:00+00:00, map_index=-1, run_start_date=2024-02-24 00:30:01.637813+00:00, run_end_date=2024-02-24 00:30:02.198493+00:00, run_duration=0.56068, state=success, executor_state=success, try_number=1, max_tries=1, job_id=267, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:30:00.518273+00:00, queued_by_job_id=2, pid=3986 2024-02-24T00:30:04.500666584Z [2024-02-24T00:30:04.500+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T00:30:04.500761273Z 2024-02-24T00:30:04.500800659Z [2024-02-24T00:30:04.500+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:30:04.501137773Z [2024-02-24T00:30:04.500+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:30:04.501173547Z 2024-02-24T00:30:04.503911647Z [2024-02-24T00:30:04.503+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T00:30:04.503970898Z [2024-02-24T00:30:04.503+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:30:04.557492331Z [2024-02-24T00:30:04.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T00:25:00+00:00 exited with status queued for try_number 1 2024-02-24T00:30:04.557554609Z [2024-02-24T00:30:04.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T00:25:00+00:00 exited with status success for try_number 1 2024-02-24T00:30:04.563287310Z [2024-02-24T00:30:04.562+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0420348-274f-4fc1-a0f0-d39fa2564c53 2024-02-24T00:30:04.563365152Z [2024-02-24T00:30:04.563+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T00:25:00+00:00, map_index=-1, run_start_date=2024-02-24 00:30:03.031644+00:00, run_end_date=2024-02-24 00:30:03.524764+00:00, run_duration=0.49312, state=success, executor_state=success, try_number=1, max_tries=1, job_id=268, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:30:00.518273+00:00, queued_by_job_id=2, pid=4007 2024-02-24T00:30:04.623980210Z [2024-02-24T00:30:04.623+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:30:04.624671889Z [2024-02-24T00:30:04.624+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:29:00+00:00, run_id=scheduled__2024-02-24T00:29:00+00:00, run_start_date=2024-02-24 00:30:00.420679+00:00, run_end_date=2024-02-24 00:30:04.624162+00:00, run_duration=4.203483, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:29:00+00:00, data_interval_end=2024-02-24 00:30:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:30:04.638544009Z [2024-02-24T00:30:04.638+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:30:00+00:00, run_after=2024-02-24T00:31:00+00:00 2024-02-24T00:30:05.765865806Z [2024-02-24T00:30:05.765+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:30:05.766860286Z [2024-02-24T00:30:05.766+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:29:00+00:00, run_id=scheduled__2024-02-24T00:29:00+00:00, run_start_date=2024-02-24 00:30:00.422865+00:00, run_end_date=2024-02-24 00:30:05.766327+00:00, run_duration=5.343462, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:29:00+00:00, data_interval_end=2024-02-24 00:30:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:30:05.783667356Z [2024-02-24T00:30:05.783+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:30:00+00:00, run_after=2024-02-24T00:31:00+00:00 2024-02-24T00:30:05.844962108Z [2024-02-24T00:30:05.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:29:00+00:00 exited with status success for try_number 1 2024-02-24T00:30:05.845022991Z [2024-02-24T00:30:05.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:29:00+00:00 exited with status success for try_number 1 2024-02-24T00:30:05.852732930Z [2024-02-24T00:30:05.852+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:29:00+00:00, map_index=-1, run_start_date=2024-02-24 00:30:03.247701+00:00, run_end_date=2024-02-24 00:30:04.558505+00:00, run_duration=1.310804, state=success, executor_state=success, try_number=1, max_tries=1, job_id=269, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:30:00.518273+00:00, queued_by_job_id=2, pid=4016 2024-02-24T00:30:05.852959631Z [2024-02-24T00:30:05.852+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:29:00+00:00, map_index=-1, run_start_date=2024-02-24 00:30:03.464270+00:00, run_end_date=2024-02-24 00:30:05.076829+00:00, run_duration=1.612559, state=success, executor_state=success, try_number=1, max_tries=1, job_id=270, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:30:00.518273+00:00, queued_by_job_id=2, pid=4022 2024-02-24T00:30:06.912134936Z [2024-02-24T00:30:06.911+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T00:30:06.912180992Z 2024-02-24T00:30:06.912218437Z [2024-02-24T00:30:06.911+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:30:06.912821639Z [2024-02-24T00:30:06.912+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:30:06.912867511Z 2024-02-24T00:30:06.915672917Z [2024-02-24T00:30:06.915+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T00:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T00:30:06.915862733Z [2024-02-24T00:30:06.915+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T00:30:06.981846280Z [2024-02-24T00:30:06.981+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T00:25:00+00:00 exited with status queued for try_number 1 2024-02-24T00:30:06.981964877Z [2024-02-24T00:30:06.981+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T00:25:00+00:00 exited with status success for try_number 1 2024-02-24T00:30:06.999485965Z [2024-02-24T00:30:06.999+0000] {scheduler_job.py:635} INFO - Setting external_id for to b38468b4-80d2-4cbc-96eb-2631af69c6be 2024-02-24T00:30:06.999634577Z [2024-02-24T00:30:06.999+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T00:25:00+00:00, map_index=-1, run_start_date=2024-02-24 00:30:06.170507+00:00, run_end_date=2024-02-24 00:30:06.522521+00:00, run_duration=0.352014, state=success, executor_state=success, try_number=1, max_tries=1, job_id=271, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:30:04.501441+00:00, queued_by_job_id=2, pid=4040 2024-02-24T00:30:09.574784220Z [2024-02-24T00:30:09.574+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T00:30:09.574829430Z 2024-02-24T00:30:09.574840728Z [2024-02-24T00:30:09.574+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:30:09.575663161Z [2024-02-24T00:30:09.575+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:30:09.575674442Z 2024-02-24T00:30:09.578969723Z [2024-02-24T00:30:09.578+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:30:09.579058931Z [2024-02-24T00:30:09.578+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:30:09.635732530Z [2024-02-24T00:30:09.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T00:25:00+00:00 exited with status queued for try_number 1 2024-02-24T00:30:09.635951154Z [2024-02-24T00:30:09.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T00:25:00+00:00 exited with status success for try_number 1 2024-02-24T00:30:09.644146534Z [2024-02-24T00:30:09.643+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e8ea7ee-19c9-412c-8e33-04afa4007ca0 2024-02-24T00:30:09.644357296Z [2024-02-24T00:30:09.644+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T00:25:00+00:00, map_index=0, run_start_date=2024-02-24 00:30:08.694300+00:00, run_end_date=2024-02-24 00:30:09.061031+00:00, run_duration=0.366731, state=success, executor_state=success, try_number=1, max_tries=1, job_id=272, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:30:06.913152+00:00, queued_by_job_id=2, pid=4048 2024-02-24T00:30:11.894171135Z [2024-02-24T00:30:11.893+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:30:11.894556877Z [2024-02-24T00:30:11.894+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:25:00+00:00, run_id=scheduled__2024-02-24T00:25:00+00:00, run_start_date=2024-02-24 00:30:00.413196+00:00, run_end_date=2024-02-24 00:30:11.894037+00:00, run_duration=11.480841, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:25:00+00:00, data_interval_end=2024-02-24 00:30:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T00:30:11.901417035Z [2024-02-24T00:30:11.901+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:30:00+00:00, run_after=2024-02-24T00:35:00+00:00 2024-02-24T00:30:11.935761920Z [2024-02-24T00:30:11.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T00:25:00+00:00 exited with status success for try_number 1 2024-02-24T00:30:11.941822806Z [2024-02-24T00:30:11.941+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T00:25:00+00:00, map_index=-1, run_start_date=2024-02-24 00:30:11.235717+00:00, run_end_date=2024-02-24 00:30:11.586962+00:00, run_duration=0.351245, state=success, executor_state=success, try_number=1, max_tries=1, job_id=273, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:30:09.576060+00:00, queued_by_job_id=2, pid=4056 2024-02-24T00:31:00.218255824Z [2024-02-24T00:31:00.217+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:31:00+00:00, run_after=2024-02-24T00:32:00+00:00 2024-02-24T00:31:00.227041815Z [2024-02-24T00:31:00.226+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:31:00.238300458Z [2024-02-24T00:31:00.238+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:31:00+00:00, run_after=2024-02-24T00:32:00+00:00 2024-02-24T00:31:00.294965218Z [2024-02-24T00:31:00.294+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T00:31:00.294989675Z 2024-02-24T00:31:00.294993334Z 2024-02-24T00:31:00.294997125Z 2024-02-24T00:31:00.295162118Z [2024-02-24T00:31:00.294+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:31:00.295427539Z [2024-02-24T00:31:00.295+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:31:00.295619572Z [2024-02-24T00:31:00.295+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:31:00.296344813Z [2024-02-24T00:31:00.296+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:31:00.296365373Z 2024-02-24T00:31:00.296388203Z 2024-02-24T00:31:00.296392656Z 2024-02-24T00:31:00.300583592Z [2024-02-24T00:31:00.300+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:31:00.300989028Z [2024-02-24T00:31:00.300+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:31:00.301448309Z [2024-02-24T00:31:00.301+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:31:00.301835703Z [2024-02-24T00:31:00.301+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:31:00.302275103Z [2024-02-24T00:31:00.302+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:31:00.302573670Z [2024-02-24T00:31:00.302+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:31:00.527389498Z [2024-02-24T00:31:00.525+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:30:00+00:00 exited with status queued for try_number 1 2024-02-24T00:31:00.531050236Z [2024-02-24T00:31:00.527+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:30:00+00:00 exited with status queued for try_number 1 2024-02-24T00:31:00.531508835Z [2024-02-24T00:31:00.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:30:00+00:00 exited with status queued for try_number 1 2024-02-24T00:31:00.542672647Z [2024-02-24T00:31:00.542+0000] {scheduler_job.py:635} INFO - Setting external_id for to b560781e-a4ad-4b01-be4c-ac52cb159b64 2024-02-24T00:31:00.543922340Z [2024-02-24T00:31:00.543+0000] {scheduler_job.py:635} INFO - Setting external_id for to a48e0c70-7875-4843-9113-6993ac6de51b 2024-02-24T00:31:00.544836684Z [2024-02-24T00:31:00.544+0000] {scheduler_job.py:635} INFO - Setting external_id for to 91095f5e-1ec7-4a14-8322-b2dd7ac3f100 2024-02-24T00:31:01.731033259Z [2024-02-24T00:31:01.730+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:31:01.733852219Z [2024-02-24T00:31:01.733+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:30:00+00:00, run_id=scheduled__2024-02-24T00:30:00+00:00, run_start_date=2024-02-24 00:31:00.248535+00:00, run_end_date=2024-02-24 00:31:01.731180+00:00, run_duration=1.482645, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:30:00+00:00, data_interval_end=2024-02-24 00:31:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:31:01.746015436Z [2024-02-24T00:31:01.745+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:31:00+00:00, run_after=2024-02-24T00:32:00+00:00 2024-02-24T00:31:02.510385047Z [2024-02-24T00:31:02.509+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:30:00+00:00 exited with status success for try_number 1 2024-02-24T00:31:02.517509423Z [2024-02-24T00:31:02.516+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:30:00+00:00, map_index=-1, run_start_date=2024-02-24 00:31:01.156033+00:00, run_end_date=2024-02-24 00:31:01.684726+00:00, run_duration=0.528693, state=success, executor_state=success, try_number=1, max_tries=1, job_id=274, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:31:00.297309+00:00, queued_by_job_id=2, pid=4078 2024-02-24T00:31:04.233090793Z [2024-02-24T00:31:04.232+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:31:04.233564299Z [2024-02-24T00:31:04.233+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:30:00+00:00, run_id=scheduled__2024-02-24T00:30:00+00:00, run_start_date=2024-02-24 00:31:00.249736+00:00, run_end_date=2024-02-24 00:31:04.232940+00:00, run_duration=3.983204, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:30:00+00:00, data_interval_end=2024-02-24 00:31:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:31:04.251578848Z [2024-02-24T00:31:04.251+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:31:00+00:00, run_after=2024-02-24T00:32:00+00:00 2024-02-24T00:31:04.304919092Z [2024-02-24T00:31:04.304+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:30:00+00:00 exited with status success for try_number 1 2024-02-24T00:31:04.312072249Z [2024-02-24T00:31:04.311+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:30:00+00:00, map_index=-1, run_start_date=2024-02-24 00:31:02.481154+00:00, run_end_date=2024-02-24 00:31:03.814433+00:00, run_duration=1.333279, state=success, executor_state=success, try_number=1, max_tries=1, job_id=275, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:31:00.297309+00:00, queued_by_job_id=2, pid=4096 2024-02-24T00:31:05.371477288Z [2024-02-24T00:31:05.370+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:31:05.371803254Z [2024-02-24T00:31:05.371+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:30:00+00:00, run_id=scheduled__2024-02-24T00:30:00+00:00, run_start_date=2024-02-24 00:31:00.250774+00:00, run_end_date=2024-02-24 00:31:05.371300+00:00, run_duration=5.120526, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:30:00+00:00, data_interval_end=2024-02-24 00:31:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:31:05.381631485Z [2024-02-24T00:31:05.381+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:31:00+00:00, run_after=2024-02-24T00:32:00+00:00 2024-02-24T00:31:05.410039576Z [2024-02-24T00:31:05.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:30:00+00:00 exited with status success for try_number 1 2024-02-24T00:31:05.417327931Z [2024-02-24T00:31:05.416+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:30:00+00:00, map_index=-1, run_start_date=2024-02-24 00:31:02.646541+00:00, run_end_date=2024-02-24 00:31:04.326719+00:00, run_duration=1.680178, state=success, executor_state=success, try_number=1, max_tries=1, job_id=276, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:31:00.297309+00:00, queued_by_job_id=2, pid=4097 2024-02-24T00:31:59.926617780Z [2024-02-24T00:31:59.926+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T00:32:00.977202863Z [2024-02-24T00:32:00.976+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:32:00.987479295Z [2024-02-24T00:32:00.987+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:32:01.001123767Z [2024-02-24T00:32:01.000+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:32:00+00:00, run_after=2024-02-24T00:33:00+00:00 2024-02-24T00:32:01.014028584Z [2024-02-24T00:32:01.013+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:32:00+00:00, run_after=2024-02-24T00:33:00+00:00 2024-02-24T00:32:01.129858191Z [2024-02-24T00:32:01.129+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T00:32:01.129889628Z 2024-02-24T00:32:01.129895989Z 2024-02-24T00:32:01.129900822Z 2024-02-24T00:32:01.129924407Z 2024-02-24T00:32:01.130159565Z [2024-02-24T00:32:01.129+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T00:32:01.130454845Z [2024-02-24T00:32:01.130+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:32:01.130667993Z [2024-02-24T00:32:01.130+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:32:01.130894299Z [2024-02-24T00:32:01.130+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:32:01.131970746Z [2024-02-24T00:32:01.131+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:32:01.131984747Z 2024-02-24T00:32:01.131990208Z 2024-02-24T00:32:01.131994642Z 2024-02-24T00:32:01.131999157Z 2024-02-24T00:32:01.137527693Z [2024-02-24T00:32:01.137+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:32:01.137973484Z [2024-02-24T00:32:01.137+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T00:32:01.138408761Z [2024-02-24T00:32:01.138+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:32:01.138642842Z [2024-02-24T00:32:01.138+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:32:01.138966125Z [2024-02-24T00:32:01.138+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:32:01.139213614Z [2024-02-24T00:32:01.138+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:32:01.139595595Z [2024-02-24T00:32:01.139+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:32:01.139834541Z [2024-02-24T00:32:01.139+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:32:01.688493351Z [2024-02-24T00:32:01.687+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:30:00+00:00 exited with status queued for try_number 1 2024-02-24T00:32:01.688831503Z [2024-02-24T00:32:01.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:31:00+00:00 exited with status queued for try_number 1 2024-02-24T00:32:01.689098672Z [2024-02-24T00:32:01.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:31:00+00:00 exited with status queued for try_number 1 2024-02-24T00:32:01.689357935Z [2024-02-24T00:32:01.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:31:00+00:00 exited with status queued for try_number 1 2024-02-24T00:32:01.703004113Z [2024-02-24T00:32:01.702+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6c18750-3f80-485c-97fa-fb56de4abf1c 2024-02-24T00:32:01.703356980Z [2024-02-24T00:32:01.703+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80584f81-1c05-45a5-a3e3-146bf0e685d1 2024-02-24T00:32:01.703694012Z [2024-02-24T00:32:01.703+0000] {scheduler_job.py:635} INFO - Setting external_id for to cc0706f5-7517-462c-9e81-927aa6145342 2024-02-24T00:32:01.704002686Z [2024-02-24T00:32:01.703+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6a94ddb9-2f0c-49f3-b9fd-83598bfb566d 2024-02-24T00:32:02.761517499Z [2024-02-24T00:32:02.760+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:32:02.761975554Z [2024-02-24T00:32:02.761+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 00:30:00+00:00, run_id=scheduled__2024-02-24T00:30:00+00:00, run_start_date=2024-02-24 00:32:01.029363+00:00, run_end_date=2024-02-24 00:32:02.761421+00:00, run_duration=1.732058, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:30:00+00:00, data_interval_end=2024-02-24 00:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T00:32:02.771241102Z [2024-02-24T00:32:02.770+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T00:32:00+00:00, run_after=2024-02-24T00:34:00+00:00 2024-02-24T00:32:02.805490750Z [2024-02-24T00:32:02.805+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:32:02.805818553Z [2024-02-24T00:32:02.805+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:31:00+00:00, run_id=scheduled__2024-02-24T00:31:00+00:00, run_start_date=2024-02-24 00:32:01.032106+00:00, run_end_date=2024-02-24 00:32:02.805442+00:00, run_duration=1.773336, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:31:00+00:00, data_interval_end=2024-02-24 00:32:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:32:02.828673040Z [2024-02-24T00:32:02.828+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:32:00+00:00, run_after=2024-02-24T00:33:00+00:00 2024-02-24T00:32:02.860683432Z [2024-02-24T00:32:02.860+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:30:00+00:00 exited with status success for try_number 1 2024-02-24T00:32:02.860798762Z [2024-02-24T00:32:02.860+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:31:00+00:00 exited with status success for try_number 1 2024-02-24T00:32:02.867885088Z [2024-02-24T00:32:02.867+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T00:30:00+00:00, map_index=-1, run_start_date=2024-02-24 00:32:02.097231+00:00, run_end_date=2024-02-24 00:32:02.504914+00:00, run_duration=0.407683, state=success, executor_state=success, try_number=1, max_tries=1, job_id=277, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:32:01.133363+00:00, queued_by_job_id=2, pid=4131 2024-02-24T00:32:02.868141199Z [2024-02-24T00:32:02.867+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:31:00+00:00, map_index=-1, run_start_date=2024-02-24 00:32:02.115247+00:00, run_end_date=2024-02-24 00:32:02.604347+00:00, run_duration=0.4891, state=success, executor_state=success, try_number=1, max_tries=1, job_id=278, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:32:01.133363+00:00, queued_by_job_id=2, pid=4130 2024-02-24T00:32:04.978208987Z [2024-02-24T00:32:04.977+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:32:04.978655524Z [2024-02-24T00:32:04.978+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:31:00+00:00, run_id=scheduled__2024-02-24T00:31:00+00:00, run_start_date=2024-02-24 00:32:01.034940+00:00, run_end_date=2024-02-24 00:32:04.978015+00:00, run_duration=3.943075, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:31:00+00:00, data_interval_end=2024-02-24 00:32:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:32:04.995017380Z [2024-02-24T00:32:04.994+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:32:00+00:00, run_after=2024-02-24T00:33:00+00:00 2024-02-24T00:32:05.007349549Z [2024-02-24T00:32:05.006+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:32:05.007987035Z [2024-02-24T00:32:05.007+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:31:00+00:00, run_id=scheduled__2024-02-24T00:31:00+00:00, run_start_date=2024-02-24 00:32:01.033596+00:00, run_end_date=2024-02-24 00:32:05.007441+00:00, run_duration=3.973845, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:31:00+00:00, data_interval_end=2024-02-24 00:32:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:32:05.025220909Z [2024-02-24T00:32:05.024+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:32:00+00:00, run_after=2024-02-24T00:33:00+00:00 2024-02-24T00:32:05.070667156Z [2024-02-24T00:32:05.069+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:31:00+00:00 exited with status success for try_number 1 2024-02-24T00:32:05.071041965Z [2024-02-24T00:32:05.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:31:00+00:00 exited with status success for try_number 1 2024-02-24T00:32:05.082636341Z [2024-02-24T00:32:05.082+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:31:00+00:00, map_index=-1, run_start_date=2024-02-24 00:32:03.244675+00:00, run_end_date=2024-02-24 00:32:04.735291+00:00, run_duration=1.490616, state=success, executor_state=success, try_number=1, max_tries=1, job_id=279, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:32:01.133363+00:00, queued_by_job_id=2, pid=4154 2024-02-24T00:32:05.083189481Z [2024-02-24T00:32:05.082+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:31:00+00:00, map_index=-1, run_start_date=2024-02-24 00:32:03.341008+00:00, run_end_date=2024-02-24 00:32:04.635483+00:00, run_duration=1.294475, state=success, executor_state=success, try_number=1, max_tries=1, job_id=280, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:32:01.133363+00:00, queued_by_job_id=2, pid=4155 2024-02-24T00:33:00.700783217Z [2024-02-24T00:33:00.700+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:33:00.725403875Z [2024-02-24T00:33:00.724+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:33:00+00:00, run_after=2024-02-24T00:34:00+00:00 2024-02-24T00:33:00.752928554Z [2024-02-24T00:33:00.752+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:33:00+00:00, run_after=2024-02-24T00:34:00+00:00 2024-02-24T00:33:00.829952984Z [2024-02-24T00:33:00.829+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T00:33:00.830128923Z 2024-02-24T00:33:00.830141324Z 2024-02-24T00:33:00.830150326Z 2024-02-24T00:33:00.830222524Z [2024-02-24T00:33:00.829+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:33:00.830437440Z [2024-02-24T00:33:00.830+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:33:00.830725954Z [2024-02-24T00:33:00.830+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:33:00.832007918Z [2024-02-24T00:33:00.831+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:33:00.832094538Z 2024-02-24T00:33:00.832111991Z 2024-02-24T00:33:00.832127078Z 2024-02-24T00:33:00.836700374Z [2024-02-24T00:33:00.835+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:33:00.836823419Z [2024-02-24T00:33:00.836+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:33:00.836837008Z [2024-02-24T00:33:00.836+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:33:00.836867312Z [2024-02-24T00:33:00.836+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:33:00.837219978Z [2024-02-24T00:33:00.836+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:33:00.837423177Z [2024-02-24T00:33:00.837+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:33:01.080373544Z [2024-02-24T00:33:01.079+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:32:00+00:00 exited with status queued for try_number 1 2024-02-24T00:33:01.080830616Z [2024-02-24T00:33:01.080+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:32:00+00:00 exited with status queued for try_number 1 2024-02-24T00:33:01.081136572Z [2024-02-24T00:33:01.080+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:32:00+00:00 exited with status queued for try_number 1 2024-02-24T00:33:01.109866670Z [2024-02-24T00:33:01.109+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6426af48-ced8-4411-b732-a8088023b79d 2024-02-24T00:33:01.110045602Z [2024-02-24T00:33:01.109+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3904cacc-9ecd-4089-be4a-95fcbddfcc41 2024-02-24T00:33:01.110157958Z [2024-02-24T00:33:01.110+0000] {scheduler_job.py:635} INFO - Setting external_id for to 259ff07f-9198-450a-9a00-4b5151a03cf5 2024-02-24T00:33:03.095899199Z [2024-02-24T00:33:03.095+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:33:03.096401644Z [2024-02-24T00:33:03.096+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:32:00+00:00, run_id=scheduled__2024-02-24T00:32:00+00:00, run_start_date=2024-02-24 00:33:00.768846+00:00, run_end_date=2024-02-24 00:33:03.095792+00:00, run_duration=2.326946, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:32:00+00:00, data_interval_end=2024-02-24 00:33:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:33:03.107748153Z [2024-02-24T00:33:03.107+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:33:00+00:00, run_after=2024-02-24T00:34:00+00:00 2024-02-24T00:33:03.162139206Z [2024-02-24T00:33:03.161+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:32:00+00:00 exited with status success for try_number 1 2024-02-24T00:33:03.168400046Z [2024-02-24T00:33:03.167+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:32:00+00:00, map_index=-1, run_start_date=2024-02-24 00:33:01.830694+00:00, run_end_date=2024-02-24 00:33:02.206025+00:00, run_duration=0.375331, state=success, executor_state=success, try_number=1, max_tries=1, job_id=281, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:33:00.833014+00:00, queued_by_job_id=2, pid=4187 2024-02-24T00:33:05.351622506Z [2024-02-24T00:33:05.350+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:33:05.351982114Z [2024-02-24T00:33:05.351+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:32:00+00:00, run_id=scheduled__2024-02-24T00:32:00+00:00, run_start_date=2024-02-24 00:33:00.771663+00:00, run_end_date=2024-02-24 00:33:05.351444+00:00, run_duration=4.579781, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:32:00+00:00, data_interval_end=2024-02-24 00:33:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:33:05.376106216Z [2024-02-24T00:33:05.375+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:33:00+00:00, run_after=2024-02-24T00:34:00+00:00 2024-02-24T00:33:05.385996752Z [2024-02-24T00:33:05.385+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:33:05.386443171Z [2024-02-24T00:33:05.386+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:32:00+00:00, run_id=scheduled__2024-02-24T00:32:00+00:00, run_start_date=2024-02-24 00:33:00.770436+00:00, run_end_date=2024-02-24 00:33:05.385905+00:00, run_duration=4.615469, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:32:00+00:00, data_interval_end=2024-02-24 00:33:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:33:05.399131959Z [2024-02-24T00:33:05.398+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:33:00+00:00, run_after=2024-02-24T00:34:00+00:00 2024-02-24T00:33:05.450895192Z [2024-02-24T00:33:05.450+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:32:00+00:00 exited with status success for try_number 1 2024-02-24T00:33:05.451025156Z [2024-02-24T00:33:05.450+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:32:00+00:00 exited with status success for try_number 1 2024-02-24T00:33:05.457680630Z [2024-02-24T00:33:05.457+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:32:00+00:00, map_index=-1, run_start_date=2024-02-24 00:33:02.935981+00:00, run_end_date=2024-02-24 00:33:05.097859+00:00, run_duration=2.161878, state=success, executor_state=success, try_number=1, max_tries=1, job_id=282, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:33:00.833014+00:00, queued_by_job_id=2, pid=4202 2024-02-24T00:33:05.458112219Z [2024-02-24T00:33:05.457+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:32:00+00:00, map_index=-1, run_start_date=2024-02-24 00:33:03.161166+00:00, run_end_date=2024-02-24 00:33:04.737272+00:00, run_duration=1.576106, state=success, executor_state=success, try_number=1, max_tries=1, job_id=283, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:33:00.833014+00:00, queued_by_job_id=2, pid=4206 2024-02-24T00:34:00.167826152Z [2024-02-24T00:34:00.167+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:34:00+00:00, run_after=2024-02-24T00:35:00+00:00 2024-02-24T00:34:00.179574561Z [2024-02-24T00:34:00.179+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:34:00.190104524Z [2024-02-24T00:34:00.189+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:34:00.205754371Z [2024-02-24T00:34:00.205+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:34:00+00:00, run_after=2024-02-24T00:35:00+00:00 2024-02-24T00:34:00.298205585Z [2024-02-24T00:34:00.297+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T00:34:00.298258770Z 2024-02-24T00:34:00.298265846Z 2024-02-24T00:34:00.298271920Z 2024-02-24T00:34:00.298277328Z 2024-02-24T00:34:00.298283421Z [2024-02-24T00:34:00.297+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T00:34:00.298704526Z [2024-02-24T00:34:00.298+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:34:00.299046099Z [2024-02-24T00:34:00.298+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:34:00.299303587Z [2024-02-24T00:34:00.298+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:34:00.300087157Z [2024-02-24T00:34:00.299+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:34:00.300103017Z 2024-02-24T00:34:00.300134286Z 2024-02-24T00:34:00.300143277Z 2024-02-24T00:34:00.300151046Z 2024-02-24T00:34:00.304784208Z [2024-02-24T00:34:00.304+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:34:00.304975388Z [2024-02-24T00:34:00.304+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T00:34:00.305300344Z [2024-02-24T00:34:00.305+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:34:00.305543646Z [2024-02-24T00:34:00.305+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:34:00.305896965Z [2024-02-24T00:34:00.305+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:34:00.306168902Z [2024-02-24T00:34:00.305+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:34:00.306469771Z [2024-02-24T00:34:00.306+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:34:00.306691660Z [2024-02-24T00:34:00.306+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:34:00.702980459Z [2024-02-24T00:34:00.702+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:32:00+00:00 exited with status queued for try_number 1 2024-02-24T00:34:00.703044235Z [2024-02-24T00:34:00.702+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:33:00+00:00 exited with status queued for try_number 1 2024-02-24T00:34:00.703123476Z [2024-02-24T00:34:00.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:33:00+00:00 exited with status queued for try_number 1 2024-02-24T00:34:00.703199433Z [2024-02-24T00:34:00.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:33:00+00:00 exited with status queued for try_number 1 2024-02-24T00:34:00.712649218Z [2024-02-24T00:34:00.712+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff3f9560-f283-40a3-bd41-a80e354eb9dd 2024-02-24T00:34:00.712713950Z [2024-02-24T00:34:00.712+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7cd956b3-3dc0-4ea4-a51a-244725b2cd9b 2024-02-24T00:34:00.712968956Z [2024-02-24T00:34:00.712+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5586a83a-b96e-41a9-a776-80474d0be9e1 2024-02-24T00:34:00.713124322Z [2024-02-24T00:34:00.712+0000] {scheduler_job.py:635} INFO - Setting external_id for to 36cc824e-87d6-4ee5-9a51-08ec474cf9ac 2024-02-24T00:34:01.900584125Z [2024-02-24T00:34:01.900+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:34:01.901288012Z [2024-02-24T00:34:01.901+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 00:32:00+00:00, run_id=scheduled__2024-02-24T00:32:00+00:00, run_start_date=2024-02-24 00:34:00.218325+00:00, run_end_date=2024-02-24 00:34:01.900866+00:00, run_duration=1.682541, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:32:00+00:00, data_interval_end=2024-02-24 00:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T00:34:01.912644268Z [2024-02-24T00:34:01.912+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T00:34:00+00:00, run_after=2024-02-24T00:36:00+00:00 2024-02-24T00:34:01.959930428Z [2024-02-24T00:34:01.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:32:00+00:00 exited with status success for try_number 1 2024-02-24T00:34:01.968476336Z [2024-02-24T00:34:01.968+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T00:32:00+00:00, map_index=-1, run_start_date=2024-02-24 00:34:01.111897+00:00, run_end_date=2024-02-24 00:34:01.583244+00:00, run_duration=0.471347, state=success, executor_state=success, try_number=1, max_tries=1, job_id=284, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:34:00.301100+00:00, queued_by_job_id=2, pid=4238 2024-02-24T00:34:03.052698989Z [2024-02-24T00:34:03.051+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:34:03.053515930Z [2024-02-24T00:34:03.052+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:33:00+00:00, run_id=scheduled__2024-02-24T00:33:00+00:00, run_start_date=2024-02-24 00:34:00.221279+00:00, run_end_date=2024-02-24 00:34:03.052490+00:00, run_duration=2.831211, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:33:00+00:00, data_interval_end=2024-02-24 00:34:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:34:03.067258952Z [2024-02-24T00:34:03.066+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:34:00+00:00, run_after=2024-02-24T00:35:00+00:00 2024-02-24T00:34:03.120162184Z [2024-02-24T00:34:03.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:33:00+00:00 exited with status success for try_number 1 2024-02-24T00:34:03.126207374Z [2024-02-24T00:34:03.125+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:33:00+00:00, map_index=-1, run_start_date=2024-02-24 00:34:01.353648+00:00, run_end_date=2024-02-24 00:34:01.777301+00:00, run_duration=0.423653, state=success, executor_state=success, try_number=1, max_tries=1, job_id=285, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:34:00.301100+00:00, queued_by_job_id=2, pid=4239 2024-02-24T00:34:04.565380274Z [2024-02-24T00:34:04.564+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:34:04.566032803Z [2024-02-24T00:34:04.565+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:33:00+00:00, run_id=scheduled__2024-02-24T00:33:00+00:00, run_start_date=2024-02-24 00:34:00.223591+00:00, run_end_date=2024-02-24 00:34:04.565426+00:00, run_duration=4.341835, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:33:00+00:00, data_interval_end=2024-02-24 00:34:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:34:04.581361310Z [2024-02-24T00:34:04.580+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:34:00+00:00, run_after=2024-02-24T00:35:00+00:00 2024-02-24T00:34:04.592120815Z [2024-02-24T00:34:04.591+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:34:04.592669019Z [2024-02-24T00:34:04.592+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:33:00+00:00, run_id=scheduled__2024-02-24T00:33:00+00:00, run_start_date=2024-02-24 00:34:00.222458+00:00, run_end_date=2024-02-24 00:34:04.592163+00:00, run_duration=4.369705, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:33:00+00:00, data_interval_end=2024-02-24 00:34:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:34:04.611185819Z [2024-02-24T00:34:04.610+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:34:00+00:00, run_after=2024-02-24T00:35:00+00:00 2024-02-24T00:34:04.650127033Z [2024-02-24T00:34:04.649+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:33:00+00:00 exited with status success for try_number 1 2024-02-24T00:34:04.650283027Z [2024-02-24T00:34:04.650+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:33:00+00:00 exited with status success for try_number 1 2024-02-24T00:34:04.657203679Z [2024-02-24T00:34:04.656+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:33:00+00:00, map_index=-1, run_start_date=2024-02-24 00:34:02.266972+00:00, run_end_date=2024-02-24 00:34:04.132493+00:00, run_duration=1.865521, state=success, executor_state=success, try_number=1, max_tries=1, job_id=286, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:34:00.301100+00:00, queued_by_job_id=2, pid=4262 2024-02-24T00:34:04.657474693Z [2024-02-24T00:34:04.657+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:33:00+00:00, map_index=-1, run_start_date=2024-02-24 00:34:02.497419+00:00, run_end_date=2024-02-24 00:34:04.003424+00:00, run_duration=1.506005, state=success, executor_state=success, try_number=1, max_tries=1, job_id=287, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:34:00.301100+00:00, queued_by_job_id=2, pid=4263 2024-02-24T00:35:00.625734968Z [2024-02-24T00:35:00.625+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:35:00+00:00, run_after=2024-02-24T00:40:00+00:00 2024-02-24T00:35:00.646103666Z [2024-02-24T00:35:00.645+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:35:00+00:00, run_after=2024-02-24T00:36:00+00:00 2024-02-24T00:35:00.661386825Z [2024-02-24T00:35:00.660+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:35:00+00:00, run_after=2024-02-24T00:36:00+00:00 2024-02-24T00:35:00.670762619Z [2024-02-24T00:35:00.670+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:35:00.795732708Z [2024-02-24T00:35:00.795+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T00:35:00.795759379Z 2024-02-24T00:35:00.795766325Z 2024-02-24T00:35:00.795769848Z 2024-02-24T00:35:00.795772976Z 2024-02-24T00:35:00.795783017Z [2024-02-24T00:35:00.795+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:35:00.796091512Z [2024-02-24T00:35:00.795+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:35:00.796254350Z [2024-02-24T00:35:00.796+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:35:00.796399401Z [2024-02-24T00:35:00.796+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:35:00.797028473Z [2024-02-24T00:35:00.796+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:35:00.797041369Z 2024-02-24T00:35:00.797045716Z 2024-02-24T00:35:00.797049290Z 2024-02-24T00:35:00.797053128Z 2024-02-24T00:35:00.801061722Z [2024-02-24T00:35:00.800+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T00:35:00.801272550Z [2024-02-24T00:35:00.800+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:35:00.801575084Z [2024-02-24T00:35:00.801+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:35:00.801694158Z [2024-02-24T00:35:00.801+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:35:00.801983201Z [2024-02-24T00:35:00.801+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:35:00.802154777Z [2024-02-24T00:35:00.801+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:35:00.802412263Z [2024-02-24T00:35:00.802+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:35:00.802537104Z [2024-02-24T00:35:00.802+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:35:01.329053551Z [2024-02-24T00:35:01.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T00:30:00+00:00 exited with status queued for try_number 1 2024-02-24T00:35:01.329215666Z [2024-02-24T00:35:01.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:34:00+00:00 exited with status queued for try_number 1 2024-02-24T00:35:01.329332114Z [2024-02-24T00:35:01.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:34:00+00:00 exited with status queued for try_number 1 2024-02-24T00:35:01.329524728Z [2024-02-24T00:35:01.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:34:00+00:00 exited with status queued for try_number 1 2024-02-24T00:35:01.338990645Z [2024-02-24T00:35:01.338+0000] {scheduler_job.py:635} INFO - Setting external_id for to 83fcfb18-436c-4741-93cf-3bbed281945e 2024-02-24T00:35:01.339215229Z [2024-02-24T00:35:01.339+0000] {scheduler_job.py:635} INFO - Setting external_id for to 966ea85a-b889-4c85-b8b4-0e8e0fc506d2 2024-02-24T00:35:01.339429149Z [2024-02-24T00:35:01.339+0000] {scheduler_job.py:635} INFO - Setting external_id for to f23b78f7-9909-41d8-bbb7-1251abdb8c02 2024-02-24T00:35:01.339610952Z [2024-02-24T00:35:01.339+0000] {scheduler_job.py:635} INFO - Setting external_id for to aebef7ca-9e4d-451f-bcce-3db8d2479917 2024-02-24T00:35:02.567469031Z [2024-02-24T00:35:02.567+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:35:02.568137836Z [2024-02-24T00:35:02.567+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:34:00+00:00, run_id=scheduled__2024-02-24T00:34:00+00:00, run_start_date=2024-02-24 00:35:00.685516+00:00, run_end_date=2024-02-24 00:35:02.567740+00:00, run_duration=1.882224, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:34:00+00:00, data_interval_end=2024-02-24 00:35:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:35:02.580752246Z [2024-02-24T00:35:02.580+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:35:00+00:00, run_after=2024-02-24T00:36:00+00:00 2024-02-24T00:35:02.699173291Z [2024-02-24T00:35:02.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:34:00+00:00 exited with status success for try_number 1 2024-02-24T00:35:02.718242652Z [2024-02-24T00:35:02.714+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:34:00+00:00, map_index=-1, run_start_date=2024-02-24 00:35:01.802529+00:00, run_end_date=2024-02-24 00:35:02.347793+00:00, run_duration=0.545264, state=success, executor_state=success, try_number=1, max_tries=1, job_id=288, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:35:00.798207+00:00, queued_by_job_id=2, pid=4296 2024-02-24T00:35:05.066455612Z [2024-02-24T00:35:05.065+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T00:35:05.066483991Z 2024-02-24T00:35:05.066629818Z [2024-02-24T00:35:05.066+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:35:05.067369606Z [2024-02-24T00:35:05.067+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:35:05.067384295Z 2024-02-24T00:35:05.073014099Z [2024-02-24T00:35:05.072+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T00:35:05.073366561Z [2024-02-24T00:35:05.072+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:35:05.152927389Z [2024-02-24T00:35:05.152+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T00:30:00+00:00 exited with status queued for try_number 1 2024-02-24T00:35:05.153216183Z [2024-02-24T00:35:05.152+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T00:30:00+00:00 exited with status success for try_number 1 2024-02-24T00:35:05.162518719Z [2024-02-24T00:35:05.162+0000] {scheduler_job.py:635} INFO - Setting external_id for to 399e0c34-ab8a-4649-924a-3bf1ff355f45 2024-02-24T00:35:05.163128615Z [2024-02-24T00:35:05.162+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T00:30:00+00:00, map_index=-1, run_start_date=2024-02-24 00:35:03.636227+00:00, run_end_date=2024-02-24 00:35:04.115263+00:00, run_duration=0.479036, state=success, executor_state=success, try_number=1, max_tries=1, job_id=290, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:35:00.798207+00:00, queued_by_job_id=2, pid=4316 2024-02-24T00:35:05.234385551Z [2024-02-24T00:35:05.233+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:35:05.234797749Z [2024-02-24T00:35:05.234+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:34:00+00:00, run_id=scheduled__2024-02-24T00:34:00+00:00, run_start_date=2024-02-24 00:35:00.686949+00:00, run_end_date=2024-02-24 00:35:05.234486+00:00, run_duration=4.547537, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:34:00+00:00, data_interval_end=2024-02-24 00:35:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:35:05.245353953Z [2024-02-24T00:35:05.245+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:35:00+00:00, run_after=2024-02-24T00:36:00+00:00 2024-02-24T00:35:05.314992707Z [2024-02-24T00:35:05.314+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:34:00+00:00 exited with status success for try_number 1 2024-02-24T00:35:05.324649253Z [2024-02-24T00:35:05.324+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:34:00+00:00, map_index=-1, run_start_date=2024-02-24 00:35:03.461820+00:00, run_end_date=2024-02-24 00:35:05.092037+00:00, run_duration=1.630217, state=success, executor_state=success, try_number=1, max_tries=1, job_id=289, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:35:00.798207+00:00, queued_by_job_id=2, pid=4315 2024-02-24T00:35:06.381280483Z [2024-02-24T00:35:06.380+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:35:06.382031494Z [2024-02-24T00:35:06.381+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:34:00+00:00, run_id=scheduled__2024-02-24T00:34:00+00:00, run_start_date=2024-02-24 00:35:00.688076+00:00, run_end_date=2024-02-24 00:35:06.381519+00:00, run_duration=5.693443, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:34:00+00:00, data_interval_end=2024-02-24 00:35:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:35:06.398630078Z [2024-02-24T00:35:06.398+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:35:00+00:00, run_after=2024-02-24T00:36:00+00:00 2024-02-24T00:35:06.471095538Z [2024-02-24T00:35:06.470+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:34:00+00:00 exited with status success for try_number 1 2024-02-24T00:35:06.478637715Z [2024-02-24T00:35:06.478+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:34:00+00:00, map_index=-1, run_start_date=2024-02-24 00:35:04.159179+00:00, run_end_date=2024-02-24 00:35:05.736738+00:00, run_duration=1.577559, state=success, executor_state=success, try_number=1, max_tries=1, job_id=291, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:35:00.798207+00:00, queued_by_job_id=2, pid=4332 2024-02-24T00:35:07.560956678Z [2024-02-24T00:35:07.560+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T00:35:07.561017841Z 2024-02-24T00:35:07.561073529Z [2024-02-24T00:35:07.560+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:35:07.561764276Z [2024-02-24T00:35:07.561+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:35:07.561847758Z 2024-02-24T00:35:07.564132703Z [2024-02-24T00:35:07.563+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T00:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T00:35:07.564727571Z [2024-02-24T00:35:07.564+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T00:35:07.609109229Z [2024-02-24T00:35:07.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T00:30:00+00:00 exited with status queued for try_number 1 2024-02-24T00:35:07.609635446Z [2024-02-24T00:35:07.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T00:30:00+00:00 exited with status success for try_number 1 2024-02-24T00:35:07.616907752Z [2024-02-24T00:35:07.616+0000] {scheduler_job.py:635} INFO - Setting external_id for to 03011895-89ba-4674-b1af-4287424d0f9e 2024-02-24T00:35:07.617314205Z [2024-02-24T00:35:07.617+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T00:30:00+00:00, map_index=-1, run_start_date=2024-02-24 00:35:06.760865+00:00, run_end_date=2024-02-24 00:35:07.141196+00:00, run_duration=0.380331, state=success, executor_state=success, try_number=1, max_tries=1, job_id=292, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:35:05.067844+00:00, queued_by_job_id=2, pid=4345 2024-02-24T00:35:10.721351936Z [2024-02-24T00:35:10.720+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T00:35:10.721390234Z 2024-02-24T00:35:10.721538159Z [2024-02-24T00:35:10.721+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:35:10.723106616Z [2024-02-24T00:35:10.722+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:35:10.723136581Z 2024-02-24T00:35:10.727755322Z [2024-02-24T00:35:10.727+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:35:10.727898721Z [2024-02-24T00:35:10.727+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:35:10.781578995Z [2024-02-24T00:35:10.781+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T00:30:00+00:00 exited with status queued for try_number 1 2024-02-24T00:35:10.781901402Z [2024-02-24T00:35:10.781+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T00:30:00+00:00 exited with status success for try_number 1 2024-02-24T00:35:10.789643030Z [2024-02-24T00:35:10.789+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5dc5f884-9789-4396-b63d-88d53b71e1de 2024-02-24T00:35:10.789977081Z [2024-02-24T00:35:10.789+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T00:30:00+00:00, map_index=0, run_start_date=2024-02-24 00:35:09.152257+00:00, run_end_date=2024-02-24 00:35:09.532279+00:00, run_duration=0.380022, state=success, executor_state=success, try_number=1, max_tries=1, job_id=293, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:35:07.562199+00:00, queued_by_job_id=2, pid=4353 2024-02-24T00:35:13.068339895Z [2024-02-24T00:35:13.067+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:35:13.068775156Z [2024-02-24T00:35:13.068+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:30:00+00:00, run_id=scheduled__2024-02-24T00:30:00+00:00, run_start_date=2024-02-24 00:35:00.684098+00:00, run_end_date=2024-02-24 00:35:13.068229+00:00, run_duration=12.384131, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:30:00+00:00, data_interval_end=2024-02-24 00:35:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T00:35:13.076664701Z [2024-02-24T00:35:13.076+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:35:00+00:00, run_after=2024-02-24T00:40:00+00:00 2024-02-24T00:35:13.113836316Z [2024-02-24T00:35:13.113+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T00:30:00+00:00 exited with status success for try_number 1 2024-02-24T00:35:13.122445678Z [2024-02-24T00:35:13.119+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T00:30:00+00:00, map_index=-1, run_start_date=2024-02-24 00:35:12.351283+00:00, run_end_date=2024-02-24 00:35:12.789387+00:00, run_duration=0.438104, state=success, executor_state=success, try_number=1, max_tries=1, job_id=294, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:35:10.723861+00:00, queued_by_job_id=2, pid=4361 2024-02-24T00:36:01.061865776Z [2024-02-24T00:36:01.061+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:36:00+00:00, run_after=2024-02-24T00:37:00+00:00 2024-02-24T00:36:01.082807026Z [2024-02-24T00:36:01.082+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:36:00+00:00, run_after=2024-02-24T00:37:00+00:00 2024-02-24T00:36:01.097233199Z [2024-02-24T00:36:01.096+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:36:01.106862802Z [2024-02-24T00:36:01.106+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:36:01.223291842Z [2024-02-24T00:36:01.221+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T00:36:01.223322173Z 2024-02-24T00:36:01.223336668Z 2024-02-24T00:36:01.223342624Z 2024-02-24T00:36:01.223348399Z 2024-02-24T00:36:01.223354821Z [2024-02-24T00:36:01.222+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T00:36:01.223360590Z [2024-02-24T00:36:01.222+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:36:01.223366341Z [2024-02-24T00:36:01.222+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:36:01.223372178Z [2024-02-24T00:36:01.222+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:36:01.224842178Z [2024-02-24T00:36:01.223+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:36:01.224855390Z 2024-02-24T00:36:01.224860247Z 2024-02-24T00:36:01.224864041Z 2024-02-24T00:36:01.224868006Z 2024-02-24T00:36:01.233184160Z [2024-02-24T00:36:01.230+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:36:01.233217986Z [2024-02-24T00:36:01.230+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T00:36:01.233223341Z [2024-02-24T00:36:01.231+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:36:01.233255065Z [2024-02-24T00:36:01.231+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:36:01.233262102Z [2024-02-24T00:36:01.231+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:36:01.233265916Z [2024-02-24T00:36:01.232+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:36:01.233269731Z [2024-02-24T00:36:01.232+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:36:01.233273561Z [2024-02-24T00:36:01.232+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:36:01.654623403Z [2024-02-24T00:36:01.653+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:34:00+00:00 exited with status queued for try_number 1 2024-02-24T00:36:01.654697020Z [2024-02-24T00:36:01.654+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:35:00+00:00 exited with status queued for try_number 1 2024-02-24T00:36:01.654792330Z [2024-02-24T00:36:01.654+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:35:00+00:00 exited with status queued for try_number 1 2024-02-24T00:36:01.654837348Z [2024-02-24T00:36:01.654+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:35:00+00:00 exited with status queued for try_number 1 2024-02-24T00:36:01.666066222Z [2024-02-24T00:36:01.665+0000] {scheduler_job.py:635} INFO - Setting external_id for to 41f77b84-997f-49ad-b0af-8b56670153bf 2024-02-24T00:36:01.666416990Z [2024-02-24T00:36:01.666+0000] {scheduler_job.py:635} INFO - Setting external_id for to 100fe654-059b-423b-8abb-42b5e74073a0 2024-02-24T00:36:01.666712042Z [2024-02-24T00:36:01.666+0000] {scheduler_job.py:635} INFO - Setting external_id for to 261c759e-ee54-46c9-b829-f8e5ff691f0b 2024-02-24T00:36:01.667013339Z [2024-02-24T00:36:01.666+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f77624a-f18e-4a15-96bb-1eab405b0f3d 2024-02-24T00:36:02.841547158Z [2024-02-24T00:36:02.841+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:36:02.842636498Z [2024-02-24T00:36:02.842+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 00:34:00+00:00, run_id=scheduled__2024-02-24T00:34:00+00:00, run_start_date=2024-02-24 00:36:01.124235+00:00, run_end_date=2024-02-24 00:36:02.841472+00:00, run_duration=1.717237, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:34:00+00:00, data_interval_end=2024-02-24 00:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T00:36:02.854372076Z [2024-02-24T00:36:02.854+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T00:36:00+00:00, run_after=2024-02-24T00:38:00+00:00 2024-02-24T00:36:02.878740670Z [2024-02-24T00:36:02.878+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:36:02.878888564Z [2024-02-24T00:36:02.878+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:35:00+00:00, run_id=scheduled__2024-02-24T00:35:00+00:00, run_start_date=2024-02-24 00:36:01.126035+00:00, run_end_date=2024-02-24 00:36:02.878648+00:00, run_duration=1.752613, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:35:00+00:00, data_interval_end=2024-02-24 00:36:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:36:02.890447460Z [2024-02-24T00:36:02.890+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:36:00+00:00, run_after=2024-02-24T00:37:00+00:00 2024-02-24T00:36:02.930008500Z [2024-02-24T00:36:02.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:34:00+00:00 exited with status success for try_number 1 2024-02-24T00:36:02.930040094Z [2024-02-24T00:36:02.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:35:00+00:00 exited with status success for try_number 1 2024-02-24T00:36:02.938079311Z [2024-02-24T00:36:02.937+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:35:00+00:00, map_index=-1, run_start_date=2024-02-24 00:36:02.142914+00:00, run_end_date=2024-02-24 00:36:02.633377+00:00, run_duration=0.490463, state=success, executor_state=success, try_number=1, max_tries=1, job_id=295, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:36:01.225602+00:00, queued_by_job_id=2, pid=4384 2024-02-24T00:36:02.938240231Z [2024-02-24T00:36:02.938+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T00:34:00+00:00, map_index=-1, run_start_date=2024-02-24 00:36:02.233371+00:00, run_end_date=2024-02-24 00:36:02.641222+00:00, run_duration=0.407851, state=success, executor_state=success, try_number=1, max_tries=1, job_id=296, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:36:01.225602+00:00, queued_by_job_id=2, pid=4385 2024-02-24T00:36:06.407443057Z [2024-02-24T00:36:06.406+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:36:06.407992211Z [2024-02-24T00:36:06.407+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:35:00+00:00, run_id=scheduled__2024-02-24T00:35:00+00:00, run_start_date=2024-02-24 00:36:01.127560+00:00, run_end_date=2024-02-24 00:36:06.407452+00:00, run_duration=5.279892, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:35:00+00:00, data_interval_end=2024-02-24 00:36:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:36:06.429140065Z [2024-02-24T00:36:06.428+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:36:00+00:00, run_after=2024-02-24T00:37:00+00:00 2024-02-24T00:36:06.489981986Z [2024-02-24T00:36:06.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:35:00+00:00 exited with status success for try_number 1 2024-02-24T00:36:06.495786985Z [2024-02-24T00:36:06.495+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:35:00+00:00, map_index=-1, run_start_date=2024-02-24 00:36:03.422731+00:00, run_end_date=2024-02-24 00:36:05.728469+00:00, run_duration=2.305738, state=success, executor_state=success, try_number=1, max_tries=1, job_id=297, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:36:01.225602+00:00, queued_by_job_id=2, pid=4408 2024-02-24T00:36:07.539847827Z [2024-02-24T00:36:07.539+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:36:07.540295356Z [2024-02-24T00:36:07.540+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:35:00+00:00, run_id=scheduled__2024-02-24T00:35:00+00:00, run_start_date=2024-02-24 00:36:01.128995+00:00, run_end_date=2024-02-24 00:36:07.539649+00:00, run_duration=6.410654, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:35:00+00:00, data_interval_end=2024-02-24 00:36:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:36:07.552510437Z [2024-02-24T00:36:07.552+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:36:00+00:00, run_after=2024-02-24T00:37:00+00:00 2024-02-24T00:36:07.594555843Z [2024-02-24T00:36:07.594+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:35:00+00:00 exited with status success for try_number 1 2024-02-24T00:36:07.599503230Z [2024-02-24T00:36:07.599+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:35:00+00:00, map_index=-1, run_start_date=2024-02-24 00:36:03.444326+00:00, run_end_date=2024-02-24 00:36:06.428273+00:00, run_duration=2.983947, state=success, executor_state=success, try_number=1, max_tries=1, job_id=298, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:36:01.225602+00:00, queued_by_job_id=2, pid=4409 2024-02-24T00:36:59.988282217Z [2024-02-24T00:36:59.987+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T00:37:00.390135589Z [2024-02-24T00:37:00.389+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:37:00+00:00, run_after=2024-02-24T00:38:00+00:00 2024-02-24T00:37:00.401267233Z [2024-02-24T00:37:00.400+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:37:00+00:00, run_after=2024-02-24T00:38:00+00:00 2024-02-24T00:37:00.418526714Z [2024-02-24T00:37:00.418+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:37:00.479470109Z [2024-02-24T00:37:00.479+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T00:37:00.479492221Z 2024-02-24T00:37:00.479495884Z 2024-02-24T00:37:00.479499074Z 2024-02-24T00:37:00.479939682Z [2024-02-24T00:37:00.479+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:37:00.480144735Z [2024-02-24T00:37:00.480+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:37:00.480327147Z [2024-02-24T00:37:00.480+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:37:00.480908433Z [2024-02-24T00:37:00.480+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:37:00.480919087Z 2024-02-24T00:37:00.480922446Z 2024-02-24T00:37:00.480925684Z 2024-02-24T00:37:00.483763739Z [2024-02-24T00:37:00.483+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:37:00.484018267Z [2024-02-24T00:37:00.483+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:37:00.484345059Z [2024-02-24T00:37:00.484+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:37:00.484543303Z [2024-02-24T00:37:00.484+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:37:00.484830932Z [2024-02-24T00:37:00.484+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:37:00.485129129Z [2024-02-24T00:37:00.484+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:37:00.757409049Z [2024-02-24T00:37:00.756+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:36:00+00:00 exited with status queued for try_number 1 2024-02-24T00:37:00.757764062Z [2024-02-24T00:37:00.757+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:36:00+00:00 exited with status queued for try_number 1 2024-02-24T00:37:00.758016590Z [2024-02-24T00:37:00.757+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:36:00+00:00 exited with status queued for try_number 1 2024-02-24T00:37:00.769496580Z [2024-02-24T00:37:00.769+0000] {scheduler_job.py:635} INFO - Setting external_id for to 79056a6b-f8f6-4cf3-927a-6ec80713b667 2024-02-24T00:37:00.769851236Z [2024-02-24T00:37:00.769+0000] {scheduler_job.py:635} INFO - Setting external_id for to c04ad19a-baba-47a6-9a1d-6834fb15a3d9 2024-02-24T00:37:00.770148858Z [2024-02-24T00:37:00.769+0000] {scheduler_job.py:635} INFO - Setting external_id for to 14264fc5-caf4-4c23-b349-1dee783df54e 2024-02-24T00:37:01.967993245Z [2024-02-24T00:37:01.967+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:37:01.968018964Z [2024-02-24T00:37:01.967+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:36:00+00:00, run_id=scheduled__2024-02-24T00:36:00+00:00, run_start_date=2024-02-24 00:37:00.432033+00:00, run_end_date=2024-02-24 00:37:01.967484+00:00, run_duration=1.535451, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:36:00+00:00, data_interval_end=2024-02-24 00:37:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:37:01.979304923Z [2024-02-24T00:37:01.978+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:37:00+00:00, run_after=2024-02-24T00:38:00+00:00 2024-02-24T00:37:02.036851713Z [2024-02-24T00:37:02.036+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:36:00+00:00 exited with status success for try_number 1 2024-02-24T00:37:02.044949264Z [2024-02-24T00:37:02.044+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:36:00+00:00, map_index=-1, run_start_date=2024-02-24 00:37:01.249953+00:00, run_end_date=2024-02-24 00:37:01.671050+00:00, run_duration=0.421097, state=success, executor_state=success, try_number=1, max_tries=1, job_id=299, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:37:00.481623+00:00, queued_by_job_id=2, pid=4441 2024-02-24T00:37:04.193616647Z [2024-02-24T00:37:04.193+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:37:04.194197061Z [2024-02-24T00:37:04.193+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:36:00+00:00, run_id=scheduled__2024-02-24T00:36:00+00:00, run_start_date=2024-02-24 00:37:00.433292+00:00, run_end_date=2024-02-24 00:37:04.193464+00:00, run_duration=3.760172, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:36:00+00:00, data_interval_end=2024-02-24 00:37:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:37:04.204273044Z [2024-02-24T00:37:04.203+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:37:00+00:00, run_after=2024-02-24T00:38:00+00:00 2024-02-24T00:37:04.258381660Z [2024-02-24T00:37:04.257+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:36:00+00:00 exited with status success for try_number 1 2024-02-24T00:37:04.263523715Z [2024-02-24T00:37:04.263+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:36:00+00:00, map_index=-1, run_start_date=2024-02-24 00:37:02.265093+00:00, run_end_date=2024-02-24 00:37:03.962790+00:00, run_duration=1.697697, state=success, executor_state=success, try_number=1, max_tries=1, job_id=300, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:37:00.481623+00:00, queued_by_job_id=2, pid=4459 2024-02-24T00:37:04.841593068Z [2024-02-24T00:37:04.840+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:37:04.842486436Z [2024-02-24T00:37:04.842+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:36:00+00:00, run_id=scheduled__2024-02-24T00:36:00+00:00, run_start_date=2024-02-24 00:37:00.438186+00:00, run_end_date=2024-02-24 00:37:04.841895+00:00, run_duration=4.403709, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:36:00+00:00, data_interval_end=2024-02-24 00:37:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:37:04.857315963Z [2024-02-24T00:37:04.856+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:37:00+00:00, run_after=2024-02-24T00:38:00+00:00 2024-02-24T00:37:05.999523743Z [2024-02-24T00:37:05.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:36:00+00:00 exited with status success for try_number 1 2024-02-24T00:37:06.007080298Z [2024-02-24T00:37:06.006+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:36:00+00:00, map_index=-1, run_start_date=2024-02-24 00:37:02.417741+00:00, run_end_date=2024-02-24 00:37:04.748066+00:00, run_duration=2.330325, state=success, executor_state=success, try_number=1, max_tries=1, job_id=301, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:37:00.481623+00:00, queued_by_job_id=2, pid=4460 2024-02-24T00:38:00.791497362Z [2024-02-24T00:38:00.790+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:38:00+00:00, run_after=2024-02-24T00:39:00+00:00 2024-02-24T00:38:00.813621902Z [2024-02-24T00:38:00.812+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:38:00+00:00, run_after=2024-02-24T00:39:00+00:00 2024-02-24T00:38:00.831907429Z [2024-02-24T00:38:00.830+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:38:00.850427731Z [2024-02-24T00:38:00.849+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:38:00.962452542Z [2024-02-24T00:38:00.962+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T00:38:00.962491559Z 2024-02-24T00:38:00.962501456Z 2024-02-24T00:38:00.962508935Z 2024-02-24T00:38:00.962516263Z 2024-02-24T00:38:00.962711533Z [2024-02-24T00:38:00.962+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T00:38:00.962838995Z [2024-02-24T00:38:00.962+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:38:00.963105289Z [2024-02-24T00:38:00.962+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:38:00.963319322Z [2024-02-24T00:38:00.963+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:38:00.964293602Z [2024-02-24T00:38:00.963+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:38:00.964317959Z 2024-02-24T00:38:00.964356457Z 2024-02-24T00:38:00.964365596Z 2024-02-24T00:38:00.964374992Z 2024-02-24T00:38:00.969874718Z [2024-02-24T00:38:00.969+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:38:00.970046552Z [2024-02-24T00:38:00.969+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T00:38:00.970378089Z [2024-02-24T00:38:00.970+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:38:00.970585133Z [2024-02-24T00:38:00.970+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:38:00.970962763Z [2024-02-24T00:38:00.970+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:38:00.971189030Z [2024-02-24T00:38:00.970+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:38:00.971524715Z [2024-02-24T00:38:00.971+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:38:00.971733092Z [2024-02-24T00:38:00.971+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:38:01.439020837Z [2024-02-24T00:38:01.438+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:36:00+00:00 exited with status queued for try_number 1 2024-02-24T00:38:01.439166328Z [2024-02-24T00:38:01.438+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:37:00+00:00 exited with status queued for try_number 1 2024-02-24T00:38:01.439318412Z [2024-02-24T00:38:01.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:37:00+00:00 exited with status queued for try_number 1 2024-02-24T00:38:01.439456585Z [2024-02-24T00:38:01.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:37:00+00:00 exited with status queued for try_number 1 2024-02-24T00:38:01.455433826Z [2024-02-24T00:38:01.454+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b2fcc23-f96a-43fa-a369-ae3a83c06664 2024-02-24T00:38:01.455519712Z [2024-02-24T00:38:01.455+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40702f8d-713e-4d36-b4ab-2b20880aa1a8 2024-02-24T00:38:01.455656078Z [2024-02-24T00:38:01.455+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ef2883e-a791-4ec9-be21-a49cbd6d9430 2024-02-24T00:38:01.455792206Z [2024-02-24T00:38:01.455+0000] {scheduler_job.py:635} INFO - Setting external_id for to ae2a734b-f967-4ae9-9c82-a8cd63d4eb10 2024-02-24T00:38:02.811428654Z [2024-02-24T00:38:02.811+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:38:02.811655075Z [2024-02-24T00:38:02.811+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 00:36:00+00:00, run_id=scheduled__2024-02-24T00:36:00+00:00, run_start_date=2024-02-24 00:38:00.871202+00:00, run_end_date=2024-02-24 00:38:02.811336+00:00, run_duration=1.940134, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:36:00+00:00, data_interval_end=2024-02-24 00:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T00:38:02.820634582Z [2024-02-24T00:38:02.820+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T00:38:00+00:00, run_after=2024-02-24T00:40:00+00:00 2024-02-24T00:38:02.836793940Z [2024-02-24T00:38:02.836+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:38:02.836942650Z [2024-02-24T00:38:02.836+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:37:00+00:00, run_id=scheduled__2024-02-24T00:37:00+00:00, run_start_date=2024-02-24 00:38:00.873063+00:00, run_end_date=2024-02-24 00:38:02.836683+00:00, run_duration=1.96362, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:37:00+00:00, data_interval_end=2024-02-24 00:38:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:38:02.859508586Z [2024-02-24T00:38:02.859+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:38:00+00:00, run_after=2024-02-24T00:39:00+00:00 2024-02-24T00:38:02.982760150Z [2024-02-24T00:38:02.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:36:00+00:00 exited with status success for try_number 1 2024-02-24T00:38:02.982901684Z [2024-02-24T00:38:02.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:37:00+00:00 exited with status success for try_number 1 2024-02-24T00:38:02.997983058Z [2024-02-24T00:38:02.997+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:37:00+00:00, map_index=-1, run_start_date=2024-02-24 00:38:01.961495+00:00, run_end_date=2024-02-24 00:38:02.379160+00:00, run_duration=0.417665, state=success, executor_state=success, try_number=1, max_tries=1, job_id=303, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:38:00.965682+00:00, queued_by_job_id=2, pid=4493 2024-02-24T00:38:02.998146760Z [2024-02-24T00:38:02.997+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T00:36:00+00:00, map_index=-1, run_start_date=2024-02-24 00:38:01.958439+00:00, run_end_date=2024-02-24 00:38:02.398831+00:00, run_duration=0.440392, state=success, executor_state=success, try_number=1, max_tries=1, job_id=302, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:38:00.965682+00:00, queued_by_job_id=2, pid=4494 2024-02-24T00:38:05.904496922Z [2024-02-24T00:38:05.903+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:38:05.904574148Z [2024-02-24T00:38:05.904+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:37:00+00:00, run_id=scheduled__2024-02-24T00:37:00+00:00, run_start_date=2024-02-24 00:38:00.874538+00:00, run_end_date=2024-02-24 00:38:05.904243+00:00, run_duration=5.029705, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:37:00+00:00, data_interval_end=2024-02-24 00:38:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:38:05.913242165Z [2024-02-24T00:38:05.912+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:38:00+00:00, run_after=2024-02-24T00:39:00+00:00 2024-02-24T00:38:05.921140174Z [2024-02-24T00:38:05.920+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:38:05.921271572Z [2024-02-24T00:38:05.921+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:37:00+00:00, run_id=scheduled__2024-02-24T00:37:00+00:00, run_start_date=2024-02-24 00:38:00.875952+00:00, run_end_date=2024-02-24 00:38:05.921001+00:00, run_duration=5.045049, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:37:00+00:00, data_interval_end=2024-02-24 00:38:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:38:05.931267256Z [2024-02-24T00:38:05.930+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:38:00+00:00, run_after=2024-02-24T00:39:00+00:00 2024-02-24T00:38:05.965897948Z [2024-02-24T00:38:05.965+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:37:00+00:00 exited with status success for try_number 1 2024-02-24T00:38:05.965990931Z [2024-02-24T00:38:05.965+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:37:00+00:00 exited with status success for try_number 1 2024-02-24T00:38:05.973573183Z [2024-02-24T00:38:05.972+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:37:00+00:00, map_index=-1, run_start_date=2024-02-24 00:38:03.261631+00:00, run_end_date=2024-02-24 00:38:04.923977+00:00, run_duration=1.662346, state=success, executor_state=success, try_number=1, max_tries=1, job_id=304, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:38:00.965682+00:00, queued_by_job_id=2, pid=4517 2024-02-24T00:38:05.973761436Z [2024-02-24T00:38:05.973+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:37:00+00:00, map_index=-1, run_start_date=2024-02-24 00:38:03.386275+00:00, run_end_date=2024-02-24 00:38:05.728295+00:00, run_duration=2.34202, state=success, executor_state=success, try_number=1, max_tries=1, job_id=305, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:38:00.965682+00:00, queued_by_job_id=2, pid=4518 2024-02-24T00:39:00.425730531Z [2024-02-24T00:39:00.425+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:39:00.438526653Z [2024-02-24T00:39:00.438+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:39:00+00:00, run_after=2024-02-24T00:40:00+00:00 2024-02-24T00:39:00.452205982Z [2024-02-24T00:39:00.451+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:39:00+00:00, run_after=2024-02-24T00:40:00+00:00 2024-02-24T00:39:00.554612098Z [2024-02-24T00:39:00.554+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T00:39:00.554719261Z 2024-02-24T00:39:00.554730264Z 2024-02-24T00:39:00.554738838Z 2024-02-24T00:39:00.554778413Z [2024-02-24T00:39:00.554+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:39:00.554884365Z [2024-02-24T00:39:00.554+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:39:00.555026927Z [2024-02-24T00:39:00.554+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:39:00.555941796Z [2024-02-24T00:39:00.555+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:39:00.555958699Z 2024-02-24T00:39:00.555988419Z 2024-02-24T00:39:00.555994391Z 2024-02-24T00:39:00.562256845Z [2024-02-24T00:39:00.561+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:39:00.562371251Z [2024-02-24T00:39:00.562+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:39:00.562794532Z [2024-02-24T00:39:00.562+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:39:00.562936793Z [2024-02-24T00:39:00.562+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:39:00.563256746Z [2024-02-24T00:39:00.563+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:39:00.563411129Z [2024-02-24T00:39:00.563+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:39:00.801734853Z [2024-02-24T00:39:00.800+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:38:00+00:00 exited with status queued for try_number 1 2024-02-24T00:39:00.804799670Z [2024-02-24T00:39:00.804+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:38:00+00:00 exited with status queued for try_number 1 2024-02-24T00:39:00.805223675Z [2024-02-24T00:39:00.804+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:38:00+00:00 exited with status queued for try_number 1 2024-02-24T00:39:00.820529557Z [2024-02-24T00:39:00.819+0000] {scheduler_job.py:635} INFO - Setting external_id for to 85e2fc53-28b5-4dab-83b7-2700566c9820 2024-02-24T00:39:00.821052762Z [2024-02-24T00:39:00.820+0000] {scheduler_job.py:635} INFO - Setting external_id for to bcb68817-9582-4d8e-8e96-47833bfd10c0 2024-02-24T00:39:00.821565052Z [2024-02-24T00:39:00.821+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc5e16eb-bb8a-45d3-85e6-855cafc08a8a 2024-02-24T00:39:02.306612388Z [2024-02-24T00:39:02.306+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:39:02.307276945Z [2024-02-24T00:39:02.306+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:38:00+00:00, run_id=scheduled__2024-02-24T00:38:00+00:00, run_start_date=2024-02-24 00:39:00.474391+00:00, run_end_date=2024-02-24 00:39:02.306468+00:00, run_duration=1.832077, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:38:00+00:00, data_interval_end=2024-02-24 00:39:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:39:02.323074211Z [2024-02-24T00:39:02.322+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:39:00+00:00, run_after=2024-02-24T00:40:00+00:00 2024-02-24T00:39:02.421910215Z [2024-02-24T00:39:02.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:38:00+00:00 exited with status success for try_number 1 2024-02-24T00:39:02.426310883Z [2024-02-24T00:39:02.425+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:38:00+00:00, map_index=-1, run_start_date=2024-02-24 00:39:01.546123+00:00, run_end_date=2024-02-24 00:39:02.038981+00:00, run_duration=0.492858, state=success, executor_state=success, try_number=1, max_tries=1, job_id=306, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:39:00.557153+00:00, queued_by_job_id=2, pid=4550 2024-02-24T00:39:04.610024547Z [2024-02-24T00:39:04.609+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:39:04.610634029Z [2024-02-24T00:39:04.610+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:38:00+00:00, run_id=scheduled__2024-02-24T00:38:00+00:00, run_start_date=2024-02-24 00:39:00.475846+00:00, run_end_date=2024-02-24 00:39:04.610229+00:00, run_duration=4.134383, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:38:00+00:00, data_interval_end=2024-02-24 00:39:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:39:04.621280593Z [2024-02-24T00:39:04.620+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:39:00+00:00, run_after=2024-02-24T00:40:00+00:00 2024-02-24T00:39:04.675858159Z [2024-02-24T00:39:04.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:38:00+00:00 exited with status success for try_number 1 2024-02-24T00:39:04.682881546Z [2024-02-24T00:39:04.682+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:38:00+00:00, map_index=-1, run_start_date=2024-02-24 00:39:02.576049+00:00, run_end_date=2024-02-24 00:39:04.215716+00:00, run_duration=1.639667, state=success, executor_state=success, try_number=1, max_tries=1, job_id=307, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:39:00.557153+00:00, queued_by_job_id=2, pid=4568 2024-02-24T00:39:05.115688198Z [2024-02-24T00:39:05.115+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:39:05.116010045Z [2024-02-24T00:39:05.115+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:38:00+00:00, run_id=scheduled__2024-02-24T00:38:00+00:00, run_start_date=2024-02-24 00:39:00.477192+00:00, run_end_date=2024-02-24 00:39:05.115620+00:00, run_duration=4.638428, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:38:00+00:00, data_interval_end=2024-02-24 00:39:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:39:05.125571630Z [2024-02-24T00:39:05.125+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:39:00+00:00, run_after=2024-02-24T00:40:00+00:00 2024-02-24T00:39:05.156185645Z [2024-02-24T00:39:05.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:38:00+00:00 exited with status success for try_number 1 2024-02-24T00:39:05.162817426Z [2024-02-24T00:39:05.162+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:38:00+00:00, map_index=-1, run_start_date=2024-02-24 00:39:02.679798+00:00, run_end_date=2024-02-24 00:39:04.604793+00:00, run_duration=1.924995, state=success, executor_state=success, try_number=1, max_tries=1, job_id=308, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:39:00.557153+00:00, queued_by_job_id=2, pid=4569 2024-02-24T00:40:00.500036343Z [2024-02-24T00:40:00.499+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:40:00+00:00, run_after=2024-02-24T00:45:00+00:00 2024-02-24T00:40:00.512264055Z [2024-02-24T00:40:00.511+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:40:00+00:00, run_after=2024-02-24T00:41:00+00:00 2024-02-24T00:40:00.519060089Z [2024-02-24T00:40:00.518+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:40:00.530590310Z [2024-02-24T00:40:00.530+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:40:00+00:00, run_after=2024-02-24T00:41:00+00:00 2024-02-24T00:40:00.540112276Z [2024-02-24T00:40:00.539+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:40:00.680310747Z [2024-02-24T00:40:00.679+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-02-24T00:40:00.680342856Z 2024-02-24T00:40:00.680361261Z 2024-02-24T00:40:00.680366824Z 2024-02-24T00:40:00.680371782Z 2024-02-24T00:40:00.680396156Z 2024-02-24T00:40:00.680697665Z [2024-02-24T00:40:00.680+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:40:00.681181096Z [2024-02-24T00:40:00.680+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T00:40:00.681544127Z [2024-02-24T00:40:00.681+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:40:00.681957553Z [2024-02-24T00:40:00.681+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:40:00.682291900Z [2024-02-24T00:40:00.682+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:40:00.683514090Z [2024-02-24T00:40:00.683+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:40:00.683532151Z 2024-02-24T00:40:00.683537454Z 2024-02-24T00:40:00.683542537Z 2024-02-24T00:40:00.683546977Z 2024-02-24T00:40:00.683551404Z 2024-02-24T00:40:00.690127721Z [2024-02-24T00:40:00.689+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T00:40:00.690468998Z [2024-02-24T00:40:00.690+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:40:00.690900362Z [2024-02-24T00:40:00.690+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:40:00.691300652Z [2024-02-24T00:40:00.690+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T00:40:00.691462680Z [2024-02-24T00:40:00.691+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:40:00.691974079Z [2024-02-24T00:40:00.691+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:40:00.692046510Z [2024-02-24T00:40:00.691+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:40:00.692338113Z [2024-02-24T00:40:00.692+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:40:00.692702507Z [2024-02-24T00:40:00.692+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:40:00.692908427Z [2024-02-24T00:40:00.692+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:40:01.379953499Z [2024-02-24T00:40:01.379+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T00:35:00+00:00 exited with status queued for try_number 1 2024-02-24T00:40:01.380124452Z [2024-02-24T00:40:01.379+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:38:00+00:00 exited with status queued for try_number 1 2024-02-24T00:40:01.380235516Z [2024-02-24T00:40:01.380+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:39:00+00:00 exited with status queued for try_number 1 2024-02-24T00:40:01.380366512Z [2024-02-24T00:40:01.380+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:39:00+00:00 exited with status queued for try_number 1 2024-02-24T00:40:01.380517053Z [2024-02-24T00:40:01.380+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:39:00+00:00 exited with status queued for try_number 1 2024-02-24T00:40:01.402537428Z [2024-02-24T00:40:01.402+0000] {scheduler_job.py:635} INFO - Setting external_id for to 41ee5c45-8f58-46cf-b76a-73e872c16e6b 2024-02-24T00:40:01.402925516Z [2024-02-24T00:40:01.402+0000] {scheduler_job.py:635} INFO - Setting external_id for to af69f735-8475-4b9e-bb2c-c14d76e93d30 2024-02-24T00:40:01.403311671Z [2024-02-24T00:40:01.402+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0240e735-c5c9-4927-b545-54769d60163b 2024-02-24T00:40:01.403750053Z [2024-02-24T00:40:01.403+0000] {scheduler_job.py:635} INFO - Setting external_id for to 94d331d4-36ef-4a56-9523-3cef739534c7 2024-02-24T00:40:01.404108207Z [2024-02-24T00:40:01.403+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f1b1508-daec-440e-ae25-783a8f601c6f 2024-02-24T00:40:02.436354435Z [2024-02-24T00:40:02.435+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:40:02.436584957Z [2024-02-24T00:40:02.436+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 00:38:00+00:00, run_id=scheduled__2024-02-24T00:38:00+00:00, run_start_date=2024-02-24 00:40:00.564894+00:00, run_end_date=2024-02-24 00:40:02.436276+00:00, run_duration=1.871382, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:38:00+00:00, data_interval_end=2024-02-24 00:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T00:40:02.445734000Z [2024-02-24T00:40:02.445+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T00:40:00+00:00, run_after=2024-02-24T00:42:00+00:00 2024-02-24T00:40:02.510754089Z [2024-02-24T00:40:02.510+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:38:00+00:00 exited with status success for try_number 1 2024-02-24T00:40:02.518516634Z [2024-02-24T00:40:02.518+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T00:38:00+00:00, map_index=-1, run_start_date=2024-02-24 00:40:01.533644+00:00, run_end_date=2024-02-24 00:40:01.965405+00:00, run_duration=0.431761, state=success, executor_state=success, try_number=1, max_tries=1, job_id=309, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:40:00.685763+00:00, queued_by_job_id=2, pid=4598 2024-02-24T00:40:03.420554858Z [2024-02-24T00:40:03.420+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:40:03.421403942Z [2024-02-24T00:40:03.420+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:39:00+00:00, run_id=scheduled__2024-02-24T00:39:00+00:00, run_start_date=2024-02-24 00:40:00.566801+00:00, run_end_date=2024-02-24 00:40:03.420392+00:00, run_duration=2.853591, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:39:00+00:00, data_interval_end=2024-02-24 00:40:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:40:03.432299538Z [2024-02-24T00:40:03.431+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:40:00+00:00, run_after=2024-02-24T00:41:00+00:00 2024-02-24T00:40:03.557051095Z [2024-02-24T00:40:03.556+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:39:00+00:00 exited with status success for try_number 1 2024-02-24T00:40:03.572369178Z [2024-02-24T00:40:03.571+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:39:00+00:00, map_index=-1, run_start_date=2024-02-24 00:40:02.430452+00:00, run_end_date=2024-02-24 00:40:02.945991+00:00, run_duration=0.515539, state=success, executor_state=success, try_number=1, max_tries=1, job_id=310, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:40:00.685763+00:00, queued_by_job_id=2, pid=4611 2024-02-24T00:40:04.708650687Z [2024-02-24T00:40:04.708+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T00:40:04.708699162Z 2024-02-24T00:40:04.708711390Z [2024-02-24T00:40:04.708+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:40:04.709179639Z [2024-02-24T00:40:04.708+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:40:04.709243796Z 2024-02-24T00:40:04.713417641Z [2024-02-24T00:40:04.712+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T00:40:04.713611221Z [2024-02-24T00:40:04.713+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:40:04.765068699Z [2024-02-24T00:40:04.764+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T00:35:00+00:00 exited with status queued for try_number 1 2024-02-24T00:40:04.765106201Z [2024-02-24T00:40:04.764+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T00:35:00+00:00 exited with status success for try_number 1 2024-02-24T00:40:04.770353330Z [2024-02-24T00:40:04.770+0000] {scheduler_job.py:635} INFO - Setting external_id for to bab5de6a-bb27-45e3-b60d-ad5d53786e7a 2024-02-24T00:40:04.770453218Z [2024-02-24T00:40:04.770+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T00:35:00+00:00, map_index=-1, run_start_date=2024-02-24 00:40:03.543196+00:00, run_end_date=2024-02-24 00:40:04.014879+00:00, run_duration=0.471683, state=success, executor_state=success, try_number=1, max_tries=1, job_id=313, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:40:00.685763+00:00, queued_by_job_id=2, pid=4636 2024-02-24T00:40:04.873458493Z [2024-02-24T00:40:04.872+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:39:00+00:00 exited with status success for try_number 1 2024-02-24T00:40:04.880501598Z [2024-02-24T00:40:04.879+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:39:00+00:00, map_index=-1, run_start_date=2024-02-24 00:40:03.231852+00:00, run_end_date=2024-02-24 00:40:04.732516+00:00, run_duration=1.500664, state=success, executor_state=success, try_number=1, max_tries=1, job_id=311, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:40:00.685763+00:00, queued_by_job_id=2, pid=4623 2024-02-24T00:40:05.368729765Z [2024-02-24T00:40:05.368+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:40:05.369447987Z [2024-02-24T00:40:05.369+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:39:00+00:00, run_id=scheduled__2024-02-24T00:39:00+00:00, run_start_date=2024-02-24 00:40:00.568462+00:00, run_end_date=2024-02-24 00:40:05.368987+00:00, run_duration=4.800525, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:39:00+00:00, data_interval_end=2024-02-24 00:40:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:40:05.383532318Z [2024-02-24T00:40:05.383+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:40:00+00:00, run_after=2024-02-24T00:41:00+00:00 2024-02-24T00:40:05.396562461Z [2024-02-24T00:40:05.396+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:40:05.397187825Z [2024-02-24T00:40:05.396+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:39:00+00:00, run_id=scheduled__2024-02-24T00:39:00+00:00, run_start_date=2024-02-24 00:40:00.569900+00:00, run_end_date=2024-02-24 00:40:05.396768+00:00, run_duration=4.826868, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:39:00+00:00, data_interval_end=2024-02-24 00:40:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:40:05.410423030Z [2024-02-24T00:40:05.409+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:40:00+00:00, run_after=2024-02-24T00:41:00+00:00 2024-02-24T00:40:05.465872633Z [2024-02-24T00:40:05.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:39:00+00:00 exited with status success for try_number 1 2024-02-24T00:40:05.471468484Z [2024-02-24T00:40:05.471+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:39:00+00:00, map_index=-1, run_start_date=2024-02-24 00:40:03.475535+00:00, run_end_date=2024-02-24 00:40:05.131488+00:00, run_duration=1.655953, state=success, executor_state=success, try_number=1, max_tries=1, job_id=312, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:40:00.685763+00:00, queued_by_job_id=2, pid=4634 2024-02-24T00:40:07.609987897Z [2024-02-24T00:40:07.608+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T00:40:07.610112505Z 2024-02-24T00:40:07.610164358Z [2024-02-24T00:40:07.609+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:40:07.611853910Z [2024-02-24T00:40:07.611+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:40:07.611873788Z 2024-02-24T00:40:07.616723230Z [2024-02-24T00:40:07.616+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T00:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T00:40:07.617102816Z [2024-02-24T00:40:07.616+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T00:40:07.680881393Z [2024-02-24T00:40:07.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T00:35:00+00:00 exited with status queued for try_number 1 2024-02-24T00:40:07.681152328Z [2024-02-24T00:40:07.680+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T00:35:00+00:00 exited with status success for try_number 1 2024-02-24T00:40:07.692899995Z [2024-02-24T00:40:07.692+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75f73205-403f-4cb6-91ab-cc325332da24 2024-02-24T00:40:07.693043478Z [2024-02-24T00:40:07.692+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T00:35:00+00:00, map_index=-1, run_start_date=2024-02-24 00:40:06.389542+00:00, run_end_date=2024-02-24 00:40:06.699974+00:00, run_duration=0.310432, state=success, executor_state=success, try_number=1, max_tries=1, job_id=314, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:40:04.709594+00:00, queued_by_job_id=2, pid=4658 2024-02-24T00:40:09.826146412Z [2024-02-24T00:40:09.825+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T00:40:09.826188368Z 2024-02-24T00:40:09.826240559Z [2024-02-24T00:40:09.825+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:40:09.826911181Z [2024-02-24T00:40:09.826+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:40:09.826927112Z 2024-02-24T00:40:09.829842404Z [2024-02-24T00:40:09.829+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:40:09.829873043Z [2024-02-24T00:40:09.829+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:40:09.883463680Z [2024-02-24T00:40:09.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T00:35:00+00:00 exited with status queued for try_number 1 2024-02-24T00:40:09.883577049Z [2024-02-24T00:40:09.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T00:35:00+00:00 exited with status success for try_number 1 2024-02-24T00:40:09.893492223Z [2024-02-24T00:40:09.892+0000] {scheduler_job.py:635} INFO - Setting external_id for to 273ab6c8-ae71-45a4-acc0-afb8fa788ca4 2024-02-24T00:40:09.893531808Z [2024-02-24T00:40:09.893+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T00:35:00+00:00, map_index=0, run_start_date=2024-02-24 00:40:09.279724+00:00, run_end_date=2024-02-24 00:40:09.652499+00:00, run_duration=0.372775, state=success, executor_state=success, try_number=1, max_tries=1, job_id=315, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:40:07.612797+00:00, queued_by_job_id=2, pid=4666 2024-02-24T00:40:12.114553328Z [2024-02-24T00:40:12.114+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:40:12.114699173Z [2024-02-24T00:40:12.114+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:35:00+00:00, run_id=scheduled__2024-02-24T00:35:00+00:00, run_start_date=2024-02-24 00:40:00.563026+00:00, run_end_date=2024-02-24 00:40:12.114401+00:00, run_duration=11.551375, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:35:00+00:00, data_interval_end=2024-02-24 00:40:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T00:40:12.120191171Z [2024-02-24T00:40:12.119+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:40:00+00:00, run_after=2024-02-24T00:45:00+00:00 2024-02-24T00:40:12.147699921Z [2024-02-24T00:40:12.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T00:35:00+00:00 exited with status success for try_number 1 2024-02-24T00:40:12.153721680Z [2024-02-24T00:40:12.153+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T00:35:00+00:00, map_index=-1, run_start_date=2024-02-24 00:40:11.467618+00:00, run_end_date=2024-02-24 00:40:11.807224+00:00, run_duration=0.339606, state=success, executor_state=success, try_number=1, max_tries=1, job_id=316, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:40:09.827502+00:00, queued_by_job_id=2, pid=4674 2024-02-24T00:41:00.581134213Z [2024-02-24T00:41:00.580+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:41:00+00:00, run_after=2024-02-24T00:42:00+00:00 2024-02-24T00:41:00.593739490Z [2024-02-24T00:41:00.593+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:41:00.616743822Z [2024-02-24T00:41:00.616+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:41:00+00:00, run_after=2024-02-24T00:42:00+00:00 2024-02-24T00:41:00.745910886Z [2024-02-24T00:41:00.745+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T00:41:00.745964160Z 2024-02-24T00:41:00.745971416Z 2024-02-24T00:41:00.745993955Z 2024-02-24T00:41:00.746136425Z [2024-02-24T00:41:00.745+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:41:00.746332385Z [2024-02-24T00:41:00.746+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:41:00.746511203Z [2024-02-24T00:41:00.746+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:41:00.747393704Z [2024-02-24T00:41:00.747+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:41:00.747409134Z 2024-02-24T00:41:00.747435344Z 2024-02-24T00:41:00.747441672Z 2024-02-24T00:41:00.751500591Z [2024-02-24T00:41:00.751+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:41:00.751683342Z [2024-02-24T00:41:00.751+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:41:00.751961875Z [2024-02-24T00:41:00.751+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:41:00.752137021Z [2024-02-24T00:41:00.751+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:41:00.752375769Z [2024-02-24T00:41:00.752+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:41:00.752524180Z [2024-02-24T00:41:00.752+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:41:01.102770123Z [2024-02-24T00:41:01.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:40:00+00:00 exited with status queued for try_number 1 2024-02-24T00:41:01.102801933Z [2024-02-24T00:41:01.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:40:00+00:00 exited with status queued for try_number 1 2024-02-24T00:41:01.102943327Z [2024-02-24T00:41:01.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:40:00+00:00 exited with status queued for try_number 1 2024-02-24T00:41:01.110325573Z [2024-02-24T00:41:01.110+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5092713-ed74-467b-a1fd-0def882e5bc8 2024-02-24T00:41:01.110384043Z [2024-02-24T00:41:01.110+0000] {scheduler_job.py:635} INFO - Setting external_id for to 21bf8e85-35e6-4534-af6f-6778996cf0b1 2024-02-24T00:41:01.110614998Z [2024-02-24T00:41:01.110+0000] {scheduler_job.py:635} INFO - Setting external_id for to dad37fe5-98cf-45be-9b8c-791141ddd3ac 2024-02-24T00:41:02.466778002Z [2024-02-24T00:41:02.466+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:41:02.467394908Z [2024-02-24T00:41:02.467+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:40:00+00:00, run_id=scheduled__2024-02-24T00:40:00+00:00, run_start_date=2024-02-24 00:41:00.632115+00:00, run_end_date=2024-02-24 00:41:02.466837+00:00, run_duration=1.834722, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:40:00+00:00, data_interval_end=2024-02-24 00:41:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:41:02.485798406Z [2024-02-24T00:41:02.485+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:41:00+00:00, run_after=2024-02-24T00:42:00+00:00 2024-02-24T00:41:02.565437737Z [2024-02-24T00:41:02.564+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:40:00+00:00 exited with status success for try_number 1 2024-02-24T00:41:02.577970269Z [2024-02-24T00:41:02.577+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:40:00+00:00, map_index=-1, run_start_date=2024-02-24 00:41:01.691944+00:00, run_end_date=2024-02-24 00:41:02.140106+00:00, run_duration=0.448162, state=success, executor_state=success, try_number=1, max_tries=1, job_id=317, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:41:00.748488+00:00, queued_by_job_id=2, pid=4696 2024-02-24T00:41:04.577231722Z [2024-02-24T00:41:04.576+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:41:04.577505996Z [2024-02-24T00:41:04.577+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:40:00+00:00, run_id=scheduled__2024-02-24T00:40:00+00:00, run_start_date=2024-02-24 00:41:00.633857+00:00, run_end_date=2024-02-24 00:41:04.577108+00:00, run_duration=3.943251, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:40:00+00:00, data_interval_end=2024-02-24 00:41:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:41:04.590512754Z [2024-02-24T00:41:04.590+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:41:00+00:00, run_after=2024-02-24T00:42:00+00:00 2024-02-24T00:41:04.638685506Z [2024-02-24T00:41:04.638+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:40:00+00:00 exited with status success for try_number 1 2024-02-24T00:41:04.644501112Z [2024-02-24T00:41:04.644+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:40:00+00:00, map_index=-1, run_start_date=2024-02-24 00:41:02.899085+00:00, run_end_date=2024-02-24 00:41:04.167629+00:00, run_duration=1.268544, state=success, executor_state=success, try_number=1, max_tries=1, job_id=319, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:41:00.748488+00:00, queued_by_job_id=2, pid=4714 2024-02-24T00:41:05.700487167Z [2024-02-24T00:41:05.699+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:41:05.701094044Z [2024-02-24T00:41:05.700+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:40:00+00:00, run_id=scheduled__2024-02-24T00:40:00+00:00, run_start_date=2024-02-24 00:41:00.635161+00:00, run_end_date=2024-02-24 00:41:05.700423+00:00, run_duration=5.065262, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:40:00+00:00, data_interval_end=2024-02-24 00:41:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:41:05.719912281Z [2024-02-24T00:41:05.719+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:41:00+00:00, run_after=2024-02-24T00:42:00+00:00 2024-02-24T00:41:05.762962363Z [2024-02-24T00:41:05.762+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:40:00+00:00 exited with status success for try_number 1 2024-02-24T00:41:05.770539618Z [2024-02-24T00:41:05.770+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:40:00+00:00, map_index=-1, run_start_date=2024-02-24 00:41:02.894622+00:00, run_end_date=2024-02-24 00:41:04.567476+00:00, run_duration=1.672854, state=success, executor_state=success, try_number=1, max_tries=1, job_id=318, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:41:00.748488+00:00, queued_by_job_id=2, pid=4715 2024-02-24T00:42:00.057295576Z [2024-02-24T00:42:00.056+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:42:00+00:00, run_after=2024-02-24T00:43:00+00:00 2024-02-24T00:42:00.070815390Z [2024-02-24T00:42:00.070+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:42:00+00:00, run_after=2024-02-24T00:43:00+00:00 2024-02-24T00:42:00.077085089Z [2024-02-24T00:42:00.076+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:42:00.083232492Z [2024-02-24T00:42:00.082+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:42:00.196411550Z [2024-02-24T00:42:00.195+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T00:42:00.196454615Z 2024-02-24T00:42:00.196464499Z 2024-02-24T00:42:00.196471739Z 2024-02-24T00:42:00.196478861Z 2024-02-24T00:42:00.196509621Z [2024-02-24T00:42:00.196+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T00:42:00.196768924Z [2024-02-24T00:42:00.196+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:42:00.196898513Z [2024-02-24T00:42:00.196+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:42:00.197241014Z [2024-02-24T00:42:00.196+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:42:00.199182414Z [2024-02-24T00:42:00.198+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:42:00.199209062Z 2024-02-24T00:42:00.199246503Z 2024-02-24T00:42:00.199256327Z 2024-02-24T00:42:00.199264886Z 2024-02-24T00:42:00.206233455Z [2024-02-24T00:42:00.205+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:42:00.206450952Z [2024-02-24T00:42:00.206+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T00:42:00.206865669Z [2024-02-24T00:42:00.206+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:42:00.206965420Z [2024-02-24T00:42:00.206+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:42:00.207407759Z [2024-02-24T00:42:00.207+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:42:00.207533787Z [2024-02-24T00:42:00.207+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:42:00.207995082Z [2024-02-24T00:42:00.207+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:42:00.208206500Z [2024-02-24T00:42:00.207+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:42:00.563020168Z [2024-02-24T00:42:00.562+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:40:00+00:00 exited with status queued for try_number 1 2024-02-24T00:42:00.563086253Z [2024-02-24T00:42:00.562+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:41:00+00:00 exited with status queued for try_number 1 2024-02-24T00:42:00.563194718Z [2024-02-24T00:42:00.563+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:41:00+00:00 exited with status queued for try_number 1 2024-02-24T00:42:00.563323764Z [2024-02-24T00:42:00.563+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:41:00+00:00 exited with status queued for try_number 1 2024-02-24T00:42:00.579161987Z [2024-02-24T00:42:00.578+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1ace5121-adc9-454a-926e-d724ac54f9b3 2024-02-24T00:42:00.580304210Z [2024-02-24T00:42:00.579+0000] {scheduler_job.py:635} INFO - Setting external_id for to 746858d2-b454-426c-9a92-812df06ff87d 2024-02-24T00:42:00.580319408Z [2024-02-24T00:42:00.579+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3495e815-3cea-49f6-979c-a76c378a92bc 2024-02-24T00:42:00.580323462Z [2024-02-24T00:42:00.579+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5dbcbbad-fdee-4a84-a785-759de7bb8c44 2024-02-24T00:42:00.652666918Z [2024-02-24T00:42:00.652+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T00:42:01.938310941Z [2024-02-24T00:42:01.937+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:42:01.938742092Z [2024-02-24T00:42:01.938+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 00:40:00+00:00, run_id=scheduled__2024-02-24T00:40:00+00:00, run_start_date=2024-02-24 00:42:00.096556+00:00, run_end_date=2024-02-24 00:42:01.938244+00:00, run_duration=1.841688, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:40:00+00:00, data_interval_end=2024-02-24 00:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T00:42:01.947511051Z [2024-02-24T00:42:01.947+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T00:42:00+00:00, run_after=2024-02-24T00:44:00+00:00 2024-02-24T00:42:01.966912257Z [2024-02-24T00:42:01.966+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:42:01.967842501Z [2024-02-24T00:42:01.967+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:41:00+00:00, run_id=scheduled__2024-02-24T00:41:00+00:00, run_start_date=2024-02-24 00:42:00.098003+00:00, run_end_date=2024-02-24 00:42:01.966820+00:00, run_duration=1.868817, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:41:00+00:00, data_interval_end=2024-02-24 00:42:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:42:01.981235835Z [2024-02-24T00:42:01.980+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:42:00+00:00, run_after=2024-02-24T00:43:00+00:00 2024-02-24T00:42:02.054776895Z [2024-02-24T00:42:02.054+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:40:00+00:00 exited with status success for try_number 1 2024-02-24T00:42:02.062286397Z [2024-02-24T00:42:02.061+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T00:40:00+00:00, map_index=-1, run_start_date=2024-02-24 00:42:01.179379+00:00, run_end_date=2024-02-24 00:42:01.848014+00:00, run_duration=0.668635, state=success, executor_state=success, try_number=1, max_tries=1, job_id=320, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:42:00.200720+00:00, queued_by_job_id=2, pid=4748 2024-02-24T00:42:03.149540155Z [2024-02-24T00:42:03.149+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:41:00+00:00 exited with status success for try_number 1 2024-02-24T00:42:03.166727903Z [2024-02-24T00:42:03.165+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:41:00+00:00, map_index=-1, run_start_date=2024-02-24 00:42:01.402883+00:00, run_end_date=2024-02-24 00:42:01.889228+00:00, run_duration=0.486345, state=success, executor_state=success, try_number=1, max_tries=1, job_id=321, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:42:00.200720+00:00, queued_by_job_id=2, pid=4749 2024-02-24T00:42:04.608404793Z [2024-02-24T00:42:04.607+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:42:04.609056832Z [2024-02-24T00:42:04.608+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:41:00+00:00, run_id=scheduled__2024-02-24T00:41:00+00:00, run_start_date=2024-02-24 00:42:00.099159+00:00, run_end_date=2024-02-24 00:42:04.608532+00:00, run_duration=4.509373, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:41:00+00:00, data_interval_end=2024-02-24 00:42:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:42:04.621092823Z [2024-02-24T00:42:04.620+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:42:00+00:00, run_after=2024-02-24T00:43:00+00:00 2024-02-24T00:42:04.661226621Z [2024-02-24T00:42:04.660+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:41:00+00:00 exited with status success for try_number 1 2024-02-24T00:42:04.667696850Z [2024-02-24T00:42:04.667+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:41:00+00:00, map_index=-1, run_start_date=2024-02-24 00:42:02.528642+00:00, run_end_date=2024-02-24 00:42:03.948843+00:00, run_duration=1.420201, state=success, executor_state=success, try_number=1, max_tries=1, job_id=322, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:42:00.200720+00:00, queued_by_job_id=2, pid=4772 2024-02-24T00:42:05.721290477Z [2024-02-24T00:42:05.720+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:42:05.721856404Z [2024-02-24T00:42:05.721+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:41:00+00:00, run_id=scheduled__2024-02-24T00:41:00+00:00, run_start_date=2024-02-24 00:42:00.100192+00:00, run_end_date=2024-02-24 00:42:05.721196+00:00, run_duration=5.621004, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:41:00+00:00, data_interval_end=2024-02-24 00:42:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:42:05.733201203Z [2024-02-24T00:42:05.732+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:42:00+00:00, run_after=2024-02-24T00:43:00+00:00 2024-02-24T00:42:05.770505776Z [2024-02-24T00:42:05.770+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:41:00+00:00 exited with status success for try_number 1 2024-02-24T00:42:05.776647276Z [2024-02-24T00:42:05.776+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:41:00+00:00, map_index=-1, run_start_date=2024-02-24 00:42:02.582714+00:00, run_end_date=2024-02-24 00:42:05.312364+00:00, run_duration=2.72965, state=success, executor_state=success, try_number=1, max_tries=1, job_id=323, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:42:00.200720+00:00, queued_by_job_id=2, pid=4773 2024-02-24T00:43:00.799589108Z [2024-02-24T00:43:00.799+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:43:00+00:00, run_after=2024-02-24T00:44:00+00:00 2024-02-24T00:43:00.807961327Z [2024-02-24T00:43:00.807+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:43:00.820750128Z [2024-02-24T00:43:00.820+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:43:00+00:00, run_after=2024-02-24T00:44:00+00:00 2024-02-24T00:43:00.921422604Z [2024-02-24T00:43:00.920+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T00:43:00.921457404Z 2024-02-24T00:43:00.921464083Z 2024-02-24T00:43:00.921470284Z 2024-02-24T00:43:00.921665784Z [2024-02-24T00:43:00.921+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:43:00.922055236Z [2024-02-24T00:43:00.921+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:43:00.922348787Z [2024-02-24T00:43:00.922+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:43:00.923585998Z [2024-02-24T00:43:00.923+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:43:00.923595914Z 2024-02-24T00:43:00.923602987Z 2024-02-24T00:43:00.923609517Z 2024-02-24T00:43:00.930370579Z [2024-02-24T00:43:00.929+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:43:00.930668742Z [2024-02-24T00:43:00.930+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:43:00.931166266Z [2024-02-24T00:43:00.930+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:43:00.931421256Z [2024-02-24T00:43:00.931+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:43:00.931899369Z [2024-02-24T00:43:00.931+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:43:00.932086609Z [2024-02-24T00:43:00.931+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:43:01.307899922Z [2024-02-24T00:43:01.307+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:42:00+00:00 exited with status queued for try_number 1 2024-02-24T00:43:01.307941131Z [2024-02-24T00:43:01.307+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:42:00+00:00 exited with status queued for try_number 1 2024-02-24T00:43:01.310120487Z [2024-02-24T00:43:01.307+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:42:00+00:00 exited with status queued for try_number 1 2024-02-24T00:43:01.328920102Z [2024-02-24T00:43:01.328+0000] {scheduler_job.py:635} INFO - Setting external_id for to a241ca53-f035-49a5-9d33-0f6efb6f0d30 2024-02-24T00:43:01.329197652Z [2024-02-24T00:43:01.328+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e936ff9-634e-4bce-9504-29b685497d0d 2024-02-24T00:43:01.329517689Z [2024-02-24T00:43:01.329+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3e5c88fc-9bce-403d-bbbe-57c75d6c6079 2024-02-24T00:43:02.845314570Z [2024-02-24T00:43:02.844+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:43:02.845843009Z [2024-02-24T00:43:02.845+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:42:00+00:00, run_id=scheduled__2024-02-24T00:42:00+00:00, run_start_date=2024-02-24 00:43:00.831920+00:00, run_end_date=2024-02-24 00:43:02.845224+00:00, run_duration=2.013304, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:42:00+00:00, data_interval_end=2024-02-24 00:43:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:43:02.857428453Z [2024-02-24T00:43:02.857+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:43:00+00:00, run_after=2024-02-24T00:44:00+00:00 2024-02-24T00:43:02.896587200Z [2024-02-24T00:43:02.896+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:42:00+00:00 exited with status success for try_number 1 2024-02-24T00:43:02.904806812Z [2024-02-24T00:43:02.904+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:42:00+00:00, map_index=-1, run_start_date=2024-02-24 00:43:01.935572+00:00, run_end_date=2024-02-24 00:43:02.358931+00:00, run_duration=0.423359, state=success, executor_state=success, try_number=1, max_tries=1, job_id=324, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:43:00.925240+00:00, queued_by_job_id=2, pid=4805 2024-02-24T00:43:05.035091873Z [2024-02-24T00:43:05.034+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:43:05.035152821Z [2024-02-24T00:43:05.035+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:42:00+00:00, run_id=scheduled__2024-02-24T00:42:00+00:00, run_start_date=2024-02-24 00:43:00.833253+00:00, run_end_date=2024-02-24 00:43:05.034930+00:00, run_duration=4.201677, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:42:00+00:00, data_interval_end=2024-02-24 00:43:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:43:05.044950318Z [2024-02-24T00:43:05.044+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:43:00+00:00, run_after=2024-02-24T00:44:00+00:00 2024-02-24T00:43:05.087788228Z [2024-02-24T00:43:05.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:42:00+00:00 exited with status success for try_number 1 2024-02-24T00:43:05.095863521Z [2024-02-24T00:43:05.095+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:42:00+00:00, map_index=-1, run_start_date=2024-02-24 00:43:03.119794+00:00, run_end_date=2024-02-24 00:43:04.670746+00:00, run_duration=1.550952, state=success, executor_state=success, try_number=1, max_tries=1, job_id=325, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:43:00.925240+00:00, queued_by_job_id=2, pid=4823 2024-02-24T00:43:06.161017402Z [2024-02-24T00:43:06.160+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:43:06.161553611Z [2024-02-24T00:43:06.161+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:42:00+00:00, run_id=scheduled__2024-02-24T00:42:00+00:00, run_start_date=2024-02-24 00:43:00.834376+00:00, run_end_date=2024-02-24 00:43:06.160941+00:00, run_duration=5.326565, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:42:00+00:00, data_interval_end=2024-02-24 00:43:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:43:06.174494427Z [2024-02-24T00:43:06.174+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:43:00+00:00, run_after=2024-02-24T00:44:00+00:00 2024-02-24T00:43:06.219136248Z [2024-02-24T00:43:06.218+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:42:00+00:00 exited with status success for try_number 1 2024-02-24T00:43:06.229228429Z [2024-02-24T00:43:06.228+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:42:00+00:00, map_index=-1, run_start_date=2024-02-24 00:43:03.335148+00:00, run_end_date=2024-02-24 00:43:05.109501+00:00, run_duration=1.774353, state=success, executor_state=success, try_number=1, max_tries=1, job_id=326, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:43:00.925240+00:00, queued_by_job_id=2, pid=4824 2024-02-24T00:44:00.726060533Z [2024-02-24T00:44:00.725+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:44:00.737241000Z [2024-02-24T00:44:00.736+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:44:00.758327980Z [2024-02-24T00:44:00.757+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:44:00+00:00, run_after=2024-02-24T00:45:00+00:00 2024-02-24T00:44:00.772985928Z [2024-02-24T00:44:00.772+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:44:00+00:00, run_after=2024-02-24T00:45:00+00:00 2024-02-24T00:44:00.862130927Z [2024-02-24T00:44:00.861+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T00:44:00.862165054Z 2024-02-24T00:44:00.862170606Z 2024-02-24T00:44:00.862175004Z 2024-02-24T00:44:00.862179368Z 2024-02-24T00:44:00.862533474Z [2024-02-24T00:44:00.862+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T00:44:00.862598106Z [2024-02-24T00:44:00.862+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:44:00.862686208Z [2024-02-24T00:44:00.862+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:44:00.862840403Z [2024-02-24T00:44:00.862+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:44:00.863451832Z [2024-02-24T00:44:00.863+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:44:00.863474862Z 2024-02-24T00:44:00.863484971Z 2024-02-24T00:44:00.863495435Z 2024-02-24T00:44:00.863505010Z 2024-02-24T00:44:00.867285861Z [2024-02-24T00:44:00.866+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:44:00.867321227Z [2024-02-24T00:44:00.867+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T00:44:00.867535402Z [2024-02-24T00:44:00.867+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:44:00.867594163Z [2024-02-24T00:44:00.867+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:44:00.867897788Z [2024-02-24T00:44:00.867+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:44:00.868074348Z [2024-02-24T00:44:00.867+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:44:00.868423483Z [2024-02-24T00:44:00.868+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:44:00.868463741Z [2024-02-24T00:44:00.868+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:44:01.323359181Z [2024-02-24T00:44:01.322+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:42:00+00:00 exited with status queued for try_number 1 2024-02-24T00:44:01.323759122Z [2024-02-24T00:44:01.323+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:43:00+00:00 exited with status queued for try_number 1 2024-02-24T00:44:01.324100179Z [2024-02-24T00:44:01.323+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:43:00+00:00 exited with status queued for try_number 1 2024-02-24T00:44:01.324438576Z [2024-02-24T00:44:01.324+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:43:00+00:00 exited with status queued for try_number 1 2024-02-24T00:44:01.351282128Z [2024-02-24T00:44:01.350+0000] {scheduler_job.py:635} INFO - Setting external_id for to 61841a9f-9258-4d11-b3eb-74ce8d74dec1 2024-02-24T00:44:01.351716306Z [2024-02-24T00:44:01.351+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5127e29-4c60-4004-89d0-58286913103f 2024-02-24T00:44:01.351983112Z [2024-02-24T00:44:01.351+0000] {scheduler_job.py:635} INFO - Setting external_id for to 01e59077-81a1-495b-92c0-6f566035d1e2 2024-02-24T00:44:01.352284000Z [2024-02-24T00:44:01.352+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d14bb5a-8a16-4b63-b969-adc90b4ada7b 2024-02-24T00:44:02.648473706Z [2024-02-24T00:44:02.647+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:44:02.648723300Z [2024-02-24T00:44:02.648+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 00:42:00+00:00, run_id=scheduled__2024-02-24T00:42:00+00:00, run_start_date=2024-02-24 00:44:00.786683+00:00, run_end_date=2024-02-24 00:44:02.648393+00:00, run_duration=1.86171, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:42:00+00:00, data_interval_end=2024-02-24 00:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T00:44:02.680797797Z [2024-02-24T00:44:02.656+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T00:44:00+00:00, run_after=2024-02-24T00:46:00+00:00 2024-02-24T00:44:02.868437616Z [2024-02-24T00:44:02.868+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:42:00+00:00 exited with status success for try_number 1 2024-02-24T00:44:02.876697051Z [2024-02-24T00:44:02.876+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T00:42:00+00:00, map_index=-1, run_start_date=2024-02-24 00:44:01.681235+00:00, run_end_date=2024-02-24 00:44:02.036614+00:00, run_duration=0.355379, state=success, executor_state=success, try_number=1, max_tries=1, job_id=327, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:44:00.864132+00:00, queued_by_job_id=2, pid=4851 2024-02-24T00:44:03.943471796Z [2024-02-24T00:44:03.943+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:44:03.943883081Z [2024-02-24T00:44:03.943+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:43:00+00:00, run_id=scheduled__2024-02-24T00:43:00+00:00, run_start_date=2024-02-24 00:44:00.788275+00:00, run_end_date=2024-02-24 00:44:03.943576+00:00, run_duration=3.155301, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:43:00+00:00, data_interval_end=2024-02-24 00:44:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:44:03.952444555Z [2024-02-24T00:44:03.952+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:44:00+00:00, run_after=2024-02-24T00:45:00+00:00 2024-02-24T00:44:04.009125194Z [2024-02-24T00:44:04.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:43:00+00:00 exited with status success for try_number 1 2024-02-24T00:44:04.015436044Z [2024-02-24T00:44:04.014+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:43:00+00:00, map_index=-1, run_start_date=2024-02-24 00:44:02.174008+00:00, run_end_date=2024-02-24 00:44:02.783744+00:00, run_duration=0.609736, state=success, executor_state=success, try_number=1, max_tries=1, job_id=328, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:44:00.864132+00:00, queued_by_job_id=2, pid=4862 2024-02-24T00:44:06.576647337Z [2024-02-24T00:44:06.576+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:44:06.576760180Z [2024-02-24T00:44:06.576+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:43:00+00:00, run_id=scheduled__2024-02-24T00:43:00+00:00, run_start_date=2024-02-24 00:44:00.790436+00:00, run_end_date=2024-02-24 00:44:06.576339+00:00, run_duration=5.785903, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:43:00+00:00, data_interval_end=2024-02-24 00:44:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:44:06.586238239Z [2024-02-24T00:44:06.585+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:44:00+00:00, run_after=2024-02-24T00:45:00+00:00 2024-02-24T00:44:06.594062340Z [2024-02-24T00:44:06.593+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:44:06.594241375Z [2024-02-24T00:44:06.593+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:43:00+00:00, run_id=scheduled__2024-02-24T00:43:00+00:00, run_start_date=2024-02-24 00:44:00.789356+00:00, run_end_date=2024-02-24 00:44:06.593900+00:00, run_duration=5.804544, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:43:00+00:00, data_interval_end=2024-02-24 00:44:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:44:06.603695588Z [2024-02-24T00:44:06.603+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:44:00+00:00, run_after=2024-02-24T00:45:00+00:00 2024-02-24T00:44:06.631653140Z [2024-02-24T00:44:06.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:43:00+00:00 exited with status success for try_number 1 2024-02-24T00:44:06.631680544Z [2024-02-24T00:44:06.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:43:00+00:00 exited with status success for try_number 1 2024-02-24T00:44:06.641849844Z [2024-02-24T00:44:06.641+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:43:00+00:00, map_index=-1, run_start_date=2024-02-24 00:44:03.318482+00:00, run_end_date=2024-02-24 00:44:06.204569+00:00, run_duration=2.886087, state=success, executor_state=success, try_number=1, max_tries=1, job_id=329, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:44:00.864132+00:00, queued_by_job_id=2, pid=4880 2024-02-24T00:44:06.642287213Z [2024-02-24T00:44:06.642+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:43:00+00:00, map_index=-1, run_start_date=2024-02-24 00:44:03.374536+00:00, run_end_date=2024-02-24 00:44:05.947004+00:00, run_duration=2.572468, state=success, executor_state=success, try_number=1, max_tries=1, job_id=330, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:44:00.864132+00:00, queued_by_job_id=2, pid=4881 2024-02-24T00:45:00.900671032Z [2024-02-24T00:45:00.900+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:45:00+00:00, run_after=2024-02-24T00:46:00+00:00 2024-02-24T00:45:00.913079141Z [2024-02-24T00:45:00.912+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:45:00+00:00, run_after=2024-02-24T00:46:00+00:00 2024-02-24T00:45:00.920942533Z [2024-02-24T00:45:00.920+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:45:00.934038789Z [2024-02-24T00:45:00.933+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:45:00+00:00, run_after=2024-02-24T00:50:00+00:00 2024-02-24T00:45:01.008884080Z [2024-02-24T00:45:01.008+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T00:45:01.008915588Z 2024-02-24T00:45:01.008922310Z 2024-02-24T00:45:01.008926616Z 2024-02-24T00:45:01.008930910Z 2024-02-24T00:45:01.008943173Z [2024-02-24T00:45:01.008+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:45:01.008991481Z [2024-02-24T00:45:01.008+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:45:01.009092160Z [2024-02-24T00:45:01.008+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:45:01.009143256Z [2024-02-24T00:45:01.009+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:45:01.009824412Z [2024-02-24T00:45:01.009+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:45:01.009834430Z 2024-02-24T00:45:01.009837966Z 2024-02-24T00:45:01.009841262Z 2024-02-24T00:45:01.009844444Z 2024-02-24T00:45:01.013425032Z [2024-02-24T00:45:01.013+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T00:45:01.013532970Z [2024-02-24T00:45:01.013+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:45:01.013745545Z [2024-02-24T00:45:01.013+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:45:01.013853509Z [2024-02-24T00:45:01.013+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:45:01.014028241Z [2024-02-24T00:45:01.013+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:45:01.014120725Z [2024-02-24T00:45:01.013+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:45:01.014343013Z [2024-02-24T00:45:01.014+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:45:01.014439829Z [2024-02-24T00:45:01.014+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:45:01.639116694Z [2024-02-24T00:45:01.638+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T00:40:00+00:00 exited with status queued for try_number 1 2024-02-24T00:45:01.641326585Z [2024-02-24T00:45:01.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:44:00+00:00 exited with status queued for try_number 1 2024-02-24T00:45:01.641570042Z [2024-02-24T00:45:01.641+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:44:00+00:00 exited with status queued for try_number 1 2024-02-24T00:45:01.641662834Z [2024-02-24T00:45:01.641+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:44:00+00:00 exited with status queued for try_number 1 2024-02-24T00:45:01.659704179Z [2024-02-24T00:45:01.659+0000] {scheduler_job.py:635} INFO - Setting external_id for to 02342830-24f4-475f-a9d0-6b235a389ab7 2024-02-24T00:45:01.661462840Z [2024-02-24T00:45:01.659+0000] {scheduler_job.py:635} INFO - Setting external_id for to aba452db-dc6d-41ea-b768-5050082f554a 2024-02-24T00:45:01.666281701Z [2024-02-24T00:45:01.661+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4221795a-9334-4b8d-abd2-860e87da9927 2024-02-24T00:45:01.666494706Z [2024-02-24T00:45:01.666+0000] {scheduler_job.py:635} INFO - Setting external_id for to 24e9c14d-1c34-4e7f-9570-d1865408227b 2024-02-24T00:45:02.955445682Z [2024-02-24T00:45:02.954+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:45:02.955834864Z [2024-02-24T00:45:02.955+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:44:00+00:00, run_id=scheduled__2024-02-24T00:44:00+00:00, run_start_date=2024-02-24 00:45:00.946474+00:00, run_end_date=2024-02-24 00:45:02.955473+00:00, run_duration=2.008999, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:44:00+00:00, data_interval_end=2024-02-24 00:45:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:45:02.980675925Z [2024-02-24T00:45:02.980+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:45:00+00:00, run_after=2024-02-24T00:46:00+00:00 2024-02-24T00:45:03.935026252Z [2024-02-24T00:45:03.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:44:00+00:00 exited with status success for try_number 1 2024-02-24T00:45:03.942798097Z [2024-02-24T00:45:03.942+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:44:00+00:00, map_index=-1, run_start_date=2024-02-24 00:45:02.255250+00:00, run_end_date=2024-02-24 00:45:02.930860+00:00, run_duration=0.67561, state=success, executor_state=success, try_number=1, max_tries=1, job_id=331, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:45:01.010584+00:00, queued_by_job_id=2, pid=4914 2024-02-24T00:45:04.900140896Z [2024-02-24T00:45:04.899+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T00:45:04.900174884Z 2024-02-24T00:45:04.900687636Z [2024-02-24T00:45:04.900+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:45:04.901752078Z [2024-02-24T00:45:04.901+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:45:04.901808207Z 2024-02-24T00:45:04.905720900Z [2024-02-24T00:45:04.905+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T00:45:04.906105144Z [2024-02-24T00:45:04.905+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:45:04.970737482Z [2024-02-24T00:45:04.970+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T00:40:00+00:00 exited with status queued for try_number 1 2024-02-24T00:45:04.971156183Z [2024-02-24T00:45:04.970+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T00:40:00+00:00 exited with status success for try_number 1 2024-02-24T00:45:04.978726347Z [2024-02-24T00:45:04.978+0000] {scheduler_job.py:635} INFO - Setting external_id for to 92e9a810-f0e9-40ec-8513-130bf5830349 2024-02-24T00:45:04.978936761Z [2024-02-24T00:45:04.978+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T00:40:00+00:00, map_index=-1, run_start_date=2024-02-24 00:45:03.393051+00:00, run_end_date=2024-02-24 00:45:03.898558+00:00, run_duration=0.505507, state=success, executor_state=success, try_number=1, max_tries=1, job_id=333, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:45:01.010584+00:00, queued_by_job_id=2, pid=4939 2024-02-24T00:45:06.205281246Z [2024-02-24T00:45:06.204+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:45:06.215786057Z [2024-02-24T00:45:06.215+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:44:00+00:00, run_id=scheduled__2024-02-24T00:44:00+00:00, run_start_date=2024-02-24 00:45:00.947477+00:00, run_end_date=2024-02-24 00:45:06.205153+00:00, run_duration=5.257676, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:44:00+00:00, data_interval_end=2024-02-24 00:45:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:45:06.230177738Z [2024-02-24T00:45:06.229+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:45:00+00:00, run_after=2024-02-24T00:46:00+00:00 2024-02-24T00:45:06.240298819Z [2024-02-24T00:45:06.239+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:45:06.240683791Z [2024-02-24T00:45:06.240+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:44:00+00:00, run_id=scheduled__2024-02-24T00:44:00+00:00, run_start_date=2024-02-24 00:45:00.948917+00:00, run_end_date=2024-02-24 00:45:06.240197+00:00, run_duration=5.29128, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:44:00+00:00, data_interval_end=2024-02-24 00:45:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:45:06.251658991Z [2024-02-24T00:45:06.251+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:45:00+00:00, run_after=2024-02-24T00:46:00+00:00 2024-02-24T00:45:06.315679776Z [2024-02-24T00:45:06.315+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:44:00+00:00 exited with status success for try_number 1 2024-02-24T00:45:06.315936845Z [2024-02-24T00:45:06.315+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:44:00+00:00 exited with status success for try_number 1 2024-02-24T00:45:06.322961625Z [2024-02-24T00:45:06.322+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:44:00+00:00, map_index=-1, run_start_date=2024-02-24 00:45:03.657223+00:00, run_end_date=2024-02-24 00:45:05.076149+00:00, run_duration=1.418926, state=success, executor_state=success, try_number=1, max_tries=1, job_id=334, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:45:01.010584+00:00, queued_by_job_id=2, pid=4940 2024-02-24T00:45:06.323269936Z [2024-02-24T00:45:06.323+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:44:00+00:00, map_index=-1, run_start_date=2024-02-24 00:45:03.365387+00:00, run_end_date=2024-02-24 00:45:05.380504+00:00, run_duration=2.015117, state=success, executor_state=success, try_number=1, max_tries=1, job_id=332, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:45:01.010584+00:00, queued_by_job_id=2, pid=4938 2024-02-24T00:45:07.977382911Z [2024-02-24T00:45:07.977+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T00:45:07.977414495Z 2024-02-24T00:45:07.977608705Z [2024-02-24T00:45:07.977+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:45:07.978345725Z [2024-02-24T00:45:07.978+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:45:07.978360034Z 2024-02-24T00:45:07.980942727Z [2024-02-24T00:45:07.980+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T00:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T00:45:07.981157414Z [2024-02-24T00:45:07.980+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T00:45:08.077416046Z [2024-02-24T00:45:08.076+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T00:40:00+00:00 exited with status queued for try_number 1 2024-02-24T00:45:08.077457605Z [2024-02-24T00:45:08.077+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T00:40:00+00:00 exited with status success for try_number 1 2024-02-24T00:45:08.085926321Z [2024-02-24T00:45:08.085+0000] {scheduler_job.py:635} INFO - Setting external_id for to 70945ffe-0f80-40b2-a937-9d6827195e83 2024-02-24T00:45:08.086175867Z [2024-02-24T00:45:08.085+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T00:40:00+00:00, map_index=-1, run_start_date=2024-02-24 00:45:06.743346+00:00, run_end_date=2024-02-24 00:45:07.076544+00:00, run_duration=0.333198, state=success, executor_state=success, try_number=1, max_tries=1, job_id=335, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:45:04.902390+00:00, queued_by_job_id=2, pid=4963 2024-02-24T00:45:10.142206838Z [2024-02-24T00:45:10.141+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T00:45:10.142250890Z 2024-02-24T00:45:10.142411937Z [2024-02-24T00:45:10.142+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:45:10.143004629Z [2024-02-24T00:45:10.142+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:45:10.143015293Z 2024-02-24T00:45:10.145212813Z [2024-02-24T00:45:10.144+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:45:10.145437640Z [2024-02-24T00:45:10.145+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:45:10.188492882Z [2024-02-24T00:45:10.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T00:40:00+00:00 exited with status queued for try_number 1 2024-02-24T00:45:10.188691245Z [2024-02-24T00:45:10.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T00:40:00+00:00 exited with status success for try_number 1 2024-02-24T00:45:10.197879796Z [2024-02-24T00:45:10.197+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4fc08345-e6f3-47b2-81c9-7774157266cf 2024-02-24T00:45:10.198213675Z [2024-02-24T00:45:10.197+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T00:40:00+00:00, map_index=0, run_start_date=2024-02-24 00:45:09.556358+00:00, run_end_date=2024-02-24 00:45:09.908844+00:00, run_duration=0.352486, state=success, executor_state=success, try_number=1, max_tries=1, job_id=336, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:45:07.978758+00:00, queued_by_job_id=2, pid=4971 2024-02-24T00:45:12.405584211Z [2024-02-24T00:45:12.404+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:45:12.406112804Z [2024-02-24T00:45:12.405+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:40:00+00:00, run_id=scheduled__2024-02-24T00:40:00+00:00, run_start_date=2024-02-24 00:45:00.945216+00:00, run_end_date=2024-02-24 00:45:12.405506+00:00, run_duration=11.46029, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:40:00+00:00, data_interval_end=2024-02-24 00:45:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T00:45:12.413451554Z [2024-02-24T00:45:12.413+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:45:00+00:00, run_after=2024-02-24T00:50:00+00:00 2024-02-24T00:45:13.528036967Z [2024-02-24T00:45:13.527+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T00:40:00+00:00 exited with status success for try_number 1 2024-02-24T00:45:13.533624593Z [2024-02-24T00:45:13.533+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T00:40:00+00:00, map_index=-1, run_start_date=2024-02-24 00:45:11.891047+00:00, run_end_date=2024-02-24 00:45:12.269695+00:00, run_duration=0.378648, state=success, executor_state=success, try_number=1, max_tries=1, job_id=337, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:45:10.143408+00:00, queued_by_job_id=2, pid=4979 2024-02-24T00:46:00.771865001Z [2024-02-24T00:46:00.771+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:46:00+00:00, run_after=2024-02-24T00:47:00+00:00 2024-02-24T00:46:00.789670712Z [2024-02-24T00:46:00.789+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:46:00.797924470Z [2024-02-24T00:46:00.797+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:46:00.811395234Z [2024-02-24T00:46:00.811+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:46:00+00:00, run_after=2024-02-24T00:47:00+00:00 2024-02-24T00:46:00.898174488Z [2024-02-24T00:46:00.897+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T00:46:00.898205741Z 2024-02-24T00:46:00.898211998Z 2024-02-24T00:46:00.898216983Z 2024-02-24T00:46:00.898221912Z 2024-02-24T00:46:00.898581658Z [2024-02-24T00:46:00.898+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T00:46:00.898909479Z [2024-02-24T00:46:00.898+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:46:00.899213400Z [2024-02-24T00:46:00.899+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:46:00.899504588Z [2024-02-24T00:46:00.899+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:46:00.900546961Z [2024-02-24T00:46:00.900+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:46:00.900561528Z 2024-02-24T00:46:00.900567567Z 2024-02-24T00:46:00.900572515Z 2024-02-24T00:46:00.900577813Z 2024-02-24T00:46:00.907232855Z [2024-02-24T00:46:00.906+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:46:00.907647662Z [2024-02-24T00:46:00.907+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T00:46:00.908215184Z [2024-02-24T00:46:00.907+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:46:00.908548790Z [2024-02-24T00:46:00.908+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:46:00.909008251Z [2024-02-24T00:46:00.908+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:46:00.909347744Z [2024-02-24T00:46:00.909+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:46:00.909822646Z [2024-02-24T00:46:00.909+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:46:00.910136277Z [2024-02-24T00:46:00.909+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:46:01.405054607Z [2024-02-24T00:46:01.402+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:44:00+00:00 exited with status queued for try_number 1 2024-02-24T00:46:01.405299008Z [2024-02-24T00:46:01.405+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:45:00+00:00 exited with status queued for try_number 1 2024-02-24T00:46:01.405469500Z [2024-02-24T00:46:01.405+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:45:00+00:00 exited with status queued for try_number 1 2024-02-24T00:46:01.405675865Z [2024-02-24T00:46:01.405+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:45:00+00:00 exited with status queued for try_number 1 2024-02-24T00:46:01.414333438Z [2024-02-24T00:46:01.413+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6833c8e-dd51-4cf7-98a1-0324c3d68deb 2024-02-24T00:46:01.414604641Z [2024-02-24T00:46:01.414+0000] {scheduler_job.py:635} INFO - Setting external_id for to 451c6535-f4a8-4ca8-a2bf-193b9de53783 2024-02-24T00:46:01.414853445Z [2024-02-24T00:46:01.414+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22e71bbc-176d-439f-8867-8bad3a32ece1 2024-02-24T00:46:01.415082048Z [2024-02-24T00:46:01.414+0000] {scheduler_job.py:635} INFO - Setting external_id for to b82390cc-9227-42ea-904d-ab19178174cf 2024-02-24T00:46:02.579539022Z [2024-02-24T00:46:02.579+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:46:02.579747409Z [2024-02-24T00:46:02.579+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 00:44:00+00:00, run_id=scheduled__2024-02-24T00:44:00+00:00, run_start_date=2024-02-24 00:46:00.823916+00:00, run_end_date=2024-02-24 00:46:02.579444+00:00, run_duration=1.755528, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:44:00+00:00, data_interval_end=2024-02-24 00:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T00:46:02.590420821Z [2024-02-24T00:46:02.590+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T00:46:00+00:00, run_after=2024-02-24T00:48:00+00:00 2024-02-24T00:46:02.627005138Z [2024-02-24T00:46:02.625+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:46:02.627619304Z [2024-02-24T00:46:02.626+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:45:00+00:00, run_id=scheduled__2024-02-24T00:45:00+00:00, run_start_date=2024-02-24 00:46:00.825514+00:00, run_end_date=2024-02-24 00:46:02.625862+00:00, run_duration=1.800348, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:45:00+00:00, data_interval_end=2024-02-24 00:46:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:46:02.663843632Z [2024-02-24T00:46:02.663+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:46:00+00:00, run_after=2024-02-24T00:47:00+00:00 2024-02-24T00:46:02.772869336Z [2024-02-24T00:46:02.772+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:44:00+00:00 exited with status success for try_number 1 2024-02-24T00:46:02.780392080Z [2024-02-24T00:46:02.779+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T00:44:00+00:00, map_index=-1, run_start_date=2024-02-24 00:46:01.782448+00:00, run_end_date=2024-02-24 00:46:02.295123+00:00, run_duration=0.512675, state=success, executor_state=success, try_number=1, max_tries=1, job_id=338, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:46:00.902265+00:00, queued_by_job_id=2, pid=5002 2024-02-24T00:46:03.873843235Z [2024-02-24T00:46:03.873+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:45:00+00:00 exited with status success for try_number 1 2024-02-24T00:46:03.882003556Z [2024-02-24T00:46:03.881+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:45:00+00:00, map_index=-1, run_start_date=2024-02-24 00:46:02.040077+00:00, run_end_date=2024-02-24 00:46:02.586801+00:00, run_duration=0.546724, state=success, executor_state=success, try_number=1, max_tries=1, job_id=339, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:46:00.902265+00:00, queued_by_job_id=2, pid=5003 2024-02-24T00:46:04.748387836Z [2024-02-24T00:46:04.747+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:46:04.748691566Z [2024-02-24T00:46:04.748+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:45:00+00:00, run_id=scheduled__2024-02-24T00:45:00+00:00, run_start_date=2024-02-24 00:46:00.826837+00:00, run_end_date=2024-02-24 00:46:04.748197+00:00, run_duration=3.92136, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:45:00+00:00, data_interval_end=2024-02-24 00:46:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:46:04.762949991Z [2024-02-24T00:46:04.762+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:46:00+00:00, run_after=2024-02-24T00:47:00+00:00 2024-02-24T00:46:05.339964674Z [2024-02-24T00:46:05.339+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:46:05.340176226Z [2024-02-24T00:46:05.339+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:45:00+00:00, run_id=scheduled__2024-02-24T00:45:00+00:00, run_start_date=2024-02-24 00:46:00.827966+00:00, run_end_date=2024-02-24 00:46:05.339696+00:00, run_duration=4.51173, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:45:00+00:00, data_interval_end=2024-02-24 00:46:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:46:05.351129148Z [2024-02-24T00:46:05.350+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:46:00+00:00, run_after=2024-02-24T00:47:00+00:00 2024-02-24T00:46:05.388084594Z [2024-02-24T00:46:05.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:45:00+00:00 exited with status success for try_number 1 2024-02-24T00:46:05.388154318Z [2024-02-24T00:46:05.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:45:00+00:00 exited with status success for try_number 1 2024-02-24T00:46:05.395027097Z [2024-02-24T00:46:05.394+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:45:00+00:00, map_index=-1, run_start_date=2024-02-24 00:46:03.238438+00:00, run_end_date=2024-02-24 00:46:04.675783+00:00, run_duration=1.437345, state=success, executor_state=success, try_number=1, max_tries=1, job_id=340, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:46:00.902265+00:00, queued_by_job_id=2, pid=5026 2024-02-24T00:46:05.395212155Z [2024-02-24T00:46:05.394+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:45:00+00:00, map_index=-1, run_start_date=2024-02-24 00:46:03.378923+00:00, run_end_date=2024-02-24 00:46:05.156028+00:00, run_duration=1.777105, state=success, executor_state=success, try_number=1, max_tries=1, job_id=341, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:46:00.902265+00:00, queued_by_job_id=2, pid=5027 2024-02-24T00:47:00.525621291Z [2024-02-24T00:47:00.525+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:47:00+00:00, run_after=2024-02-24T00:48:00+00:00 2024-02-24T00:47:00.540222213Z [2024-02-24T00:47:00.539+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:47:00+00:00, run_after=2024-02-24T00:48:00+00:00 2024-02-24T00:47:00.548287771Z [2024-02-24T00:47:00.547+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:47:00.628260226Z [2024-02-24T00:47:00.627+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T00:47:00.628320180Z 2024-02-24T00:47:00.628327287Z 2024-02-24T00:47:00.628333342Z 2024-02-24T00:47:00.628420302Z [2024-02-24T00:47:00.628+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:47:00.628661595Z [2024-02-24T00:47:00.628+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:47:00.628926037Z [2024-02-24T00:47:00.628+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:47:00.629733736Z [2024-02-24T00:47:00.629+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:47:00.629750862Z 2024-02-24T00:47:00.629812049Z 2024-02-24T00:47:00.629819751Z 2024-02-24T00:47:00.633632615Z [2024-02-24T00:47:00.633+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:47:00.633918324Z [2024-02-24T00:47:00.633+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:47:00.634296522Z [2024-02-24T00:47:00.634+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:47:00.634488860Z [2024-02-24T00:47:00.634+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:47:00.634747104Z [2024-02-24T00:47:00.634+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:47:00.634873453Z [2024-02-24T00:47:00.634+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:47:00.848087875Z [2024-02-24T00:47:00.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:46:00+00:00 exited with status queued for try_number 1 2024-02-24T00:47:00.848460126Z [2024-02-24T00:47:00.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:46:00+00:00 exited with status queued for try_number 1 2024-02-24T00:47:00.848660260Z [2024-02-24T00:47:00.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:46:00+00:00 exited with status queued for try_number 1 2024-02-24T00:47:00.856601551Z [2024-02-24T00:47:00.856+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a2af803-a12d-4237-8f16-bbc4e800e4e5 2024-02-24T00:47:00.857077202Z [2024-02-24T00:47:00.856+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39fc4286-4660-43d2-a7d2-6f92116eca0f 2024-02-24T00:47:00.857381692Z [2024-02-24T00:47:00.857+0000] {scheduler_job.py:635} INFO - Setting external_id for to 94a5a555-4ed4-46ed-b5b1-ef10e88dd815 2024-02-24T00:47:00.888587719Z [2024-02-24T00:47:00.888+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T00:47:02.043308736Z [2024-02-24T00:47:02.042+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:47:02.043658080Z [2024-02-24T00:47:02.043+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:46:00+00:00, run_id=scheduled__2024-02-24T00:46:00+00:00, run_start_date=2024-02-24 00:47:00.559482+00:00, run_end_date=2024-02-24 00:47:02.043257+00:00, run_duration=1.483775, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:46:00+00:00, data_interval_end=2024-02-24 00:47:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:47:02.063499832Z [2024-02-24T00:47:02.063+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:47:00+00:00, run_after=2024-02-24T00:48:00+00:00 2024-02-24T00:47:02.125919190Z [2024-02-24T00:47:02.125+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:46:00+00:00 exited with status success for try_number 1 2024-02-24T00:47:02.134938149Z [2024-02-24T00:47:02.134+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:46:00+00:00, map_index=-1, run_start_date=2024-02-24 00:47:01.397764+00:00, run_end_date=2024-02-24 00:47:01.759684+00:00, run_duration=0.36192, state=success, executor_state=success, try_number=1, max_tries=1, job_id=342, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:47:00.630718+00:00, queued_by_job_id=2, pid=5059 2024-02-24T00:47:04.303441811Z [2024-02-24T00:47:04.303+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:47:04.303882343Z [2024-02-24T00:47:04.303+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:46:00+00:00, run_id=scheduled__2024-02-24T00:46:00+00:00, run_start_date=2024-02-24 00:47:00.560713+00:00, run_end_date=2024-02-24 00:47:04.303351+00:00, run_duration=3.742638, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:46:00+00:00, data_interval_end=2024-02-24 00:47:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:47:04.315512400Z [2024-02-24T00:47:04.315+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:47:00+00:00, run_after=2024-02-24T00:48:00+00:00 2024-02-24T00:47:04.367137208Z [2024-02-24T00:47:04.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:46:00+00:00 exited with status success for try_number 1 2024-02-24T00:47:04.374187933Z [2024-02-24T00:47:04.373+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:46:00+00:00, map_index=-1, run_start_date=2024-02-24 00:47:02.519861+00:00, run_end_date=2024-02-24 00:47:03.849346+00:00, run_duration=1.329485, state=success, executor_state=success, try_number=1, max_tries=1, job_id=344, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:47:00.630718+00:00, queued_by_job_id=2, pid=5078 2024-02-24T00:47:05.438300541Z [2024-02-24T00:47:05.437+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:47:05.438671075Z [2024-02-24T00:47:05.438+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:46:00+00:00, run_id=scheduled__2024-02-24T00:46:00+00:00, run_start_date=2024-02-24 00:47:00.561795+00:00, run_end_date=2024-02-24 00:47:05.438322+00:00, run_duration=4.876527, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:46:00+00:00, data_interval_end=2024-02-24 00:47:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:47:05.451545110Z [2024-02-24T00:47:05.451+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:47:00+00:00, run_after=2024-02-24T00:48:00+00:00 2024-02-24T00:47:05.493878880Z [2024-02-24T00:47:05.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:46:00+00:00 exited with status success for try_number 1 2024-02-24T00:47:05.504158389Z [2024-02-24T00:47:05.503+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:46:00+00:00, map_index=-1, run_start_date=2024-02-24 00:47:02.501513+00:00, run_end_date=2024-02-24 00:47:04.315324+00:00, run_duration=1.813811, state=success, executor_state=success, try_number=1, max_tries=1, job_id=343, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:47:00.630718+00:00, queued_by_job_id=2, pid=5077 2024-02-24T00:48:00.981526760Z [2024-02-24T00:48:00.981+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:48:00+00:00, run_after=2024-02-24T00:49:00+00:00 2024-02-24T00:48:00.988493069Z [2024-02-24T00:48:00.988+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:48:00.999751046Z [2024-02-24T00:48:00.999+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:48:00+00:00, run_after=2024-02-24T00:49:00+00:00 2024-02-24T00:48:01.006618389Z [2024-02-24T00:48:01.006+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:48:01.101490879Z [2024-02-24T00:48:01.100+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T00:48:01.101528280Z 2024-02-24T00:48:01.101535386Z 2024-02-24T00:48:01.101540631Z 2024-02-24T00:48:01.101563650Z 2024-02-24T00:48:01.101894043Z [2024-02-24T00:48:01.101+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T00:48:01.102153896Z [2024-02-24T00:48:01.101+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:48:01.103867646Z [2024-02-24T00:48:01.102+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:48:01.104179837Z [2024-02-24T00:48:01.103+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:48:01.105600648Z [2024-02-24T00:48:01.105+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:48:01.105616706Z 2024-02-24T00:48:01.105622742Z 2024-02-24T00:48:01.105627844Z 2024-02-24T00:48:01.105633277Z 2024-02-24T00:48:01.112676776Z [2024-02-24T00:48:01.112+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:48:01.113200874Z [2024-02-24T00:48:01.112+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T00:48:01.115390542Z [2024-02-24T00:48:01.112+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:48:01.115675026Z [2024-02-24T00:48:01.115+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:48:01.115983078Z [2024-02-24T00:48:01.115+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:48:01.116182558Z [2024-02-24T00:48:01.115+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:48:01.116828775Z [2024-02-24T00:48:01.116+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:48:01.116956776Z [2024-02-24T00:48:01.116+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:48:01.485572987Z [2024-02-24T00:48:01.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:46:00+00:00 exited with status queued for try_number 1 2024-02-24T00:48:01.485765689Z [2024-02-24T00:48:01.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:47:00+00:00 exited with status queued for try_number 1 2024-02-24T00:48:01.485943522Z [2024-02-24T00:48:01.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:47:00+00:00 exited with status queued for try_number 1 2024-02-24T00:48:01.486119713Z [2024-02-24T00:48:01.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:47:00+00:00 exited with status queued for try_number 1 2024-02-24T00:48:01.496695474Z [2024-02-24T00:48:01.496+0000] {scheduler_job.py:635} INFO - Setting external_id for to 78ca8d24-d1b4-4186-8ce3-119c11d843ba 2024-02-24T00:48:01.496972876Z [2024-02-24T00:48:01.496+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ac8c009-5aa8-478d-a6e3-868a6a4b30e5 2024-02-24T00:48:01.497214914Z [2024-02-24T00:48:01.497+0000] {scheduler_job.py:635} INFO - Setting external_id for to f30eed31-f0c5-4765-98c7-47f007377536 2024-02-24T00:48:01.497488717Z [2024-02-24T00:48:01.497+0000] {scheduler_job.py:635} INFO - Setting external_id for to 004b50ec-c688-4f57-9d55-5a62ea67d14a 2024-02-24T00:48:03.068909087Z [2024-02-24T00:48:03.068+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:48:03.069638283Z [2024-02-24T00:48:03.069+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 00:46:00+00:00, run_id=scheduled__2024-02-24T00:46:00+00:00, run_start_date=2024-02-24 00:48:01.019125+00:00, run_end_date=2024-02-24 00:48:03.069037+00:00, run_duration=2.049912, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:46:00+00:00, data_interval_end=2024-02-24 00:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T00:48:03.085828991Z [2024-02-24T00:48:03.085+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T00:48:00+00:00, run_after=2024-02-24T00:50:00+00:00 2024-02-24T00:48:03.096284841Z [2024-02-24T00:48:03.095+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:48:03.096710633Z [2024-02-24T00:48:03.096+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:47:00+00:00, run_id=scheduled__2024-02-24T00:47:00+00:00, run_start_date=2024-02-24 00:48:01.020497+00:00, run_end_date=2024-02-24 00:48:03.096147+00:00, run_duration=2.07565, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:47:00+00:00, data_interval_end=2024-02-24 00:48:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:48:03.107770774Z [2024-02-24T00:48:03.107+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:48:00+00:00, run_after=2024-02-24T00:49:00+00:00 2024-02-24T00:48:03.173108145Z [2024-02-24T00:48:03.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:46:00+00:00 exited with status success for try_number 1 2024-02-24T00:48:03.173446422Z [2024-02-24T00:48:03.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:47:00+00:00 exited with status success for try_number 1 2024-02-24T00:48:03.183824255Z [2024-02-24T00:48:03.183+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T00:46:00+00:00, map_index=-1, run_start_date=2024-02-24 00:48:02.054613+00:00, run_end_date=2024-02-24 00:48:02.580567+00:00, run_duration=0.525954, state=success, executor_state=success, try_number=1, max_tries=1, job_id=346, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:48:01.108993+00:00, queued_by_job_id=2, pid=5112 2024-02-24T00:48:03.183847788Z [2024-02-24T00:48:03.183+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:47:00+00:00, map_index=-1, run_start_date=2024-02-24 00:48:01.992696+00:00, run_end_date=2024-02-24 00:48:02.561628+00:00, run_duration=0.568932, state=success, executor_state=success, try_number=1, max_tries=1, job_id=345, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:48:01.108993+00:00, queued_by_job_id=2, pid=5111 2024-02-24T00:48:05.351110368Z [2024-02-24T00:48:05.350+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:48:05.351533539Z [2024-02-24T00:48:05.351+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:47:00+00:00, run_id=scheduled__2024-02-24T00:47:00+00:00, run_start_date=2024-02-24 00:48:01.022882+00:00, run_end_date=2024-02-24 00:48:05.351102+00:00, run_duration=4.32822, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:47:00+00:00, data_interval_end=2024-02-24 00:48:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:48:05.361651518Z [2024-02-24T00:48:05.361+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:48:00+00:00, run_after=2024-02-24T00:49:00+00:00 2024-02-24T00:48:05.368762127Z [2024-02-24T00:48:05.368+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:48:05.369084880Z [2024-02-24T00:48:05.368+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:47:00+00:00, run_id=scheduled__2024-02-24T00:47:00+00:00, run_start_date=2024-02-24 00:48:01.021813+00:00, run_end_date=2024-02-24 00:48:05.368740+00:00, run_duration=4.346927, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:47:00+00:00, data_interval_end=2024-02-24 00:48:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:48:05.378332124Z [2024-02-24T00:48:05.378+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:48:00+00:00, run_after=2024-02-24T00:49:00+00:00 2024-02-24T00:48:05.419299723Z [2024-02-24T00:48:05.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:47:00+00:00 exited with status success for try_number 1 2024-02-24T00:48:05.419453063Z [2024-02-24T00:48:05.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:47:00+00:00 exited with status success for try_number 1 2024-02-24T00:48:05.427597339Z [2024-02-24T00:48:05.427+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:47:00+00:00, map_index=-1, run_start_date=2024-02-24 00:48:03.317202+00:00, run_end_date=2024-02-24 00:48:05.013430+00:00, run_duration=1.696228, state=success, executor_state=success, try_number=1, max_tries=1, job_id=347, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:48:01.108993+00:00, queued_by_job_id=2, pid=5135 2024-02-24T00:48:05.428019197Z [2024-02-24T00:48:05.427+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:47:00+00:00, map_index=-1, run_start_date=2024-02-24 00:48:03.456553+00:00, run_end_date=2024-02-24 00:48:04.980644+00:00, run_duration=1.524091, state=success, executor_state=success, try_number=1, max_tries=1, job_id=348, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:48:01.108993+00:00, queued_by_job_id=2, pid=5136 2024-02-24T00:49:00.989067951Z [2024-02-24T00:49:00.988+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:49:00+00:00, run_after=2024-02-24T00:50:00+00:00 2024-02-24T00:49:01.007139630Z [2024-02-24T00:49:01.006+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:49:00+00:00, run_after=2024-02-24T00:50:00+00:00 2024-02-24T00:49:01.015320470Z [2024-02-24T00:49:01.014+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:49:01.135150178Z [2024-02-24T00:49:01.134+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T00:49:01.135183504Z 2024-02-24T00:49:01.135190542Z 2024-02-24T00:49:01.135195980Z 2024-02-24T00:49:01.135201563Z [2024-02-24T00:49:01.135+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:49:01.138135844Z [2024-02-24T00:49:01.135+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:49:01.138172385Z [2024-02-24T00:49:01.138+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:49:01.138889810Z [2024-02-24T00:49:01.138+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:49:01.138906997Z 2024-02-24T00:49:01.138918341Z 2024-02-24T00:49:01.138928513Z 2024-02-24T00:49:01.143355450Z [2024-02-24T00:49:01.142+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:49:01.143387511Z [2024-02-24T00:49:01.143+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:49:01.143729035Z [2024-02-24T00:49:01.143+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:49:01.143814636Z [2024-02-24T00:49:01.143+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:49:01.144060158Z [2024-02-24T00:49:01.143+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:49:01.144141186Z [2024-02-24T00:49:01.143+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:49:01.452438195Z [2024-02-24T00:49:01.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:48:00+00:00 exited with status queued for try_number 1 2024-02-24T00:49:01.452527469Z [2024-02-24T00:49:01.452+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:48:00+00:00 exited with status queued for try_number 1 2024-02-24T00:49:01.452533377Z [2024-02-24T00:49:01.452+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:48:00+00:00 exited with status queued for try_number 1 2024-02-24T00:49:01.463661581Z [2024-02-24T00:49:01.463+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5432cae3-6d28-4624-87c0-cd46b03b61c7 2024-02-24T00:49:01.463758618Z [2024-02-24T00:49:01.463+0000] {scheduler_job.py:635} INFO - Setting external_id for to ccb3606f-a68e-4d05-b169-0f841ca5a738 2024-02-24T00:49:01.463803699Z [2024-02-24T00:49:01.463+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30a69216-a976-43e3-8330-2bcc9c299ce7 2024-02-24T00:49:02.620400292Z [2024-02-24T00:49:02.619+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:49:02.621038606Z [2024-02-24T00:49:02.620+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:48:00+00:00, run_id=scheduled__2024-02-24T00:48:00+00:00, run_start_date=2024-02-24 00:49:01.035042+00:00, run_end_date=2024-02-24 00:49:02.620475+00:00, run_duration=1.585433, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:48:00+00:00, data_interval_end=2024-02-24 00:49:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:49:02.639927237Z [2024-02-24T00:49:02.639+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:49:00+00:00, run_after=2024-02-24T00:50:00+00:00 2024-02-24T00:49:02.690332619Z [2024-02-24T00:49:02.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:48:00+00:00 exited with status success for try_number 1 2024-02-24T00:49:02.699805091Z [2024-02-24T00:49:02.698+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:48:00+00:00, map_index=-1, run_start_date=2024-02-24 00:49:01.994038+00:00, run_end_date=2024-02-24 00:49:02.440738+00:00, run_duration=0.4467, state=success, executor_state=success, try_number=1, max_tries=1, job_id=349, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:49:01.139630+00:00, queued_by_job_id=2, pid=5168 2024-02-24T00:49:05.132268317Z [2024-02-24T00:49:05.131+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:49:05.132314604Z [2024-02-24T00:49:05.132+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:48:00+00:00, run_id=scheduled__2024-02-24T00:48:00+00:00, run_start_date=2024-02-24 00:49:01.038041+00:00, run_end_date=2024-02-24 00:49:05.131975+00:00, run_duration=4.093934, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:48:00+00:00, data_interval_end=2024-02-24 00:49:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:49:05.142541668Z [2024-02-24T00:49:05.142+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:49:00+00:00, run_after=2024-02-24T00:50:00+00:00 2024-02-24T00:49:05.182688836Z [2024-02-24T00:49:05.182+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:48:00+00:00 exited with status success for try_number 1 2024-02-24T00:49:05.188912395Z [2024-02-24T00:49:05.188+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:48:00+00:00, map_index=-1, run_start_date=2024-02-24 00:49:03.078446+00:00, run_end_date=2024-02-24 00:49:04.997213+00:00, run_duration=1.918767, state=success, executor_state=success, try_number=1, max_tries=1, job_id=350, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:49:01.139630+00:00, queued_by_job_id=2, pid=5186 2024-02-24T00:49:06.248555539Z [2024-02-24T00:49:06.247+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:49:06.249211730Z [2024-02-24T00:49:06.248+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:48:00+00:00, run_id=scheduled__2024-02-24T00:48:00+00:00, run_start_date=2024-02-24 00:49:01.041098+00:00, run_end_date=2024-02-24 00:49:06.248428+00:00, run_duration=5.20733, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:48:00+00:00, data_interval_end=2024-02-24 00:49:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:49:06.265353804Z [2024-02-24T00:49:06.264+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:49:00+00:00, run_after=2024-02-24T00:50:00+00:00 2024-02-24T00:49:06.309121735Z [2024-02-24T00:49:06.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:48:00+00:00 exited with status success for try_number 1 2024-02-24T00:49:06.318671044Z [2024-02-24T00:49:06.318+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:48:00+00:00, map_index=-1, run_start_date=2024-02-24 00:49:03.184346+00:00, run_end_date=2024-02-24 00:49:05.706460+00:00, run_duration=2.522114, state=success, executor_state=success, try_number=1, max_tries=1, job_id=351, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:49:01.139630+00:00, queued_by_job_id=2, pid=5187 2024-02-24T00:50:00.879005441Z [2024-02-24T00:50:00.878+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:50:00+00:00, run_after=2024-02-24T00:51:00+00:00 2024-02-24T00:50:00.891249542Z [2024-02-24T00:50:00.890+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:50:00+00:00, run_after=2024-02-24T00:51:00+00:00 2024-02-24T00:50:00.904809360Z [2024-02-24T00:50:00.904+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:50:00.912944109Z [2024-02-24T00:50:00.912+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:50:00.923964555Z [2024-02-24T00:50:00.923+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:50:00+00:00, run_after=2024-02-24T00:55:00+00:00 2024-02-24T00:50:01.091709575Z [2024-02-24T00:50:01.091+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-02-24T00:50:01.091753431Z 2024-02-24T00:50:01.091762798Z 2024-02-24T00:50:01.091790842Z 2024-02-24T00:50:01.091800180Z 2024-02-24T00:50:01.091809938Z 2024-02-24T00:50:01.091818686Z [2024-02-24T00:50:01.091+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:50:01.091938774Z [2024-02-24T00:50:01.091+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T00:50:01.092238652Z [2024-02-24T00:50:01.091+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:50:01.092490231Z [2024-02-24T00:50:01.092+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:50:01.092810831Z [2024-02-24T00:50:01.092+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:50:01.093903398Z [2024-02-24T00:50:01.093+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:50:01.093921457Z 2024-02-24T00:50:01.093927251Z 2024-02-24T00:50:01.093932740Z 2024-02-24T00:50:01.093938156Z 2024-02-24T00:50:01.093943649Z 2024-02-24T00:50:01.099999039Z [2024-02-24T00:50:01.099+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T00:50:01.100052640Z [2024-02-24T00:50:01.099+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:50:01.100466111Z [2024-02-24T00:50:01.100+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:50:01.100527013Z [2024-02-24T00:50:01.100+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T00:50:01.100784245Z [2024-02-24T00:50:01.100+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:50:01.101015647Z [2024-02-24T00:50:01.100+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:50:01.101400648Z [2024-02-24T00:50:01.101+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:50:01.101550629Z [2024-02-24T00:50:01.101+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:50:01.102001863Z [2024-02-24T00:50:01.101+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:50:01.102013937Z [2024-02-24T00:50:01.101+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:50:01.863018943Z [2024-02-24T00:50:01.862+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T00:45:00+00:00 exited with status queued for try_number 1 2024-02-24T00:50:01.863067999Z [2024-02-24T00:50:01.862+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:48:00+00:00 exited with status queued for try_number 1 2024-02-24T00:50:01.863106201Z [2024-02-24T00:50:01.862+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:49:00+00:00 exited with status queued for try_number 1 2024-02-24T00:50:01.863160265Z [2024-02-24T00:50:01.863+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:49:00+00:00 exited with status queued for try_number 1 2024-02-24T00:50:01.863245480Z [2024-02-24T00:50:01.863+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:49:00+00:00 exited with status queued for try_number 1 2024-02-24T00:50:01.889834548Z [2024-02-24T00:50:01.889+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c8c8c79-5c9b-40a0-af71-7a580ad0a9c6 2024-02-24T00:50:01.890169303Z [2024-02-24T00:50:01.889+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a9a2324-88cd-4b11-86bb-3b38dd3f2ec6 2024-02-24T00:50:01.890380174Z [2024-02-24T00:50:01.890+0000] {scheduler_job.py:635} INFO - Setting external_id for to 340662af-a42b-4108-bfe7-13db97e100e5 2024-02-24T00:50:01.890579573Z [2024-02-24T00:50:01.890+0000] {scheduler_job.py:635} INFO - Setting external_id for to da6d58a9-fb47-45c0-895a-7c5f502028a4 2024-02-24T00:50:01.890785224Z [2024-02-24T00:50:01.890+0000] {scheduler_job.py:635} INFO - Setting external_id for to 177bf368-55bb-4802-a3c3-647dbc566a49 2024-02-24T00:50:03.222339303Z [2024-02-24T00:50:03.221+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:50:03.222978326Z [2024-02-24T00:50:03.222+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 00:48:00+00:00, run_id=scheduled__2024-02-24T00:48:00+00:00, run_start_date=2024-02-24 00:50:00.951673+00:00, run_end_date=2024-02-24 00:50:03.222585+00:00, run_duration=2.270912, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:48:00+00:00, data_interval_end=2024-02-24 00:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T00:50:03.234770208Z [2024-02-24T00:50:03.234+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T00:50:00+00:00, run_after=2024-02-24T00:52:00+00:00 2024-02-24T00:50:03.244126596Z [2024-02-24T00:50:03.243+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:50:03.244645620Z [2024-02-24T00:50:03.244+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:49:00+00:00, run_id=scheduled__2024-02-24T00:49:00+00:00, run_start_date=2024-02-24 00:50:00.953962+00:00, run_end_date=2024-02-24 00:50:03.244310+00:00, run_duration=2.290348, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:49:00+00:00, data_interval_end=2024-02-24 00:50:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:50:03.255950548Z [2024-02-24T00:50:03.255+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:50:00+00:00, run_after=2024-02-24T00:51:00+00:00 2024-02-24T00:50:03.326820362Z [2024-02-24T00:50:03.326+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:48:00+00:00 exited with status success for try_number 1 2024-02-24T00:50:03.326847604Z [2024-02-24T00:50:03.326+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:49:00+00:00 exited with status success for try_number 1 2024-02-24T00:50:03.343625740Z [2024-02-24T00:50:03.343+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:49:00+00:00, map_index=-1, run_start_date=2024-02-24 00:50:02.284509+00:00, run_end_date=2024-02-24 00:50:02.840516+00:00, run_duration=0.556007, state=success, executor_state=success, try_number=1, max_tries=1, job_id=352, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:50:01.095507+00:00, queued_by_job_id=2, pid=5223 2024-02-24T00:50:03.343799144Z [2024-02-24T00:50:03.343+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T00:48:00+00:00, map_index=-1, run_start_date=2024-02-24 00:50:02.360164+00:00, run_end_date=2024-02-24 00:50:02.978746+00:00, run_duration=0.618582, state=success, executor_state=success, try_number=1, max_tries=1, job_id=353, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:50:01.095507+00:00, queued_by_job_id=2, pid=5224 2024-02-24T00:50:03.938412754Z [2024-02-24T00:50:03.937+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T00:50:03.938430407Z 2024-02-24T00:50:03.938479056Z [2024-02-24T00:50:03.938+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:50:03.939182735Z [2024-02-24T00:50:03.938+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:50:03.939197699Z 2024-02-24T00:50:03.944492932Z [2024-02-24T00:50:03.944+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T00:50:03.944531333Z [2024-02-24T00:50:03.944+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:50:04.062222257Z [2024-02-24T00:50:04.061+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T00:45:00+00:00 exited with status queued for try_number 1 2024-02-24T00:50:04.062255304Z [2024-02-24T00:50:04.062+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T00:45:00+00:00 exited with status success for try_number 1 2024-02-24T00:50:04.070055331Z [2024-02-24T00:50:04.069+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9631e48a-d81f-4f1d-9c8e-8ab8c56882f0 2024-02-24T00:50:04.070198344Z [2024-02-24T00:50:04.070+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T00:45:00+00:00, map_index=-1, run_start_date=2024-02-24 00:50:03.247009+00:00, run_end_date=2024-02-24 00:50:03.674981+00:00, run_duration=0.427972, state=success, executor_state=success, try_number=1, max_tries=1, job_id=354, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:50:01.095507+00:00, queued_by_job_id=2, pid=5247 2024-02-24T00:50:06.361410524Z [2024-02-24T00:50:06.360+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:50:06.361931661Z [2024-02-24T00:50:06.361+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:49:00+00:00, run_id=scheduled__2024-02-24T00:49:00+00:00, run_start_date=2024-02-24 00:50:00.955924+00:00, run_end_date=2024-02-24 00:50:06.361324+00:00, run_duration=5.4054, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:49:00+00:00, data_interval_end=2024-02-24 00:50:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:50:06.381377931Z [2024-02-24T00:50:06.380+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:50:00+00:00, run_after=2024-02-24T00:51:00+00:00 2024-02-24T00:50:06.394051434Z [2024-02-24T00:50:06.393+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:50:06.394691718Z [2024-02-24T00:50:06.394+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:49:00+00:00, run_id=scheduled__2024-02-24T00:49:00+00:00, run_start_date=2024-02-24 00:50:00.957700+00:00, run_end_date=2024-02-24 00:50:06.393885+00:00, run_duration=5.436185, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:49:00+00:00, data_interval_end=2024-02-24 00:50:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:50:06.411719943Z [2024-02-24T00:50:06.411+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:50:00+00:00, run_after=2024-02-24T00:51:00+00:00 2024-02-24T00:50:06.460363454Z [2024-02-24T00:50:06.459+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T00:50:06.460397593Z 2024-02-24T00:50:06.460555152Z [2024-02-24T00:50:06.460+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:50:06.461181279Z [2024-02-24T00:50:06.460+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:50:06.461192717Z 2024-02-24T00:50:06.464678931Z [2024-02-24T00:50:06.464+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T00:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T00:50:06.464953357Z [2024-02-24T00:50:06.464+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T00:50:06.525087815Z [2024-02-24T00:50:06.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T00:45:00+00:00 exited with status queued for try_number 1 2024-02-24T00:50:06.525159952Z [2024-02-24T00:50:06.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:49:00+00:00 exited with status success for try_number 1 2024-02-24T00:50:06.525340230Z [2024-02-24T00:50:06.525+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:49:00+00:00 exited with status success for try_number 1 2024-02-24T00:50:06.525454397Z [2024-02-24T00:50:06.525+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T00:45:00+00:00 exited with status success for try_number 1 2024-02-24T00:50:06.535217176Z [2024-02-24T00:50:06.534+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T00:45:00+00:00, map_index=-1, run_start_date=2024-02-24 00:50:05.653561+00:00, run_end_date=2024-02-24 00:50:06.072194+00:00, run_duration=0.418633, state=success, executor_state=success, try_number=1, max_tries=1, job_id=357, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:50:03.940819+00:00, queued_by_job_id=2, pid=5277 2024-02-24T00:50:06.535400558Z [2024-02-24T00:50:06.535+0000] {scheduler_job.py:635} INFO - Setting external_id for to e7e8b880-08c0-47e7-84e1-6400b504fb9f 2024-02-24T00:50:06.535683055Z [2024-02-24T00:50:06.535+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:49:00+00:00, map_index=-1, run_start_date=2024-02-24 00:50:03.987340+00:00, run_end_date=2024-02-24 00:50:05.553459+00:00, run_duration=1.566119, state=success, executor_state=success, try_number=1, max_tries=1, job_id=356, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:50:01.095507+00:00, queued_by_job_id=2, pid=5265 2024-02-24T00:50:06.535945009Z [2024-02-24T00:50:06.535+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:49:00+00:00, map_index=-1, run_start_date=2024-02-24 00:50:03.443735+00:00, run_end_date=2024-02-24 00:50:05.941264+00:00, run_duration=2.497529, state=success, executor_state=success, try_number=1, max_tries=1, job_id=355, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:50:01.095507+00:00, queued_by_job_id=2, pid=5248 2024-02-24T00:50:08.750826329Z [2024-02-24T00:50:08.750+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T00:50:08.750983693Z 2024-02-24T00:50:08.751042427Z [2024-02-24T00:50:08.750+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:50:08.751737742Z [2024-02-24T00:50:08.751+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:50:08.751768395Z 2024-02-24T00:50:08.754619535Z [2024-02-24T00:50:08.754+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:50:08.754841032Z [2024-02-24T00:50:08.754+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:50:08.829311049Z [2024-02-24T00:50:08.828+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T00:45:00+00:00 exited with status queued for try_number 1 2024-02-24T00:50:08.829354945Z [2024-02-24T00:50:08.828+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T00:45:00+00:00 exited with status success for try_number 1 2024-02-24T00:50:08.837597523Z [2024-02-24T00:50:08.837+0000] {scheduler_job.py:635} INFO - Setting external_id for to 91b73480-3e61-4f90-bde6-83afdd9d81a6 2024-02-24T00:50:08.838091352Z [2024-02-24T00:50:08.837+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T00:45:00+00:00, map_index=0, run_start_date=2024-02-24 00:50:08.064939+00:00, run_end_date=2024-02-24 00:50:08.461469+00:00, run_duration=0.39653, state=success, executor_state=success, try_number=1, max_tries=1, job_id=358, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:50:06.461688+00:00, queued_by_job_id=2, pid=5285 2024-02-24T00:50:11.418764841Z [2024-02-24T00:50:11.418+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:50:11.419012031Z [2024-02-24T00:50:11.418+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:45:00+00:00, run_id=scheduled__2024-02-24T00:45:00+00:00, run_start_date=2024-02-24 00:50:00.949130+00:00, run_end_date=2024-02-24 00:50:11.418511+00:00, run_duration=10.469381, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:45:00+00:00, data_interval_end=2024-02-24 00:50:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T00:50:11.428963666Z [2024-02-24T00:50:11.428+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:50:00+00:00, run_after=2024-02-24T00:55:00+00:00 2024-02-24T00:50:11.476622009Z [2024-02-24T00:50:11.476+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T00:45:00+00:00 exited with status success for try_number 1 2024-02-24T00:50:11.486937577Z [2024-02-24T00:50:11.486+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T00:45:00+00:00, map_index=-1, run_start_date=2024-02-24 00:50:10.412245+00:00, run_end_date=2024-02-24 00:50:10.811321+00:00, run_duration=0.399076, state=success, executor_state=success, try_number=1, max_tries=1, job_id=359, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:50:08.752125+00:00, queued_by_job_id=2, pid=5293 2024-02-24T00:51:01.087878017Z [2024-02-24T00:51:01.087+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:51:01.103779928Z [2024-02-24T00:51:01.103+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:51:00+00:00, run_after=2024-02-24T00:52:00+00:00 2024-02-24T00:51:01.117319668Z [2024-02-24T00:51:01.116+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:51:00+00:00, run_after=2024-02-24T00:52:00+00:00 2024-02-24T00:51:01.220117268Z [2024-02-24T00:51:01.219+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T00:51:01.220152655Z 2024-02-24T00:51:01.220157672Z 2024-02-24T00:51:01.220162015Z 2024-02-24T00:51:01.221692572Z [2024-02-24T00:51:01.220+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:51:01.222011616Z [2024-02-24T00:51:01.221+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:51:01.222153905Z [2024-02-24T00:51:01.221+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:51:01.222956136Z [2024-02-24T00:51:01.222+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:51:01.222968271Z 2024-02-24T00:51:01.222972836Z 2024-02-24T00:51:01.222977345Z 2024-02-24T00:51:01.228123672Z [2024-02-24T00:51:01.226+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:51:01.228144383Z [2024-02-24T00:51:01.226+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:51:01.228148768Z [2024-02-24T00:51:01.227+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:51:01.228152852Z [2024-02-24T00:51:01.227+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:51:01.228183882Z [2024-02-24T00:51:01.227+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:51:01.228187912Z [2024-02-24T00:51:01.227+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:51:01.485451289Z [2024-02-24T00:51:01.484+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:50:00+00:00 exited with status queued for try_number 1 2024-02-24T00:51:01.490306994Z [2024-02-24T00:51:01.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:50:00+00:00 exited with status queued for try_number 1 2024-02-24T00:51:01.490582100Z [2024-02-24T00:51:01.490+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:50:00+00:00 exited with status queued for try_number 1 2024-02-24T00:51:01.499914240Z [2024-02-24T00:51:01.499+0000] {scheduler_job.py:635} INFO - Setting external_id for to b83099ed-68ee-44f3-bf86-3c6671ee8c81 2024-02-24T00:51:01.500251827Z [2024-02-24T00:51:01.500+0000] {scheduler_job.py:635} INFO - Setting external_id for to 913bbbc3-a890-4db8-b243-f582c91cdc2c 2024-02-24T00:51:01.500500223Z [2024-02-24T00:51:01.500+0000] {scheduler_job.py:635} INFO - Setting external_id for to b2acc364-055b-4deb-96c5-2c50f17f84d8 2024-02-24T00:51:02.710217438Z [2024-02-24T00:51:02.709+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:51:02.710745159Z [2024-02-24T00:51:02.710+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:50:00+00:00, run_id=scheduled__2024-02-24T00:50:00+00:00, run_start_date=2024-02-24 00:51:01.130758+00:00, run_end_date=2024-02-24 00:51:02.710159+00:00, run_duration=1.579401, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:50:00+00:00, data_interval_end=2024-02-24 00:51:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:51:02.722277091Z [2024-02-24T00:51:02.721+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:51:00+00:00, run_after=2024-02-24T00:52:00+00:00 2024-02-24T00:51:02.806865850Z [2024-02-24T00:51:02.806+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:50:00+00:00 exited with status success for try_number 1 2024-02-24T00:51:02.812470925Z [2024-02-24T00:51:02.812+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:50:00+00:00, map_index=-1, run_start_date=2024-02-24 00:51:02.008703+00:00, run_end_date=2024-02-24 00:51:02.410448+00:00, run_duration=0.401745, state=success, executor_state=success, try_number=1, max_tries=1, job_id=360, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:51:01.223900+00:00, queued_by_job_id=2, pid=5315 2024-02-24T00:51:05.097015240Z [2024-02-24T00:51:05.096+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:51:05.097585701Z [2024-02-24T00:51:05.097+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:50:00+00:00, run_id=scheduled__2024-02-24T00:50:00+00:00, run_start_date=2024-02-24 00:51:01.132222+00:00, run_end_date=2024-02-24 00:51:05.096907+00:00, run_duration=3.964685, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:50:00+00:00, data_interval_end=2024-02-24 00:51:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:51:05.107810316Z [2024-02-24T00:51:05.107+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:51:00+00:00, run_after=2024-02-24T00:52:00+00:00 2024-02-24T00:51:05.163589526Z [2024-02-24T00:51:05.163+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:50:00+00:00 exited with status success for try_number 1 2024-02-24T00:51:05.171121325Z [2024-02-24T00:51:05.170+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:50:00+00:00, map_index=-1, run_start_date=2024-02-24 00:51:03.234276+00:00, run_end_date=2024-02-24 00:51:04.829425+00:00, run_duration=1.595149, state=success, executor_state=success, try_number=1, max_tries=1, job_id=362, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:51:01.223900+00:00, queued_by_job_id=2, pid=5334 2024-02-24T00:51:06.257494768Z [2024-02-24T00:51:06.256+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:51:06.258176694Z [2024-02-24T00:51:06.257+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:50:00+00:00, run_id=scheduled__2024-02-24T00:50:00+00:00, run_start_date=2024-02-24 00:51:01.133605+00:00, run_end_date=2024-02-24 00:51:06.257365+00:00, run_duration=5.12376, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:50:00+00:00, data_interval_end=2024-02-24 00:51:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:51:06.276397869Z [2024-02-24T00:51:06.275+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:51:00+00:00, run_after=2024-02-24T00:52:00+00:00 2024-02-24T00:51:06.312593934Z [2024-02-24T00:51:06.312+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:50:00+00:00 exited with status success for try_number 1 2024-02-24T00:51:06.317679169Z [2024-02-24T00:51:06.317+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:50:00+00:00, map_index=-1, run_start_date=2024-02-24 00:51:03.068488+00:00, run_end_date=2024-02-24 00:51:05.455135+00:00, run_duration=2.386647, state=success, executor_state=success, try_number=1, max_tries=1, job_id=361, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:51:01.223900+00:00, queued_by_job_id=2, pid=5333 2024-02-24T00:52:00.942602369Z [2024-02-24T00:52:00.942+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:52:00+00:00, run_after=2024-02-24T00:53:00+00:00 2024-02-24T00:52:00.954575341Z [2024-02-24T00:52:00.954+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:52:00.966290007Z [2024-02-24T00:52:00.965+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:52:00.988941887Z [2024-02-24T00:52:00.988+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:52:00+00:00, run_after=2024-02-24T00:53:00+00:00 2024-02-24T00:52:01.105606508Z [2024-02-24T00:52:01.105+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T00:52:01.105632757Z 2024-02-24T00:52:01.105636841Z 2024-02-24T00:52:01.105640356Z 2024-02-24T00:52:01.105644080Z 2024-02-24T00:52:01.105941834Z [2024-02-24T00:52:01.105+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T00:52:01.106173018Z [2024-02-24T00:52:01.106+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:52:01.106369565Z [2024-02-24T00:52:01.106+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:52:01.106664704Z [2024-02-24T00:52:01.106+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:52:01.107376138Z [2024-02-24T00:52:01.107+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:52:01.107390826Z 2024-02-24T00:52:01.107395536Z 2024-02-24T00:52:01.107400150Z 2024-02-24T00:52:01.107404598Z 2024-02-24T00:52:01.112186950Z [2024-02-24T00:52:01.111+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:52:01.112592199Z [2024-02-24T00:52:01.112+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T00:52:01.113020795Z [2024-02-24T00:52:01.112+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:52:01.113331493Z [2024-02-24T00:52:01.113+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:52:01.113828935Z [2024-02-24T00:52:01.113+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:52:01.114944024Z [2024-02-24T00:52:01.114+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:52:01.115416307Z [2024-02-24T00:52:01.115+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:52:01.116338434Z [2024-02-24T00:52:01.115+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:52:01.570283350Z [2024-02-24T00:52:01.567+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:50:00+00:00 exited with status queued for try_number 1 2024-02-24T00:52:01.570882681Z [2024-02-24T00:52:01.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:51:00+00:00 exited with status queued for try_number 1 2024-02-24T00:52:01.571284653Z [2024-02-24T00:52:01.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:51:00+00:00 exited with status queued for try_number 1 2024-02-24T00:52:01.571629196Z [2024-02-24T00:52:01.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:51:00+00:00 exited with status queued for try_number 1 2024-02-24T00:52:01.589053995Z [2024-02-24T00:52:01.588+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ae41681-fa4a-4fa9-94bd-c466155b0c5b 2024-02-24T00:52:01.589312096Z [2024-02-24T00:52:01.588+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c123589-2021-4c2d-b3ce-aa70f4b2d1ce 2024-02-24T00:52:01.589554383Z [2024-02-24T00:52:01.589+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1042acf2-87dd-4775-ac02-a6ffaab2359a 2024-02-24T00:52:01.589636629Z [2024-02-24T00:52:01.589+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7324be49-a8e9-4405-bd34-e46cbe835dd4 2024-02-24T00:52:01.618774616Z [2024-02-24T00:52:01.618+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T00:52:02.800845746Z [2024-02-24T00:52:02.800+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:52:02.801195803Z [2024-02-24T00:52:02.800+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 00:50:00+00:00, run_id=scheduled__2024-02-24T00:50:00+00:00, run_start_date=2024-02-24 00:52:01.015174+00:00, run_end_date=2024-02-24 00:52:02.800741+00:00, run_duration=1.785567, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:50:00+00:00, data_interval_end=2024-02-24 00:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T00:52:02.813320945Z [2024-02-24T00:52:02.812+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T00:52:00+00:00, run_after=2024-02-24T00:54:00+00:00 2024-02-24T00:52:02.915495627Z [2024-02-24T00:52:02.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:50:00+00:00 exited with status success for try_number 1 2024-02-24T00:52:02.926214969Z [2024-02-24T00:52:02.925+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T00:50:00+00:00, map_index=-1, run_start_date=2024-02-24 00:52:02.171959+00:00, run_end_date=2024-02-24 00:52:02.642539+00:00, run_duration=0.47058, state=success, executor_state=success, try_number=1, max_tries=1, job_id=363, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:52:01.108570+00:00, queued_by_job_id=2, pid=5367 2024-02-24T00:52:03.969912120Z [2024-02-24T00:52:03.969+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:52:03.970343800Z [2024-02-24T00:52:03.970+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:51:00+00:00, run_id=scheduled__2024-02-24T00:51:00+00:00, run_start_date=2024-02-24 00:52:01.017816+00:00, run_end_date=2024-02-24 00:52:03.969912+00:00, run_duration=2.952096, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:51:00+00:00, data_interval_end=2024-02-24 00:52:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:52:03.981600116Z [2024-02-24T00:52:03.981+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:52:00+00:00, run_after=2024-02-24T00:53:00+00:00 2024-02-24T00:52:04.055995966Z [2024-02-24T00:52:04.055+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:51:00+00:00 exited with status success for try_number 1 2024-02-24T00:52:04.070742304Z [2024-02-24T00:52:04.070+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:51:00+00:00, map_index=-1, run_start_date=2024-02-24 00:52:02.287677+00:00, run_end_date=2024-02-24 00:52:02.932154+00:00, run_duration=0.644477, state=success, executor_state=success, try_number=1, max_tries=1, job_id=364, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:52:01.108570+00:00, queued_by_job_id=2, pid=5369 2024-02-24T00:52:06.267497483Z [2024-02-24T00:52:06.267+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:52:06.267857661Z [2024-02-24T00:52:06.267+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:51:00+00:00, run_id=scheduled__2024-02-24T00:51:00+00:00, run_start_date=2024-02-24 00:52:01.019706+00:00, run_end_date=2024-02-24 00:52:06.267451+00:00, run_duration=5.247745, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:51:00+00:00, data_interval_end=2024-02-24 00:52:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:52:06.283147651Z [2024-02-24T00:52:06.282+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:52:00+00:00, run_after=2024-02-24T00:53:00+00:00 2024-02-24T00:52:06.292776852Z [2024-02-24T00:52:06.292+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:52:06.293288610Z [2024-02-24T00:52:06.293+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:51:00+00:00, run_id=scheduled__2024-02-24T00:51:00+00:00, run_start_date=2024-02-24 00:52:01.021562+00:00, run_end_date=2024-02-24 00:52:06.292912+00:00, run_duration=5.27135, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:51:00+00:00, data_interval_end=2024-02-24 00:52:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:52:06.302088644Z [2024-02-24T00:52:06.301+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:52:00+00:00, run_after=2024-02-24T00:53:00+00:00 2024-02-24T00:52:06.332653348Z [2024-02-24T00:52:06.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:51:00+00:00 exited with status success for try_number 1 2024-02-24T00:52:06.332832137Z [2024-02-24T00:52:06.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:51:00+00:00 exited with status success for try_number 1 2024-02-24T00:52:06.339154142Z [2024-02-24T00:52:06.338+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:51:00+00:00, map_index=-1, run_start_date=2024-02-24 00:52:03.609270+00:00, run_end_date=2024-02-24 00:52:05.681103+00:00, run_duration=2.071833, state=success, executor_state=success, try_number=1, max_tries=1, job_id=366, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:52:01.108570+00:00, queued_by_job_id=2, pid=5392 2024-02-24T00:52:06.339433865Z [2024-02-24T00:52:06.339+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:51:00+00:00, map_index=-1, run_start_date=2024-02-24 00:52:03.308346+00:00, run_end_date=2024-02-24 00:52:05.864883+00:00, run_duration=2.556537, state=success, executor_state=success, try_number=1, max_tries=1, job_id=365, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:52:01.108570+00:00, queued_by_job_id=2, pid=5386 2024-02-24T00:53:00.415446237Z [2024-02-24T00:53:00.414+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:53:00+00:00, run_after=2024-02-24T00:54:00+00:00 2024-02-24T00:53:00.422203631Z [2024-02-24T00:53:00.421+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:53:00.432880186Z [2024-02-24T00:53:00.432+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:53:00+00:00, run_after=2024-02-24T00:54:00+00:00 2024-02-24T00:53:00.518950677Z [2024-02-24T00:53:00.518+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T00:53:00.518985631Z 2024-02-24T00:53:00.518989723Z 2024-02-24T00:53:00.518993103Z 2024-02-24T00:53:00.519008404Z [2024-02-24T00:53:00.518+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:53:00.519047030Z [2024-02-24T00:53:00.518+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:53:00.519118764Z [2024-02-24T00:53:00.519+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:53:00.519651905Z [2024-02-24T00:53:00.519+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:53:00.519661625Z 2024-02-24T00:53:00.519665332Z 2024-02-24T00:53:00.519668430Z 2024-02-24T00:53:00.522872543Z [2024-02-24T00:53:00.522+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:53:00.523009178Z [2024-02-24T00:53:00.522+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:53:00.523244459Z [2024-02-24T00:53:00.523+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:53:00.523281708Z [2024-02-24T00:53:00.523+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:53:00.523620209Z [2024-02-24T00:53:00.523+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:53:00.523682610Z [2024-02-24T00:53:00.523+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:53:00.968528337Z [2024-02-24T00:53:00.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:52:00+00:00 exited with status queued for try_number 1 2024-02-24T00:53:00.968834157Z [2024-02-24T00:53:00.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:52:00+00:00 exited with status queued for try_number 1 2024-02-24T00:53:00.969020338Z [2024-02-24T00:53:00.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:52:00+00:00 exited with status queued for try_number 1 2024-02-24T00:53:00.990866514Z [2024-02-24T00:53:00.990+0000] {scheduler_job.py:635} INFO - Setting external_id for to 03d557f8-a233-4843-a95c-6e0da45ce244 2024-02-24T00:53:00.991328184Z [2024-02-24T00:53:00.990+0000] {scheduler_job.py:635} INFO - Setting external_id for to 74d76ba1-80d9-4a98-bf1a-5f7bfc779744 2024-02-24T00:53:00.991545411Z [2024-02-24T00:53:00.991+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9005f6c0-db18-4b71-8ddd-f768fa9b5c5d 2024-02-24T00:53:05.121724289Z [2024-02-24T00:53:05.121+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:53:05.122259230Z [2024-02-24T00:53:05.122+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:52:00+00:00, run_id=scheduled__2024-02-24T00:52:00+00:00, run_start_date=2024-02-24 00:53:00.461957+00:00, run_end_date=2024-02-24 00:53:05.121591+00:00, run_duration=4.659634, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:52:00+00:00, data_interval_end=2024-02-24 00:53:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:53:05.140518676Z [2024-02-24T00:53:05.140+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:53:00+00:00, run_after=2024-02-24T00:54:00+00:00 2024-02-24T00:53:05.180989812Z [2024-02-24T00:53:05.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:52:00+00:00 exited with status success for try_number 1 2024-02-24T00:53:05.187276793Z [2024-02-24T00:53:05.186+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:52:00+00:00, map_index=-1, run_start_date=2024-02-24 00:53:03.713143+00:00, run_end_date=2024-02-24 00:53:04.675258+00:00, run_duration=0.962115, state=success, executor_state=success, try_number=1, max_tries=1, job_id=367, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:53:00.520217+00:00, queued_by_job_id=2, pid=5426 2024-02-24T00:53:07.407197953Z [2024-02-24T00:53:07.406+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:53:07.407488908Z [2024-02-24T00:53:07.407+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:52:00+00:00, run_id=scheduled__2024-02-24T00:52:00+00:00, run_start_date=2024-02-24 00:53:00.464611+00:00, run_end_date=2024-02-24 00:53:07.406990+00:00, run_duration=6.942379, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:52:00+00:00, data_interval_end=2024-02-24 00:53:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:53:07.421598828Z [2024-02-24T00:53:07.421+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:53:00+00:00, run_after=2024-02-24T00:54:00+00:00 2024-02-24T00:53:07.474760176Z [2024-02-24T00:53:07.474+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:52:00+00:00 exited with status success for try_number 1 2024-02-24T00:53:07.480608702Z [2024-02-24T00:53:07.480+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:52:00+00:00, map_index=-1, run_start_date=2024-02-24 00:53:04.867079+00:00, run_end_date=2024-02-24 00:53:06.753647+00:00, run_duration=1.886568, state=success, executor_state=success, try_number=1, max_tries=1, job_id=368, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:53:00.520217+00:00, queued_by_job_id=2, pid=5437 2024-02-24T00:53:10.156301093Z [2024-02-24T00:53:10.155+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:53:10.157000221Z [2024-02-24T00:53:10.156+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:52:00+00:00, run_id=scheduled__2024-02-24T00:52:00+00:00, run_start_date=2024-02-24 00:53:00.466855+00:00, run_end_date=2024-02-24 00:53:10.156232+00:00, run_duration=9.689377, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:52:00+00:00, data_interval_end=2024-02-24 00:53:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:53:10.166754723Z [2024-02-24T00:53:10.166+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:53:00+00:00, run_after=2024-02-24T00:54:00+00:00 2024-02-24T00:53:10.205009590Z [2024-02-24T00:53:10.204+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:52:00+00:00 exited with status success for try_number 1 2024-02-24T00:53:10.209855223Z [2024-02-24T00:53:10.209+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:52:00+00:00, map_index=-1, run_start_date=2024-02-24 00:53:05.443344+00:00, run_end_date=2024-02-24 00:53:09.179935+00:00, run_duration=3.736591, state=success, executor_state=success, try_number=1, max_tries=1, job_id=369, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:53:00.520217+00:00, queued_by_job_id=2, pid=5448 2024-02-24T00:54:00.838095984Z [2024-02-24T00:54:00.837+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:54:00+00:00, run_after=2024-02-24T00:55:00+00:00 2024-02-24T00:54:00.845886071Z [2024-02-24T00:54:00.845+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:54:00.852881435Z [2024-02-24T00:54:00.852+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:54:00.866245904Z [2024-02-24T00:54:00.865+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:54:00+00:00, run_after=2024-02-24T00:55:00+00:00 2024-02-24T00:54:00.962729033Z [2024-02-24T00:54:00.962+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T00:54:00.962772992Z 2024-02-24T00:54:00.962783714Z 2024-02-24T00:54:00.962793950Z 2024-02-24T00:54:00.962826620Z 2024-02-24T00:54:00.963005784Z [2024-02-24T00:54:00.962+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T00:54:00.963293852Z [2024-02-24T00:54:00.963+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:54:00.963610548Z [2024-02-24T00:54:00.963+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:54:00.963867758Z [2024-02-24T00:54:00.963+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:54:00.965022145Z [2024-02-24T00:54:00.964+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:54:00.965044078Z 2024-02-24T00:54:00.965076732Z 2024-02-24T00:54:00.965083206Z 2024-02-24T00:54:00.965089510Z 2024-02-24T00:54:00.971401620Z [2024-02-24T00:54:00.970+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:54:00.971688251Z [2024-02-24T00:54:00.971+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T00:54:00.972067747Z [2024-02-24T00:54:00.971+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:54:00.972277636Z [2024-02-24T00:54:00.972+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:54:00.972634234Z [2024-02-24T00:54:00.972+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:54:00.972910009Z [2024-02-24T00:54:00.972+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:54:00.973151737Z [2024-02-24T00:54:00.972+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:54:00.973487328Z [2024-02-24T00:54:00.973+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:54:01.479402312Z [2024-02-24T00:54:01.478+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:52:00+00:00 exited with status queued for try_number 1 2024-02-24T00:54:01.480302064Z [2024-02-24T00:54:01.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:53:00+00:00 exited with status queued for try_number 1 2024-02-24T00:54:01.480535542Z [2024-02-24T00:54:01.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:53:00+00:00 exited with status queued for try_number 1 2024-02-24T00:54:01.482755901Z [2024-02-24T00:54:01.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:53:00+00:00 exited with status queued for try_number 1 2024-02-24T00:54:01.504027253Z [2024-02-24T00:54:01.503+0000] {scheduler_job.py:635} INFO - Setting external_id for to 66a8095b-4426-4ada-82ca-83fb8a98f701 2024-02-24T00:54:01.504383861Z [2024-02-24T00:54:01.504+0000] {scheduler_job.py:635} INFO - Setting external_id for to 980be89d-55e6-4bf7-8fbd-aef5e1b80954 2024-02-24T00:54:01.505073433Z [2024-02-24T00:54:01.504+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2fa3aead-f6b4-49fe-8346-7430b849f3fd 2024-02-24T00:54:01.506039710Z [2024-02-24T00:54:01.505+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56d67561-6336-4830-a0fb-a39967c3545d 2024-02-24T00:54:02.788222952Z [2024-02-24T00:54:02.787+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:54:02.788989976Z [2024-02-24T00:54:02.788+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 00:52:00+00:00, run_id=scheduled__2024-02-24T00:52:00+00:00, run_start_date=2024-02-24 00:54:00.879130+00:00, run_end_date=2024-02-24 00:54:02.788185+00:00, run_duration=1.909055, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:52:00+00:00, data_interval_end=2024-02-24 00:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T00:54:02.802892785Z [2024-02-24T00:54:02.802+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T00:54:00+00:00, run_after=2024-02-24T00:56:00+00:00 2024-02-24T00:54:02.827374702Z [2024-02-24T00:54:02.826+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:54:02.828107733Z [2024-02-24T00:54:02.827+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:53:00+00:00, run_id=scheduled__2024-02-24T00:53:00+00:00, run_start_date=2024-02-24 00:54:00.880462+00:00, run_end_date=2024-02-24 00:54:02.827681+00:00, run_duration=1.947219, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:53:00+00:00, data_interval_end=2024-02-24 00:54:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:54:02.856378600Z [2024-02-24T00:54:02.855+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:54:00+00:00, run_after=2024-02-24T00:55:00+00:00 2024-02-24T00:54:02.924836765Z [2024-02-24T00:54:02.924+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:52:00+00:00 exited with status success for try_number 1 2024-02-24T00:54:02.931486325Z [2024-02-24T00:54:02.931+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T00:52:00+00:00, map_index=-1, run_start_date=2024-02-24 00:54:01.853527+00:00, run_end_date=2024-02-24 00:54:02.261103+00:00, run_duration=0.407576, state=success, executor_state=success, try_number=1, max_tries=1, job_id=370, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:54:00.966765+00:00, queued_by_job_id=2, pid=5472 2024-02-24T00:54:03.679669918Z [2024-02-24T00:54:03.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:53:00+00:00 exited with status success for try_number 1 2024-02-24T00:54:03.685318589Z [2024-02-24T00:54:03.684+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:53:00+00:00, map_index=-1, run_start_date=2024-02-24 00:54:02.102492+00:00, run_end_date=2024-02-24 00:54:02.716462+00:00, run_duration=0.61397, state=success, executor_state=success, try_number=1, max_tries=1, job_id=371, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:54:00.966765+00:00, queued_by_job_id=2, pid=5477 2024-02-24T00:54:06.980266855Z [2024-02-24T00:54:06.979+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:54:06.980852513Z [2024-02-24T00:54:06.980+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:53:00+00:00, run_id=scheduled__2024-02-24T00:53:00+00:00, run_start_date=2024-02-24 00:54:00.882754+00:00, run_end_date=2024-02-24 00:54:06.980170+00:00, run_duration=6.097416, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:53:00+00:00, data_interval_end=2024-02-24 00:54:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:54:06.992040142Z [2024-02-24T00:54:06.991+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:54:00+00:00, run_after=2024-02-24T00:55:00+00:00 2024-02-24T00:54:06.999491335Z [2024-02-24T00:54:06.999+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:54:06.999779712Z [2024-02-24T00:54:06.999+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:53:00+00:00, run_id=scheduled__2024-02-24T00:53:00+00:00, run_start_date=2024-02-24 00:54:00.881577+00:00, run_end_date=2024-02-24 00:54:06.999412+00:00, run_duration=6.117835, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:53:00+00:00, data_interval_end=2024-02-24 00:54:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:54:07.016144354Z [2024-02-24T00:54:07.015+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:54:00+00:00, run_after=2024-02-24T00:55:00+00:00 2024-02-24T00:54:07.051031558Z [2024-02-24T00:54:07.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:53:00+00:00 exited with status success for try_number 1 2024-02-24T00:54:07.051293621Z [2024-02-24T00:54:07.051+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:53:00+00:00 exited with status success for try_number 1 2024-02-24T00:54:07.060325619Z [2024-02-24T00:54:07.059+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:53:00+00:00, map_index=-1, run_start_date=2024-02-24 00:54:03.700740+00:00, run_end_date=2024-02-24 00:54:06.744624+00:00, run_duration=3.043884, state=success, executor_state=success, try_number=1, max_tries=1, job_id=373, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:54:00.966765+00:00, queued_by_job_id=2, pid=5501 2024-02-24T00:54:07.060962611Z [2024-02-24T00:54:07.060+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:53:00+00:00, map_index=-1, run_start_date=2024-02-24 00:54:03.570051+00:00, run_end_date=2024-02-24 00:54:06.156016+00:00, run_duration=2.585965, state=success, executor_state=success, try_number=1, max_tries=1, job_id=372, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:54:00.966765+00:00, queued_by_job_id=2, pid=5500 2024-02-24T00:55:00.570346819Z [2024-02-24T00:55:00.569+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:55:00.585066390Z [2024-02-24T00:55:00.584+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:55:00+00:00, run_after=2024-02-24T01:00:00+00:00 2024-02-24T00:55:00.613568537Z [2024-02-24T00:55:00.613+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:55:00+00:00, run_after=2024-02-24T00:56:00+00:00 2024-02-24T00:55:00.630478349Z [2024-02-24T00:55:00.630+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:55:00+00:00, run_after=2024-02-24T00:56:00+00:00 2024-02-24T00:55:00.709798305Z [2024-02-24T00:55:00.709+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T00:55:00.709824615Z 2024-02-24T00:55:00.709828904Z 2024-02-24T00:55:00.709832220Z 2024-02-24T00:55:00.709835550Z 2024-02-24T00:55:00.710086137Z [2024-02-24T00:55:00.709+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:55:00.710262581Z [2024-02-24T00:55:00.710+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:55:00.710430373Z [2024-02-24T00:55:00.710+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:55:00.710570752Z [2024-02-24T00:55:00.710+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:55:00.711636343Z [2024-02-24T00:55:00.711+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:55:00.711649850Z 2024-02-24T00:55:00.711653308Z 2024-02-24T00:55:00.711656345Z 2024-02-24T00:55:00.711659363Z 2024-02-24T00:55:00.715521657Z [2024-02-24T00:55:00.715+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T00:55:00.715688773Z [2024-02-24T00:55:00.715+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:55:00.716036124Z [2024-02-24T00:55:00.715+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:55:00.716179364Z [2024-02-24T00:55:00.716+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:55:00.716486495Z [2024-02-24T00:55:00.716+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:55:00.716614248Z [2024-02-24T00:55:00.716+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:55:00.716855615Z [2024-02-24T00:55:00.716+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:55:00.716973919Z [2024-02-24T00:55:00.716+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:55:01.352474782Z [2024-02-24T00:55:01.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T00:50:00+00:00 exited with status queued for try_number 1 2024-02-24T00:55:01.354193538Z [2024-02-24T00:55:01.353+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:54:00+00:00 exited with status queued for try_number 1 2024-02-24T00:55:01.354492424Z [2024-02-24T00:55:01.354+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:54:00+00:00 exited with status queued for try_number 1 2024-02-24T00:55:01.354699976Z [2024-02-24T00:55:01.354+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:54:00+00:00 exited with status queued for try_number 1 2024-02-24T00:55:01.377988872Z [2024-02-24T00:55:01.377+0000] {scheduler_job.py:635} INFO - Setting external_id for to b1e0483f-8741-4cec-9ec2-7d6cdaf57243 2024-02-24T00:55:01.378703288Z [2024-02-24T00:55:01.378+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60d717d2-a997-40e3-905b-977376b1c4c0 2024-02-24T00:55:01.378962912Z [2024-02-24T00:55:01.378+0000] {scheduler_job.py:635} INFO - Setting external_id for to bbad9a7c-d890-4dcc-a42a-cca177993286 2024-02-24T00:55:01.379179722Z [2024-02-24T00:55:01.379+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6d13770f-e4ee-4fb4-adec-9a88addc1d2c 2024-02-24T00:55:02.773450659Z [2024-02-24T00:55:02.769+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:55:02.773482364Z [2024-02-24T00:55:02.769+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:54:00+00:00, run_id=scheduled__2024-02-24T00:54:00+00:00, run_start_date=2024-02-24 00:55:00.642631+00:00, run_end_date=2024-02-24 00:55:02.769605+00:00, run_duration=2.126974, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:54:00+00:00, data_interval_end=2024-02-24 00:55:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:55:02.785099455Z [2024-02-24T00:55:02.784+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:55:00+00:00, run_after=2024-02-24T00:56:00+00:00 2024-02-24T00:55:02.906986874Z [2024-02-24T00:55:02.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:54:00+00:00 exited with status success for try_number 1 2024-02-24T00:55:02.912909158Z [2024-02-24T00:55:02.912+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:54:00+00:00, map_index=-1, run_start_date=2024-02-24 00:55:02.127621+00:00, run_end_date=2024-02-24 00:55:02.717430+00:00, run_duration=0.589809, state=success, executor_state=success, try_number=1, max_tries=1, job_id=374, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:55:00.712715+00:00, queued_by_job_id=2, pid=5536 2024-02-24T00:55:04.651861402Z [2024-02-24T00:55:04.650+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T00:55:04.651896144Z 2024-02-24T00:55:04.651907005Z [2024-02-24T00:55:04.651+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:55:04.652541728Z [2024-02-24T00:55:04.652+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:55:04.652639501Z 2024-02-24T00:55:04.656778425Z [2024-02-24T00:55:04.656+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T00:55:04.656921411Z [2024-02-24T00:55:04.656+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:55:04.738845616Z [2024-02-24T00:55:04.736+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T00:50:00+00:00 exited with status queued for try_number 1 2024-02-24T00:55:04.738935679Z [2024-02-24T00:55:04.738+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T00:50:00+00:00 exited with status success for try_number 1 2024-02-24T00:55:04.750479406Z [2024-02-24T00:55:04.750+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22a2d17a-b90f-43fb-95aa-575f227caf53 2024-02-24T00:55:04.752901484Z [2024-02-24T00:55:04.752+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T00:50:00+00:00, map_index=-1, run_start_date=2024-02-24 00:55:03.510637+00:00, run_end_date=2024-02-24 00:55:04.013008+00:00, run_duration=0.502371, state=success, executor_state=success, try_number=1, max_tries=1, job_id=377, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:55:00.712715+00:00, queued_by_job_id=2, pid=5565 2024-02-24T00:55:04.833735135Z [2024-02-24T00:55:04.832+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:55:04.834277725Z [2024-02-24T00:55:04.833+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:54:00+00:00, run_id=scheduled__2024-02-24T00:54:00+00:00, run_start_date=2024-02-24 00:55:00.644653+00:00, run_end_date=2024-02-24 00:55:04.833738+00:00, run_duration=4.189085, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:54:00+00:00, data_interval_end=2024-02-24 00:55:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:55:04.849857113Z [2024-02-24T00:55:04.849+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:55:00+00:00, run_after=2024-02-24T00:56:00+00:00 2024-02-24T00:55:04.862184677Z [2024-02-24T00:55:04.861+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:55:04.862570888Z [2024-02-24T00:55:04.862+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:54:00+00:00, run_id=scheduled__2024-02-24T00:54:00+00:00, run_start_date=2024-02-24 00:55:00.643625+00:00, run_end_date=2024-02-24 00:55:04.862074+00:00, run_duration=4.218449, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:54:00+00:00, data_interval_end=2024-02-24 00:55:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:55:04.880032395Z [2024-02-24T00:55:04.879+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:55:00+00:00, run_after=2024-02-24T00:56:00+00:00 2024-02-24T00:55:04.949308979Z [2024-02-24T00:55:04.948+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:54:00+00:00 exited with status success for try_number 1 2024-02-24T00:55:04.949538841Z [2024-02-24T00:55:04.949+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:54:00+00:00 exited with status success for try_number 1 2024-02-24T00:55:04.957063991Z [2024-02-24T00:55:04.956+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:54:00+00:00, map_index=-1, run_start_date=2024-02-24 00:55:03.005425+00:00, run_end_date=2024-02-24 00:55:04.590631+00:00, run_duration=1.585206, state=success, executor_state=success, try_number=1, max_tries=1, job_id=375, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:55:00.712715+00:00, queued_by_job_id=2, pid=5552 2024-02-24T00:55:04.957436267Z [2024-02-24T00:55:04.957+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:54:00+00:00, map_index=-1, run_start_date=2024-02-24 00:55:03.237591+00:00, run_end_date=2024-02-24 00:55:04.586066+00:00, run_duration=1.348475, state=success, executor_state=success, try_number=1, max_tries=1, job_id=376, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:55:00.712715+00:00, queued_by_job_id=2, pid=5559 2024-02-24T00:55:07.189633051Z [2024-02-24T00:55:07.188+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T00:55:07.189678427Z 2024-02-24T00:55:07.189740001Z [2024-02-24T00:55:07.189+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:55:07.191076592Z [2024-02-24T00:55:07.190+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:55:07.191155138Z 2024-02-24T00:55:07.194713973Z [2024-02-24T00:55:07.194+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T00:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T00:55:07.195019582Z [2024-02-24T00:55:07.194+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T00:55:07.266846089Z [2024-02-24T00:55:07.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T00:50:00+00:00 exited with status queued for try_number 1 2024-02-24T00:55:07.267199197Z [2024-02-24T00:55:07.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T00:50:00+00:00 exited with status success for try_number 1 2024-02-24T00:55:07.281174311Z [2024-02-24T00:55:07.280+0000] {scheduler_job.py:635} INFO - Setting external_id for to a39f3687-5016-4206-95d2-d5b2496c0d9b 2024-02-24T00:55:07.282081245Z [2024-02-24T00:55:07.281+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T00:50:00+00:00, map_index=-1, run_start_date=2024-02-24 00:55:06.407228+00:00, run_end_date=2024-02-24 00:55:06.836540+00:00, run_duration=0.429312, state=success, executor_state=success, try_number=1, max_tries=1, job_id=378, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:55:04.653150+00:00, queued_by_job_id=2, pid=5583 2024-02-24T00:55:09.388370325Z [2024-02-24T00:55:09.387+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T00:55:09.388418486Z 2024-02-24T00:55:09.388656035Z [2024-02-24T00:55:09.388+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:55:09.389440536Z [2024-02-24T00:55:09.389+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:55:09.389463645Z 2024-02-24T00:55:09.392576896Z [2024-02-24T00:55:09.392+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:55:09.393005108Z [2024-02-24T00:55:09.392+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T00:55:09.463006830Z [2024-02-24T00:55:09.462+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T00:50:00+00:00 exited with status queued for try_number 1 2024-02-24T00:55:09.463481008Z [2024-02-24T00:55:09.462+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T00:50:00+00:00 exited with status success for try_number 1 2024-02-24T00:55:09.472534758Z [2024-02-24T00:55:09.471+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3dd3a1f5-d606-4686-92ec-03ed89727cbd 2024-02-24T00:55:09.472774332Z [2024-02-24T00:55:09.472+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T00:50:00+00:00, map_index=0, run_start_date=2024-02-24 00:55:08.853826+00:00, run_end_date=2024-02-24 00:55:09.202163+00:00, run_duration=0.348337, state=success, executor_state=success, try_number=1, max_tries=1, job_id=379, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:55:07.191502+00:00, queued_by_job_id=2, pid=5591 2024-02-24T00:55:12.060085209Z [2024-02-24T00:55:12.059+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:55:12.060737694Z [2024-02-24T00:55:12.060+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:50:00+00:00, run_id=scheduled__2024-02-24T00:50:00+00:00, run_start_date=2024-02-24 00:55:00.641467+00:00, run_end_date=2024-02-24 00:55:12.060236+00:00, run_duration=11.418769, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:50:00+00:00, data_interval_end=2024-02-24 00:55:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T00:55:12.068136307Z [2024-02-24T00:55:12.067+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:55:00+00:00, run_after=2024-02-24T01:00:00+00:00 2024-02-24T00:55:12.107582952Z [2024-02-24T00:55:12.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T00:50:00+00:00 exited with status success for try_number 1 2024-02-24T00:55:12.114261525Z [2024-02-24T00:55:12.113+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T00:50:00+00:00, map_index=-1, run_start_date=2024-02-24 00:55:11.129612+00:00, run_end_date=2024-02-24 00:55:11.526897+00:00, run_duration=0.397285, state=success, executor_state=success, try_number=1, max_tries=1, job_id=380, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:55:09.390069+00:00, queued_by_job_id=2, pid=5599 2024-02-24T00:56:00.581969956Z [2024-02-24T00:56:00.581+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:56:00+00:00, run_after=2024-02-24T00:57:00+00:00 2024-02-24T00:56:00.596429343Z [2024-02-24T00:56:00.596+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:56:00+00:00, run_after=2024-02-24T00:57:00+00:00 2024-02-24T00:56:00.603610167Z [2024-02-24T00:56:00.603+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:56:00.610200153Z [2024-02-24T00:56:00.609+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:56:00.726397175Z [2024-02-24T00:56:00.726+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T00:56:00.726422754Z 2024-02-24T00:56:00.726441694Z 2024-02-24T00:56:00.726445148Z 2024-02-24T00:56:00.726448267Z 2024-02-24T00:56:00.726582891Z [2024-02-24T00:56:00.726+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T00:56:00.726899759Z [2024-02-24T00:56:00.726+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:56:00.727181272Z [2024-02-24T00:56:00.726+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:56:00.727460396Z [2024-02-24T00:56:00.727+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:56:00.728244591Z [2024-02-24T00:56:00.728+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:56:00.728259246Z 2024-02-24T00:56:00.728263174Z 2024-02-24T00:56:00.728266754Z 2024-02-24T00:56:00.728288933Z 2024-02-24T00:56:00.734540565Z [2024-02-24T00:56:00.733+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:56:00.734862650Z [2024-02-24T00:56:00.734+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T00:56:00.735324636Z [2024-02-24T00:56:00.735+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:56:00.735678531Z [2024-02-24T00:56:00.735+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:56:00.736084259Z [2024-02-24T00:56:00.735+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:56:00.736351173Z [2024-02-24T00:56:00.736+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:56:00.736685243Z [2024-02-24T00:56:00.736+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:56:00.736904829Z [2024-02-24T00:56:00.736+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:56:01.205603721Z [2024-02-24T00:56:01.204+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:54:00+00:00 exited with status queued for try_number 1 2024-02-24T00:56:01.205739762Z [2024-02-24T00:56:01.205+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:55:00+00:00 exited with status queued for try_number 1 2024-02-24T00:56:01.205746648Z [2024-02-24T00:56:01.205+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:55:00+00:00 exited with status queued for try_number 1 2024-02-24T00:56:01.205760606Z [2024-02-24T00:56:01.205+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:55:00+00:00 exited with status queued for try_number 1 2024-02-24T00:56:01.229912365Z [2024-02-24T00:56:01.226+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4518e5b3-7b51-47a2-95c0-005316fd652a 2024-02-24T00:56:01.229937021Z [2024-02-24T00:56:01.227+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23e5bc6f-296f-40ad-bcf7-02fd7f974ce8 2024-02-24T00:56:01.229940923Z [2024-02-24T00:56:01.227+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b629c10-882f-416e-8262-be645b6a1bc1 2024-02-24T00:56:01.229944439Z [2024-02-24T00:56:01.227+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3cebdb23-1e2e-4cfa-b48d-778ed4fc0849 2024-02-24T00:56:02.454411531Z [2024-02-24T00:56:02.453+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:56:02.455191096Z [2024-02-24T00:56:02.454+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 00:54:00+00:00, run_id=scheduled__2024-02-24T00:54:00+00:00, run_start_date=2024-02-24 00:56:00.623756+00:00, run_end_date=2024-02-24 00:56:02.454302+00:00, run_duration=1.830546, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:54:00+00:00, data_interval_end=2024-02-24 00:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T00:56:02.464172368Z [2024-02-24T00:56:02.463+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T00:56:00+00:00, run_after=2024-02-24T00:58:00+00:00 2024-02-24T00:56:02.473944092Z [2024-02-24T00:56:02.473+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:56:02.474315727Z [2024-02-24T00:56:02.474+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:55:00+00:00, run_id=scheduled__2024-02-24T00:55:00+00:00, run_start_date=2024-02-24 00:56:00.627588+00:00, run_end_date=2024-02-24 00:56:02.473896+00:00, run_duration=1.846308, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:55:00+00:00, data_interval_end=2024-02-24 00:56:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:56:02.486640189Z [2024-02-24T00:56:02.486+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:56:00+00:00, run_after=2024-02-24T00:57:00+00:00 2024-02-24T00:56:02.635305814Z [2024-02-24T00:56:02.633+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:54:00+00:00 exited with status success for try_number 1 2024-02-24T00:56:02.635332627Z [2024-02-24T00:56:02.634+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:55:00+00:00 exited with status success for try_number 1 2024-02-24T00:56:02.661643563Z [2024-02-24T00:56:02.652+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T00:54:00+00:00, map_index=-1, run_start_date=2024-02-24 00:56:01.750753+00:00, run_end_date=2024-02-24 00:56:02.214132+00:00, run_duration=0.463379, state=success, executor_state=success, try_number=1, max_tries=1, job_id=381, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:56:00.729233+00:00, queued_by_job_id=2, pid=5622 2024-02-24T00:56:02.661665634Z [2024-02-24T00:56:02.655+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:55:00+00:00, map_index=-1, run_start_date=2024-02-24 00:56:01.718068+00:00, run_end_date=2024-02-24 00:56:02.222654+00:00, run_duration=0.504586, state=success, executor_state=success, try_number=1, max_tries=1, job_id=382, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:56:00.729233+00:00, queued_by_job_id=2, pid=5621 2024-02-24T00:56:05.978938458Z [2024-02-24T00:56:05.978+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:56:05.979357029Z [2024-02-24T00:56:05.978+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:55:00+00:00, run_id=scheduled__2024-02-24T00:55:00+00:00, run_start_date=2024-02-24 00:56:00.631498+00:00, run_end_date=2024-02-24 00:56:05.978782+00:00, run_duration=5.347284, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:55:00+00:00, data_interval_end=2024-02-24 00:56:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:56:05.994432905Z [2024-02-24T00:56:05.994+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:56:00+00:00, run_after=2024-02-24T00:57:00+00:00 2024-02-24T00:56:06.003882351Z [2024-02-24T00:56:06.003+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:56:06.004109034Z [2024-02-24T00:56:06.003+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:55:00+00:00, run_id=scheduled__2024-02-24T00:55:00+00:00, run_start_date=2024-02-24 00:56:00.633662+00:00, run_end_date=2024-02-24 00:56:06.003763+00:00, run_duration=5.370101, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:55:00+00:00, data_interval_end=2024-02-24 00:56:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:56:06.012745920Z [2024-02-24T00:56:06.012+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:56:00+00:00, run_after=2024-02-24T00:57:00+00:00 2024-02-24T00:56:06.076066198Z [2024-02-24T00:56:06.075+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:55:00+00:00 exited with status success for try_number 1 2024-02-24T00:56:06.076927782Z [2024-02-24T00:56:06.076+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:55:00+00:00 exited with status success for try_number 1 2024-02-24T00:56:06.087489290Z [2024-02-24T00:56:06.086+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:55:00+00:00, map_index=-1, run_start_date=2024-02-24 00:56:03.327113+00:00, run_end_date=2024-02-24 00:56:05.400367+00:00, run_duration=2.073254, state=success, executor_state=success, try_number=1, max_tries=1, job_id=384, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:56:00.729233+00:00, queued_by_job_id=2, pid=5646 2024-02-24T00:56:06.087960698Z [2024-02-24T00:56:06.087+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:55:00+00:00, map_index=-1, run_start_date=2024-02-24 00:56:03.153887+00:00, run_end_date=2024-02-24 00:56:05.121617+00:00, run_duration=1.96773, state=success, executor_state=success, try_number=1, max_tries=1, job_id=383, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:56:00.729233+00:00, queued_by_job_id=2, pid=5645 2024-02-24T00:57:00.996887612Z [2024-02-24T00:57:00.996+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:57:01.014764050Z [2024-02-24T00:57:01.014+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:57:00+00:00, run_after=2024-02-24T00:58:00+00:00 2024-02-24T00:57:01.035903986Z [2024-02-24T00:57:01.035+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:57:00+00:00, run_after=2024-02-24T00:58:00+00:00 2024-02-24T00:57:01.187912144Z [2024-02-24T00:57:01.187+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T00:57:01.187945232Z 2024-02-24T00:57:01.187949009Z 2024-02-24T00:57:01.187964505Z 2024-02-24T00:57:01.188251847Z [2024-02-24T00:57:01.188+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:57:01.188519494Z [2024-02-24T00:57:01.188+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:57:01.188751866Z [2024-02-24T00:57:01.188+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:57:01.189830386Z [2024-02-24T00:57:01.189+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:57:01.189845698Z 2024-02-24T00:57:01.189849273Z 2024-02-24T00:57:01.189852605Z 2024-02-24T00:57:01.194889858Z [2024-02-24T00:57:01.194+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:57:01.195202026Z [2024-02-24T00:57:01.194+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:57:01.195715373Z [2024-02-24T00:57:01.195+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:57:01.196084695Z [2024-02-24T00:57:01.195+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:57:01.198367979Z [2024-02-24T00:57:01.198+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:57:01.198724213Z [2024-02-24T00:57:01.198+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:57:01.572821813Z [2024-02-24T00:57:01.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:56:00+00:00 exited with status queued for try_number 1 2024-02-24T00:57:01.572990550Z [2024-02-24T00:57:01.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:56:00+00:00 exited with status queued for try_number 1 2024-02-24T00:57:01.573100959Z [2024-02-24T00:57:01.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:56:00+00:00 exited with status queued for try_number 1 2024-02-24T00:57:01.581755396Z [2024-02-24T00:57:01.581+0000] {scheduler_job.py:635} INFO - Setting external_id for to afd637c6-7efa-4391-bb4b-78d546ede0ae 2024-02-24T00:57:01.582000786Z [2024-02-24T00:57:01.581+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8639a819-c673-4e24-a84e-33704119cd7d 2024-02-24T00:57:01.582162978Z [2024-02-24T00:57:01.582+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71445e38-2243-4dfc-8c28-ba485b44e997 2024-02-24T00:57:01.709087197Z [2024-02-24T00:57:01.708+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T00:57:03.275248241Z [2024-02-24T00:57:03.274+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:57:03.275462200Z [2024-02-24T00:57:03.275+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:56:00+00:00, run_id=scheduled__2024-02-24T00:56:00+00:00, run_start_date=2024-02-24 00:57:01.048385+00:00, run_end_date=2024-02-24 00:57:03.275152+00:00, run_duration=2.226767, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:56:00+00:00, data_interval_end=2024-02-24 00:57:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:57:03.288339756Z [2024-02-24T00:57:03.287+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:57:00+00:00, run_after=2024-02-24T00:58:00+00:00 2024-02-24T00:57:03.342322231Z [2024-02-24T00:57:03.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:56:00+00:00 exited with status success for try_number 1 2024-02-24T00:57:03.347663903Z [2024-02-24T00:57:03.347+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:56:00+00:00, map_index=-1, run_start_date=2024-02-24 00:57:02.248768+00:00, run_end_date=2024-02-24 00:57:02.968723+00:00, run_duration=0.719955, state=success, executor_state=success, try_number=1, max_tries=1, job_id=385, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:57:01.191300+00:00, queued_by_job_id=2, pid=5678 2024-02-24T00:57:06.622320446Z [2024-02-24T00:57:06.621+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:57:06.622565217Z [2024-02-24T00:57:06.622+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:56:00+00:00, run_id=scheduled__2024-02-24T00:56:00+00:00, run_start_date=2024-02-24 00:57:01.049767+00:00, run_end_date=2024-02-24 00:57:06.622195+00:00, run_duration=5.572428, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:56:00+00:00, data_interval_end=2024-02-24 00:57:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:57:06.632282960Z [2024-02-24T00:57:06.631+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:57:00+00:00, run_after=2024-02-24T00:58:00+00:00 2024-02-24T00:57:06.685119465Z [2024-02-24T00:57:06.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:56:00+00:00 exited with status success for try_number 1 2024-02-24T00:57:06.690861091Z [2024-02-24T00:57:06.690+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:56:00+00:00, map_index=-1, run_start_date=2024-02-24 00:57:03.979969+00:00, run_end_date=2024-02-24 00:57:06.336894+00:00, run_duration=2.356925, state=success, executor_state=success, try_number=1, max_tries=1, job_id=387, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:57:01.191300+00:00, queued_by_job_id=2, pid=5698 2024-02-24T00:57:07.280443673Z [2024-02-24T00:57:07.279+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:57:07.280994839Z [2024-02-24T00:57:07.280+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:56:00+00:00, run_id=scheduled__2024-02-24T00:56:00+00:00, run_start_date=2024-02-24 00:57:01.050993+00:00, run_end_date=2024-02-24 00:57:07.280453+00:00, run_duration=6.22946, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:56:00+00:00, data_interval_end=2024-02-24 00:57:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:57:07.294564564Z [2024-02-24T00:57:07.294+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:57:00+00:00, run_after=2024-02-24T00:58:00+00:00 2024-02-24T00:57:07.343248734Z [2024-02-24T00:57:07.342+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:56:00+00:00 exited with status success for try_number 1 2024-02-24T00:57:07.353060584Z [2024-02-24T00:57:07.352+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:56:00+00:00, map_index=-1, run_start_date=2024-02-24 00:57:03.578033+00:00, run_end_date=2024-02-24 00:57:07.032991+00:00, run_duration=3.454958, state=success, executor_state=success, try_number=1, max_tries=1, job_id=386, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:57:01.191300+00:00, queued_by_job_id=2, pid=5691 2024-02-24T00:58:00.261545628Z [2024-02-24T00:58:00.260+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:58:00.273183852Z [2024-02-24T00:58:00.272+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:58:00.287186735Z [2024-02-24T00:58:00.286+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:58:00+00:00, run_after=2024-02-24T00:59:00+00:00 2024-02-24T00:58:00.300168548Z [2024-02-24T00:58:00.299+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:58:00+00:00, run_after=2024-02-24T00:59:00+00:00 2024-02-24T00:58:00.379291676Z [2024-02-24T00:58:00.378+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T00:58:00.379319458Z 2024-02-24T00:58:00.379324970Z 2024-02-24T00:58:00.379329547Z 2024-02-24T00:58:00.379334283Z 2024-02-24T00:58:00.379478462Z [2024-02-24T00:58:00.379+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T00:58:00.379733398Z [2024-02-24T00:58:00.379+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:58:00.380041282Z [2024-02-24T00:58:00.379+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:58:00.380067446Z [2024-02-24T00:58:00.379+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:58:00.380804549Z [2024-02-24T00:58:00.380+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:58:00.380817764Z 2024-02-24T00:58:00.380822455Z 2024-02-24T00:58:00.380826521Z 2024-02-24T00:58:00.380830700Z 2024-02-24T00:58:00.386416140Z [2024-02-24T00:58:00.386+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:58:00.386626074Z [2024-02-24T00:58:00.386+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T00:58:00.387063368Z [2024-02-24T00:58:00.386+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:58:00.387228393Z [2024-02-24T00:58:00.386+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:58:00.387516103Z [2024-02-24T00:58:00.387+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:58:00.387628561Z [2024-02-24T00:58:00.387+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:58:00.387853112Z [2024-02-24T00:58:00.387+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:58:00.387915804Z [2024-02-24T00:58:00.387+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:58:00.821425358Z [2024-02-24T00:58:00.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:56:00+00:00 exited with status queued for try_number 1 2024-02-24T00:58:00.821634717Z [2024-02-24T00:58:00.821+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:57:00+00:00 exited with status queued for try_number 1 2024-02-24T00:58:00.821827134Z [2024-02-24T00:58:00.821+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:57:00+00:00 exited with status queued for try_number 1 2024-02-24T00:58:00.821992478Z [2024-02-24T00:58:00.821+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:57:00+00:00 exited with status queued for try_number 1 2024-02-24T00:58:00.846047909Z [2024-02-24T00:58:00.845+0000] {scheduler_job.py:635} INFO - Setting external_id for to 87f09e28-a8b9-46dc-8686-d909a81a6a6f 2024-02-24T00:58:00.846346316Z [2024-02-24T00:58:00.846+0000] {scheduler_job.py:635} INFO - Setting external_id for to 57505e63-bc8a-4feb-b523-b381f5482b1a 2024-02-24T00:58:00.846754968Z [2024-02-24T00:58:00.846+0000] {scheduler_job.py:635} INFO - Setting external_id for to f4a87029-937f-4849-b748-134a6ac0fd5a 2024-02-24T00:58:00.847954664Z [2024-02-24T00:58:00.846+0000] {scheduler_job.py:635} INFO - Setting external_id for to 073a4adb-8557-4082-814a-05493fdd261a 2024-02-24T00:58:02.014305218Z [2024-02-24T00:58:02.013+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:58:02.014690213Z [2024-02-24T00:58:02.014+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 00:56:00+00:00, run_id=scheduled__2024-02-24T00:56:00+00:00, run_start_date=2024-02-24 00:58:00.310258+00:00, run_end_date=2024-02-24 00:58:02.014198+00:00, run_duration=1.70394, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:56:00+00:00, data_interval_end=2024-02-24 00:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T00:58:02.022603921Z [2024-02-24T00:58:02.022+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T00:58:00+00:00, run_after=2024-02-24T01:00:00+00:00 2024-02-24T00:58:02.039352704Z [2024-02-24T00:58:02.038+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:58:02.039669993Z [2024-02-24T00:58:02.039+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:57:00+00:00, run_id=scheduled__2024-02-24T00:57:00+00:00, run_start_date=2024-02-24 00:58:00.311375+00:00, run_end_date=2024-02-24 00:58:02.039252+00:00, run_duration=1.727877, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:57:00+00:00, data_interval_end=2024-02-24 00:58:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:58:02.051913540Z [2024-02-24T00:58:02.051+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:58:00+00:00, run_after=2024-02-24T00:59:00+00:00 2024-02-24T00:58:02.104112430Z [2024-02-24T00:58:02.103+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:56:00+00:00 exited with status success for try_number 1 2024-02-24T00:58:02.104186676Z [2024-02-24T00:58:02.103+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:57:00+00:00 exited with status success for try_number 1 2024-02-24T00:58:02.112699982Z [2024-02-24T00:58:02.112+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T00:56:00+00:00, map_index=-1, run_start_date=2024-02-24 00:58:01.403665+00:00, run_end_date=2024-02-24 00:58:01.805410+00:00, run_duration=0.401745, state=success, executor_state=success, try_number=1, max_tries=1, job_id=389, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:58:00.382261+00:00, queued_by_job_id=2, pid=5731 2024-02-24T00:58:02.112894531Z [2024-02-24T00:58:02.112+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:57:00+00:00, map_index=-1, run_start_date=2024-02-24 00:58:01.368515+00:00, run_end_date=2024-02-24 00:58:01.831975+00:00, run_duration=0.46346, state=success, executor_state=success, try_number=1, max_tries=1, job_id=388, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:58:00.382261+00:00, queued_by_job_id=2, pid=5730 2024-02-24T00:58:05.409560878Z [2024-02-24T00:58:05.409+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:58:05.409909316Z [2024-02-24T00:58:05.409+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:57:00+00:00, run_id=scheduled__2024-02-24T00:57:00+00:00, run_start_date=2024-02-24 00:58:00.313475+00:00, run_end_date=2024-02-24 00:58:05.409439+00:00, run_duration=5.095964, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:57:00+00:00, data_interval_end=2024-02-24 00:58:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:58:05.418065240Z [2024-02-24T00:58:05.417+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:58:00+00:00, run_after=2024-02-24T00:59:00+00:00 2024-02-24T00:58:05.424175416Z [2024-02-24T00:58:05.423+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:58:05.424463203Z [2024-02-24T00:58:05.424+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:57:00+00:00, run_id=scheduled__2024-02-24T00:57:00+00:00, run_start_date=2024-02-24 00:58:00.312388+00:00, run_end_date=2024-02-24 00:58:05.424078+00:00, run_duration=5.11169, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:57:00+00:00, data_interval_end=2024-02-24 00:58:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:58:05.433847614Z [2024-02-24T00:58:05.433+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:58:00+00:00, run_after=2024-02-24T00:59:00+00:00 2024-02-24T00:58:05.478556921Z [2024-02-24T00:58:05.478+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:57:00+00:00 exited with status success for try_number 1 2024-02-24T00:58:05.478703875Z [2024-02-24T00:58:05.478+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:57:00+00:00 exited with status success for try_number 1 2024-02-24T00:58:05.484807406Z [2024-02-24T00:58:05.484+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:57:00+00:00, map_index=-1, run_start_date=2024-02-24 00:58:02.583969+00:00, run_end_date=2024-02-24 00:58:04.326261+00:00, run_duration=1.742292, state=success, executor_state=success, try_number=1, max_tries=1, job_id=390, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:58:00.382261+00:00, queued_by_job_id=2, pid=5749 2024-02-24T00:58:05.485177781Z [2024-02-24T00:58:05.484+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:57:00+00:00, map_index=-1, run_start_date=2024-02-24 00:58:02.944190+00:00, run_end_date=2024-02-24 00:58:04.390790+00:00, run_duration=1.4466, state=success, executor_state=success, try_number=1, max_tries=1, job_id=391, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:58:00.382261+00:00, queued_by_job_id=2, pid=5760 2024-02-24T00:59:00.203467469Z [2024-02-24T00:59:00.202+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:59:00+00:00, run_after=2024-02-24T01:00:00+00:00 2024-02-24T00:59:00.224590050Z [2024-02-24T00:59:00.223+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:59:00+00:00, run_after=2024-02-24T01:00:00+00:00 2024-02-24T00:59:00.238618110Z [2024-02-24T00:59:00.237+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T00:59:00.324898634Z [2024-02-24T00:59:00.324+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T00:59:00.324958174Z 2024-02-24T00:59:00.324972084Z 2024-02-24T00:59:00.324981718Z 2024-02-24T00:59:00.324990535Z [2024-02-24T00:59:00.324+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:59:00.325557107Z [2024-02-24T00:59:00.324+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T00:59:00.325578911Z [2024-02-24T00:59:00.324+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T00:59:00.330577314Z [2024-02-24T00:59:00.326+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T00:59:00.330613002Z 2024-02-24T00:59:00.330637491Z 2024-02-24T00:59:00.330653229Z 2024-02-24T00:59:00.330668333Z [2024-02-24T00:59:00.328+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:59:00.330682236Z [2024-02-24T00:59:00.328+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T00:59:00.330696820Z [2024-02-24T00:59:00.329+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:59:00.330710222Z [2024-02-24T00:59:00.329+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T00:59:00.330722754Z [2024-02-24T00:59:00.329+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T00:59:00.330769112Z [2024-02-24T00:59:00.329+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T00:59:00.579326168Z [2024-02-24T00:59:00.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:58:00+00:00 exited with status queued for try_number 1 2024-02-24T00:59:00.579498017Z [2024-02-24T00:59:00.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:58:00+00:00 exited with status queued for try_number 1 2024-02-24T00:59:00.579650555Z [2024-02-24T00:59:00.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:58:00+00:00 exited with status queued for try_number 1 2024-02-24T00:59:00.587291790Z [2024-02-24T00:59:00.586+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62587390-cd42-4a1a-841a-eefb78a1e361 2024-02-24T00:59:00.587558634Z [2024-02-24T00:59:00.587+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b7b0f02-0b6f-4301-ae9d-c476ea11035f 2024-02-24T00:59:00.587802559Z [2024-02-24T00:59:00.587+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc8e6c75-7efe-4129-b9d6-c76fe640e7ee 2024-02-24T00:59:02.477509752Z [2024-02-24T00:59:02.476+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:59:02.478192605Z [2024-02-24T00:59:02.477+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:58:00+00:00, run_id=scheduled__2024-02-24T00:58:00+00:00, run_start_date=2024-02-24 00:59:00.257999+00:00, run_end_date=2024-02-24 00:59:02.477427+00:00, run_duration=2.219428, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:58:00+00:00, data_interval_end=2024-02-24 00:59:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T00:59:02.500513699Z [2024-02-24T00:59:02.499+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T00:59:00+00:00, run_after=2024-02-24T01:00:00+00:00 2024-02-24T00:59:02.572558697Z [2024-02-24T00:59:02.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:58:00+00:00 exited with status success for try_number 1 2024-02-24T00:59:02.581977174Z [2024-02-24T00:59:02.581+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:58:00+00:00, map_index=-1, run_start_date=2024-02-24 00:59:01.414825+00:00, run_end_date=2024-02-24 00:59:01.959514+00:00, run_duration=0.544689, state=success, executor_state=success, try_number=1, max_tries=1, job_id=392, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:59:00.326858+00:00, queued_by_job_id=2, pid=5786 2024-02-24T00:59:05.320310397Z [2024-02-24T00:59:05.319+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:59:05.320797708Z [2024-02-24T00:59:05.320+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:58:00+00:00, run_id=scheduled__2024-02-24T00:58:00+00:00, run_start_date=2024-02-24 00:59:00.259423+00:00, run_end_date=2024-02-24 00:59:05.320244+00:00, run_duration=5.060821, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:58:00+00:00, data_interval_end=2024-02-24 00:59:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T00:59:05.336049709Z [2024-02-24T00:59:05.335+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:59:00+00:00, run_after=2024-02-24T01:00:00+00:00 2024-02-24T00:59:05.345240447Z [2024-02-24T00:59:05.344+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T00:59:05.345534264Z [2024-02-24T00:59:05.345+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:58:00+00:00, run_id=scheduled__2024-02-24T00:58:00+00:00, run_start_date=2024-02-24 00:59:00.260885+00:00, run_end_date=2024-02-24 00:59:05.345226+00:00, run_duration=5.084341, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:58:00+00:00, data_interval_end=2024-02-24 00:59:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T00:59:05.355340297Z [2024-02-24T00:59:05.354+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T00:59:00+00:00, run_after=2024-02-24T01:00:00+00:00 2024-02-24T00:59:05.402526752Z [2024-02-24T00:59:05.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:58:00+00:00 exited with status success for try_number 1 2024-02-24T00:59:05.402804458Z [2024-02-24T00:59:05.402+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:58:00+00:00 exited with status success for try_number 1 2024-02-24T00:59:05.417629087Z [2024-02-24T00:59:05.416+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:58:00+00:00, map_index=-1, run_start_date=2024-02-24 00:59:02.616294+00:00, run_end_date=2024-02-24 00:59:04.624753+00:00, run_duration=2.008459, state=success, executor_state=success, try_number=1, max_tries=1, job_id=394, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:59:00.326858+00:00, queued_by_job_id=2, pid=5805 2024-02-24T00:59:05.418507671Z [2024-02-24T00:59:05.417+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:58:00+00:00, map_index=-1, run_start_date=2024-02-24 00:59:02.491712+00:00, run_end_date=2024-02-24 00:59:05.064501+00:00, run_duration=2.572789, state=success, executor_state=success, try_number=1, max_tries=1, job_id=393, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 00:59:00.326858+00:00, queued_by_job_id=2, pid=5804 2024-02-24T01:00:01.038216206Z [2024-02-24T01:00:01.037+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:00:00+00:00, run_after=2024-02-24T01:01:00+00:00 2024-02-24T01:00:01.056345182Z [2024-02-24T01:00:01.055+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:00:00+00:00, run_after=2024-02-24T01:05:00+00:00 2024-02-24T01:00:01.063898585Z [2024-02-24T01:00:01.063+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:00:01.077006033Z [2024-02-24T01:00:01.076+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:00:00+00:00, run_after=2024-02-24T01:01:00+00:00 2024-02-24T01:00:01.084773568Z [2024-02-24T01:00:01.084+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:00:01.186913720Z [2024-02-24T01:00:01.186+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-02-24T01:00:01.186939870Z 2024-02-24T01:00:01.186943329Z 2024-02-24T01:00:01.186947418Z 2024-02-24T01:00:01.186950549Z 2024-02-24T01:00:01.186953663Z 2024-02-24T01:00:01.187238709Z [2024-02-24T01:00:01.187+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:00:01.187418807Z [2024-02-24T01:00:01.187+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T01:00:01.187584686Z [2024-02-24T01:00:01.187+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:00:01.187774547Z [2024-02-24T01:00:01.187+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:00:01.187947502Z [2024-02-24T01:00:01.187+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:00:01.188718565Z [2024-02-24T01:00:01.188+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:00:01.188730898Z 2024-02-24T01:00:01.188734662Z 2024-02-24T01:00:01.188738205Z 2024-02-24T01:00:01.188741359Z 2024-02-24T01:00:01.188758309Z 2024-02-24T01:00:01.193315170Z [2024-02-24T01:00:01.193+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T01:00:01.193582513Z [2024-02-24T01:00:01.193+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T01:00:01.193908435Z [2024-02-24T01:00:01.193+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:00:01.194081605Z [2024-02-24T01:00:01.193+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T01:00:01.194347494Z [2024-02-24T01:00:01.194+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:00:01.194806426Z [2024-02-24T01:00:01.194+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:00:01.195085798Z [2024-02-24T01:00:01.194+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:00:01.195297523Z [2024-02-24T01:00:01.195+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:00:01.195592613Z [2024-02-24T01:00:01.195+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T00:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:00:01.195885406Z [2024-02-24T01:00:01.195+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:00:01.744484631Z [2024-02-24T01:00:01.743+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T00:55:00+00:00 exited with status queued for try_number 1 2024-02-24T01:00:01.744531273Z [2024-02-24T01:00:01.744+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:58:00+00:00 exited with status queued for try_number 1 2024-02-24T01:00:01.744767059Z [2024-02-24T01:00:01.744+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:59:00+00:00 exited with status queued for try_number 1 2024-02-24T01:00:01.745079241Z [2024-02-24T01:00:01.744+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:59:00+00:00 exited with status queued for try_number 1 2024-02-24T01:00:01.745251365Z [2024-02-24T01:00:01.745+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:59:00+00:00 exited with status queued for try_number 1 2024-02-24T01:00:01.767586119Z [2024-02-24T01:00:01.767+0000] {scheduler_job.py:635} INFO - Setting external_id for to b448737e-dcb5-4484-968d-38744856fc25 2024-02-24T01:00:01.767809380Z [2024-02-24T01:00:01.767+0000] {scheduler_job.py:635} INFO - Setting external_id for to d8d728da-66a8-4543-8c79-770db61be6aa 2024-02-24T01:00:01.768022656Z [2024-02-24T01:00:01.767+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b344da3-9ea5-4e84-a471-7321ebbbc355 2024-02-24T01:00:01.768196612Z [2024-02-24T01:00:01.768+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75b9e3a7-3760-40f2-b06e-6f8be3a5e0f8 2024-02-24T01:00:01.768380189Z [2024-02-24T01:00:01.768+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0066a550-369b-4050-bead-bc7e4b7b1c2e 2024-02-24T01:00:02.949710896Z [2024-02-24T01:00:02.949+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:00:02.950126712Z [2024-02-24T01:00:02.949+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 00:58:00+00:00, run_id=scheduled__2024-02-24T00:58:00+00:00, run_start_date=2024-02-24 01:00:01.101096+00:00, run_end_date=2024-02-24 01:00:02.949719+00:00, run_duration=1.848623, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:58:00+00:00, data_interval_end=2024-02-24 01:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T01:00:02.959662573Z [2024-02-24T01:00:02.959+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T01:00:00+00:00, run_after=2024-02-24T01:02:00+00:00 2024-02-24T01:00:02.967189062Z [2024-02-24T01:00:02.966+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:00:02.967513786Z [2024-02-24T01:00:02.967+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 00:59:00+00:00, run_id=scheduled__2024-02-24T00:59:00+00:00, run_start_date=2024-02-24 01:00:01.102207+00:00, run_end_date=2024-02-24 01:00:02.967233+00:00, run_duration=1.865026, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:59:00+00:00, data_interval_end=2024-02-24 01:00:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:00:02.978970565Z [2024-02-24T01:00:02.978+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:00:00+00:00, run_after=2024-02-24T01:01:00+00:00 2024-02-24T01:00:03.071855913Z [2024-02-24T01:00:03.071+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T00:58:00+00:00 exited with status success for try_number 1 2024-02-24T01:00:03.072116827Z [2024-02-24T01:00:03.071+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:59:00+00:00 exited with status success for try_number 1 2024-02-24T01:00:03.082084068Z [2024-02-24T01:00:03.081+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T00:58:00+00:00, map_index=-1, run_start_date=2024-02-24 01:00:02.171659+00:00, run_end_date=2024-02-24 01:00:02.577888+00:00, run_duration=0.406229, state=success, executor_state=success, try_number=1, max_tries=1, job_id=395, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:00:01.189923+00:00, queued_by_job_id=2, pid=5840 2024-02-24T01:00:03.082205396Z [2024-02-24T01:00:03.082+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:59:00+00:00, map_index=-1, run_start_date=2024-02-24 01:00:02.161515+00:00, run_end_date=2024-02-24 01:00:02.615386+00:00, run_duration=0.453871, state=success, executor_state=success, try_number=1, max_tries=1, job_id=396, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:00:01.189923+00:00, queued_by_job_id=2, pid=5839 2024-02-24T01:00:04.164654386Z [2024-02-24T01:00:04.164+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:00:04.164680827Z 2024-02-24T01:00:04.166794718Z [2024-02-24T01:00:04.166+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:00:04.168024249Z [2024-02-24T01:00:04.167+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:00:04.168039401Z 2024-02-24T01:00:04.173891403Z [2024-02-24T01:00:04.173+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T01:00:04.174190773Z [2024-02-24T01:00:04.173+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T01:00:04.303619060Z [2024-02-24T01:00:04.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T00:55:00+00:00 exited with status queued for try_number 1 2024-02-24T01:00:04.303821458Z [2024-02-24T01:00:04.303+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T00:55:00+00:00 exited with status success for try_number 1 2024-02-24T01:00:04.310763554Z [2024-02-24T01:00:04.310+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4234531a-f4bc-4c64-a776-0f25afc97669 2024-02-24T01:00:04.311087652Z [2024-02-24T01:00:04.310+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T00:55:00+00:00, map_index=-1, run_start_date=2024-02-24 01:00:03.596269+00:00, run_end_date=2024-02-24 01:00:04.063690+00:00, run_duration=0.467421, state=success, executor_state=success, try_number=1, max_tries=1, job_id=397, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:00:01.189923+00:00, queued_by_job_id=2, pid=5860 2024-02-24T01:00:06.172604560Z [2024-02-24T01:00:06.172+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:00:06.173161548Z [2024-02-24T01:00:06.172+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:59:00+00:00, run_id=scheduled__2024-02-24T00:59:00+00:00, run_start_date=2024-02-24 01:00:01.103200+00:00, run_end_date=2024-02-24 01:00:06.172761+00:00, run_duration=5.069561, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:59:00+00:00, data_interval_end=2024-02-24 01:00:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:00:06.184545962Z [2024-02-24T01:00:06.184+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:00:00+00:00, run_after=2024-02-24T01:01:00+00:00 2024-02-24T01:00:06.192741286Z [2024-02-24T01:00:06.192+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:00:06.193097414Z [2024-02-24T01:00:06.192+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:59:00+00:00, run_id=scheduled__2024-02-24T00:59:00+00:00, run_start_date=2024-02-24 01:00:01.104180+00:00, run_end_date=2024-02-24 01:00:06.192696+00:00, run_duration=5.088516, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:59:00+00:00, data_interval_end=2024-02-24 01:00:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:00:06.202840854Z [2024-02-24T01:00:06.202+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:00:00+00:00, run_after=2024-02-24T01:01:00+00:00 2024-02-24T01:00:06.274296901Z [2024-02-24T01:00:06.273+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:00:06.274328851Z 2024-02-24T01:00:06.274640041Z [2024-02-24T01:00:06.274+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:00:06.275645069Z [2024-02-24T01:00:06.275+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:00:06.275681948Z 2024-02-24T01:00:06.279068511Z [2024-02-24T01:00:06.278+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T00:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T01:00:06.279336735Z [2024-02-24T01:00:06.279+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T01:00:06.339503004Z [2024-02-24T01:00:06.339+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T00:55:00+00:00 exited with status queued for try_number 1 2024-02-24T01:00:06.339756184Z [2024-02-24T01:00:06.339+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:59:00+00:00 exited with status success for try_number 1 2024-02-24T01:00:06.339975983Z [2024-02-24T01:00:06.339+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T00:59:00+00:00 exited with status success for try_number 1 2024-02-24T01:00:06.340145790Z [2024-02-24T01:00:06.339+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T00:55:00+00:00 exited with status success for try_number 1 2024-02-24T01:00:06.349920017Z [2024-02-24T01:00:06.349+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:59:00+00:00, map_index=-1, run_start_date=2024-02-24 01:00:03.850503+00:00, run_end_date=2024-02-24 01:00:05.243071+00:00, run_duration=1.392568, state=success, executor_state=success, try_number=1, max_tries=1, job_id=398, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:00:01.189923+00:00, queued_by_job_id=2, pid=5870 2024-02-24T01:00:06.350230586Z [2024-02-24T01:00:06.350+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T00:59:00+00:00, map_index=-1, run_start_date=2024-02-24 01:00:03.977687+00:00, run_end_date=2024-02-24 01:00:05.634143+00:00, run_duration=1.656456, state=success, executor_state=success, try_number=1, max_tries=1, job_id=399, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:00:01.189923+00:00, queued_by_job_id=2, pid=5874 2024-02-24T01:00:06.350513174Z [2024-02-24T01:00:06.350+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T00:55:00+00:00, map_index=-1, run_start_date=2024-02-24 01:00:05.863008+00:00, run_end_date=2024-02-24 01:00:06.190784+00:00, run_duration=0.327776, state=success, executor_state=success, try_number=1, max_tries=1, job_id=400, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:00:04.168493+00:00, queued_by_job_id=2, pid=5894 2024-02-24T01:00:06.350746069Z [2024-02-24T01:00:06.350+0000] {scheduler_job.py:635} INFO - Setting external_id for to 16969339-b15a-4f44-a2ec-1cc08a4d8107 2024-02-24T01:00:08.657912048Z [2024-02-24T01:00:08.655+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:00:08.657990288Z 2024-02-24T01:00:08.658014247Z [2024-02-24T01:00:08.656+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:00:08.658020755Z [2024-02-24T01:00:08.656+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:00:08.658025385Z 2024-02-24T01:00:08.660396204Z [2024-02-24T01:00:08.659+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:00:08.660432403Z [2024-02-24T01:00:08.659+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T01:00:08.726117364Z [2024-02-24T01:00:08.725+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T00:55:00+00:00 exited with status queued for try_number 1 2024-02-24T01:00:08.726294104Z [2024-02-24T01:00:08.726+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T00:55:00+00:00 exited with status success for try_number 1 2024-02-24T01:00:08.735167527Z [2024-02-24T01:00:08.734+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3049934-a26b-45db-8c0a-3dc204402f1b 2024-02-24T01:00:08.735481358Z [2024-02-24T01:00:08.735+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T00:55:00+00:00, map_index=0, run_start_date=2024-02-24 01:00:08.012178+00:00, run_end_date=2024-02-24 01:00:08.341316+00:00, run_duration=0.329138, state=success, executor_state=success, try_number=1, max_tries=1, job_id=401, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:00:06.276232+00:00, queued_by_job_id=2, pid=5902 2024-02-24T01:00:10.773643495Z [2024-02-24T01:00:10.773+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:00:10.774032936Z [2024-02-24T01:00:10.773+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 00:55:00+00:00, run_id=scheduled__2024-02-24T00:55:00+00:00, run_start_date=2024-02-24 01:00:01.099857+00:00, run_end_date=2024-02-24 01:00:10.773469+00:00, run_duration=9.673612, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 00:55:00+00:00, data_interval_end=2024-02-24 01:00:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T01:00:10.781383565Z [2024-02-24T01:00:10.780+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:00:00+00:00, run_after=2024-02-24T01:05:00+00:00 2024-02-24T01:00:11.856776164Z [2024-02-24T01:00:11.856+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T00:55:00+00:00 exited with status success for try_number 1 2024-02-24T01:00:11.862557711Z [2024-02-24T01:00:11.862+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T00:55:00+00:00, map_index=-1, run_start_date=2024-02-24 01:00:10.370694+00:00, run_end_date=2024-02-24 01:00:10.692313+00:00, run_duration=0.321619, state=success, executor_state=success, try_number=1, max_tries=1, job_id=402, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:00:08.657189+00:00, queued_by_job_id=2, pid=5910 2024-02-24T01:01:00.216772150Z [2024-02-24T01:01:00.216+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:01:00+00:00, run_after=2024-02-24T01:02:00+00:00 2024-02-24T01:01:00.229395801Z [2024-02-24T01:01:00.228+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:01:00.251448240Z [2024-02-24T01:01:00.251+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:01:00+00:00, run_after=2024-02-24T01:02:00+00:00 2024-02-24T01:01:00.328347719Z [2024-02-24T01:01:00.327+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T01:01:00.328381032Z 2024-02-24T01:01:00.328387750Z 2024-02-24T01:01:00.328393684Z 2024-02-24T01:01:00.328433627Z [2024-02-24T01:01:00.328+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:01:00.328684228Z [2024-02-24T01:01:00.328+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:01:00.328757660Z [2024-02-24T01:01:00.328+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:01:00.329723408Z [2024-02-24T01:01:00.329+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:01:00.329756018Z 2024-02-24T01:01:00.329762496Z 2024-02-24T01:01:00.329794155Z 2024-02-24T01:01:00.333927178Z [2024-02-24T01:01:00.333+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:01:00.334221161Z [2024-02-24T01:01:00.333+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:01:00.334684971Z [2024-02-24T01:01:00.334+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:01:00.335174485Z [2024-02-24T01:01:00.334+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:01:00.335840566Z [2024-02-24T01:01:00.335+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:01:00.336186800Z [2024-02-24T01:01:00.335+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:01:00.547122698Z [2024-02-24T01:01:00.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:00:00+00:00 exited with status queued for try_number 1 2024-02-24T01:01:00.547230238Z [2024-02-24T01:01:00.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:00:00+00:00 exited with status queued for try_number 1 2024-02-24T01:01:00.547386080Z [2024-02-24T01:01:00.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:00:00+00:00 exited with status queued for try_number 1 2024-02-24T01:01:00.554678437Z [2024-02-24T01:01:00.554+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35b1a507-a8ed-4389-8b35-e004725b9712 2024-02-24T01:01:00.554880297Z [2024-02-24T01:01:00.554+0000] {scheduler_job.py:635} INFO - Setting external_id for to dbaca769-303b-4598-99cc-a243667be742 2024-02-24T01:01:00.555141939Z [2024-02-24T01:01:00.554+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f46f598-f840-4000-94e3-f24598917342 2024-02-24T01:01:02.081513376Z [2024-02-24T01:01:02.080+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:01:02.082305874Z [2024-02-24T01:01:02.081+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:00:00+00:00, run_id=scheduled__2024-02-24T01:00:00+00:00, run_start_date=2024-02-24 01:01:00.265647+00:00, run_end_date=2024-02-24 01:01:02.081613+00:00, run_duration=1.815966, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:00:00+00:00, data_interval_end=2024-02-24 01:01:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:01:02.104504305Z [2024-02-24T01:01:02.103+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:01:00+00:00, run_after=2024-02-24T01:02:00+00:00 2024-02-24T01:01:02.186413152Z [2024-02-24T01:01:02.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:00:00+00:00 exited with status success for try_number 1 2024-02-24T01:01:02.196061572Z [2024-02-24T01:01:02.195+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:00:00+00:00, map_index=-1, run_start_date=2024-02-24 01:01:01.060995+00:00, run_end_date=2024-02-24 01:01:01.443182+00:00, run_duration=0.382187, state=success, executor_state=success, try_number=1, max_tries=1, job_id=403, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:01:00.330655+00:00, queued_by_job_id=2, pid=5933 2024-02-24T01:01:04.362257809Z [2024-02-24T01:01:04.361+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:01:04.362859910Z [2024-02-24T01:01:04.362+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:00:00+00:00, run_id=scheduled__2024-02-24T01:00:00+00:00, run_start_date=2024-02-24 01:01:00.268109+00:00, run_end_date=2024-02-24 01:01:04.362271+00:00, run_duration=4.094162, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:00:00+00:00, data_interval_end=2024-02-24 01:01:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:01:04.381597408Z [2024-02-24T01:01:04.381+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:01:00+00:00, run_after=2024-02-24T01:02:00+00:00 2024-02-24T01:01:04.394091556Z [2024-02-24T01:01:04.393+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:01:04.394547935Z [2024-02-24T01:01:04.394+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:00:00+00:00, run_id=scheduled__2024-02-24T01:00:00+00:00, run_start_date=2024-02-24 01:01:00.266874+00:00, run_end_date=2024-02-24 01:01:04.394064+00:00, run_duration=4.12719, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:00:00+00:00, data_interval_end=2024-02-24 01:01:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:01:04.414723631Z [2024-02-24T01:01:04.414+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:01:00+00:00, run_after=2024-02-24T01:02:00+00:00 2024-02-24T01:01:04.454445209Z [2024-02-24T01:01:04.454+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:00:00+00:00 exited with status success for try_number 1 2024-02-24T01:01:04.454559831Z [2024-02-24T01:01:04.454+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:00:00+00:00 exited with status success for try_number 1 2024-02-24T01:01:04.462545256Z [2024-02-24T01:01:04.462+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:00:00+00:00, map_index=-1, run_start_date=2024-02-24 01:01:02.237621+00:00, run_end_date=2024-02-24 01:01:03.921433+00:00, run_duration=1.683812, state=success, executor_state=success, try_number=1, max_tries=1, job_id=404, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:01:00.330655+00:00, queued_by_job_id=2, pid=5951 2024-02-24T01:01:04.462893325Z [2024-02-24T01:01:04.462+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:00:00+00:00, map_index=-1, run_start_date=2024-02-24 01:01:02.348934+00:00, run_end_date=2024-02-24 01:01:03.856348+00:00, run_duration=1.507414, state=success, executor_state=success, try_number=1, max_tries=1, job_id=405, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:01:00.330655+00:00, queued_by_job_id=2, pid=5952 2024-02-24T01:02:01.000902570Z [2024-02-24T01:02:01.000+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:02:01.041352036Z [2024-02-24T01:02:01.040+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:02:00+00:00, run_after=2024-02-24T01:03:00+00:00 2024-02-24T01:02:01.059448252Z [2024-02-24T01:02:01.059+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:02:00+00:00, run_after=2024-02-24T01:03:00+00:00 2024-02-24T01:02:01.066311350Z [2024-02-24T01:02:01.065+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:02:01.189112992Z [2024-02-24T01:02:01.188+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T01:02:01.189218992Z 2024-02-24T01:02:01.189226786Z 2024-02-24T01:02:01.189232663Z 2024-02-24T01:02:01.189238939Z 2024-02-24T01:02:01.189539356Z [2024-02-24T01:02:01.188+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T01:02:01.189888771Z [2024-02-24T01:02:01.189+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:02:01.190864165Z [2024-02-24T01:02:01.189+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:02:01.191097280Z [2024-02-24T01:02:01.190+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:02:01.192412695Z [2024-02-24T01:02:01.192+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:02:01.192426940Z 2024-02-24T01:02:01.192433219Z 2024-02-24T01:02:01.192439093Z 2024-02-24T01:02:01.192444686Z 2024-02-24T01:02:01.199053257Z [2024-02-24T01:02:01.198+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:02:01.199422425Z [2024-02-24T01:02:01.198+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T01:02:01.199749492Z [2024-02-24T01:02:01.199+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:02:01.200420773Z [2024-02-24T01:02:01.199+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:02:01.200997008Z [2024-02-24T01:02:01.200+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:02:01.201136954Z [2024-02-24T01:02:01.200+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:02:01.201525582Z [2024-02-24T01:02:01.201+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:02:01.201965092Z [2024-02-24T01:02:01.201+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:02:01.680484584Z [2024-02-24T01:02:01.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:00:00+00:00 exited with status queued for try_number 1 2024-02-24T01:02:01.682941863Z [2024-02-24T01:02:01.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:01:00+00:00 exited with status queued for try_number 1 2024-02-24T01:02:01.683275499Z [2024-02-24T01:02:01.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:01:00+00:00 exited with status queued for try_number 1 2024-02-24T01:02:01.683493659Z [2024-02-24T01:02:01.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:01:00+00:00 exited with status queued for try_number 1 2024-02-24T01:02:01.695463975Z [2024-02-24T01:02:01.695+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d8d3691-a067-4e65-830d-133f961c9238 2024-02-24T01:02:01.695863832Z [2024-02-24T01:02:01.695+0000] {scheduler_job.py:635} INFO - Setting external_id for to 45e19e73-5664-458b-8cdd-1293ca677f4b 2024-02-24T01:02:01.696119276Z [2024-02-24T01:02:01.695+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c2d5712-7bf5-40b9-bc63-e85bbc83d56f 2024-02-24T01:02:01.696373143Z [2024-02-24T01:02:01.696+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0f0c60ea-f590-4920-8c04-ce76621092d2 2024-02-24T01:02:01.829309773Z [2024-02-24T01:02:01.828+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T01:02:03.805977810Z [2024-02-24T01:02:03.805+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:02:03.806198216Z [2024-02-24T01:02:03.806+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 01:00:00+00:00, run_id=scheduled__2024-02-24T01:00:00+00:00, run_start_date=2024-02-24 01:02:01.081987+00:00, run_end_date=2024-02-24 01:02:03.805877+00:00, run_duration=2.72389, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:00:00+00:00, data_interval_end=2024-02-24 01:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T01:02:03.818866618Z [2024-02-24T01:02:03.818+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T01:02:00+00:00, run_after=2024-02-24T01:04:00+00:00 2024-02-24T01:02:03.828178841Z [2024-02-24T01:02:03.827+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:02:03.828307493Z [2024-02-24T01:02:03.828+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:01:00+00:00, run_id=scheduled__2024-02-24T01:01:00+00:00, run_start_date=2024-02-24 01:02:01.084813+00:00, run_end_date=2024-02-24 01:02:03.828055+00:00, run_duration=2.743242, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:01:00+00:00, data_interval_end=2024-02-24 01:02:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:02:03.841618025Z [2024-02-24T01:02:03.841+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:02:00+00:00, run_after=2024-02-24T01:03:00+00:00 2024-02-24T01:02:03.897179499Z [2024-02-24T01:02:03.896+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:00:00+00:00 exited with status success for try_number 1 2024-02-24T01:02:03.901960742Z [2024-02-24T01:02:03.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:01:00+00:00 exited with status success for try_number 1 2024-02-24T01:02:03.922087852Z [2024-02-24T01:02:03.919+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:01:00+00:00, map_index=-1, run_start_date=2024-02-24 01:02:02.270930+00:00, run_end_date=2024-02-24 01:02:02.857988+00:00, run_duration=0.587058, state=success, executor_state=success, try_number=1, max_tries=1, job_id=407, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:02:01.193684+00:00, queued_by_job_id=2, pid=5987 2024-02-24T01:02:03.922110549Z [2024-02-24T01:02:03.919+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T01:00:00+00:00, map_index=-1, run_start_date=2024-02-24 01:02:02.208193+00:00, run_end_date=2024-02-24 01:02:02.693714+00:00, run_duration=0.485521, state=success, executor_state=success, try_number=1, max_tries=1, job_id=406, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:02:01.193684+00:00, queued_by_job_id=2, pid=5985 2024-02-24T01:02:04.968693104Z [2024-02-24T01:02:04.967+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:02:04.968723276Z [2024-02-24T01:02:04.968+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:01:00+00:00, run_id=scheduled__2024-02-24T01:01:00+00:00, run_start_date=2024-02-24 01:02:01.086886+00:00, run_end_date=2024-02-24 01:02:04.968087+00:00, run_duration=3.881201, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:01:00+00:00, data_interval_end=2024-02-24 01:02:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:02:04.978124211Z [2024-02-24T01:02:04.977+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:02:00+00:00, run_after=2024-02-24T01:03:00+00:00 2024-02-24T01:02:05.032320777Z [2024-02-24T01:02:05.031+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:01:00+00:00 exited with status success for try_number 1 2024-02-24T01:02:05.038936748Z [2024-02-24T01:02:05.038+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:01:00+00:00, map_index=-1, run_start_date=2024-02-24 01:02:03.468495+00:00, run_end_date=2024-02-24 01:02:04.838914+00:00, run_duration=1.370419, state=success, executor_state=success, try_number=1, max_tries=1, job_id=409, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:02:01.193684+00:00, queued_by_job_id=2, pid=6010 2024-02-24T01:02:06.093722418Z [2024-02-24T01:02:06.092+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:02:06.094691594Z [2024-02-24T01:02:06.094+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:01:00+00:00, run_id=scheduled__2024-02-24T01:01:00+00:00, run_start_date=2024-02-24 01:02:01.088523+00:00, run_end_date=2024-02-24 01:02:06.093938+00:00, run_duration=5.005415, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:01:00+00:00, data_interval_end=2024-02-24 01:02:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:02:06.107396559Z [2024-02-24T01:02:06.106+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:02:00+00:00, run_after=2024-02-24T01:03:00+00:00 2024-02-24T01:02:06.136014819Z [2024-02-24T01:02:06.135+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:01:00+00:00 exited with status success for try_number 1 2024-02-24T01:02:06.141989045Z [2024-02-24T01:02:06.141+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:01:00+00:00, map_index=-1, run_start_date=2024-02-24 01:02:03.356423+00:00, run_end_date=2024-02-24 01:02:05.044759+00:00, run_duration=1.688336, state=success, executor_state=success, try_number=1, max_tries=1, job_id=408, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:02:01.193684+00:00, queued_by_job_id=2, pid=6009 2024-02-24T01:03:00.802606509Z [2024-02-24T01:03:00.802+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:03:00+00:00, run_after=2024-02-24T01:04:00+00:00 2024-02-24T01:03:00.816428635Z [2024-02-24T01:03:00.816+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:03:00.834881883Z [2024-02-24T01:03:00.834+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:03:00+00:00, run_after=2024-02-24T01:04:00+00:00 2024-02-24T01:03:00.907167807Z [2024-02-24T01:03:00.906+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T01:03:00.907192843Z 2024-02-24T01:03:00.907197363Z 2024-02-24T01:03:00.907200953Z 2024-02-24T01:03:00.907274661Z [2024-02-24T01:03:00.907+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:03:00.907456095Z [2024-02-24T01:03:00.907+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:03:00.907612856Z [2024-02-24T01:03:00.907+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:03:00.908232743Z [2024-02-24T01:03:00.908+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:03:00.908255788Z 2024-02-24T01:03:00.908259307Z 2024-02-24T01:03:00.908262368Z 2024-02-24T01:03:00.911561850Z [2024-02-24T01:03:00.911+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:03:00.911710090Z [2024-02-24T01:03:00.911+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:03:00.911991948Z [2024-02-24T01:03:00.911+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:03:00.912422112Z [2024-02-24T01:03:00.912+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:03:00.912727264Z [2024-02-24T01:03:00.912+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:03:00.912891749Z [2024-02-24T01:03:00.912+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:03:01.455614037Z [2024-02-24T01:03:01.454+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:02:00+00:00 exited with status queued for try_number 1 2024-02-24T01:03:01.455635466Z [2024-02-24T01:03:01.454+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:02:00+00:00 exited with status queued for try_number 1 2024-02-24T01:03:01.455639456Z [2024-02-24T01:03:01.455+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:02:00+00:00 exited with status queued for try_number 1 2024-02-24T01:03:01.482363845Z [2024-02-24T01:03:01.480+0000] {scheduler_job.py:635} INFO - Setting external_id for to a58833c3-3f3e-453b-9f70-aeadb86910e7 2024-02-24T01:03:01.482384164Z [2024-02-24T01:03:01.481+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81a632a9-dbe6-4630-b7fc-734d5e9a9d65 2024-02-24T01:03:01.483707557Z [2024-02-24T01:03:01.482+0000] {scheduler_job.py:635} INFO - Setting external_id for to 38f25de5-ff08-42a0-aefb-b5e117a7087f 2024-02-24T01:03:04.167552822Z [2024-02-24T01:03:04.167+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:03:04.168360853Z [2024-02-24T01:03:04.168+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:02:00+00:00, run_id=scheduled__2024-02-24T01:02:00+00:00, run_start_date=2024-02-24 01:03:00.849233+00:00, run_end_date=2024-02-24 01:03:04.167996+00:00, run_duration=3.318763, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:02:00+00:00, data_interval_end=2024-02-24 01:03:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:03:04.178059394Z [2024-02-24T01:03:04.177+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:03:00+00:00, run_after=2024-02-24T01:04:00+00:00 2024-02-24T01:03:04.234615968Z [2024-02-24T01:03:04.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:02:00+00:00 exited with status success for try_number 1 2024-02-24T01:03:04.239214049Z [2024-02-24T01:03:04.238+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:02:00+00:00, map_index=-1, run_start_date=2024-02-24 01:03:03.156918+00:00, run_end_date=2024-02-24 01:03:03.885962+00:00, run_duration=0.729044, state=success, executor_state=success, try_number=1, max_tries=1, job_id=410, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:03:00.909036+00:00, queued_by_job_id=2, pid=6042 2024-02-24T01:03:07.442450753Z [2024-02-24T01:03:07.442+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:03:07.442885204Z [2024-02-24T01:03:07.442+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:02:00+00:00, run_id=scheduled__2024-02-24T01:02:00+00:00, run_start_date=2024-02-24 01:03:00.850559+00:00, run_end_date=2024-02-24 01:03:07.442297+00:00, run_duration=6.591738, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:02:00+00:00, data_interval_end=2024-02-24 01:03:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:03:07.453025446Z [2024-02-24T01:03:07.452+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:03:00+00:00, run_after=2024-02-24T01:04:00+00:00 2024-02-24T01:03:07.503535705Z [2024-02-24T01:03:07.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:02:00+00:00 exited with status success for try_number 1 2024-02-24T01:03:07.509171861Z [2024-02-24T01:03:07.508+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:02:00+00:00, map_index=-1, run_start_date=2024-02-24 01:03:04.560348+00:00, run_end_date=2024-02-24 01:03:06.387087+00:00, run_duration=1.826739, state=success, executor_state=success, try_number=1, max_tries=1, job_id=411, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:03:00.909036+00:00, queued_by_job_id=2, pid=6055 2024-02-24T01:03:08.162801504Z [2024-02-24T01:03:08.162+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:03:08.163148665Z [2024-02-24T01:03:08.162+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:02:00+00:00, run_id=scheduled__2024-02-24T01:02:00+00:00, run_start_date=2024-02-24 01:03:00.851618+00:00, run_end_date=2024-02-24 01:03:08.162824+00:00, run_duration=7.311206, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:02:00+00:00, data_interval_end=2024-02-24 01:03:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:03:08.172153180Z [2024-02-24T01:03:08.171+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:03:00+00:00, run_after=2024-02-24T01:04:00+00:00 2024-02-24T01:03:08.205035315Z [2024-02-24T01:03:08.204+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:02:00+00:00 exited with status success for try_number 1 2024-02-24T01:03:08.210032828Z [2024-02-24T01:03:08.209+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:02:00+00:00, map_index=-1, run_start_date=2024-02-24 01:03:05.048118+00:00, run_end_date=2024-02-24 01:03:07.631675+00:00, run_duration=2.583557, state=success, executor_state=success, try_number=1, max_tries=1, job_id=412, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:03:00.909036+00:00, queued_by_job_id=2, pid=6066 2024-02-24T01:04:00.203983680Z [2024-02-24T01:04:00.203+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:04:00+00:00, run_after=2024-02-24T01:05:00+00:00 2024-02-24T01:04:00.216426095Z [2024-02-24T01:04:00.215+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:04:00.233714021Z [2024-02-24T01:04:00.233+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:04:00+00:00, run_after=2024-02-24T01:05:00+00:00 2024-02-24T01:04:00.245938734Z [2024-02-24T01:04:00.245+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:04:00.341581207Z [2024-02-24T01:04:00.340+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T01:04:00.341642122Z 2024-02-24T01:04:00.341654781Z 2024-02-24T01:04:00.341663615Z 2024-02-24T01:04:00.341708393Z 2024-02-24T01:04:00.341718624Z [2024-02-24T01:04:00.341+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T01:04:00.341879605Z [2024-02-24T01:04:00.341+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:04:00.342137719Z [2024-02-24T01:04:00.341+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:04:00.342246021Z [2024-02-24T01:04:00.342+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:04:00.343257385Z [2024-02-24T01:04:00.342+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:04:00.343274254Z 2024-02-24T01:04:00.343279682Z 2024-02-24T01:04:00.343285369Z 2024-02-24T01:04:00.343290071Z 2024-02-24T01:04:00.348798870Z [2024-02-24T01:04:00.348+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:04:00.349038376Z [2024-02-24T01:04:00.348+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T01:04:00.349395234Z [2024-02-24T01:04:00.349+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:04:00.349716540Z [2024-02-24T01:04:00.349+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:04:00.350068337Z [2024-02-24T01:04:00.349+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:04:00.350236407Z [2024-02-24T01:04:00.350+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:04:00.350508327Z [2024-02-24T01:04:00.350+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:04:00.350752335Z [2024-02-24T01:04:00.350+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:04:00.783585691Z [2024-02-24T01:04:00.781+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:02:00+00:00 exited with status queued for try_number 1 2024-02-24T01:04:00.783616641Z [2024-02-24T01:04:00.782+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:03:00+00:00 exited with status queued for try_number 1 2024-02-24T01:04:00.783620286Z [2024-02-24T01:04:00.782+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:03:00+00:00 exited with status queued for try_number 1 2024-02-24T01:04:00.783629577Z [2024-02-24T01:04:00.782+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:03:00+00:00 exited with status queued for try_number 1 2024-02-24T01:04:00.792843661Z [2024-02-24T01:04:00.792+0000] {scheduler_job.py:635} INFO - Setting external_id for to cbcc05f4-d7c5-4303-99a8-62f2e1e88529 2024-02-24T01:04:00.793418097Z [2024-02-24T01:04:00.792+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c12018f-a66c-4907-bcbf-f6ee060cd1f8 2024-02-24T01:04:00.793673002Z [2024-02-24T01:04:00.793+0000] {scheduler_job.py:635} INFO - Setting external_id for to ae3cee21-fd1c-45d9-aed2-458d2717cda4 2024-02-24T01:04:00.793852402Z [2024-02-24T01:04:00.793+0000] {scheduler_job.py:635} INFO - Setting external_id for to 048a081a-011d-4bfb-b3b9-52b6abdaa443 2024-02-24T01:04:02.023240011Z [2024-02-24T01:04:02.022+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:04:02.023604460Z [2024-02-24T01:04:02.023+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 01:02:00+00:00, run_id=scheduled__2024-02-24T01:02:00+00:00, run_start_date=2024-02-24 01:04:00.259254+00:00, run_end_date=2024-02-24 01:04:02.023155+00:00, run_duration=1.763901, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:02:00+00:00, data_interval_end=2024-02-24 01:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T01:04:02.036967702Z [2024-02-24T01:04:02.036+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T01:04:00+00:00, run_after=2024-02-24T01:06:00+00:00 2024-02-24T01:04:02.228952632Z [2024-02-24T01:04:02.228+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:02:00+00:00 exited with status success for try_number 1 2024-02-24T01:04:02.237676617Z [2024-02-24T01:04:02.237+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T01:02:00+00:00, map_index=-1, run_start_date=2024-02-24 01:04:01.403738+00:00, run_end_date=2024-02-24 01:04:01.905123+00:00, run_duration=0.501385, state=success, executor_state=success, try_number=1, max_tries=1, job_id=413, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:04:00.344382+00:00, queued_by_job_id=2, pid=6093 2024-02-24T01:04:03.295726422Z [2024-02-24T01:04:03.295+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:04:03.295915007Z [2024-02-24T01:04:03.295+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:03:00+00:00, run_id=scheduled__2024-02-24T01:03:00+00:00, run_start_date=2024-02-24 01:04:00.261279+00:00, run_end_date=2024-02-24 01:04:03.295488+00:00, run_duration=3.034209, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:03:00+00:00, data_interval_end=2024-02-24 01:04:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:04:03.306667571Z [2024-02-24T01:04:03.306+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:04:00+00:00, run_after=2024-02-24T01:05:00+00:00 2024-02-24T01:04:03.389443624Z [2024-02-24T01:04:03.389+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:03:00+00:00 exited with status success for try_number 1 2024-02-24T01:04:03.397127171Z [2024-02-24T01:04:03.396+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:03:00+00:00, map_index=-1, run_start_date=2024-02-24 01:04:01.542838+00:00, run_end_date=2024-02-24 01:04:02.184659+00:00, run_duration=0.641821, state=success, executor_state=success, try_number=1, max_tries=1, job_id=414, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:04:00.344382+00:00, queued_by_job_id=2, pid=6094 2024-02-24T01:04:05.312068125Z [2024-02-24T01:04:05.311+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:04:05.312579530Z [2024-02-24T01:04:05.312+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:03:00+00:00, run_id=scheduled__2024-02-24T01:03:00+00:00, run_start_date=2024-02-24 01:04:00.264032+00:00, run_end_date=2024-02-24 01:04:05.311989+00:00, run_duration=5.047957, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:03:00+00:00, data_interval_end=2024-02-24 01:04:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:04:05.322126077Z [2024-02-24T01:04:05.321+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:04:00+00:00, run_after=2024-02-24T01:05:00+00:00 2024-02-24T01:04:05.330258812Z [2024-02-24T01:04:05.329+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:04:05.330513533Z [2024-02-24T01:04:05.330+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:03:00+00:00, run_id=scheduled__2024-02-24T01:03:00+00:00, run_start_date=2024-02-24 01:04:00.262745+00:00, run_end_date=2024-02-24 01:04:05.330159+00:00, run_duration=5.067414, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:03:00+00:00, data_interval_end=2024-02-24 01:04:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:04:05.341485798Z [2024-02-24T01:04:05.341+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:04:00+00:00, run_after=2024-02-24T01:05:00+00:00 2024-02-24T01:04:05.379040874Z [2024-02-24T01:04:05.378+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:03:00+00:00 exited with status success for try_number 1 2024-02-24T01:04:05.379286313Z [2024-02-24T01:04:05.379+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:03:00+00:00 exited with status success for try_number 1 2024-02-24T01:04:05.388071176Z [2024-02-24T01:04:05.387+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:03:00+00:00, map_index=-1, run_start_date=2024-02-24 01:04:03.157988+00:00, run_end_date=2024-02-24 01:04:05.014847+00:00, run_duration=1.856859, state=success, executor_state=success, try_number=1, max_tries=1, job_id=415, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:04:00.344382+00:00, queued_by_job_id=2, pid=6117 2024-02-24T01:04:05.388538063Z [2024-02-24T01:04:05.388+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:03:00+00:00, map_index=-1, run_start_date=2024-02-24 01:04:03.265739+00:00, run_end_date=2024-02-24 01:04:04.950822+00:00, run_duration=1.685083, state=success, executor_state=success, try_number=1, max_tries=1, job_id=416, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:04:00.344382+00:00, queued_by_job_id=2, pid=6118 2024-02-24T01:05:00.112196469Z [2024-02-24T01:05:00.111+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:05:00.139330730Z [2024-02-24T01:05:00.138+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:05:00+00:00, run_after=2024-02-24T01:10:00+00:00 2024-02-24T01:05:00.158146040Z [2024-02-24T01:05:00.157+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:05:00+00:00, run_after=2024-02-24T01:06:00+00:00 2024-02-24T01:05:00.171560802Z [2024-02-24T01:05:00.171+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:05:00+00:00, run_after=2024-02-24T01:06:00+00:00 2024-02-24T01:05:00.261465555Z [2024-02-24T01:05:00.260+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T01:05:00.261494320Z 2024-02-24T01:05:00.261505184Z 2024-02-24T01:05:00.261530494Z 2024-02-24T01:05:00.261534993Z 2024-02-24T01:05:00.261674283Z [2024-02-24T01:05:00.261+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:05:00.261924486Z [2024-02-24T01:05:00.261+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:05:00.262134358Z [2024-02-24T01:05:00.261+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:05:00.262343677Z [2024-02-24T01:05:00.262+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:05:00.263221543Z [2024-02-24T01:05:00.262+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:05:00.263230128Z 2024-02-24T01:05:00.263234661Z 2024-02-24T01:05:00.263238903Z 2024-02-24T01:05:00.263243130Z 2024-02-24T01:05:00.267958227Z [2024-02-24T01:05:00.267+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T01:05:00.268302868Z [2024-02-24T01:05:00.267+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T01:05:00.268748835Z [2024-02-24T01:05:00.268+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:05:00.268983970Z [2024-02-24T01:05:00.268+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:05:00.269369739Z [2024-02-24T01:05:00.269+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:05:00.269600837Z [2024-02-24T01:05:00.269+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:05:00.269985999Z [2024-02-24T01:05:00.269+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:05:00.270211744Z [2024-02-24T01:05:00.270+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:05:00.594586581Z [2024-02-24T01:05:00.594+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T01:00:00+00:00 exited with status queued for try_number 1 2024-02-24T01:05:00.594759512Z [2024-02-24T01:05:00.594+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:04:00+00:00 exited with status queued for try_number 1 2024-02-24T01:05:00.594909102Z [2024-02-24T01:05:00.594+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:04:00+00:00 exited with status queued for try_number 1 2024-02-24T01:05:00.595030030Z [2024-02-24T01:05:00.594+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:04:00+00:00 exited with status queued for try_number 1 2024-02-24T01:05:00.603109001Z [2024-02-24T01:05:00.602+0000] {scheduler_job.py:635} INFO - Setting external_id for to 26aeea30-6ade-46c5-9f78-59b8aebeee56 2024-02-24T01:05:00.603284855Z [2024-02-24T01:05:00.603+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b7212e9-f3ad-4765-bb70-9867364c6631 2024-02-24T01:05:00.603453437Z [2024-02-24T01:05:00.603+0000] {scheduler_job.py:635} INFO - Setting external_id for to 41775535-3f49-4e61-911e-2a2edd1621b4 2024-02-24T01:05:00.603647596Z [2024-02-24T01:05:00.603+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23821bbf-7fe4-4f6d-ab80-6e61f494c525 2024-02-24T01:05:01.806703367Z [2024-02-24T01:05:01.806+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:05:01.807116663Z [2024-02-24T01:05:01.806+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:04:00+00:00, run_id=scheduled__2024-02-24T01:04:00+00:00, run_start_date=2024-02-24 01:05:00.186102+00:00, run_end_date=2024-02-24 01:05:01.806754+00:00, run_duration=1.620652, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:04:00+00:00, data_interval_end=2024-02-24 01:05:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:05:01.818084530Z [2024-02-24T01:05:01.817+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:05:00+00:00, run_after=2024-02-24T01:06:00+00:00 2024-02-24T01:05:01.861368011Z [2024-02-24T01:05:01.861+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:04:00+00:00 exited with status success for try_number 1 2024-02-24T01:05:01.869632792Z [2024-02-24T01:05:01.869+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:04:00+00:00, map_index=-1, run_start_date=2024-02-24 01:05:01.155707+00:00, run_end_date=2024-02-24 01:05:01.580541+00:00, run_duration=0.424834, state=success, executor_state=success, try_number=1, max_tries=1, job_id=417, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:05:00.264542+00:00, queued_by_job_id=2, pid=6152 2024-02-24T01:05:04.080361590Z [2024-02-24T01:05:04.079+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:05:04.080389338Z 2024-02-24T01:05:04.080621779Z [2024-02-24T01:05:04.080+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:05:04.081310970Z [2024-02-24T01:05:04.081+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:05:04.081327988Z 2024-02-24T01:05:04.084168118Z [2024-02-24T01:05:04.083+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T01:05:04.084476453Z [2024-02-24T01:05:04.084+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T01:05:04.148939526Z [2024-02-24T01:05:04.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T01:00:00+00:00 exited with status queued for try_number 1 2024-02-24T01:05:04.149039753Z [2024-02-24T01:05:04.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T01:00:00+00:00 exited with status success for try_number 1 2024-02-24T01:05:04.158642743Z [2024-02-24T01:05:04.158+0000] {scheduler_job.py:635} INFO - Setting external_id for to 617fac58-9780-410b-b67f-d150af97b569 2024-02-24T01:05:04.158978340Z [2024-02-24T01:05:04.158+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T01:00:00+00:00, map_index=-1, run_start_date=2024-02-24 01:05:02.471353+00:00, run_end_date=2024-02-24 01:05:03.056686+00:00, run_duration=0.585333, state=success, executor_state=success, try_number=1, max_tries=1, job_id=420, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:05:00.264542+00:00, queued_by_job_id=2, pid=6178 2024-02-24T01:05:04.235277798Z [2024-02-24T01:05:04.234+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:05:04.235588911Z [2024-02-24T01:05:04.235+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:04:00+00:00, run_id=scheduled__2024-02-24T01:04:00+00:00, run_start_date=2024-02-24 01:05:00.187194+00:00, run_end_date=2024-02-24 01:05:04.235139+00:00, run_duration=4.047945, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:04:00+00:00, data_interval_end=2024-02-24 01:05:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:05:04.252982196Z [2024-02-24T01:05:04.252+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:05:00+00:00, run_after=2024-02-24T01:06:00+00:00 2024-02-24T01:05:04.342496422Z [2024-02-24T01:05:04.342+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:04:00+00:00 exited with status success for try_number 1 2024-02-24T01:05:04.355474941Z [2024-02-24T01:05:04.354+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:04:00+00:00, map_index=-1, run_start_date=2024-02-24 01:05:02.347484+00:00, run_end_date=2024-02-24 01:05:04.049690+00:00, run_duration=1.702206, state=success, executor_state=success, try_number=1, max_tries=1, job_id=419, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:05:00.264542+00:00, queued_by_job_id=2, pid=6177 2024-02-24T01:05:05.405298034Z [2024-02-24T01:05:05.404+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:05:05.405831146Z [2024-02-24T01:05:05.405+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:04:00+00:00, run_id=scheduled__2024-02-24T01:04:00+00:00, run_start_date=2024-02-24 01:05:00.188271+00:00, run_end_date=2024-02-24 01:05:05.405234+00:00, run_duration=5.216963, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:04:00+00:00, data_interval_end=2024-02-24 01:05:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:05:05.424200492Z [2024-02-24T01:05:05.423+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:05:00+00:00, run_after=2024-02-24T01:06:00+00:00 2024-02-24T01:05:05.495512881Z [2024-02-24T01:05:05.494+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:04:00+00:00 exited with status success for try_number 1 2024-02-24T01:05:05.504420759Z [2024-02-24T01:05:05.503+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:04:00+00:00, map_index=-1, run_start_date=2024-02-24 01:05:02.297074+00:00, run_end_date=2024-02-24 01:05:04.350219+00:00, run_duration=2.053145, state=success, executor_state=success, try_number=1, max_tries=1, job_id=418, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:05:00.264542+00:00, queued_by_job_id=2, pid=6176 2024-02-24T01:05:06.858440544Z [2024-02-24T01:05:06.857+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:05:06.858478339Z 2024-02-24T01:05:06.858809176Z [2024-02-24T01:05:06.858+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:05:06.860263093Z [2024-02-24T01:05:06.859+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:05:06.860305833Z 2024-02-24T01:05:06.865503176Z [2024-02-24T01:05:06.864+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T01:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T01:05:06.865563395Z [2024-02-24T01:05:06.865+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T01:05:06.925061099Z [2024-02-24T01:05:06.924+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T01:00:00+00:00 exited with status queued for try_number 1 2024-02-24T01:05:06.925088420Z [2024-02-24T01:05:06.924+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T01:00:00+00:00 exited with status success for try_number 1 2024-02-24T01:05:06.932536471Z [2024-02-24T01:05:06.932+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4dfc7a48-42f6-4ac0-b248-6b6a1d49b2a0 2024-02-24T01:05:06.932804642Z [2024-02-24T01:05:06.932+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T01:00:00+00:00, map_index=-1, run_start_date=2024-02-24 01:05:05.779557+00:00, run_end_date=2024-02-24 01:05:06.209597+00:00, run_duration=0.43004, state=success, executor_state=success, try_number=1, max_tries=1, job_id=421, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:05:04.081879+00:00, queued_by_job_id=2, pid=6201 2024-02-24T01:05:09.233120941Z [2024-02-24T01:05:09.232+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:05:09.233147563Z 2024-02-24T01:05:09.233524068Z [2024-02-24T01:05:09.233+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:05:09.234399472Z [2024-02-24T01:05:09.234+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:05:09.234413355Z 2024-02-24T01:05:09.236983711Z [2024-02-24T01:05:09.236+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:05:09.237382817Z [2024-02-24T01:05:09.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T01:05:09.308701824Z [2024-02-24T01:05:09.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T01:00:00+00:00 exited with status queued for try_number 1 2024-02-24T01:05:09.308973386Z [2024-02-24T01:05:09.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T01:00:00+00:00 exited with status success for try_number 1 2024-02-24T01:05:09.317509081Z [2024-02-24T01:05:09.317+0000] {scheduler_job.py:635} INFO - Setting external_id for to 42b0dd03-e5ad-46ea-87ae-426526eb24b7 2024-02-24T01:05:09.317736366Z [2024-02-24T01:05:09.317+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T01:00:00+00:00, map_index=0, run_start_date=2024-02-24 01:05:08.561026+00:00, run_end_date=2024-02-24 01:05:08.975212+00:00, run_duration=0.414186, state=success, executor_state=success, try_number=1, max_tries=1, job_id=422, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:05:06.860858+00:00, queued_by_job_id=2, pid=6209 2024-02-24T01:05:11.931298790Z [2024-02-24T01:05:11.930+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:05:11.931526660Z [2024-02-24T01:05:11.931+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:00:00+00:00, run_id=scheduled__2024-02-24T01:00:00+00:00, run_start_date=2024-02-24 01:05:00.184684+00:00, run_end_date=2024-02-24 01:05:11.931111+00:00, run_duration=11.746427, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:00:00+00:00, data_interval_end=2024-02-24 01:05:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T01:05:11.939623677Z [2024-02-24T01:05:11.939+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:05:00+00:00, run_after=2024-02-24T01:10:00+00:00 2024-02-24T01:05:11.982163848Z [2024-02-24T01:05:11.980+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T01:00:00+00:00 exited with status success for try_number 1 2024-02-24T01:05:11.994609221Z [2024-02-24T01:05:11.994+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T01:00:00+00:00, map_index=-1, run_start_date=2024-02-24 01:05:10.928767+00:00, run_end_date=2024-02-24 01:05:11.341418+00:00, run_duration=0.412651, state=success, executor_state=success, try_number=1, max_tries=1, job_id=423, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:05:09.234960+00:00, queued_by_job_id=2, pid=6217 2024-02-24T01:06:00.505732910Z [2024-02-24T01:06:00.505+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:06:00.517834186Z [2024-02-24T01:06:00.517+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:06:00.535547543Z [2024-02-24T01:06:00.535+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:06:00+00:00, run_after=2024-02-24T01:07:00+00:00 2024-02-24T01:06:00.551079387Z [2024-02-24T01:06:00.550+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:06:00+00:00, run_after=2024-02-24T01:07:00+00:00 2024-02-24T01:06:00.661029088Z [2024-02-24T01:06:00.660+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T01:06:00.661064363Z 2024-02-24T01:06:00.661072588Z 2024-02-24T01:06:00.661078730Z 2024-02-24T01:06:00.661085405Z 2024-02-24T01:06:00.662903587Z [2024-02-24T01:06:00.662+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T01:06:00.664157845Z [2024-02-24T01:06:00.663+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:06:00.665977014Z [2024-02-24T01:06:00.665+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:06:00.674551512Z [2024-02-24T01:06:00.665+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:06:00.676173616Z [2024-02-24T01:06:00.675+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:06:00.676206169Z 2024-02-24T01:06:00.676210968Z 2024-02-24T01:06:00.676214270Z 2024-02-24T01:06:00.676217666Z 2024-02-24T01:06:00.688746829Z [2024-02-24T01:06:00.684+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:06:00.688785842Z [2024-02-24T01:06:00.684+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T01:06:00.688791565Z [2024-02-24T01:06:00.685+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:06:00.688812508Z [2024-02-24T01:06:00.685+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:06:00.688817427Z [2024-02-24T01:06:00.686+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:06:00.688821791Z [2024-02-24T01:06:00.686+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:06:00.688826012Z [2024-02-24T01:06:00.686+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:06:00.688830264Z [2024-02-24T01:06:00.687+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:06:01.184603517Z [2024-02-24T01:06:01.184+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:04:00+00:00 exited with status queued for try_number 1 2024-02-24T01:06:01.184661574Z [2024-02-24T01:06:01.184+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:05:00+00:00 exited with status queued for try_number 1 2024-02-24T01:06:01.184679744Z [2024-02-24T01:06:01.184+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:05:00+00:00 exited with status queued for try_number 1 2024-02-24T01:06:01.184927130Z [2024-02-24T01:06:01.184+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:05:00+00:00 exited with status queued for try_number 1 2024-02-24T01:06:01.193083720Z [2024-02-24T01:06:01.192+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc5dcd07-72d8-483a-a3ad-e0b992bbcf03 2024-02-24T01:06:01.193244042Z [2024-02-24T01:06:01.192+0000] {scheduler_job.py:635} INFO - Setting external_id for to f26121b3-5656-43a5-bea5-509b41de7cb1 2024-02-24T01:06:01.193401514Z [2024-02-24T01:06:01.193+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c524038-858f-4149-ad80-e8be8c89ac35 2024-02-24T01:06:01.193532749Z [2024-02-24T01:06:01.193+0000] {scheduler_job.py:635} INFO - Setting external_id for to 83b4784a-936f-446e-a334-917fce3ce213 2024-02-24T01:06:02.941954390Z [2024-02-24T01:06:02.941+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:06:02.942504277Z [2024-02-24T01:06:02.942+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 01:04:00+00:00, run_id=scheduled__2024-02-24T01:04:00+00:00, run_start_date=2024-02-24 01:06:00.567073+00:00, run_end_date=2024-02-24 01:06:02.941835+00:00, run_duration=2.374762, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:04:00+00:00, data_interval_end=2024-02-24 01:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T01:06:02.951649938Z [2024-02-24T01:06:02.951+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T01:06:00+00:00, run_after=2024-02-24T01:08:00+00:00 2024-02-24T01:06:02.966544130Z [2024-02-24T01:06:02.966+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:06:02.967174048Z [2024-02-24T01:06:02.966+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:05:00+00:00, run_id=scheduled__2024-02-24T01:05:00+00:00, run_start_date=2024-02-24 01:06:00.568980+00:00, run_end_date=2024-02-24 01:06:02.966456+00:00, run_duration=2.397476, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:05:00+00:00, data_interval_end=2024-02-24 01:06:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:06:02.978458935Z [2024-02-24T01:06:02.978+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:06:00+00:00, run_after=2024-02-24T01:07:00+00:00 2024-02-24T01:06:03.046843108Z [2024-02-24T01:06:03.046+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:04:00+00:00 exited with status success for try_number 1 2024-02-24T01:06:03.046884885Z [2024-02-24T01:06:03.046+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:05:00+00:00 exited with status success for try_number 1 2024-02-24T01:06:03.060394579Z [2024-02-24T01:06:03.059+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T01:04:00+00:00, map_index=-1, run_start_date=2024-02-24 01:06:01.712733+00:00, run_end_date=2024-02-24 01:06:02.132906+00:00, run_duration=0.420173, state=success, executor_state=success, try_number=1, max_tries=1, job_id=424, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:06:00.679789+00:00, queued_by_job_id=2, pid=6240 2024-02-24T01:06:03.060443921Z [2024-02-24T01:06:03.060+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:05:00+00:00, map_index=-1, run_start_date=2024-02-24 01:06:01.723075+00:00, run_end_date=2024-02-24 01:06:02.217244+00:00, run_duration=0.494169, state=success, executor_state=success, try_number=1, max_tries=1, job_id=425, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:06:00.679789+00:00, queued_by_job_id=2, pid=6241 2024-02-24T01:06:05.663406846Z [2024-02-24T01:06:05.662+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:06:05.663929332Z [2024-02-24T01:06:05.663+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:05:00+00:00, run_id=scheduled__2024-02-24T01:05:00+00:00, run_start_date=2024-02-24 01:06:00.582520+00:00, run_end_date=2024-02-24 01:06:05.663257+00:00, run_duration=5.080737, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:05:00+00:00, data_interval_end=2024-02-24 01:06:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:06:05.676535043Z [2024-02-24T01:06:05.676+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:06:00+00:00, run_after=2024-02-24T01:07:00+00:00 2024-02-24T01:06:05.717236703Z [2024-02-24T01:06:05.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:05:00+00:00 exited with status success for try_number 1 2024-02-24T01:06:05.723218993Z [2024-02-24T01:06:05.722+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:05:00+00:00, map_index=-1, run_start_date=2024-02-24 01:06:03.140826+00:00, run_end_date=2024-02-24 01:06:05.457997+00:00, run_duration=2.317171, state=success, executor_state=success, try_number=1, max_tries=1, job_id=426, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:06:00.679789+00:00, queued_by_job_id=2, pid=6264 2024-02-24T01:06:06.775345842Z [2024-02-24T01:06:06.774+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:06:06.775516532Z [2024-02-24T01:06:06.775+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:05:00+00:00, run_id=scheduled__2024-02-24T01:05:00+00:00, run_start_date=2024-02-24 01:06:00.570797+00:00, run_end_date=2024-02-24 01:06:06.775176+00:00, run_duration=6.204379, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:05:00+00:00, data_interval_end=2024-02-24 01:06:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:06:06.786040534Z [2024-02-24T01:06:06.785+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:06:00+00:00, run_after=2024-02-24T01:07:00+00:00 2024-02-24T01:06:06.822282623Z [2024-02-24T01:06:06.821+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:05:00+00:00 exited with status success for try_number 1 2024-02-24T01:06:06.827818248Z [2024-02-24T01:06:06.827+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:05:00+00:00, map_index=-1, run_start_date=2024-02-24 01:06:03.339607+00:00, run_end_date=2024-02-24 01:06:05.979905+00:00, run_duration=2.640298, state=success, executor_state=success, try_number=1, max_tries=1, job_id=427, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:06:00.679789+00:00, queued_by_job_id=2, pid=6265 2024-02-24T01:07:01.017096448Z [2024-02-24T01:07:01.016+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:07:00+00:00, run_after=2024-02-24T01:08:00+00:00 2024-02-24T01:07:01.033856726Z [2024-02-24T01:07:01.033+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:07:01.059558700Z [2024-02-24T01:07:01.059+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:07:00+00:00, run_after=2024-02-24T01:08:00+00:00 2024-02-24T01:07:01.174947473Z [2024-02-24T01:07:01.174+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T01:07:01.174994070Z 2024-02-24T01:07:01.174997840Z 2024-02-24T01:07:01.175001010Z 2024-02-24T01:07:01.175333510Z [2024-02-24T01:07:01.175+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:07:01.175680733Z [2024-02-24T01:07:01.175+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:07:01.176016720Z [2024-02-24T01:07:01.175+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:07:01.177466347Z [2024-02-24T01:07:01.177+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:07:01.177476557Z 2024-02-24T01:07:01.177479802Z 2024-02-24T01:07:01.177483155Z 2024-02-24T01:07:01.183000473Z [2024-02-24T01:07:01.182+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:07:01.183523109Z [2024-02-24T01:07:01.183+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:07:01.184000059Z [2024-02-24T01:07:01.183+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:07:01.184956476Z [2024-02-24T01:07:01.184+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:07:01.185458680Z [2024-02-24T01:07:01.185+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:07:01.185728377Z [2024-02-24T01:07:01.185+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:07:01.487444346Z [2024-02-24T01:07:01.483+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:06:00+00:00 exited with status queued for try_number 1 2024-02-24T01:07:01.487545931Z [2024-02-24T01:07:01.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:06:00+00:00 exited with status queued for try_number 1 2024-02-24T01:07:01.487682163Z [2024-02-24T01:07:01.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:06:00+00:00 exited with status queued for try_number 1 2024-02-24T01:07:01.498787070Z [2024-02-24T01:07:01.498+0000] {scheduler_job.py:635} INFO - Setting external_id for to f62affc5-ea25-4f6f-8fc4-81a940cf37ef 2024-02-24T01:07:01.498872459Z [2024-02-24T01:07:01.498+0000] {scheduler_job.py:635} INFO - Setting external_id for to 642d9f89-262d-4d37-9873-22935fd06784 2024-02-24T01:07:01.498935162Z [2024-02-24T01:07:01.498+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e552a2e-205a-4382-b66f-11f921ec399a 2024-02-24T01:07:02.044760340Z [2024-02-24T01:07:02.044+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T01:07:02.881546065Z [2024-02-24T01:07:02.880+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:07:02.881606160Z [2024-02-24T01:07:02.881+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:06:00+00:00, run_id=scheduled__2024-02-24T01:06:00+00:00, run_start_date=2024-02-24 01:07:01.074038+00:00, run_end_date=2024-02-24 01:07:02.880994+00:00, run_duration=1.806956, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:06:00+00:00, data_interval_end=2024-02-24 01:07:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:07:02.891889293Z [2024-02-24T01:07:02.891+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:07:00+00:00, run_after=2024-02-24T01:08:00+00:00 2024-02-24T01:07:02.968487145Z [2024-02-24T01:07:02.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:06:00+00:00 exited with status success for try_number 1 2024-02-24T01:07:02.977115682Z [2024-02-24T01:07:02.976+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:06:00+00:00, map_index=-1, run_start_date=2024-02-24 01:07:02.071362+00:00, run_end_date=2024-02-24 01:07:02.506030+00:00, run_duration=0.434668, state=success, executor_state=success, try_number=1, max_tries=1, job_id=428, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:07:01.178944+00:00, queued_by_job_id=2, pid=6298 2024-02-24T01:07:06.180920430Z [2024-02-24T01:07:06.180+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:07:06.181102097Z [2024-02-24T01:07:06.180+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:06:00+00:00, run_id=scheduled__2024-02-24T01:06:00+00:00, run_start_date=2024-02-24 01:07:01.075740+00:00, run_end_date=2024-02-24 01:07:06.180702+00:00, run_duration=5.104962, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:06:00+00:00, data_interval_end=2024-02-24 01:07:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:07:06.193264694Z [2024-02-24T01:07:06.192+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:07:00+00:00, run_after=2024-02-24T01:08:00+00:00 2024-02-24T01:07:06.256651069Z [2024-02-24T01:07:06.256+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:06:00+00:00 exited with status success for try_number 1 2024-02-24T01:07:06.264233525Z [2024-02-24T01:07:06.263+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:06:00+00:00, map_index=-1, run_start_date=2024-02-24 01:07:03.353462+00:00, run_end_date=2024-02-24 01:07:05.789215+00:00, run_duration=2.435753, state=success, executor_state=success, try_number=1, max_tries=1, job_id=430, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:07:01.178944+00:00, queued_by_job_id=2, pid=6317 2024-02-24T01:07:07.321951080Z [2024-02-24T01:07:07.321+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:07:07.322224136Z [2024-02-24T01:07:07.321+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:06:00+00:00, run_id=scheduled__2024-02-24T01:06:00+00:00, run_start_date=2024-02-24 01:07:01.076788+00:00, run_end_date=2024-02-24 01:07:07.321615+00:00, run_duration=6.244827, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:06:00+00:00, data_interval_end=2024-02-24 01:07:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:07:07.333738747Z [2024-02-24T01:07:07.333+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:07:00+00:00, run_after=2024-02-24T01:08:00+00:00 2024-02-24T01:07:07.395707061Z [2024-02-24T01:07:07.395+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:06:00+00:00 exited with status success for try_number 1 2024-02-24T01:07:07.402629495Z [2024-02-24T01:07:07.402+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:06:00+00:00, map_index=-1, run_start_date=2024-02-24 01:07:03.169894+00:00, run_end_date=2024-02-24 01:07:06.888310+00:00, run_duration=3.718416, state=success, executor_state=success, try_number=1, max_tries=1, job_id=429, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:07:01.178944+00:00, queued_by_job_id=2, pid=6316 2024-02-24T01:08:00.976734196Z [2024-02-24T01:08:00.976+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:08:00.995745599Z [2024-02-24T01:08:00.995+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:08:00+00:00, run_after=2024-02-24T01:09:00+00:00 2024-02-24T01:08:01.015521937Z [2024-02-24T01:08:01.015+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:08:00+00:00, run_after=2024-02-24T01:09:00+00:00 2024-02-24T01:08:01.040109603Z [2024-02-24T01:08:01.039+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:08:01.166889173Z [2024-02-24T01:08:01.166+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T01:08:01.166914434Z 2024-02-24T01:08:01.166918855Z 2024-02-24T01:08:01.166922109Z 2024-02-24T01:08:01.166925309Z 2024-02-24T01:08:01.167651483Z [2024-02-24T01:08:01.167+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T01:08:01.168165559Z [2024-02-24T01:08:01.167+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:08:01.168497958Z [2024-02-24T01:08:01.168+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:08:01.168895550Z [2024-02-24T01:08:01.168+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:08:01.169962376Z [2024-02-24T01:08:01.169+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:08:01.169975785Z 2024-02-24T01:08:01.169979797Z 2024-02-24T01:08:01.169983272Z 2024-02-24T01:08:01.169986770Z 2024-02-24T01:08:01.176531784Z [2024-02-24T01:08:01.176+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:08:01.176841570Z [2024-02-24T01:08:01.176+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T01:08:01.177448371Z [2024-02-24T01:08:01.177+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:08:01.177765025Z [2024-02-24T01:08:01.177+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:08:01.178428803Z [2024-02-24T01:08:01.178+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:08:01.178780779Z [2024-02-24T01:08:01.178+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:08:01.179329035Z [2024-02-24T01:08:01.179+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:08:01.179639732Z [2024-02-24T01:08:01.179+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:08:01.623472469Z [2024-02-24T01:08:01.622+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:06:00+00:00 exited with status queued for try_number 1 2024-02-24T01:08:01.623619230Z [2024-02-24T01:08:01.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:07:00+00:00 exited with status queued for try_number 1 2024-02-24T01:08:01.623740641Z [2024-02-24T01:08:01.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:07:00+00:00 exited with status queued for try_number 1 2024-02-24T01:08:01.623866042Z [2024-02-24T01:08:01.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:07:00+00:00 exited with status queued for try_number 1 2024-02-24T01:08:01.644058515Z [2024-02-24T01:08:01.643+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39979b7e-50d2-46fd-9419-7a5d53e4a6dd 2024-02-24T01:08:01.644212446Z [2024-02-24T01:08:01.644+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c7f8b84-22f6-4f14-ab93-2b445a1b7af1 2024-02-24T01:08:01.644379578Z [2024-02-24T01:08:01.644+0000] {scheduler_job.py:635} INFO - Setting external_id for to 95294d7b-9c1e-464b-a7f1-51873227b2bf 2024-02-24T01:08:01.644538951Z [2024-02-24T01:08:01.644+0000] {scheduler_job.py:635} INFO - Setting external_id for to c587deb0-3ca1-450a-ac7d-e1c5a9da30e6 2024-02-24T01:08:02.961562328Z [2024-02-24T01:08:02.960+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:08:02.961830825Z [2024-02-24T01:08:02.961+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 01:06:00+00:00, run_id=scheduled__2024-02-24T01:06:00+00:00, run_start_date=2024-02-24 01:08:01.061444+00:00, run_end_date=2024-02-24 01:08:02.961478+00:00, run_duration=1.900034, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:06:00+00:00, data_interval_end=2024-02-24 01:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T01:08:02.971220069Z [2024-02-24T01:08:02.970+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T01:08:00+00:00, run_after=2024-02-24T01:10:00+00:00 2024-02-24T01:08:02.987470071Z [2024-02-24T01:08:02.987+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:08:02.987660828Z [2024-02-24T01:08:02.987+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:07:00+00:00, run_id=scheduled__2024-02-24T01:07:00+00:00, run_start_date=2024-02-24 01:08:01.063334+00:00, run_end_date=2024-02-24 01:08:02.987375+00:00, run_duration=1.924041, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:07:00+00:00, data_interval_end=2024-02-24 01:08:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:08:02.999597344Z [2024-02-24T01:08:02.999+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:08:00+00:00, run_after=2024-02-24T01:09:00+00:00 2024-02-24T01:08:03.081882551Z [2024-02-24T01:08:03.081+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:06:00+00:00 exited with status success for try_number 1 2024-02-24T01:08:03.082151043Z [2024-02-24T01:08:03.081+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:07:00+00:00 exited with status success for try_number 1 2024-02-24T01:08:03.092522701Z [2024-02-24T01:08:03.092+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:07:00+00:00, map_index=-1, run_start_date=2024-02-24 01:08:02.026900+00:00, run_end_date=2024-02-24 01:08:02.451039+00:00, run_duration=0.424139, state=success, executor_state=success, try_number=1, max_tries=1, job_id=431, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:08:01.171619+00:00, queued_by_job_id=2, pid=6350 2024-02-24T01:08:03.093010829Z [2024-02-24T01:08:03.092+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T01:06:00+00:00, map_index=-1, run_start_date=2024-02-24 01:08:02.311523+00:00, run_end_date=2024-02-24 01:08:02.803971+00:00, run_duration=0.492448, state=success, executor_state=success, try_number=1, max_tries=1, job_id=432, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:08:01.171619+00:00, queued_by_job_id=2, pid=6356 2024-02-24T01:08:05.617821902Z [2024-02-24T01:08:05.617+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:08:05.618414000Z [2024-02-24T01:08:05.618+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:07:00+00:00, run_id=scheduled__2024-02-24T01:07:00+00:00, run_start_date=2024-02-24 01:08:01.064998+00:00, run_end_date=2024-02-24 01:08:05.617915+00:00, run_duration=4.552917, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:07:00+00:00, data_interval_end=2024-02-24 01:08:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:08:05.634064798Z [2024-02-24T01:08:05.633+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:08:00+00:00, run_after=2024-02-24T01:09:00+00:00 2024-02-24T01:08:05.683750956Z [2024-02-24T01:08:05.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:07:00+00:00 exited with status success for try_number 1 2024-02-24T01:08:05.683972075Z [2024-02-24T01:08:05.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:07:00+00:00 exited with status success for try_number 1 2024-02-24T01:08:05.692364728Z [2024-02-24T01:08:05.691+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:07:00+00:00, map_index=-1, run_start_date=2024-02-24 01:08:03.421866+00:00, run_end_date=2024-02-24 01:08:05.511001+00:00, run_duration=2.089135, state=success, executor_state=success, try_number=1, max_tries=1, job_id=434, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:08:01.171619+00:00, queued_by_job_id=2, pid=6375 2024-02-24T01:08:05.692748089Z [2024-02-24T01:08:05.692+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:07:00+00:00, map_index=-1, run_start_date=2024-02-24 01:08:03.365603+00:00, run_end_date=2024-02-24 01:08:05.100915+00:00, run_duration=1.735312, state=success, executor_state=success, try_number=1, max_tries=1, job_id=433, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:08:01.171619+00:00, queued_by_job_id=2, pid=6374 2024-02-24T01:08:06.752529109Z [2024-02-24T01:08:06.746+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:08:06.752580979Z [2024-02-24T01:08:06.746+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:07:00+00:00, run_id=scheduled__2024-02-24T01:07:00+00:00, run_start_date=2024-02-24 01:08:01.066587+00:00, run_end_date=2024-02-24 01:08:06.746579+00:00, run_duration=5.679992, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:07:00+00:00, data_interval_end=2024-02-24 01:08:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:08:06.771421402Z [2024-02-24T01:08:06.770+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:08:00+00:00, run_after=2024-02-24T01:09:00+00:00 2024-02-24T01:09:01.050625340Z [2024-02-24T01:09:01.050+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:09:01.069147746Z [2024-02-24T01:09:01.068+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:09:00+00:00, run_after=2024-02-24T01:10:00+00:00 2024-02-24T01:09:01.083752366Z [2024-02-24T01:09:01.083+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:09:00+00:00, run_after=2024-02-24T01:10:00+00:00 2024-02-24T01:09:01.177121633Z [2024-02-24T01:09:01.176+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T01:09:01.177166786Z 2024-02-24T01:09:01.177172839Z 2024-02-24T01:09:01.177185594Z 2024-02-24T01:09:01.177320294Z [2024-02-24T01:09:01.177+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:09:01.177507648Z [2024-02-24T01:09:01.177+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:09:01.177698461Z [2024-02-24T01:09:01.177+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:09:01.178688347Z [2024-02-24T01:09:01.178+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:09:01.178705816Z 2024-02-24T01:09:01.178711075Z 2024-02-24T01:09:01.178715852Z 2024-02-24T01:09:01.183851470Z [2024-02-24T01:09:01.183+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:09:01.184460020Z [2024-02-24T01:09:01.183+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:09:01.185150033Z [2024-02-24T01:09:01.184+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:09:01.185535911Z [2024-02-24T01:09:01.185+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:09:01.185987324Z [2024-02-24T01:09:01.185+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:09:01.186285507Z [2024-02-24T01:09:01.186+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:09:01.505636446Z [2024-02-24T01:09:01.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:08:00+00:00 exited with status queued for try_number 1 2024-02-24T01:09:01.505713034Z [2024-02-24T01:09:01.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:08:00+00:00 exited with status queued for try_number 1 2024-02-24T01:09:01.505730106Z [2024-02-24T01:09:01.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:08:00+00:00 exited with status queued for try_number 1 2024-02-24T01:09:01.519169025Z [2024-02-24T01:09:01.518+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3af7d855-824a-4000-ac0a-2dc007e49454 2024-02-24T01:09:01.519198886Z [2024-02-24T01:09:01.519+0000] {scheduler_job.py:635} INFO - Setting external_id for to b103b2d5-9270-4248-bbb4-64fb8abe4c17 2024-02-24T01:09:01.519329976Z [2024-02-24T01:09:01.519+0000] {scheduler_job.py:635} INFO - Setting external_id for to 50c0e25a-7687-433d-a6d8-f765bd40650e 2024-02-24T01:09:02.737178473Z [2024-02-24T01:09:02.736+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:09:02.737704213Z [2024-02-24T01:09:02.737+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:08:00+00:00, run_id=scheduled__2024-02-24T01:08:00+00:00, run_start_date=2024-02-24 01:09:01.100054+00:00, run_end_date=2024-02-24 01:09:02.737080+00:00, run_duration=1.637026, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:08:00+00:00, data_interval_end=2024-02-24 01:09:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:09:02.748698576Z [2024-02-24T01:09:02.748+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:09:00+00:00, run_after=2024-02-24T01:10:00+00:00 2024-02-24T01:09:02.807025474Z [2024-02-24T01:09:02.806+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:08:00+00:00 exited with status success for try_number 1 2024-02-24T01:09:02.814984233Z [2024-02-24T01:09:02.814+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:08:00+00:00, map_index=-1, run_start_date=2024-02-24 01:09:02.095969+00:00, run_end_date=2024-02-24 01:09:02.499749+00:00, run_duration=0.40378, state=success, executor_state=success, try_number=1, max_tries=1, job_id=435, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:09:01.179892+00:00, queued_by_job_id=2, pid=6408 2024-02-24T01:09:06.127684902Z [2024-02-24T01:09:06.127+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:09:06.128168646Z [2024-02-24T01:09:06.127+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:08:00+00:00, run_id=scheduled__2024-02-24T01:08:00+00:00, run_start_date=2024-02-24 01:09:01.101654+00:00, run_end_date=2024-02-24 01:09:06.127531+00:00, run_duration=5.025877, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:08:00+00:00, data_interval_end=2024-02-24 01:09:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:09:06.136860338Z [2024-02-24T01:09:06.136+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:09:00+00:00, run_after=2024-02-24T01:10:00+00:00 2024-02-24T01:09:06.176645375Z [2024-02-24T01:09:06.176+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:08:00+00:00 exited with status success for try_number 1 2024-02-24T01:09:06.182358187Z [2024-02-24T01:09:06.181+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:08:00+00:00, map_index=-1, run_start_date=2024-02-24 01:09:03.135073+00:00, run_end_date=2024-02-24 01:09:05.600936+00:00, run_duration=2.465863, state=success, executor_state=success, try_number=1, max_tries=1, job_id=437, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:09:01.179892+00:00, queued_by_job_id=2, pid=6427 2024-02-24T01:09:07.248262115Z [2024-02-24T01:09:07.247+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:09:07.248763407Z [2024-02-24T01:09:07.248+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:08:00+00:00, run_id=scheduled__2024-02-24T01:08:00+00:00, run_start_date=2024-02-24 01:09:01.102889+00:00, run_end_date=2024-02-24 01:09:07.248298+00:00, run_duration=6.145409, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:08:00+00:00, data_interval_end=2024-02-24 01:09:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:09:07.271560287Z [2024-02-24T01:09:07.271+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:09:00+00:00, run_after=2024-02-24T01:10:00+00:00 2024-02-24T01:09:07.306439519Z [2024-02-24T01:09:07.306+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:08:00+00:00 exited with status success for try_number 1 2024-02-24T01:09:07.312872475Z [2024-02-24T01:09:07.312+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:08:00+00:00, map_index=-1, run_start_date=2024-02-24 01:09:03.123227+00:00, run_end_date=2024-02-24 01:09:06.447858+00:00, run_duration=3.324631, state=success, executor_state=success, try_number=1, max_tries=1, job_id=436, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:09:01.179892+00:00, queued_by_job_id=2, pid=6426 2024-02-24T01:10:00.425527494Z [2024-02-24T01:10:00.424+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:10:00.445935855Z [2024-02-24T01:10:00.445+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:10:00+00:00, run_after=2024-02-24T01:11:00+00:00 2024-02-24T01:10:00.461653389Z [2024-02-24T01:10:00.461+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:10:00+00:00, run_after=2024-02-24T01:15:00+00:00 2024-02-24T01:10:00.473641880Z [2024-02-24T01:10:00.473+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:10:00+00:00, run_after=2024-02-24T01:11:00+00:00 2024-02-24T01:10:00.481284329Z [2024-02-24T01:10:00.480+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:10:00.586715542Z [2024-02-24T01:10:00.586+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-02-24T01:10:00.586749305Z 2024-02-24T01:10:00.586755211Z 2024-02-24T01:10:00.586761266Z 2024-02-24T01:10:00.586769862Z 2024-02-24T01:10:00.586776524Z 2024-02-24T01:10:00.586981515Z [2024-02-24T01:10:00.586+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:10:00.587174012Z [2024-02-24T01:10:00.586+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T01:10:00.587339117Z [2024-02-24T01:10:00.587+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:10:00.587551117Z [2024-02-24T01:10:00.587+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:10:00.587687078Z [2024-02-24T01:10:00.587+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:10:00.588736053Z [2024-02-24T01:10:00.588+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:10:00.588751396Z 2024-02-24T01:10:00.588777084Z 2024-02-24T01:10:00.588783908Z 2024-02-24T01:10:00.588788575Z 2024-02-24T01:10:00.588793286Z 2024-02-24T01:10:00.596368222Z [2024-02-24T01:10:00.595+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T01:10:00.596437410Z [2024-02-24T01:10:00.596+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T01:10:00.596809823Z [2024-02-24T01:10:00.596+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:10:00.596847905Z [2024-02-24T01:10:00.596+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T01:10:00.597351618Z [2024-02-24T01:10:00.597+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:10:00.597384181Z [2024-02-24T01:10:00.597+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:10:00.597717806Z [2024-02-24T01:10:00.597+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:10:00.597885405Z [2024-02-24T01:10:00.597+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:10:00.598192946Z [2024-02-24T01:10:00.597+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:10:00.598206265Z [2024-02-24T01:10:00.598+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:10:01.093072468Z [2024-02-24T01:10:01.092+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T01:05:00+00:00 exited with status queued for try_number 1 2024-02-24T01:10:01.093336361Z [2024-02-24T01:10:01.092+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:08:00+00:00 exited with status queued for try_number 1 2024-02-24T01:10:01.093489184Z [2024-02-24T01:10:01.093+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:09:00+00:00 exited with status queued for try_number 1 2024-02-24T01:10:01.093641489Z [2024-02-24T01:10:01.093+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:09:00+00:00 exited with status queued for try_number 1 2024-02-24T01:10:01.093748034Z [2024-02-24T01:10:01.093+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:09:00+00:00 exited with status queued for try_number 1 2024-02-24T01:10:01.109569732Z [2024-02-24T01:10:01.109+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75a2f2fa-9524-4246-8b69-ca2d1bfb7b63 2024-02-24T01:10:01.114687988Z [2024-02-24T01:10:01.114+0000] {scheduler_job.py:635} INFO - Setting external_id for to 02277c8c-8699-4601-afa5-f5ad6bc2c4f2 2024-02-24T01:10:01.118411385Z [2024-02-24T01:10:01.118+0000] {scheduler_job.py:635} INFO - Setting external_id for to b25454b4-a087-4c21-88c5-c34dbd464a40 2024-02-24T01:10:01.118661254Z [2024-02-24T01:10:01.118+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa08e53b-764f-4f04-afab-1eab150042bb 2024-02-24T01:10:01.118836682Z [2024-02-24T01:10:01.118+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d29e0c5-9218-4eb6-accc-f34c931a6d00 2024-02-24T01:10:02.519051569Z [2024-02-24T01:10:02.518+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:10:02.520583887Z [2024-02-24T01:10:02.520+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 01:08:00+00:00, run_id=scheduled__2024-02-24T01:08:00+00:00, run_start_date=2024-02-24 01:10:00.494912+00:00, run_end_date=2024-02-24 01:10:02.518960+00:00, run_duration=2.024048, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:08:00+00:00, data_interval_end=2024-02-24 01:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T01:10:02.548909784Z [2024-02-24T01:10:02.548+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T01:10:00+00:00, run_after=2024-02-24T01:12:00+00:00 2024-02-24T01:10:02.840051284Z [2024-02-24T01:10:02.839+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:08:00+00:00 exited with status success for try_number 1 2024-02-24T01:10:02.850229186Z [2024-02-24T01:10:02.849+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T01:08:00+00:00, map_index=-1, run_start_date=2024-02-24 01:10:01.614097+00:00, run_end_date=2024-02-24 01:10:02.178801+00:00, run_duration=0.564704, state=success, executor_state=success, try_number=1, max_tries=1, job_id=438, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:10:00.590561+00:00, queued_by_job_id=2, pid=6459 2024-02-24T01:10:03.937753450Z [2024-02-24T01:10:03.937+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:10:03.938382433Z [2024-02-24T01:10:03.938+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:09:00+00:00, run_id=scheduled__2024-02-24T01:09:00+00:00, run_start_date=2024-02-24 01:10:00.496011+00:00, run_end_date=2024-02-24 01:10:03.937861+00:00, run_duration=3.44185, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:09:00+00:00, data_interval_end=2024-02-24 01:10:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:10:03.958353806Z [2024-02-24T01:10:03.957+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:10:00+00:00, run_after=2024-02-24T01:11:00+00:00 2024-02-24T01:10:04.160837524Z [2024-02-24T01:10:04.160+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:09:00+00:00 exited with status success for try_number 1 2024-02-24T01:10:04.172013007Z [2024-02-24T01:10:04.171+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:09:00+00:00, map_index=-1, run_start_date=2024-02-24 01:10:02.056268+00:00, run_end_date=2024-02-24 01:10:03.092603+00:00, run_duration=1.036335, state=success, executor_state=success, try_number=1, max_tries=1, job_id=439, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:10:00.590561+00:00, queued_by_job_id=2, pid=6466 2024-02-24T01:10:06.257721740Z [2024-02-24T01:10:06.257+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:10:06.257754850Z 2024-02-24T01:10:06.258239216Z [2024-02-24T01:10:06.257+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:10:06.259317129Z [2024-02-24T01:10:06.258+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:10:06.259365325Z 2024-02-24T01:10:06.262632022Z [2024-02-24T01:10:06.262+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T01:10:06.263064106Z [2024-02-24T01:10:06.262+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T01:10:06.317292690Z [2024-02-24T01:10:06.316+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T01:05:00+00:00 exited with status queued for try_number 1 2024-02-24T01:10:06.317447146Z [2024-02-24T01:10:06.317+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T01:05:00+00:00 exited with status success for try_number 1 2024-02-24T01:10:06.326110501Z [2024-02-24T01:10:06.325+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4877920-89c4-4168-a6ce-8b9be04474be 2024-02-24T01:10:06.326205695Z [2024-02-24T01:10:06.326+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T01:05:00+00:00, map_index=-1, run_start_date=2024-02-24 01:10:04.932720+00:00, run_end_date=2024-02-24 01:10:05.351732+00:00, run_duration=0.419012, state=success, executor_state=success, try_number=1, max_tries=1, job_id=442, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:10:00.590561+00:00, queued_by_job_id=2, pid=6492 2024-02-24T01:10:06.605580861Z [2024-02-24T01:10:06.604+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:10:06.606487037Z [2024-02-24T01:10:06.606+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:09:00+00:00, run_id=scheduled__2024-02-24T01:09:00+00:00, run_start_date=2024-02-24 01:10:00.497077+00:00, run_end_date=2024-02-24 01:10:06.605738+00:00, run_duration=6.108661, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:09:00+00:00, data_interval_end=2024-02-24 01:10:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:10:06.625588101Z [2024-02-24T01:10:06.625+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:10:00+00:00, run_after=2024-02-24T01:11:00+00:00 2024-02-24T01:10:06.699129371Z [2024-02-24T01:10:06.698+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:09:00+00:00 exited with status success for try_number 1 2024-02-24T01:10:06.706878610Z [2024-02-24T01:10:06.706+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:09:00+00:00, map_index=-1, run_start_date=2024-02-24 01:10:04.700270+00:00, run_end_date=2024-02-24 01:10:06.406469+00:00, run_duration=1.706199, state=success, executor_state=success, try_number=1, max_tries=1, job_id=440, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:10:00.590561+00:00, queued_by_job_id=2, pid=6491 2024-02-24T01:10:07.780049760Z [2024-02-24T01:10:07.779+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:10:07.780251894Z [2024-02-24T01:10:07.779+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:09:00+00:00, run_id=scheduled__2024-02-24T01:09:00+00:00, run_start_date=2024-02-24 01:10:00.498281+00:00, run_end_date=2024-02-24 01:10:07.779869+00:00, run_duration=7.281588, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:09:00+00:00, data_interval_end=2024-02-24 01:10:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:10:07.789469831Z [2024-02-24T01:10:07.789+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:10:00+00:00, run_after=2024-02-24T01:11:00+00:00 2024-02-24T01:10:07.838584633Z [2024-02-24T01:10:07.838+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:09:00+00:00 exited with status success for try_number 1 2024-02-24T01:10:07.851026719Z [2024-02-24T01:10:07.850+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:09:00+00:00, map_index=-1, run_start_date=2024-02-24 01:10:04.932392+00:00, run_end_date=2024-02-24 01:10:06.730257+00:00, run_duration=1.797865, state=success, executor_state=success, try_number=1, max_tries=1, job_id=441, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:10:00.590561+00:00, queued_by_job_id=2, pid=6493 2024-02-24T01:10:08.921607709Z [2024-02-24T01:10:08.920+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:10:08.921673640Z 2024-02-24T01:10:08.922385777Z [2024-02-24T01:10:08.921+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:10:08.924029988Z [2024-02-24T01:10:08.923+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:10:08.924051016Z 2024-02-24T01:10:08.929398119Z [2024-02-24T01:10:08.928+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T01:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T01:10:08.930247473Z [2024-02-24T01:10:08.929+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T01:10:09.018382930Z [2024-02-24T01:10:09.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T01:05:00+00:00 exited with status queued for try_number 1 2024-02-24T01:10:09.018659975Z [2024-02-24T01:10:09.018+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T01:05:00+00:00 exited with status success for try_number 1 2024-02-24T01:10:09.025722007Z [2024-02-24T01:10:09.025+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba4a285e-addd-4aee-886c-c95c6525f892 2024-02-24T01:10:09.026134879Z [2024-02-24T01:10:09.025+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T01:05:00+00:00, map_index=-1, run_start_date=2024-02-24 01:10:07.962374+00:00, run_end_date=2024-02-24 01:10:08.341243+00:00, run_duration=0.378869, state=success, executor_state=success, try_number=1, max_tries=1, job_id=443, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:10:06.259810+00:00, queued_by_job_id=2, pid=6516 2024-02-24T01:10:11.393031811Z [2024-02-24T01:10:11.392+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:10:11.393047939Z 2024-02-24T01:10:11.393136943Z [2024-02-24T01:10:11.392+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:10:11.393884253Z [2024-02-24T01:10:11.393+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:10:11.393892565Z 2024-02-24T01:10:11.396286338Z [2024-02-24T01:10:11.396+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:10:11.396406853Z [2024-02-24T01:10:11.396+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T01:10:11.471464255Z [2024-02-24T01:10:11.471+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T01:05:00+00:00 exited with status queued for try_number 1 2024-02-24T01:10:11.471558639Z [2024-02-24T01:10:11.471+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T01:05:00+00:00 exited with status success for try_number 1 2024-02-24T01:10:11.485848851Z [2024-02-24T01:10:11.485+0000] {scheduler_job.py:635} INFO - Setting external_id for to a4aa5b12-e156-420b-aa92-b61652d4c4ce 2024-02-24T01:10:11.485953108Z [2024-02-24T01:10:11.485+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T01:05:00+00:00, map_index=0, run_start_date=2024-02-24 01:10:10.575038+00:00, run_end_date=2024-02-24 01:10:10.999880+00:00, run_duration=0.424842, state=success, executor_state=success, try_number=1, max_tries=1, job_id=444, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:10:08.924970+00:00, queued_by_job_id=2, pid=6524 2024-02-24T01:10:14.487440797Z [2024-02-24T01:10:14.484+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:10:14.487461052Z [2024-02-24T01:10:14.485+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:05:00+00:00, run_id=scheduled__2024-02-24T01:05:00+00:00, run_start_date=2024-02-24 01:10:00.493630+00:00, run_end_date=2024-02-24 01:10:14.485254+00:00, run_duration=13.991624, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:05:00+00:00, data_interval_end=2024-02-24 01:10:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T01:10:14.493949905Z [2024-02-24T01:10:14.493+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:10:00+00:00, run_after=2024-02-24T01:15:00+00:00 2024-02-24T01:10:14.528300175Z [2024-02-24T01:10:14.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T01:05:00+00:00 exited with status success for try_number 1 2024-02-24T01:10:14.530452740Z [2024-02-24T01:10:14.529+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T01:05:00+00:00, map_index=-1, run_start_date=2024-02-24 01:10:13.143684+00:00, run_end_date=2024-02-24 01:10:13.496475+00:00, run_duration=0.352791, state=success, executor_state=success, try_number=1, max_tries=1, job_id=445, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:10:11.394199+00:00, queued_by_job_id=2, pid=6532 2024-02-24T01:11:00.738771066Z [2024-02-24T01:11:00.738+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:11:00+00:00, run_after=2024-02-24T01:12:00+00:00 2024-02-24T01:11:00.757184044Z [2024-02-24T01:11:00.756+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:11:00+00:00, run_after=2024-02-24T01:12:00+00:00 2024-02-24T01:11:00.768985370Z [2024-02-24T01:11:00.766+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:11:00.884129929Z [2024-02-24T01:11:00.883+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T01:11:00.884222752Z 2024-02-24T01:11:00.884230043Z 2024-02-24T01:11:00.884236076Z 2024-02-24T01:11:00.884671142Z [2024-02-24T01:11:00.884+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:11:00.885070170Z [2024-02-24T01:11:00.884+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:11:00.885498292Z [2024-02-24T01:11:00.885+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:11:00.887025861Z [2024-02-24T01:11:00.886+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:11:00.887041831Z 2024-02-24T01:11:00.887063476Z 2024-02-24T01:11:00.887071197Z 2024-02-24T01:11:00.893542629Z [2024-02-24T01:11:00.892+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:11:00.893891286Z [2024-02-24T01:11:00.893+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:11:00.894527584Z [2024-02-24T01:11:00.894+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:11:00.894940662Z [2024-02-24T01:11:00.894+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:11:00.895544413Z [2024-02-24T01:11:00.895+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:11:00.895830506Z [2024-02-24T01:11:00.895+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:11:01.100255016Z [2024-02-24T01:11:01.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:10:00+00:00 exited with status queued for try_number 1 2024-02-24T01:11:01.100759564Z [2024-02-24T01:11:01.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:10:00+00:00 exited with status queued for try_number 1 2024-02-24T01:11:01.101535788Z [2024-02-24T01:11:01.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:10:00+00:00 exited with status queued for try_number 1 2024-02-24T01:11:01.114042573Z [2024-02-24T01:11:01.112+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d92fc2f-73c8-42f3-b553-881c0b391209 2024-02-24T01:11:01.114581774Z [2024-02-24T01:11:01.114+0000] {scheduler_job.py:635} INFO - Setting external_id for to 47e01262-1a31-406e-adfb-13bb602d5efc 2024-02-24T01:11:01.115628272Z [2024-02-24T01:11:01.115+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8740b15c-1cc5-43ac-b4be-9abf94aff52a 2024-02-24T01:11:03.394420685Z [2024-02-24T01:11:03.393+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:11:03.394578746Z [2024-02-24T01:11:03.394+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:10:00+00:00, run_id=scheduled__2024-02-24T01:10:00+00:00, run_start_date=2024-02-24 01:11:00.788595+00:00, run_end_date=2024-02-24 01:11:03.394191+00:00, run_duration=2.605596, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:10:00+00:00, data_interval_end=2024-02-24 01:11:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:11:03.407449913Z [2024-02-24T01:11:03.407+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:11:00+00:00, run_after=2024-02-24T01:12:00+00:00 2024-02-24T01:11:03.459137551Z [2024-02-24T01:11:03.458+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:10:00+00:00 exited with status success for try_number 1 2024-02-24T01:11:03.467407470Z [2024-02-24T01:11:03.466+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:10:00+00:00, map_index=-1, run_start_date=2024-02-24 01:11:01.870889+00:00, run_end_date=2024-02-24 01:11:02.315235+00:00, run_duration=0.444346, state=success, executor_state=success, try_number=1, max_tries=1, job_id=446, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:11:00.888381+00:00, queued_by_job_id=2, pid=6554 2024-02-24T01:11:05.617832143Z [2024-02-24T01:11:05.617+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:11:05.618321333Z [2024-02-24T01:11:05.618+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:10:00+00:00, run_id=scheduled__2024-02-24T01:10:00+00:00, run_start_date=2024-02-24 01:11:00.790879+00:00, run_end_date=2024-02-24 01:11:05.617725+00:00, run_duration=4.826846, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:10:00+00:00, data_interval_end=2024-02-24 01:11:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:11:05.631746713Z [2024-02-24T01:11:05.631+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:11:00+00:00, run_after=2024-02-24T01:12:00+00:00 2024-02-24T01:11:05.639819742Z [2024-02-24T01:11:05.639+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:11:05.640158204Z [2024-02-24T01:11:05.639+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:10:00+00:00, run_id=scheduled__2024-02-24T01:10:00+00:00, run_start_date=2024-02-24 01:11:00.792783+00:00, run_end_date=2024-02-24 01:11:05.639707+00:00, run_duration=4.846924, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:10:00+00:00, data_interval_end=2024-02-24 01:11:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:11:05.650073903Z [2024-02-24T01:11:05.649+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:11:00+00:00, run_after=2024-02-24T01:12:00+00:00 2024-02-24T01:11:05.685704366Z [2024-02-24T01:11:05.685+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:10:00+00:00 exited with status success for try_number 1 2024-02-24T01:11:05.686071704Z [2024-02-24T01:11:05.685+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:10:00+00:00 exited with status success for try_number 1 2024-02-24T01:11:05.695474014Z [2024-02-24T01:11:05.694+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:10:00+00:00, map_index=-1, run_start_date=2024-02-24 01:11:02.848985+00:00, run_end_date=2024-02-24 01:11:04.952674+00:00, run_duration=2.103689, state=success, executor_state=success, try_number=1, max_tries=1, job_id=448, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:11:00.888381+00:00, queued_by_job_id=2, pid=6572 2024-02-24T01:11:05.695965816Z [2024-02-24T01:11:05.695+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:10:00+00:00, map_index=-1, run_start_date=2024-02-24 01:11:02.873084+00:00, run_end_date=2024-02-24 01:11:05.170938+00:00, run_duration=2.297854, state=success, executor_state=success, try_number=1, max_tries=1, job_id=447, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:11:00.888381+00:00, queued_by_job_id=2, pid=6573 2024-02-24T01:12:00.972775155Z [2024-02-24T01:12:00.972+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:12:00+00:00, run_after=2024-02-24T01:13:00+00:00 2024-02-24T01:12:00.980925775Z [2024-02-24T01:12:00.980+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:12:00.993285080Z [2024-02-24T01:12:00.992+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:12:00+00:00, run_after=2024-02-24T01:13:00+00:00 2024-02-24T01:12:01.000807667Z [2024-02-24T01:12:01.000+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:12:01.094997853Z [2024-02-24T01:12:01.094+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T01:12:01.095057919Z 2024-02-24T01:12:01.095088214Z 2024-02-24T01:12:01.095091842Z 2024-02-24T01:12:01.095094923Z 2024-02-24T01:12:01.095261645Z [2024-02-24T01:12:01.095+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T01:12:01.095558912Z [2024-02-24T01:12:01.095+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:12:01.095695339Z [2024-02-24T01:12:01.095+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:12:01.095914514Z [2024-02-24T01:12:01.095+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:12:01.096691341Z [2024-02-24T01:12:01.096+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:12:01.096700891Z 2024-02-24T01:12:01.096704231Z 2024-02-24T01:12:01.096707277Z 2024-02-24T01:12:01.096710596Z 2024-02-24T01:12:01.100885962Z [2024-02-24T01:12:01.100+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:12:01.101173237Z [2024-02-24T01:12:01.100+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T01:12:01.101512904Z [2024-02-24T01:12:01.101+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:12:01.101707345Z [2024-02-24T01:12:01.101+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:12:01.102013431Z [2024-02-24T01:12:01.101+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:12:01.102205731Z [2024-02-24T01:12:01.102+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:12:01.102489925Z [2024-02-24T01:12:01.102+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:12:01.102678629Z [2024-02-24T01:12:01.102+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:12:01.646713336Z [2024-02-24T01:12:01.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:10:00+00:00 exited with status queued for try_number 1 2024-02-24T01:12:01.646823345Z [2024-02-24T01:12:01.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:11:00+00:00 exited with status queued for try_number 1 2024-02-24T01:12:01.646828154Z [2024-02-24T01:12:01.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:11:00+00:00 exited with status queued for try_number 1 2024-02-24T01:12:01.646841486Z [2024-02-24T01:12:01.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:11:00+00:00 exited with status queued for try_number 1 2024-02-24T01:12:01.668235532Z [2024-02-24T01:12:01.667+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3755e5f3-a9c5-4a46-8f6d-c0e43ab6913a 2024-02-24T01:12:01.668310745Z [2024-02-24T01:12:01.668+0000] {scheduler_job.py:635} INFO - Setting external_id for to b693d262-780a-4fd0-b2d3-5951a3507114 2024-02-24T01:12:01.674077378Z [2024-02-24T01:12:01.668+0000] {scheduler_job.py:635} INFO - Setting external_id for to a439c22a-b907-4779-b18d-228e15cc97e2 2024-02-24T01:12:01.674287041Z [2024-02-24T01:12:01.674+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb5136dd-838f-4ebf-8925-c55fcf34c75c 2024-02-24T01:12:02.282698757Z [2024-02-24T01:12:02.282+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T01:12:03.246841012Z [2024-02-24T01:12:03.246+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:12:03.247298645Z [2024-02-24T01:12:03.247+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 01:10:00+00:00, run_id=scheduled__2024-02-24T01:10:00+00:00, run_start_date=2024-02-24 01:12:01.012027+00:00, run_end_date=2024-02-24 01:12:03.246942+00:00, run_duration=2.234915, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:10:00+00:00, data_interval_end=2024-02-24 01:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T01:12:03.254859067Z [2024-02-24T01:12:03.254+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T01:12:00+00:00, run_after=2024-02-24T01:14:00+00:00 2024-02-24T01:12:03.262304130Z [2024-02-24T01:12:03.261+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:12:03.262608969Z [2024-02-24T01:12:03.262+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:11:00+00:00, run_id=scheduled__2024-02-24T01:11:00+00:00, run_start_date=2024-02-24 01:12:01.013254+00:00, run_end_date=2024-02-24 01:12:03.262293+00:00, run_duration=2.249039, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:11:00+00:00, data_interval_end=2024-02-24 01:12:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:12:03.272175138Z [2024-02-24T01:12:03.271+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:12:00+00:00, run_after=2024-02-24T01:13:00+00:00 2024-02-24T01:12:03.343542379Z [2024-02-24T01:12:03.343+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:10:00+00:00 exited with status success for try_number 1 2024-02-24T01:12:03.346290492Z [2024-02-24T01:12:03.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:11:00+00:00 exited with status success for try_number 1 2024-02-24T01:12:03.356774910Z [2024-02-24T01:12:03.356+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T01:10:00+00:00, map_index=-1, run_start_date=2024-02-24 01:12:02.002047+00:00, run_end_date=2024-02-24 01:12:02.474712+00:00, run_duration=0.472665, state=success, executor_state=success, try_number=1, max_tries=1, job_id=449, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:12:01.097907+00:00, queued_by_job_id=2, pid=6606 2024-02-24T01:12:03.357380774Z [2024-02-24T01:12:03.357+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:11:00+00:00, map_index=-1, run_start_date=2024-02-24 01:12:02.034168+00:00, run_end_date=2024-02-24 01:12:02.442891+00:00, run_duration=0.408723, state=success, executor_state=success, try_number=1, max_tries=1, job_id=450, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:12:01.097907+00:00, queued_by_job_id=2, pid=6607 2024-02-24T01:12:05.569974813Z [2024-02-24T01:12:05.569+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:12:05.571360411Z [2024-02-24T01:12:05.571+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:11:00+00:00, run_id=scheduled__2024-02-24T01:11:00+00:00, run_start_date=2024-02-24 01:12:01.014340+00:00, run_end_date=2024-02-24 01:12:05.569886+00:00, run_duration=4.555546, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:11:00+00:00, data_interval_end=2024-02-24 01:12:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:12:05.588777712Z [2024-02-24T01:12:05.587+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:12:00+00:00, run_after=2024-02-24T01:13:00+00:00 2024-02-24T01:12:05.633659124Z [2024-02-24T01:12:05.633+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:11:00+00:00 exited with status success for try_number 1 2024-02-24T01:12:05.640259695Z [2024-02-24T01:12:05.639+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:11:00+00:00, map_index=-1, run_start_date=2024-02-24 01:12:03.242579+00:00, run_end_date=2024-02-24 01:12:05.162607+00:00, run_duration=1.920028, state=success, executor_state=success, try_number=1, max_tries=1, job_id=451, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:12:01.097907+00:00, queued_by_job_id=2, pid=6630 2024-02-24T01:12:06.685577740Z [2024-02-24T01:12:06.685+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:12:06.685651565Z [2024-02-24T01:12:06.685+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:11:00+00:00, run_id=scheduled__2024-02-24T01:11:00+00:00, run_start_date=2024-02-24 01:12:01.015305+00:00, run_end_date=2024-02-24 01:12:06.685332+00:00, run_duration=5.670027, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:11:00+00:00, data_interval_end=2024-02-24 01:12:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:12:06.694447334Z [2024-02-24T01:12:06.694+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:12:00+00:00, run_after=2024-02-24T01:13:00+00:00 2024-02-24T01:12:06.735513623Z [2024-02-24T01:12:06.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:11:00+00:00 exited with status success for try_number 1 2024-02-24T01:12:06.739932909Z [2024-02-24T01:12:06.739+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:11:00+00:00, map_index=-1, run_start_date=2024-02-24 01:12:03.265909+00:00, run_end_date=2024-02-24 01:12:06.441213+00:00, run_duration=3.175304, state=success, executor_state=success, try_number=1, max_tries=1, job_id=452, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:12:01.097907+00:00, queued_by_job_id=2, pid=6631 2024-02-24T01:13:00.392715981Z [2024-02-24T01:13:00.392+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:13:00+00:00, run_after=2024-02-24T01:14:00+00:00 2024-02-24T01:13:00.408517480Z [2024-02-24T01:13:00.408+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:13:00+00:00, run_after=2024-02-24T01:14:00+00:00 2024-02-24T01:13:00.416577504Z [2024-02-24T01:13:00.416+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:13:00.514773085Z [2024-02-24T01:13:00.514+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T01:13:00.514822807Z 2024-02-24T01:13:00.514861857Z 2024-02-24T01:13:00.514871289Z 2024-02-24T01:13:00.515089558Z [2024-02-24T01:13:00.514+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:13:00.515406077Z [2024-02-24T01:13:00.515+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:13:00.515690571Z [2024-02-24T01:13:00.515+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:13:00.516899901Z [2024-02-24T01:13:00.516+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:13:00.516919246Z 2024-02-24T01:13:00.516928588Z 2024-02-24T01:13:00.516937275Z 2024-02-24T01:13:00.522972138Z [2024-02-24T01:13:00.522+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:13:00.523406482Z [2024-02-24T01:13:00.523+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:13:00.523755202Z [2024-02-24T01:13:00.523+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:13:00.523914535Z [2024-02-24T01:13:00.523+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:13:00.524240660Z [2024-02-24T01:13:00.524+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:13:00.524499645Z [2024-02-24T01:13:00.524+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:13:00.722850745Z [2024-02-24T01:13:00.722+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:12:00+00:00 exited with status queued for try_number 1 2024-02-24T01:13:00.723074735Z [2024-02-24T01:13:00.722+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:12:00+00:00 exited with status queued for try_number 1 2024-02-24T01:13:00.723209048Z [2024-02-24T01:13:00.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:12:00+00:00 exited with status queued for try_number 1 2024-02-24T01:13:00.736904130Z [2024-02-24T01:13:00.736+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9bee0cf9-fa1f-4560-9b7c-5b5bac3fb673 2024-02-24T01:13:00.740100072Z [2024-02-24T01:13:00.736+0000] {scheduler_job.py:635} INFO - Setting external_id for to b85532d2-a378-46a3-86c6-8b91e47addc3 2024-02-24T01:13:00.742200525Z [2024-02-24T01:13:00.740+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37e6cd62-170a-4ac2-91da-0f100c5f8d07 2024-02-24T01:13:02.996168534Z [2024-02-24T01:13:02.995+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:13:02.996704872Z [2024-02-24T01:13:02.996+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:12:00+00:00, run_id=scheduled__2024-02-24T01:12:00+00:00, run_start_date=2024-02-24 01:13:00.428781+00:00, run_end_date=2024-02-24 01:13:02.996255+00:00, run_duration=2.567474, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:12:00+00:00, data_interval_end=2024-02-24 01:13:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:13:03.010926914Z [2024-02-24T01:13:03.010+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:13:00+00:00, run_after=2024-02-24T01:14:00+00:00 2024-02-24T01:13:03.066093941Z [2024-02-24T01:13:03.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:12:00+00:00 exited with status success for try_number 1 2024-02-24T01:13:03.073954649Z [2024-02-24T01:13:03.073+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:12:00+00:00, map_index=-1, run_start_date=2024-02-24 01:13:01.375141+00:00, run_end_date=2024-02-24 01:13:01.797162+00:00, run_duration=0.422021, state=success, executor_state=success, try_number=1, max_tries=1, job_id=453, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:13:00.518347+00:00, queued_by_job_id=2, pid=6663 2024-02-24T01:13:04.143886781Z [2024-02-24T01:13:04.143+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:13:04.144135593Z [2024-02-24T01:13:04.143+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:12:00+00:00, run_id=scheduled__2024-02-24T01:12:00+00:00, run_start_date=2024-02-24 01:13:00.430162+00:00, run_end_date=2024-02-24 01:13:04.143817+00:00, run_duration=3.713655, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:12:00+00:00, data_interval_end=2024-02-24 01:13:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:13:04.154067634Z [2024-02-24T01:13:04.153+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:13:00+00:00, run_after=2024-02-24T01:14:00+00:00 2024-02-24T01:13:04.193649062Z [2024-02-24T01:13:04.193+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:12:00+00:00 exited with status success for try_number 1 2024-02-24T01:13:04.198673970Z [2024-02-24T01:13:04.198+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:12:00+00:00, map_index=-1, run_start_date=2024-02-24 01:13:02.613533+00:00, run_end_date=2024-02-24 01:13:03.953766+00:00, run_duration=1.340233, state=success, executor_state=success, try_number=1, max_tries=1, job_id=455, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:13:00.518347+00:00, queued_by_job_id=2, pid=6682 2024-02-24T01:13:04.402470706Z [2024-02-24T01:13:04.401+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:13:04.402880799Z [2024-02-24T01:13:04.402+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:12:00+00:00, run_id=scheduled__2024-02-24T01:12:00+00:00, run_start_date=2024-02-24 01:13:00.431529+00:00, run_end_date=2024-02-24 01:13:04.402368+00:00, run_duration=3.970839, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:12:00+00:00, data_interval_end=2024-02-24 01:13:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:13:04.415505991Z [2024-02-24T01:13:04.415+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:13:00+00:00, run_after=2024-02-24T01:14:00+00:00 2024-02-24T01:13:04.470413746Z [2024-02-24T01:13:04.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:12:00+00:00 exited with status success for try_number 1 2024-02-24T01:13:04.480064914Z [2024-02-24T01:13:04.479+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:12:00+00:00, map_index=-1, run_start_date=2024-02-24 01:13:02.476750+00:00, run_end_date=2024-02-24 01:13:04.151930+00:00, run_duration=1.67518, state=success, executor_state=success, try_number=1, max_tries=1, job_id=454, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:13:00.518347+00:00, queued_by_job_id=2, pid=6681 2024-02-24T01:14:00.405321453Z [2024-02-24T01:14:00.404+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:14:00.421972364Z [2024-02-24T01:14:00.421+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:14:00+00:00, run_after=2024-02-24T01:15:00+00:00 2024-02-24T01:14:00.429634608Z [2024-02-24T01:14:00.429+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:14:00.442811833Z [2024-02-24T01:14:00.442+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:14:00+00:00, run_after=2024-02-24T01:15:00+00:00 2024-02-24T01:14:00.541756080Z [2024-02-24T01:14:00.541+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T01:14:00.541841093Z 2024-02-24T01:14:00.541850312Z 2024-02-24T01:14:00.541856183Z 2024-02-24T01:14:00.541862285Z 2024-02-24T01:14:00.542177702Z [2024-02-24T01:14:00.541+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T01:14:00.542537572Z [2024-02-24T01:14:00.542+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:14:00.542740600Z [2024-02-24T01:14:00.542+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:14:00.542936630Z [2024-02-24T01:14:00.542+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:14:00.543889849Z [2024-02-24T01:14:00.543+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:14:00.543917157Z 2024-02-24T01:14:00.543934889Z 2024-02-24T01:14:00.543946781Z 2024-02-24T01:14:00.543956567Z 2024-02-24T01:14:00.549535230Z [2024-02-24T01:14:00.549+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:14:00.549678588Z [2024-02-24T01:14:00.549+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T01:14:00.550223431Z [2024-02-24T01:14:00.549+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:14:00.550466255Z [2024-02-24T01:14:00.550+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:14:00.550819873Z [2024-02-24T01:14:00.550+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:14:00.551016640Z [2024-02-24T01:14:00.550+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:14:00.551616748Z [2024-02-24T01:14:00.551+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:14:00.551989638Z [2024-02-24T01:14:00.551+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:14:01.178341066Z [2024-02-24T01:14:01.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:12:00+00:00 exited with status queued for try_number 1 2024-02-24T01:14:01.180436575Z [2024-02-24T01:14:01.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:13:00+00:00 exited with status queued for try_number 1 2024-02-24T01:14:01.180780639Z [2024-02-24T01:14:01.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:13:00+00:00 exited with status queued for try_number 1 2024-02-24T01:14:01.181003287Z [2024-02-24T01:14:01.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:13:00+00:00 exited with status queued for try_number 1 2024-02-24T01:14:01.191497527Z [2024-02-24T01:14:01.191+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99668358-58ea-4900-b767-b5ff995e3606 2024-02-24T01:14:01.191900598Z [2024-02-24T01:14:01.191+0000] {scheduler_job.py:635} INFO - Setting external_id for to a88c712f-1533-4906-836b-5dbe5beb2c83 2024-02-24T01:14:01.192042373Z [2024-02-24T01:14:01.191+0000] {scheduler_job.py:635} INFO - Setting external_id for to 359841c1-22f1-4df9-8de9-424eeb7142e8 2024-02-24T01:14:01.192213562Z [2024-02-24T01:14:01.192+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6cd679f-4672-4a81-9bd6-a4a5d0ede2a5 2024-02-24T01:14:02.422542787Z [2024-02-24T01:14:02.421+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:14:02.423767179Z [2024-02-24T01:14:02.422+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 01:12:00+00:00, run_id=scheduled__2024-02-24T01:12:00+00:00, run_start_date=2024-02-24 01:14:00.456373+00:00, run_end_date=2024-02-24 01:14:02.422568+00:00, run_duration=1.966195, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:12:00+00:00, data_interval_end=2024-02-24 01:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T01:14:02.436393167Z [2024-02-24T01:14:02.435+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T01:14:00+00:00, run_after=2024-02-24T01:16:00+00:00 2024-02-24T01:14:02.454918639Z [2024-02-24T01:14:02.454+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:14:02.455322029Z [2024-02-24T01:14:02.455+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:13:00+00:00, run_id=scheduled__2024-02-24T01:13:00+00:00, run_start_date=2024-02-24 01:14:00.457803+00:00, run_end_date=2024-02-24 01:14:02.454853+00:00, run_duration=1.99705, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:13:00+00:00, data_interval_end=2024-02-24 01:14:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:14:02.468819933Z [2024-02-24T01:14:02.468+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:14:00+00:00, run_after=2024-02-24T01:15:00+00:00 2024-02-24T01:14:02.520042742Z [2024-02-24T01:14:02.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:12:00+00:00 exited with status success for try_number 1 2024-02-24T01:14:02.522887635Z [2024-02-24T01:14:02.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:13:00+00:00 exited with status success for try_number 1 2024-02-24T01:14:02.532035593Z [2024-02-24T01:14:02.531+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T01:12:00+00:00, map_index=-1, run_start_date=2024-02-24 01:14:01.448090+00:00, run_end_date=2024-02-24 01:14:01.915094+00:00, run_duration=0.467004, state=success, executor_state=success, try_number=1, max_tries=1, job_id=456, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:14:00.545376+00:00, queued_by_job_id=2, pid=6715 2024-02-24T01:14:02.532404178Z [2024-02-24T01:14:02.532+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:13:00+00:00, map_index=-1, run_start_date=2024-02-24 01:14:01.553154+00:00, run_end_date=2024-02-24 01:14:02.024899+00:00, run_duration=0.471745, state=success, executor_state=success, try_number=1, max_tries=1, job_id=457, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:14:00.545376+00:00, queued_by_job_id=2, pid=6716 2024-02-24T01:14:04.702764024Z [2024-02-24T01:14:04.702+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:14:04.703034306Z [2024-02-24T01:14:04.702+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:13:00+00:00, run_id=scheduled__2024-02-24T01:13:00+00:00, run_start_date=2024-02-24 01:14:00.459354+00:00, run_end_date=2024-02-24 01:14:04.702536+00:00, run_duration=4.243182, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:13:00+00:00, data_interval_end=2024-02-24 01:14:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:14:04.712220745Z [2024-02-24T01:14:04.711+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:14:00+00:00, run_after=2024-02-24T01:15:00+00:00 2024-02-24T01:14:04.776856755Z [2024-02-24T01:14:04.775+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:13:00+00:00 exited with status success for try_number 1 2024-02-24T01:14:04.786340864Z [2024-02-24T01:14:04.785+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:13:00+00:00, map_index=-1, run_start_date=2024-02-24 01:14:02.603245+00:00, run_end_date=2024-02-24 01:14:04.318035+00:00, run_duration=1.71479, state=success, executor_state=success, try_number=1, max_tries=1, job_id=459, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:14:00.545376+00:00, queued_by_job_id=2, pid=6740 2024-02-24T01:14:05.831444261Z [2024-02-24T01:14:05.830+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:14:05.831904205Z [2024-02-24T01:14:05.831+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:13:00+00:00, run_id=scheduled__2024-02-24T01:13:00+00:00, run_start_date=2024-02-24 01:14:00.460692+00:00, run_end_date=2024-02-24 01:14:05.831548+00:00, run_duration=5.370856, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:13:00+00:00, data_interval_end=2024-02-24 01:14:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:14:05.841359545Z [2024-02-24T01:14:05.840+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:14:00+00:00, run_after=2024-02-24T01:15:00+00:00 2024-02-24T01:14:05.876101055Z [2024-02-24T01:14:05.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:13:00+00:00 exited with status success for try_number 1 2024-02-24T01:14:05.883274710Z [2024-02-24T01:14:05.882+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:13:00+00:00, map_index=-1, run_start_date=2024-02-24 01:14:02.588292+00:00, run_end_date=2024-02-24 01:14:04.955711+00:00, run_duration=2.367419, state=success, executor_state=success, try_number=1, max_tries=1, job_id=458, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:14:00.545376+00:00, queued_by_job_id=2, pid=6739 2024-02-24T01:15:00.817590502Z [2024-02-24T01:15:00.817+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:15:00+00:00, run_after=2024-02-24T01:20:00+00:00 2024-02-24T01:15:00.843108933Z [2024-02-24T01:15:00.842+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:15:00+00:00, run_after=2024-02-24T01:16:00+00:00 2024-02-24T01:15:00.867723069Z [2024-02-24T01:15:00.867+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:15:00+00:00, run_after=2024-02-24T01:16:00+00:00 2024-02-24T01:15:00.879011157Z [2024-02-24T01:15:00.878+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:15:00.984919562Z [2024-02-24T01:15:00.984+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T01:15:00.984935815Z 2024-02-24T01:15:00.984939684Z 2024-02-24T01:15:00.984942766Z 2024-02-24T01:15:00.984946191Z 2024-02-24T01:15:00.985801630Z [2024-02-24T01:15:00.984+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:15:00.985997577Z [2024-02-24T01:15:00.985+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:15:00.986216198Z [2024-02-24T01:15:00.986+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:15:00.986665429Z [2024-02-24T01:15:00.986+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:15:00.987302973Z [2024-02-24T01:15:00.987+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:15:00.987309400Z 2024-02-24T01:15:00.987313008Z 2024-02-24T01:15:00.987316202Z 2024-02-24T01:15:00.987323763Z 2024-02-24T01:15:00.991653097Z [2024-02-24T01:15:00.991+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T01:15:00.991887405Z [2024-02-24T01:15:00.991+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T01:15:00.992182864Z [2024-02-24T01:15:00.992+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:15:00.992323051Z [2024-02-24T01:15:00.992+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:15:00.992595906Z [2024-02-24T01:15:00.992+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:15:00.992883873Z [2024-02-24T01:15:00.992+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:15:00.993138732Z [2024-02-24T01:15:00.992+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:15:00.993244560Z [2024-02-24T01:15:00.993+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:15:01.584843451Z [2024-02-24T01:15:01.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T01:10:00+00:00 exited with status queued for try_number 1 2024-02-24T01:15:01.585442273Z [2024-02-24T01:15:01.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:14:00+00:00 exited with status queued for try_number 1 2024-02-24T01:15:01.585708196Z [2024-02-24T01:15:01.585+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:14:00+00:00 exited with status queued for try_number 1 2024-02-24T01:15:01.587490036Z [2024-02-24T01:15:01.585+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:14:00+00:00 exited with status queued for try_number 1 2024-02-24T01:15:01.603141830Z [2024-02-24T01:15:01.602+0000] {scheduler_job.py:635} INFO - Setting external_id for to c25d4a68-e83f-4179-a586-faeebedcd078 2024-02-24T01:15:01.606628647Z [2024-02-24T01:15:01.603+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4cdd7f83-04e8-4634-b434-7a4b44786247 2024-02-24T01:15:01.607345397Z [2024-02-24T01:15:01.606+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc2a7801-fc13-4e3a-9ed6-ac6d6dfdcc67 2024-02-24T01:15:01.607544718Z [2024-02-24T01:15:01.607+0000] {scheduler_job.py:635} INFO - Setting external_id for to f370c54f-ccef-45d3-96bd-f04a51093061 2024-02-24T01:15:03.254566328Z [2024-02-24T01:15:03.254+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:15:03.254858989Z [2024-02-24T01:15:03.254+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:14:00+00:00, run_id=scheduled__2024-02-24T01:14:00+00:00, run_start_date=2024-02-24 01:15:00.900456+00:00, run_end_date=2024-02-24 01:15:03.254471+00:00, run_duration=2.354015, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:14:00+00:00, data_interval_end=2024-02-24 01:15:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:15:03.267587804Z [2024-02-24T01:15:03.266+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:15:00+00:00, run_after=2024-02-24T01:16:00+00:00 2024-02-24T01:15:03.316351816Z [2024-02-24T01:15:03.316+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:14:00+00:00 exited with status success for try_number 1 2024-02-24T01:15:03.324736761Z [2024-02-24T01:15:03.324+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:14:00+00:00, map_index=-1, run_start_date=2024-02-24 01:15:02.045873+00:00, run_end_date=2024-02-24 01:15:02.640533+00:00, run_duration=0.59466, state=success, executor_state=success, try_number=1, max_tries=1, job_id=460, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:15:00.988379+00:00, queued_by_job_id=2, pid=6774 2024-02-24T01:15:05.559184150Z [2024-02-24T01:15:05.558+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:15:05.559536354Z [2024-02-24T01:15:05.559+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:14:00+00:00, run_id=scheduled__2024-02-24T01:14:00+00:00, run_start_date=2024-02-24 01:15:00.901851+00:00, run_end_date=2024-02-24 01:15:05.559052+00:00, run_duration=4.657201, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:14:00+00:00, data_interval_end=2024-02-24 01:15:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:15:05.569135909Z [2024-02-24T01:15:05.568+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:15:00+00:00, run_after=2024-02-24T01:16:00+00:00 2024-02-24T01:15:05.617848869Z [2024-02-24T01:15:05.617+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:15:05.617898129Z 2024-02-24T01:15:05.618033055Z [2024-02-24T01:15:05.617+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:15:05.619124154Z [2024-02-24T01:15:05.618+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:15:05.619192543Z 2024-02-24T01:15:05.622448597Z [2024-02-24T01:15:05.622+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T01:15:05.622669421Z [2024-02-24T01:15:05.622+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T01:15:05.675941693Z [2024-02-24T01:15:05.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T01:10:00+00:00 exited with status queued for try_number 1 2024-02-24T01:15:05.676201060Z [2024-02-24T01:15:05.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T01:10:00+00:00 exited with status success for try_number 1 2024-02-24T01:15:05.676416081Z [2024-02-24T01:15:05.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:14:00+00:00 exited with status success for try_number 1 2024-02-24T01:15:05.684639135Z [2024-02-24T01:15:05.684+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T01:10:00+00:00, map_index=-1, run_start_date=2024-02-24 01:15:03.779696+00:00, run_end_date=2024-02-24 01:15:04.458419+00:00, run_duration=0.678723, state=success, executor_state=success, try_number=1, max_tries=1, job_id=463, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:15:00.988379+00:00, queued_by_job_id=2, pid=6805 2024-02-24T01:15:05.685128418Z [2024-02-24T01:15:05.684+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:14:00+00:00, map_index=-1, run_start_date=2024-02-24 01:15:03.343960+00:00, run_end_date=2024-02-24 01:15:04.957761+00:00, run_duration=1.613801, state=success, executor_state=success, try_number=1, max_tries=1, job_id=461, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:15:00.988379+00:00, queued_by_job_id=2, pid=6793 2024-02-24T01:15:05.685509254Z [2024-02-24T01:15:05.685+0000] {scheduler_job.py:635} INFO - Setting external_id for to 67129a9d-1c95-4c53-80ff-94fdd2e618f3 2024-02-24T01:15:06.851591031Z [2024-02-24T01:15:06.851+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:15:06.852331325Z [2024-02-24T01:15:06.851+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:14:00+00:00, run_id=scheduled__2024-02-24T01:14:00+00:00, run_start_date=2024-02-24 01:15:00.903301+00:00, run_end_date=2024-02-24 01:15:06.851740+00:00, run_duration=5.948439, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:14:00+00:00, data_interval_end=2024-02-24 01:15:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:15:06.865348190Z [2024-02-24T01:15:06.864+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:15:00+00:00, run_after=2024-02-24T01:16:00+00:00 2024-02-24T01:15:06.930448851Z [2024-02-24T01:15:06.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:14:00+00:00 exited with status success for try_number 1 2024-02-24T01:15:06.946026457Z [2024-02-24T01:15:06.945+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:14:00+00:00, map_index=-1, run_start_date=2024-02-24 01:15:03.661378+00:00, run_end_date=2024-02-24 01:15:05.838807+00:00, run_duration=2.177429, state=success, executor_state=success, try_number=1, max_tries=1, job_id=462, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:15:00.988379+00:00, queued_by_job_id=2, pid=6799 2024-02-24T01:15:08.354143475Z [2024-02-24T01:15:08.353+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:15:08.354196708Z 2024-02-24T01:15:08.354207950Z [2024-02-24T01:15:08.353+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:15:08.354962867Z [2024-02-24T01:15:08.354+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:15:08.354991284Z 2024-02-24T01:15:08.357894789Z [2024-02-24T01:15:08.357+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T01:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T01:15:08.358033834Z [2024-02-24T01:15:08.357+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T01:15:08.415032490Z [2024-02-24T01:15:08.414+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T01:10:00+00:00 exited with status queued for try_number 1 2024-02-24T01:15:08.415071407Z [2024-02-24T01:15:08.414+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T01:10:00+00:00 exited with status success for try_number 1 2024-02-24T01:15:08.422549519Z [2024-02-24T01:15:08.422+0000] {scheduler_job.py:635} INFO - Setting external_id for to 89015928-5505-47cb-b868-1fc4c453e0f4 2024-02-24T01:15:08.422688978Z [2024-02-24T01:15:08.422+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T01:10:00+00:00, map_index=-1, run_start_date=2024-02-24 01:15:07.345092+00:00, run_end_date=2024-02-24 01:15:07.691863+00:00, run_duration=0.346771, state=success, executor_state=success, try_number=1, max_tries=1, job_id=464, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:15:05.619674+00:00, queued_by_job_id=2, pid=6823 2024-02-24T01:15:10.694657667Z [2024-02-24T01:15:10.694+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:15:10.694700233Z 2024-02-24T01:15:10.694959872Z [2024-02-24T01:15:10.694+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:15:10.696469043Z [2024-02-24T01:15:10.696+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:15:10.696508647Z 2024-02-24T01:15:10.699733504Z [2024-02-24T01:15:10.699+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:15:10.699947715Z [2024-02-24T01:15:10.699+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T01:15:10.762202157Z [2024-02-24T01:15:10.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T01:10:00+00:00 exited with status queued for try_number 1 2024-02-24T01:15:10.762310029Z [2024-02-24T01:15:10.762+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T01:10:00+00:00 exited with status success for try_number 1 2024-02-24T01:15:10.769385152Z [2024-02-24T01:15:10.769+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9666073c-917a-41a6-baa5-4ce08f84dd71 2024-02-24T01:15:10.769723180Z [2024-02-24T01:15:10.769+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T01:10:00+00:00, map_index=0, run_start_date=2024-02-24 01:15:09.950301+00:00, run_end_date=2024-02-24 01:15:10.338958+00:00, run_duration=0.388657, state=success, executor_state=success, try_number=1, max_tries=1, job_id=465, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:15:08.355428+00:00, queued_by_job_id=2, pid=6831 2024-02-24T01:15:13.458398217Z [2024-02-24T01:15:13.457+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:15:13.459322529Z [2024-02-24T01:15:13.458+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:10:00+00:00, run_id=scheduled__2024-02-24T01:10:00+00:00, run_start_date=2024-02-24 01:15:00.896576+00:00, run_end_date=2024-02-24 01:15:13.458375+00:00, run_duration=12.561799, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:10:00+00:00, data_interval_end=2024-02-24 01:15:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T01:15:13.471213347Z [2024-02-24T01:15:13.470+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:15:00+00:00, run_after=2024-02-24T01:20:00+00:00 2024-02-24T01:15:13.511410944Z [2024-02-24T01:15:13.510+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T01:10:00+00:00 exited with status success for try_number 1 2024-02-24T01:15:13.518672731Z [2024-02-24T01:15:13.518+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T01:10:00+00:00, map_index=-1, run_start_date=2024-02-24 01:15:12.361034+00:00, run_end_date=2024-02-24 01:15:12.730714+00:00, run_duration=0.36968, state=success, executor_state=success, try_number=1, max_tries=1, job_id=466, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:15:10.697006+00:00, queued_by_job_id=2, pid=6839 2024-02-24T01:16:01.064718053Z [2024-02-24T01:16:01.064+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:16:01.077552968Z [2024-02-24T01:16:01.077+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:16:00+00:00, run_after=2024-02-24T01:17:00+00:00 2024-02-24T01:16:01.091283481Z [2024-02-24T01:16:01.090+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:16:00+00:00, run_after=2024-02-24T01:17:00+00:00 2024-02-24T01:16:01.098566731Z [2024-02-24T01:16:01.098+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:16:01.182575541Z [2024-02-24T01:16:01.182+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T01:16:01.182594988Z 2024-02-24T01:16:01.182601665Z 2024-02-24T01:16:01.182604880Z 2024-02-24T01:16:01.182608014Z 2024-02-24T01:16:01.182915812Z [2024-02-24T01:16:01.182+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T01:16:01.183149230Z [2024-02-24T01:16:01.182+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:16:01.183343292Z [2024-02-24T01:16:01.183+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:16:01.183573191Z [2024-02-24T01:16:01.183+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:16:01.184445106Z [2024-02-24T01:16:01.184+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:16:01.184468169Z 2024-02-24T01:16:01.184472492Z 2024-02-24T01:16:01.184476079Z 2024-02-24T01:16:01.184494076Z 2024-02-24T01:16:01.188348929Z [2024-02-24T01:16:01.188+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:16:01.188657719Z [2024-02-24T01:16:01.188+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T01:16:01.189089007Z [2024-02-24T01:16:01.188+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:16:01.189299304Z [2024-02-24T01:16:01.189+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:16:01.189667533Z [2024-02-24T01:16:01.189+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:16:01.189887645Z [2024-02-24T01:16:01.189+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:16:01.190153532Z [2024-02-24T01:16:01.189+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:16:01.190321255Z [2024-02-24T01:16:01.190+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:16:01.699019582Z [2024-02-24T01:16:01.698+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:14:00+00:00 exited with status queued for try_number 1 2024-02-24T01:16:01.699159099Z [2024-02-24T01:16:01.699+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:15:00+00:00 exited with status queued for try_number 1 2024-02-24T01:16:01.699287414Z [2024-02-24T01:16:01.699+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:15:00+00:00 exited with status queued for try_number 1 2024-02-24T01:16:01.699394772Z [2024-02-24T01:16:01.699+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:15:00+00:00 exited with status queued for try_number 1 2024-02-24T01:16:01.718956109Z [2024-02-24T01:16:01.718+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f0ec12e-b1f0-4583-896c-ab19a3b736f9 2024-02-24T01:16:01.722259367Z [2024-02-24T01:16:01.721+0000] {scheduler_job.py:635} INFO - Setting external_id for to e2cc4e3d-c5cc-46e9-b9fd-865b58265026 2024-02-24T01:16:01.722435760Z [2024-02-24T01:16:01.722+0000] {scheduler_job.py:635} INFO - Setting external_id for to c239e033-8104-4b27-bf8a-a73335fbfdd7 2024-02-24T01:16:01.722593578Z [2024-02-24T01:16:01.722+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c91ced1-5046-47dc-a6da-48323372d58c 2024-02-24T01:16:03.024449984Z [2024-02-24T01:16:03.023+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:16:03.024506283Z [2024-02-24T01:16:03.024+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 01:14:00+00:00, run_id=scheduled__2024-02-24T01:14:00+00:00, run_start_date=2024-02-24 01:16:01.108967+00:00, run_end_date=2024-02-24 01:16:03.024124+00:00, run_duration=1.915157, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:14:00+00:00, data_interval_end=2024-02-24 01:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T01:16:03.034455737Z [2024-02-24T01:16:03.034+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T01:16:00+00:00, run_after=2024-02-24T01:18:00+00:00 2024-02-24T01:16:03.053666804Z [2024-02-24T01:16:03.053+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:16:03.058379955Z [2024-02-24T01:16:03.058+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:15:00+00:00, run_id=scheduled__2024-02-24T01:15:00+00:00, run_start_date=2024-02-24 01:16:01.110222+00:00, run_end_date=2024-02-24 01:16:03.057934+00:00, run_duration=1.947712, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:15:00+00:00, data_interval_end=2024-02-24 01:16:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:16:03.078555683Z [2024-02-24T01:16:03.078+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:16:00+00:00, run_after=2024-02-24T01:17:00+00:00 2024-02-24T01:16:03.144375800Z [2024-02-24T01:16:03.144+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:14:00+00:00 exited with status success for try_number 1 2024-02-24T01:16:03.144469048Z [2024-02-24T01:16:03.144+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:15:00+00:00 exited with status success for try_number 1 2024-02-24T01:16:03.151084950Z [2024-02-24T01:16:03.150+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T01:14:00+00:00, map_index=-1, run_start_date=2024-02-24 01:16:02.051733+00:00, run_end_date=2024-02-24 01:16:02.531388+00:00, run_duration=0.479655, state=success, executor_state=success, try_number=1, max_tries=1, job_id=468, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:16:01.185552+00:00, queued_by_job_id=2, pid=6863 2024-02-24T01:16:03.151316452Z [2024-02-24T01:16:03.151+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:15:00+00:00, map_index=-1, run_start_date=2024-02-24 01:16:02.043145+00:00, run_end_date=2024-02-24 01:16:02.551013+00:00, run_duration=0.507868, state=success, executor_state=success, try_number=1, max_tries=1, job_id=467, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:16:01.185552+00:00, queued_by_job_id=2, pid=6862 2024-02-24T01:16:05.383432338Z [2024-02-24T01:16:05.382+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:16:05.383797051Z [2024-02-24T01:16:05.383+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:15:00+00:00, run_id=scheduled__2024-02-24T01:15:00+00:00, run_start_date=2024-02-24 01:16:01.111244+00:00, run_end_date=2024-02-24 01:16:05.383272+00:00, run_duration=4.272028, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:15:00+00:00, data_interval_end=2024-02-24 01:16:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:16:05.395248662Z [2024-02-24T01:16:05.394+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:16:00+00:00, run_after=2024-02-24T01:17:00+00:00 2024-02-24T01:16:05.404072759Z [2024-02-24T01:16:05.403+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:16:05.404520668Z [2024-02-24T01:16:05.404+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:15:00+00:00, run_id=scheduled__2024-02-24T01:15:00+00:00, run_start_date=2024-02-24 01:16:01.112223+00:00, run_end_date=2024-02-24 01:16:05.403926+00:00, run_duration=4.291703, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:15:00+00:00, data_interval_end=2024-02-24 01:16:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:16:05.415994609Z [2024-02-24T01:16:05.415+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:16:00+00:00, run_after=2024-02-24T01:17:00+00:00 2024-02-24T01:16:05.446263095Z [2024-02-24T01:16:05.445+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:15:00+00:00 exited with status success for try_number 1 2024-02-24T01:16:05.446435016Z [2024-02-24T01:16:05.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:15:00+00:00 exited with status success for try_number 1 2024-02-24T01:16:05.453364130Z [2024-02-24T01:16:05.452+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:15:00+00:00, map_index=-1, run_start_date=2024-02-24 01:16:03.563143+00:00, run_end_date=2024-02-24 01:16:04.850822+00:00, run_duration=1.287679, state=success, executor_state=success, try_number=1, max_tries=1, job_id=470, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:16:01.185552+00:00, queued_by_job_id=2, pid=6886 2024-02-24T01:16:05.453653030Z [2024-02-24T01:16:05.453+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:15:00+00:00, map_index=-1, run_start_date=2024-02-24 01:16:03.553887+00:00, run_end_date=2024-02-24 01:16:05.197326+00:00, run_duration=1.643439, state=success, executor_state=success, try_number=1, max_tries=1, job_id=469, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:16:01.185552+00:00, queued_by_job_id=2, pid=6887 2024-02-24T01:17:00.234566940Z [2024-02-24T01:17:00.233+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:17:00+00:00, run_after=2024-02-24T01:18:00+00:00 2024-02-24T01:17:00.246094600Z [2024-02-24T01:17:00.245+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:17:00.270669499Z [2024-02-24T01:17:00.270+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:17:00+00:00, run_after=2024-02-24T01:18:00+00:00 2024-02-24T01:17:00.393578048Z [2024-02-24T01:17:00.392+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T01:17:00.393630081Z 2024-02-24T01:17:00.393639965Z 2024-02-24T01:17:00.393649143Z 2024-02-24T01:17:00.394018643Z [2024-02-24T01:17:00.393+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:17:00.394466331Z [2024-02-24T01:17:00.394+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:17:00.394773655Z [2024-02-24T01:17:00.394+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:17:00.396187362Z [2024-02-24T01:17:00.395+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:17:00.396202767Z 2024-02-24T01:17:00.396211719Z 2024-02-24T01:17:00.396220673Z 2024-02-24T01:17:00.402413267Z [2024-02-24T01:17:00.402+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:17:00.402831945Z [2024-02-24T01:17:00.402+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:17:00.403392174Z [2024-02-24T01:17:00.403+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:17:00.403772167Z [2024-02-24T01:17:00.403+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:17:00.404275778Z [2024-02-24T01:17:00.404+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:17:00.404503094Z [2024-02-24T01:17:00.404+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:17:00.630360395Z [2024-02-24T01:17:00.629+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:16:00+00:00 exited with status queued for try_number 1 2024-02-24T01:17:00.630700691Z [2024-02-24T01:17:00.630+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:16:00+00:00 exited with status queued for try_number 1 2024-02-24T01:17:00.630996915Z [2024-02-24T01:17:00.630+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:16:00+00:00 exited with status queued for try_number 1 2024-02-24T01:17:00.642807873Z [2024-02-24T01:17:00.642+0000] {scheduler_job.py:635} INFO - Setting external_id for to a56de4e3-1b5b-469c-ae86-effee2b98c84 2024-02-24T01:17:00.643015930Z [2024-02-24T01:17:00.642+0000] {scheduler_job.py:635} INFO - Setting external_id for to d877957b-e691-410a-899c-c930dea1f623 2024-02-24T01:17:00.643222160Z [2024-02-24T01:17:00.643+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22c3c8dc-9375-4260-bc06-1bbc3fb07811 2024-02-24T01:17:02.345853247Z [2024-02-24T01:17:02.345+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:17:02.346522289Z [2024-02-24T01:17:02.346+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:16:00+00:00, run_id=scheduled__2024-02-24T01:16:00+00:00, run_start_date=2024-02-24 01:17:00.287263+00:00, run_end_date=2024-02-24 01:17:02.345969+00:00, run_duration=2.058706, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:16:00+00:00, data_interval_end=2024-02-24 01:17:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:17:02.366449058Z [2024-02-24T01:17:02.366+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:17:00+00:00, run_after=2024-02-24T01:18:00+00:00 2024-02-24T01:17:02.459646528Z [2024-02-24T01:17:02.458+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:16:00+00:00 exited with status success for try_number 1 2024-02-24T01:17:02.468752500Z [2024-02-24T01:17:02.468+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:16:00+00:00, map_index=-1, run_start_date=2024-02-24 01:17:01.345201+00:00, run_end_date=2024-02-24 01:17:01.742993+00:00, run_duration=0.397792, state=success, executor_state=success, try_number=1, max_tries=1, job_id=471, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:17:00.398036+00:00, queued_by_job_id=2, pid=6920 2024-02-24T01:17:02.481098249Z [2024-02-24T01:17:02.480+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T01:17:04.010109746Z [2024-02-24T01:17:04.009+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:17:04.010494597Z [2024-02-24T01:17:04.010+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:16:00+00:00, run_id=scheduled__2024-02-24T01:16:00+00:00, run_start_date=2024-02-24 01:17:00.290799+00:00, run_end_date=2024-02-24 01:17:04.010139+00:00, run_duration=3.71934, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:16:00+00:00, data_interval_end=2024-02-24 01:17:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:17:04.022010871Z [2024-02-24T01:17:04.021+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:17:00+00:00, run_after=2024-02-24T01:18:00+00:00 2024-02-24T01:17:04.035135343Z [2024-02-24T01:17:04.034+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:17:04.035781990Z [2024-02-24T01:17:04.035+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:16:00+00:00, run_id=scheduled__2024-02-24T01:16:00+00:00, run_start_date=2024-02-24 01:17:00.289363+00:00, run_end_date=2024-02-24 01:17:04.035406+00:00, run_duration=3.746043, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:16:00+00:00, data_interval_end=2024-02-24 01:17:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:17:04.046818865Z [2024-02-24T01:17:04.046+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:17:00+00:00, run_after=2024-02-24T01:18:00+00:00 2024-02-24T01:17:04.080307933Z [2024-02-24T01:17:04.079+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:16:00+00:00 exited with status success for try_number 1 2024-02-24T01:17:04.088778426Z [2024-02-24T01:17:04.086+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:16:00+00:00, map_index=-1, run_start_date=2024-02-24 01:17:02.365404+00:00, run_end_date=2024-02-24 01:17:03.874216+00:00, run_duration=1.508812, state=success, executor_state=success, try_number=1, max_tries=1, job_id=473, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:17:00.398036+00:00, queued_by_job_id=2, pid=6939 2024-02-24T01:17:05.161857813Z [2024-02-24T01:17:05.161+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:16:00+00:00 exited with status success for try_number 1 2024-02-24T01:17:05.167972197Z [2024-02-24T01:17:05.167+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:16:00+00:00, map_index=-1, run_start_date=2024-02-24 01:17:02.272752+00:00, run_end_date=2024-02-24 01:17:03.972987+00:00, run_duration=1.700235, state=success, executor_state=success, try_number=1, max_tries=1, job_id=472, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:17:00.398036+00:00, queued_by_job_id=2, pid=6938 2024-02-24T01:18:00.858019152Z [2024-02-24T01:18:00.857+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:18:00+00:00, run_after=2024-02-24T01:19:00+00:00 2024-02-24T01:18:00.870264965Z [2024-02-24T01:18:00.869+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:18:00.897854166Z [2024-02-24T01:18:00.897+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:18:00+00:00, run_after=2024-02-24T01:19:00+00:00 2024-02-24T01:18:00.915838922Z [2024-02-24T01:18:00.915+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:18:00.993702135Z [2024-02-24T01:18:00.993+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T01:18:00.993747547Z 2024-02-24T01:18:00.993856077Z 2024-02-24T01:18:00.993876770Z 2024-02-24T01:18:00.993886556Z 2024-02-24T01:18:00.993929719Z [2024-02-24T01:18:00.993+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T01:18:00.994141517Z [2024-02-24T01:18:00.993+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:18:00.994357158Z [2024-02-24T01:18:00.994+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:18:00.994600041Z [2024-02-24T01:18:00.994+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:18:00.995671430Z [2024-02-24T01:18:00.995+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:18:00.995686030Z 2024-02-24T01:18:00.995690878Z 2024-02-24T01:18:00.995695047Z 2024-02-24T01:18:00.995699127Z 2024-02-24T01:18:01.004034819Z [2024-02-24T01:18:01.003+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:18:01.004244555Z [2024-02-24T01:18:01.003+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T01:18:01.004504277Z [2024-02-24T01:18:01.004+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:18:01.004696560Z [2024-02-24T01:18:01.004+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:18:01.004997768Z [2024-02-24T01:18:01.004+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:18:01.005239732Z [2024-02-24T01:18:01.005+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:18:01.005535770Z [2024-02-24T01:18:01.005+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:18:01.005721119Z [2024-02-24T01:18:01.005+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:18:01.534325789Z [2024-02-24T01:18:01.533+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:16:00+00:00 exited with status queued for try_number 1 2024-02-24T01:18:01.534376079Z [2024-02-24T01:18:01.534+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:17:00+00:00 exited with status queued for try_number 1 2024-02-24T01:18:01.534474562Z [2024-02-24T01:18:01.534+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:17:00+00:00 exited with status queued for try_number 1 2024-02-24T01:18:01.534483360Z [2024-02-24T01:18:01.534+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:17:00+00:00 exited with status queued for try_number 1 2024-02-24T01:18:01.552634755Z [2024-02-24T01:18:01.552+0000] {scheduler_job.py:635} INFO - Setting external_id for to 253cad39-2ae9-473e-a157-1c02888a53e1 2024-02-24T01:18:01.552666194Z [2024-02-24T01:18:01.552+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c01fb2d-1e75-49ec-8648-2a74ff014751 2024-02-24T01:18:01.552792424Z [2024-02-24T01:18:01.552+0000] {scheduler_job.py:635} INFO - Setting external_id for to 68ff3fe3-5c43-4c87-9cc9-a7e74b8e9a19 2024-02-24T01:18:01.552907650Z [2024-02-24T01:18:01.552+0000] {scheduler_job.py:635} INFO - Setting external_id for to fd14bdf0-c480-4d31-896c-a63d89be6408 2024-02-24T01:18:02.829727829Z [2024-02-24T01:18:02.829+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:18:02.834015508Z [2024-02-24T01:18:02.833+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 01:16:00+00:00, run_id=scheduled__2024-02-24T01:16:00+00:00, run_start_date=2024-02-24 01:18:00.928979+00:00, run_end_date=2024-02-24 01:18:02.829643+00:00, run_duration=1.900664, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:16:00+00:00, data_interval_end=2024-02-24 01:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T01:18:02.843432223Z [2024-02-24T01:18:02.843+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T01:18:00+00:00, run_after=2024-02-24T01:20:00+00:00 2024-02-24T01:18:02.851225927Z [2024-02-24T01:18:02.850+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:18:02.851455967Z [2024-02-24T01:18:02.851+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:17:00+00:00, run_id=scheduled__2024-02-24T01:17:00+00:00, run_start_date=2024-02-24 01:18:00.930387+00:00, run_end_date=2024-02-24 01:18:02.851118+00:00, run_duration=1.920731, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:17:00+00:00, data_interval_end=2024-02-24 01:18:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:18:02.862772492Z [2024-02-24T01:18:02.862+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:18:00+00:00, run_after=2024-02-24T01:19:00+00:00 2024-02-24T01:18:02.919006594Z [2024-02-24T01:18:02.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:16:00+00:00 exited with status success for try_number 1 2024-02-24T01:18:02.919057765Z [2024-02-24T01:18:02.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:17:00+00:00 exited with status success for try_number 1 2024-02-24T01:18:02.926213388Z [2024-02-24T01:18:02.925+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:17:00+00:00, map_index=-1, run_start_date=2024-02-24 01:18:01.851140+00:00, run_end_date=2024-02-24 01:18:02.262259+00:00, run_duration=0.411119, state=success, executor_state=success, try_number=1, max_tries=1, job_id=475, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:18:00.996708+00:00, queued_by_job_id=2, pid=6973 2024-02-24T01:18:02.926388721Z [2024-02-24T01:18:02.926+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T01:16:00+00:00, map_index=-1, run_start_date=2024-02-24 01:18:01.783300+00:00, run_end_date=2024-02-24 01:18:02.178793+00:00, run_duration=0.395493, state=success, executor_state=success, try_number=1, max_tries=1, job_id=474, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:18:00.996708+00:00, queued_by_job_id=2, pid=6972 2024-02-24T01:18:04.893544242Z [2024-02-24T01:18:04.893+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:18:04.893872670Z [2024-02-24T01:18:04.893+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:17:00+00:00, run_id=scheduled__2024-02-24T01:17:00+00:00, run_start_date=2024-02-24 01:18:00.931524+00:00, run_end_date=2024-02-24 01:18:04.893424+00:00, run_duration=3.9619, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:17:00+00:00, data_interval_end=2024-02-24 01:18:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:18:04.902729527Z [2024-02-24T01:18:04.902+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:18:00+00:00, run_after=2024-02-24T01:19:00+00:00 2024-02-24T01:18:04.949259816Z [2024-02-24T01:18:04.948+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:17:00+00:00 exited with status success for try_number 1 2024-02-24T01:18:04.956230127Z [2024-02-24T01:18:04.955+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:17:00+00:00, map_index=-1, run_start_date=2024-02-24 01:18:03.149379+00:00, run_end_date=2024-02-24 01:18:04.684173+00:00, run_duration=1.534794, state=success, executor_state=success, try_number=1, max_tries=1, job_id=476, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:18:00.996708+00:00, queued_by_job_id=2, pid=6993 2024-02-24T01:18:06.020692249Z [2024-02-24T01:18:06.020+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:18:06.021611046Z [2024-02-24T01:18:06.020+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:17:00+00:00, run_id=scheduled__2024-02-24T01:17:00+00:00, run_start_date=2024-02-24 01:18:00.932523+00:00, run_end_date=2024-02-24 01:18:06.020808+00:00, run_duration=5.088285, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:17:00+00:00, data_interval_end=2024-02-24 01:18:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:18:06.037362466Z [2024-02-24T01:18:06.036+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:18:00+00:00, run_after=2024-02-24T01:19:00+00:00 2024-02-24T01:18:06.132719126Z [2024-02-24T01:18:06.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:17:00+00:00 exited with status success for try_number 1 2024-02-24T01:18:06.139906237Z [2024-02-24T01:18:06.139+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:17:00+00:00, map_index=-1, run_start_date=2024-02-24 01:18:03.331976+00:00, run_end_date=2024-02-24 01:18:05.443444+00:00, run_duration=2.111468, state=success, executor_state=success, try_number=1, max_tries=1, job_id=477, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:18:00.996708+00:00, queued_by_job_id=2, pid=6997 2024-02-24T01:19:00.062351005Z [2024-02-24T01:19:00.059+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:19:00.084704291Z [2024-02-24T01:19:00.084+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:19:00+00:00, run_after=2024-02-24T01:20:00+00:00 2024-02-24T01:19:00.096858817Z [2024-02-24T01:19:00.096+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:19:00+00:00, run_after=2024-02-24T01:20:00+00:00 2024-02-24T01:19:00.189556050Z [2024-02-24T01:19:00.189+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T01:19:00.189587630Z 2024-02-24T01:19:00.189594494Z 2024-02-24T01:19:00.189600753Z 2024-02-24T01:19:00.189877096Z [2024-02-24T01:19:00.189+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:19:00.190142659Z [2024-02-24T01:19:00.189+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:19:00.190376807Z [2024-02-24T01:19:00.190+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:19:00.191232712Z [2024-02-24T01:19:00.190+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:19:00.191259088Z 2024-02-24T01:19:00.191264986Z 2024-02-24T01:19:00.191271486Z 2024-02-24T01:19:00.194693632Z [2024-02-24T01:19:00.194+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:19:00.194930745Z [2024-02-24T01:19:00.194+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:19:00.195369543Z [2024-02-24T01:19:00.195+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:19:00.195714889Z [2024-02-24T01:19:00.195+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:19:00.196055957Z [2024-02-24T01:19:00.195+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:19:00.196377836Z [2024-02-24T01:19:00.195+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:19:00.403913078Z [2024-02-24T01:19:00.403+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:18:00+00:00 exited with status queued for try_number 1 2024-02-24T01:19:00.404044815Z [2024-02-24T01:19:00.403+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:18:00+00:00 exited with status queued for try_number 1 2024-02-24T01:19:00.404150155Z [2024-02-24T01:19:00.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:18:00+00:00 exited with status queued for try_number 1 2024-02-24T01:19:00.411248095Z [2024-02-24T01:19:00.410+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9ee28f15-6d77-40ff-8687-e49bc304f0ee 2024-02-24T01:19:00.411405823Z [2024-02-24T01:19:00.411+0000] {scheduler_job.py:635} INFO - Setting external_id for to abfcb585-94ec-443d-96f7-bd3aa742293e 2024-02-24T01:19:00.411544929Z [2024-02-24T01:19:00.411+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20166fd1-676f-49ca-8ed3-158492b99c7b 2024-02-24T01:19:01.851540286Z [2024-02-24T01:19:01.851+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:19:01.851797107Z [2024-02-24T01:19:01.851+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:18:00+00:00, run_id=scheduled__2024-02-24T01:18:00+00:00, run_start_date=2024-02-24 01:19:00.110183+00:00, run_end_date=2024-02-24 01:19:01.851402+00:00, run_duration=1.741219, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:18:00+00:00, data_interval_end=2024-02-24 01:19:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:19:01.872448303Z [2024-02-24T01:19:01.872+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:19:00+00:00, run_after=2024-02-24T01:20:00+00:00 2024-02-24T01:19:02.026997510Z [2024-02-24T01:19:02.026+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:18:00+00:00 exited with status success for try_number 1 2024-02-24T01:19:02.056204404Z [2024-02-24T01:19:02.055+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:18:00+00:00, map_index=-1, run_start_date=2024-02-24 01:19:00.914126+00:00, run_end_date=2024-02-24 01:19:01.494368+00:00, run_duration=0.580242, state=success, executor_state=success, try_number=1, max_tries=1, job_id=478, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:19:00.191998+00:00, queued_by_job_id=2, pid=7029 2024-02-24T01:19:04.232574838Z [2024-02-24T01:19:04.231+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:19:04.233352468Z [2024-02-24T01:19:04.232+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:18:00+00:00, run_id=scheduled__2024-02-24T01:18:00+00:00, run_start_date=2024-02-24 01:19:00.111497+00:00, run_end_date=2024-02-24 01:19:04.232524+00:00, run_duration=4.121027, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:18:00+00:00, data_interval_end=2024-02-24 01:19:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:19:04.250951482Z [2024-02-24T01:19:04.250+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:19:00+00:00, run_after=2024-02-24T01:20:00+00:00 2024-02-24T01:19:05.357335733Z [2024-02-24T01:19:05.356+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:19:05.357730736Z [2024-02-24T01:19:05.357+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:18:00+00:00, run_id=scheduled__2024-02-24T01:18:00+00:00, run_start_date=2024-02-24 01:19:00.113225+00:00, run_end_date=2024-02-24 01:19:05.357138+00:00, run_duration=5.243913, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:18:00+00:00, data_interval_end=2024-02-24 01:19:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:19:05.373319317Z [2024-02-24T01:19:05.372+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:19:00+00:00, run_after=2024-02-24T01:20:00+00:00 2024-02-24T01:19:05.416650504Z [2024-02-24T01:19:05.416+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:18:00+00:00 exited with status success for try_number 1 2024-02-24T01:19:05.416705371Z [2024-02-24T01:19:05.416+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:18:00+00:00 exited with status success for try_number 1 2024-02-24T01:19:05.424093712Z [2024-02-24T01:19:05.423+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:18:00+00:00, map_index=-1, run_start_date=2024-02-24 01:19:02.233715+00:00, run_end_date=2024-02-24 01:19:04.140413+00:00, run_duration=1.906698, state=success, executor_state=success, try_number=1, max_tries=1, job_id=479, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:19:00.191998+00:00, queued_by_job_id=2, pid=7047 2024-02-24T01:19:05.424301083Z [2024-02-24T01:19:05.424+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:18:00+00:00, map_index=-1, run_start_date=2024-02-24 01:19:02.299377+00:00, run_end_date=2024-02-24 01:19:04.468056+00:00, run_duration=2.168679, state=success, executor_state=success, try_number=1, max_tries=1, job_id=480, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:19:00.191998+00:00, queued_by_job_id=2, pid=7048 2024-02-24T01:20:00.866496635Z [2024-02-24T01:20:00.866+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:20:00+00:00, run_after=2024-02-24T01:25:00+00:00 2024-02-24T01:20:00.880526811Z [2024-02-24T01:20:00.880+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:20:00+00:00, run_after=2024-02-24T01:21:00+00:00 2024-02-24T01:20:00.894034937Z [2024-02-24T01:20:00.893+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:20:00+00:00, run_after=2024-02-24T01:21:00+00:00 2024-02-24T01:20:00.912224014Z [2024-02-24T01:20:00.911+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:20:00.924419312Z [2024-02-24T01:20:00.923+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:20:01.056472097Z [2024-02-24T01:20:01.056+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-02-24T01:20:01.056498020Z 2024-02-24T01:20:01.056501620Z 2024-02-24T01:20:01.056521868Z 2024-02-24T01:20:01.056525077Z 2024-02-24T01:20:01.056528239Z 2024-02-24T01:20:01.056772298Z [2024-02-24T01:20:01.056+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:20:01.056923877Z [2024-02-24T01:20:01.056+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T01:20:01.057111319Z [2024-02-24T01:20:01.056+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:20:01.057296639Z [2024-02-24T01:20:01.057+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:20:01.057511651Z [2024-02-24T01:20:01.057+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:20:01.058214983Z [2024-02-24T01:20:01.058+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:20:01.058226335Z 2024-02-24T01:20:01.058230452Z 2024-02-24T01:20:01.058233739Z 2024-02-24T01:20:01.058236833Z 2024-02-24T01:20:01.058240183Z 2024-02-24T01:20:01.062383967Z [2024-02-24T01:20:01.062+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T01:20:01.062609790Z [2024-02-24T01:20:01.062+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T01:20:01.062897639Z [2024-02-24T01:20:01.062+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:20:01.063111437Z [2024-02-24T01:20:01.062+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T01:20:01.063408358Z [2024-02-24T01:20:01.063+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:20:01.063670526Z [2024-02-24T01:20:01.063+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:20:01.064004913Z [2024-02-24T01:20:01.063+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:20:01.064265377Z [2024-02-24T01:20:01.064+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:20:01.064731496Z [2024-02-24T01:20:01.064+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:20:01.064987773Z [2024-02-24T01:20:01.064+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:20:01.812580565Z [2024-02-24T01:20:01.811+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T01:15:00+00:00 exited with status queued for try_number 1 2024-02-24T01:20:01.821633303Z [2024-02-24T01:20:01.821+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:18:00+00:00 exited with status queued for try_number 1 2024-02-24T01:20:01.821832357Z [2024-02-24T01:20:01.821+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:19:00+00:00 exited with status queued for try_number 1 2024-02-24T01:20:01.822037632Z [2024-02-24T01:20:01.821+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:19:00+00:00 exited with status queued for try_number 1 2024-02-24T01:20:01.830325642Z [2024-02-24T01:20:01.822+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:19:00+00:00 exited with status queued for try_number 1 2024-02-24T01:20:01.850453198Z [2024-02-24T01:20:01.848+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3061c1c6-b864-488a-b191-efceaa97d081 2024-02-24T01:20:01.850733828Z [2024-02-24T01:20:01.850+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a946ed6-7d24-4f57-9328-4f0e028b2929 2024-02-24T01:20:01.850977880Z [2024-02-24T01:20:01.850+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6fc62c9a-b71d-47ad-a1c4-56b2b64c9eb9 2024-02-24T01:20:01.851197351Z [2024-02-24T01:20:01.850+0000] {scheduler_job.py:635} INFO - Setting external_id for to e7cc3175-339e-466d-866e-024dc8d02f4c 2024-02-24T01:20:01.852061549Z [2024-02-24T01:20:01.851+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60ad62ee-7619-45b0-8faf-9b9a70b9f595 2024-02-24T01:20:02.394094447Z [2024-02-24T01:20:02.385+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:20:02.394127049Z [2024-02-24T01:20:02.386+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 01:18:00+00:00, run_id=scheduled__2024-02-24T01:18:00+00:00, run_start_date=2024-02-24 01:20:00.944007+00:00, run_end_date=2024-02-24 01:20:02.385849+00:00, run_duration=1.441842, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:18:00+00:00, data_interval_end=2024-02-24 01:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T01:20:02.409924343Z [2024-02-24T01:20:02.402+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T01:20:00+00:00, run_after=2024-02-24T01:22:00+00:00 2024-02-24T01:20:02.610769551Z [2024-02-24T01:20:02.610+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:18:00+00:00 exited with status success for try_number 1 2024-02-24T01:20:02.633208504Z [2024-02-24T01:20:02.632+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T01:18:00+00:00, map_index=-1, run_start_date=2024-02-24 01:20:01.904192+00:00, run_end_date=2024-02-24 01:20:02.276041+00:00, run_duration=0.371849, state=success, executor_state=success, try_number=1, max_tries=1, job_id=481, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:20:01.059339+00:00, queued_by_job_id=2, pid=7077 2024-02-24T01:20:03.783104024Z [2024-02-24T01:20:03.782+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:20:03.783301265Z [2024-02-24T01:20:03.783+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:19:00+00:00, run_id=scheduled__2024-02-24T01:19:00+00:00, run_start_date=2024-02-24 01:20:00.945749+00:00, run_end_date=2024-02-24 01:20:03.783007+00:00, run_duration=2.837258, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:19:00+00:00, data_interval_end=2024-02-24 01:20:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:20:03.792927225Z [2024-02-24T01:20:03.792+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:20:00+00:00, run_after=2024-02-24T01:21:00+00:00 2024-02-24T01:20:03.917120233Z [2024-02-24T01:20:03.916+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:19:00+00:00 exited with status success for try_number 1 2024-02-24T01:20:03.929500392Z [2024-02-24T01:20:03.929+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:19:00+00:00, map_index=-1, run_start_date=2024-02-24 01:20:02.542787+00:00, run_end_date=2024-02-24 01:20:03.059838+00:00, run_duration=0.517051, state=success, executor_state=success, try_number=1, max_tries=1, job_id=482, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:20:01.059339+00:00, queued_by_job_id=2, pid=7089 2024-02-24T01:20:05.047051337Z [2024-02-24T01:20:05.046+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:20:05.047095580Z 2024-02-24T01:20:05.047629762Z [2024-02-24T01:20:05.047+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:20:05.048654533Z [2024-02-24T01:20:05.048+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:20:05.048672964Z 2024-02-24T01:20:05.052494274Z [2024-02-24T01:20:05.052+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T01:20:05.053658045Z [2024-02-24T01:20:05.053+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T01:20:05.106875215Z [2024-02-24T01:20:05.106+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T01:15:00+00:00 exited with status queued for try_number 1 2024-02-24T01:20:05.107318365Z [2024-02-24T01:20:05.106+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T01:15:00+00:00 exited with status success for try_number 1 2024-02-24T01:20:05.114222706Z [2024-02-24T01:20:05.113+0000] {scheduler_job.py:635} INFO - Setting external_id for to cc140e34-338d-4160-a177-725f5e970338 2024-02-24T01:20:05.114549570Z [2024-02-24T01:20:05.114+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T01:15:00+00:00, map_index=-1, run_start_date=2024-02-24 01:20:03.712436+00:00, run_end_date=2024-02-24 01:20:04.168501+00:00, run_duration=0.456065, state=success, executor_state=success, try_number=1, max_tries=1, job_id=484, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:20:01.059339+00:00, queued_by_job_id=2, pid=7113 2024-02-24T01:20:06.267003475Z [2024-02-24T01:20:06.266+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:20:06.267522797Z [2024-02-24T01:20:06.267+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:19:00+00:00, run_id=scheduled__2024-02-24T01:19:00+00:00, run_start_date=2024-02-24 01:20:00.947344+00:00, run_end_date=2024-02-24 01:20:06.267152+00:00, run_duration=5.319808, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:19:00+00:00, data_interval_end=2024-02-24 01:20:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:20:06.278539155Z [2024-02-24T01:20:06.278+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:20:00+00:00, run_after=2024-02-24T01:21:00+00:00 2024-02-24T01:20:06.295647542Z [2024-02-24T01:20:06.295+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:20:06.296220793Z [2024-02-24T01:20:06.295+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:19:00+00:00, run_id=scheduled__2024-02-24T01:19:00+00:00, run_start_date=2024-02-24 01:20:00.948874+00:00, run_end_date=2024-02-24 01:20:06.295511+00:00, run_duration=5.346637, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:19:00+00:00, data_interval_end=2024-02-24 01:20:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:20:06.307891146Z [2024-02-24T01:20:06.307+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:20:00+00:00, run_after=2024-02-24T01:21:00+00:00 2024-02-24T01:20:06.392422599Z [2024-02-24T01:20:06.392+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:19:00+00:00 exited with status success for try_number 1 2024-02-24T01:20:06.392888729Z [2024-02-24T01:20:06.392+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:19:00+00:00 exited with status success for try_number 1 2024-02-24T01:20:06.402409540Z [2024-02-24T01:20:06.402+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:19:00+00:00, map_index=-1, run_start_date=2024-02-24 01:20:03.957619+00:00, run_end_date=2024-02-24 01:20:05.262342+00:00, run_duration=1.304723, state=success, executor_state=success, try_number=1, max_tries=1, job_id=485, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:20:01.059339+00:00, queued_by_job_id=2, pid=7114 2024-02-24T01:20:06.402744292Z [2024-02-24T01:20:06.402+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:19:00+00:00, map_index=-1, run_start_date=2024-02-24 01:20:03.530903+00:00, run_end_date=2024-02-24 01:20:05.289427+00:00, run_duration=1.758524, state=success, executor_state=success, try_number=1, max_tries=1, job_id=483, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:20:01.059339+00:00, queued_by_job_id=2, pid=7107 2024-02-24T01:20:08.123799876Z [2024-02-24T01:20:08.123+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:20:08.123866169Z 2024-02-24T01:20:08.123876467Z [2024-02-24T01:20:08.123+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:20:08.125195712Z [2024-02-24T01:20:08.124+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:20:08.125229470Z 2024-02-24T01:20:08.128911605Z [2024-02-24T01:20:08.128+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T01:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T01:20:08.129125629Z [2024-02-24T01:20:08.128+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T01:20:08.194959374Z [2024-02-24T01:20:08.194+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T01:15:00+00:00 exited with status queued for try_number 1 2024-02-24T01:20:08.195364407Z [2024-02-24T01:20:08.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T01:15:00+00:00 exited with status success for try_number 1 2024-02-24T01:20:08.202537083Z [2024-02-24T01:20:08.202+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3dfba33b-1414-433b-af4a-76ee78c79613 2024-02-24T01:20:08.203076518Z [2024-02-24T01:20:08.202+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T01:15:00+00:00, map_index=-1, run_start_date=2024-02-24 01:20:06.723388+00:00, run_end_date=2024-02-24 01:20:07.125116+00:00, run_duration=0.401728, state=success, executor_state=success, try_number=1, max_tries=1, job_id=486, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:20:05.049419+00:00, queued_by_job_id=2, pid=7137 2024-02-24T01:20:10.466434933Z [2024-02-24T01:20:10.465+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:20:10.466485685Z 2024-02-24T01:20:10.466598083Z [2024-02-24T01:20:10.466+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:20:10.467486556Z [2024-02-24T01:20:10.467+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:20:10.467514952Z 2024-02-24T01:20:10.470885199Z [2024-02-24T01:20:10.470+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:20:10.471002734Z [2024-02-24T01:20:10.470+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T01:20:10.542565781Z [2024-02-24T01:20:10.542+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T01:15:00+00:00 exited with status queued for try_number 1 2024-02-24T01:20:10.542755032Z [2024-02-24T01:20:10.542+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T01:15:00+00:00 exited with status success for try_number 1 2024-02-24T01:20:10.550221362Z [2024-02-24T01:20:10.549+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c4c863b-db32-4ba8-af7a-4c5fb0bd34f9 2024-02-24T01:20:10.550482444Z [2024-02-24T01:20:10.550+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T01:15:00+00:00, map_index=0, run_start_date=2024-02-24 01:20:09.865592+00:00, run_end_date=2024-02-24 01:20:10.227782+00:00, run_duration=0.36219, state=success, executor_state=success, try_number=1, max_tries=1, job_id=487, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:20:08.125458+00:00, queued_by_job_id=2, pid=7145 2024-02-24T01:20:13.113106182Z [2024-02-24T01:20:13.112+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:20:13.113474466Z [2024-02-24T01:20:13.113+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:15:00+00:00, run_id=scheduled__2024-02-24T01:15:00+00:00, run_start_date=2024-02-24 01:20:00.941671+00:00, run_end_date=2024-02-24 01:20:13.112975+00:00, run_duration=12.171304, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:15:00+00:00, data_interval_end=2024-02-24 01:20:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T01:20:13.119809623Z [2024-02-24T01:20:13.119+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:20:00+00:00, run_after=2024-02-24T01:25:00+00:00 2024-02-24T01:20:13.155256542Z [2024-02-24T01:20:13.154+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T01:15:00+00:00 exited with status success for try_number 1 2024-02-24T01:20:13.162419367Z [2024-02-24T01:20:13.161+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T01:15:00+00:00, map_index=-1, run_start_date=2024-02-24 01:20:12.366106+00:00, run_end_date=2024-02-24 01:20:12.786830+00:00, run_duration=0.420724, state=success, executor_state=success, try_number=1, max_tries=1, job_id=488, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:20:10.468043+00:00, queued_by_job_id=2, pid=7153 2024-02-24T01:21:00.976943021Z [2024-02-24T01:21:00.976+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:21:00+00:00, run_after=2024-02-24T01:22:00+00:00 2024-02-24T01:21:00.988439422Z [2024-02-24T01:21:00.988+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:21:01.005971579Z [2024-02-24T01:21:01.005+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:21:00+00:00, run_after=2024-02-24T01:22:00+00:00 2024-02-24T01:21:01.112588764Z [2024-02-24T01:21:01.112+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T01:21:01.112628375Z 2024-02-24T01:21:01.112634899Z 2024-02-24T01:21:01.112641098Z 2024-02-24T01:21:01.112757581Z [2024-02-24T01:21:01.112+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:21:01.112884873Z [2024-02-24T01:21:01.112+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:21:01.113089640Z [2024-02-24T01:21:01.112+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:21:01.113753539Z [2024-02-24T01:21:01.113+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:21:01.113818902Z 2024-02-24T01:21:01.113828323Z 2024-02-24T01:21:01.113834339Z 2024-02-24T01:21:01.116760209Z [2024-02-24T01:21:01.116+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:21:01.116946219Z [2024-02-24T01:21:01.116+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:21:01.118245560Z [2024-02-24T01:21:01.118+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:21:01.118496635Z [2024-02-24T01:21:01.118+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:21:01.118717002Z [2024-02-24T01:21:01.118+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:21:01.118839376Z [2024-02-24T01:21:01.118+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:21:01.419187274Z [2024-02-24T01:21:01.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:20:00+00:00 exited with status queued for try_number 1 2024-02-24T01:21:01.419272714Z [2024-02-24T01:21:01.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:20:00+00:00 exited with status queued for try_number 1 2024-02-24T01:21:01.419406205Z [2024-02-24T01:21:01.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:20:00+00:00 exited with status queued for try_number 1 2024-02-24T01:21:01.429605348Z [2024-02-24T01:21:01.429+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56c434b9-4f6f-4a7a-a2ea-099dfee5e11b 2024-02-24T01:21:01.429791202Z [2024-02-24T01:21:01.429+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1ff6f1c9-e509-485d-a0f4-5953120c1955 2024-02-24T01:21:01.430024454Z [2024-02-24T01:21:01.429+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7d2b90f-5f5d-41de-a76e-e50947ea7521 2024-02-24T01:21:02.421291612Z [2024-02-24T01:21:02.420+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:21:02.421808324Z [2024-02-24T01:21:02.421+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:20:00+00:00, run_id=scheduled__2024-02-24T01:20:00+00:00, run_start_date=2024-02-24 01:21:01.025419+00:00, run_end_date=2024-02-24 01:21:02.421398+00:00, run_duration=1.395979, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:20:00+00:00, data_interval_end=2024-02-24 01:21:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:21:02.433877260Z [2024-02-24T01:21:02.433+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:21:00+00:00, run_after=2024-02-24T01:22:00+00:00 2024-02-24T01:21:02.897288660Z [2024-02-24T01:21:02.896+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:20:00+00:00 exited with status success for try_number 1 2024-02-24T01:21:02.906737551Z [2024-02-24T01:21:02.906+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:20:00+00:00, map_index=-1, run_start_date=2024-02-24 01:21:01.959256+00:00, run_end_date=2024-02-24 01:21:02.345923+00:00, run_duration=0.386667, state=success, executor_state=success, try_number=1, max_tries=1, job_id=489, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:21:01.114466+00:00, queued_by_job_id=2, pid=7175 2024-02-24T01:21:05.259278475Z [2024-02-24T01:21:05.258+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:21:05.259661835Z [2024-02-24T01:21:05.259+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:20:00+00:00, run_id=scheduled__2024-02-24T01:20:00+00:00, run_start_date=2024-02-24 01:21:01.030017+00:00, run_end_date=2024-02-24 01:21:05.259053+00:00, run_duration=4.229036, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:20:00+00:00, data_interval_end=2024-02-24 01:21:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:21:05.269833877Z [2024-02-24T01:21:05.269+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:21:00+00:00, run_after=2024-02-24T01:22:00+00:00 2024-02-24T01:21:05.276696685Z [2024-02-24T01:21:05.276+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:21:05.276723297Z [2024-02-24T01:21:05.276+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:20:00+00:00, run_id=scheduled__2024-02-24T01:20:00+00:00, run_start_date=2024-02-24 01:21:01.032531+00:00, run_end_date=2024-02-24 01:21:05.276444+00:00, run_duration=4.243913, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:20:00+00:00, data_interval_end=2024-02-24 01:21:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:21:05.285641687Z [2024-02-24T01:21:05.285+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:21:00+00:00, run_after=2024-02-24T01:22:00+00:00 2024-02-24T01:21:05.329459138Z [2024-02-24T01:21:05.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:20:00+00:00 exited with status success for try_number 1 2024-02-24T01:21:05.329629289Z [2024-02-24T01:21:05.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:20:00+00:00 exited with status success for try_number 1 2024-02-24T01:21:05.336814522Z [2024-02-24T01:21:05.336+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:20:00+00:00, map_index=-1, run_start_date=2024-02-24 01:21:02.990158+00:00, run_end_date=2024-02-24 01:21:04.332376+00:00, run_duration=1.342218, state=success, executor_state=success, try_number=1, max_tries=1, job_id=490, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:21:01.114466+00:00, queued_by_job_id=2, pid=7193 2024-02-24T01:21:05.337175405Z [2024-02-24T01:21:05.336+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:20:00+00:00, map_index=-1, run_start_date=2024-02-24 01:21:03.003004+00:00, run_end_date=2024-02-24 01:21:04.903727+00:00, run_duration=1.900723, state=success, executor_state=success, try_number=1, max_tries=1, job_id=491, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:21:01.114466+00:00, queued_by_job_id=2, pid=7194 2024-02-24T01:22:00.930433782Z [2024-02-24T01:22:00.929+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:22:00.951854387Z [2024-02-24T01:22:00.951+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:22:00+00:00, run_after=2024-02-24T01:23:00+00:00 2024-02-24T01:22:00.966390875Z [2024-02-24T01:22:00.966+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:22:00+00:00, run_after=2024-02-24T01:23:00+00:00 2024-02-24T01:22:00.974825994Z [2024-02-24T01:22:00.974+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:22:01.078144262Z [2024-02-24T01:22:01.077+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T01:22:01.078187960Z 2024-02-24T01:22:01.078198497Z 2024-02-24T01:22:01.078207638Z 2024-02-24T01:22:01.078216875Z 2024-02-24T01:22:01.078594616Z [2024-02-24T01:22:01.078+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T01:22:01.078888864Z [2024-02-24T01:22:01.078+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:22:01.079207873Z [2024-02-24T01:22:01.078+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:22:01.079519499Z [2024-02-24T01:22:01.079+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:22:01.080816980Z [2024-02-24T01:22:01.080+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:22:01.080834553Z 2024-02-24T01:22:01.080843870Z 2024-02-24T01:22:01.080852594Z 2024-02-24T01:22:01.080889038Z 2024-02-24T01:22:01.086401504Z [2024-02-24T01:22:01.085+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:22:01.086756360Z [2024-02-24T01:22:01.086+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T01:22:01.086953544Z [2024-02-24T01:22:01.086+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:22:01.087186123Z [2024-02-24T01:22:01.086+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:22:01.087627429Z [2024-02-24T01:22:01.087+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:22:01.088058704Z [2024-02-24T01:22:01.087+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:22:01.088444307Z [2024-02-24T01:22:01.088+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:22:01.088725398Z [2024-02-24T01:22:01.088+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:22:01.618934945Z [2024-02-24T01:22:01.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:20:00+00:00 exited with status queued for try_number 1 2024-02-24T01:22:01.619669300Z [2024-02-24T01:22:01.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:21:00+00:00 exited with status queued for try_number 1 2024-02-24T01:22:01.619821759Z [2024-02-24T01:22:01.619+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:21:00+00:00 exited with status queued for try_number 1 2024-02-24T01:22:01.619962742Z [2024-02-24T01:22:01.619+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:21:00+00:00 exited with status queued for try_number 1 2024-02-24T01:22:01.635644525Z [2024-02-24T01:22:01.635+0000] {scheduler_job.py:635} INFO - Setting external_id for to 150634e7-ee1e-4cf8-ac0c-fbc9fa4932af 2024-02-24T01:22:01.635936259Z [2024-02-24T01:22:01.635+0000] {scheduler_job.py:635} INFO - Setting external_id for to c731e562-cc0e-4727-98d6-646ef3fc7d6a 2024-02-24T01:22:01.636123215Z [2024-02-24T01:22:01.635+0000] {scheduler_job.py:635} INFO - Setting external_id for to a6004fdb-011c-449f-8c86-0dd20e689c8d 2024-02-24T01:22:01.636300269Z [2024-02-24T01:22:01.636+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05681218-2b12-48ae-be08-a56be6598bc6 2024-02-24T01:22:02.563177044Z [2024-02-24T01:22:02.562+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:22:02.563663726Z [2024-02-24T01:22:02.563+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:21:00+00:00, run_id=scheduled__2024-02-24T01:21:00+00:00, run_start_date=2024-02-24 01:22:00.987573+00:00, run_end_date=2024-02-24 01:22:02.563263+00:00, run_duration=1.57569, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:21:00+00:00, data_interval_end=2024-02-24 01:22:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:22:02.577492395Z [2024-02-24T01:22:02.577+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:22:00+00:00, run_after=2024-02-24T01:23:00+00:00 2024-02-24T01:22:02.662788349Z [2024-02-24T01:22:02.652+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:21:00+00:00 exited with status success for try_number 1 2024-02-24T01:22:02.666062873Z [2024-02-24T01:22:02.664+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:21:00+00:00, map_index=-1, run_start_date=2024-02-24 01:22:02.032046+00:00, run_end_date=2024-02-24 01:22:02.438269+00:00, run_duration=0.406223, state=success, executor_state=success, try_number=1, max_tries=1, job_id=493, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:22:01.082427+00:00, queued_by_job_id=2, pid=7227 2024-02-24T01:22:02.722603193Z [2024-02-24T01:22:02.722+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T01:22:02.912012483Z [2024-02-24T01:22:02.911+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:22:02.912610242Z [2024-02-24T01:22:02.911+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 01:20:00+00:00, run_id=scheduled__2024-02-24T01:20:00+00:00, run_start_date=2024-02-24 01:22:00.986263+00:00, run_end_date=2024-02-24 01:22:02.911892+00:00, run_duration=1.925629, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:20:00+00:00, data_interval_end=2024-02-24 01:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T01:22:02.920623788Z [2024-02-24T01:22:02.920+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T01:22:00+00:00, run_after=2024-02-24T01:24:00+00:00 2024-02-24T01:22:02.984764717Z [2024-02-24T01:22:02.984+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:20:00+00:00 exited with status success for try_number 1 2024-02-24T01:22:02.993615942Z [2024-02-24T01:22:02.993+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T01:20:00+00:00, map_index=-1, run_start_date=2024-02-24 01:22:02.033278+00:00, run_end_date=2024-02-24 01:22:02.538810+00:00, run_duration=0.505532, state=success, executor_state=success, try_number=1, max_tries=1, job_id=492, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:22:01.082427+00:00, queued_by_job_id=2, pid=7228 2024-02-24T01:22:04.981456459Z [2024-02-24T01:22:04.981+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:22:04.981594670Z [2024-02-24T01:22:04.981+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:21:00+00:00, run_id=scheduled__2024-02-24T01:21:00+00:00, run_start_date=2024-02-24 01:22:00.988638+00:00, run_end_date=2024-02-24 01:22:04.981342+00:00, run_duration=3.992704, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:21:00+00:00, data_interval_end=2024-02-24 01:22:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:22:04.990914627Z [2024-02-24T01:22:04.990+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:22:00+00:00, run_after=2024-02-24T01:23:00+00:00 2024-02-24T01:22:05.041399134Z [2024-02-24T01:22:05.040+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:21:00+00:00 exited with status success for try_number 1 2024-02-24T01:22:05.047392023Z [2024-02-24T01:22:05.046+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:21:00+00:00, map_index=-1, run_start_date=2024-02-24 01:22:03.256373+00:00, run_end_date=2024-02-24 01:22:04.807257+00:00, run_duration=1.550884, state=success, executor_state=success, try_number=1, max_tries=1, job_id=494, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:22:01.082427+00:00, queued_by_job_id=2, pid=7251 2024-02-24T01:22:06.109099514Z [2024-02-24T01:22:06.108+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:22:06.109154226Z [2024-02-24T01:22:06.108+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:21:00+00:00, run_id=scheduled__2024-02-24T01:21:00+00:00, run_start_date=2024-02-24 01:22:00.989634+00:00, run_end_date=2024-02-24 01:22:06.108809+00:00, run_duration=5.119175, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:21:00+00:00, data_interval_end=2024-02-24 01:22:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:22:06.119704670Z [2024-02-24T01:22:06.119+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:22:00+00:00, run_after=2024-02-24T01:23:00+00:00 2024-02-24T01:22:06.160596739Z [2024-02-24T01:22:06.160+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:21:00+00:00 exited with status success for try_number 1 2024-02-24T01:22:06.167687809Z [2024-02-24T01:22:06.167+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:21:00+00:00, map_index=-1, run_start_date=2024-02-24 01:22:03.286802+00:00, run_end_date=2024-02-24 01:22:05.198962+00:00, run_duration=1.91216, state=success, executor_state=success, try_number=1, max_tries=1, job_id=495, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:22:01.082427+00:00, queued_by_job_id=2, pid=7252 2024-02-24T01:23:00.921245840Z [2024-02-24T01:23:00.918+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:23:00+00:00, run_after=2024-02-24T01:24:00+00:00 2024-02-24T01:23:00.935703957Z [2024-02-24T01:23:00.935+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:23:00.947716028Z [2024-02-24T01:23:00.947+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:23:00+00:00, run_after=2024-02-24T01:24:00+00:00 2024-02-24T01:23:01.038518118Z [2024-02-24T01:23:01.038+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T01:23:01.038556880Z 2024-02-24T01:23:01.038563459Z 2024-02-24T01:23:01.038569661Z 2024-02-24T01:23:01.038805002Z [2024-02-24T01:23:01.038+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:23:01.038934042Z [2024-02-24T01:23:01.038+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:23:01.039093489Z [2024-02-24T01:23:01.038+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:23:01.039838995Z [2024-02-24T01:23:01.039+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:23:01.039851663Z 2024-02-24T01:23:01.039857291Z 2024-02-24T01:23:01.039863161Z 2024-02-24T01:23:01.045230494Z [2024-02-24T01:23:01.044+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:23:01.045560561Z [2024-02-24T01:23:01.045+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:23:01.046745471Z [2024-02-24T01:23:01.046+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:23:01.046762707Z [2024-02-24T01:23:01.046+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:23:01.046788006Z [2024-02-24T01:23:01.046+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:23:01.046852614Z [2024-02-24T01:23:01.046+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:23:01.402335097Z [2024-02-24T01:23:01.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:22:00+00:00 exited with status queued for try_number 1 2024-02-24T01:23:01.402491203Z [2024-02-24T01:23:01.402+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:22:00+00:00 exited with status queued for try_number 1 2024-02-24T01:23:01.402598153Z [2024-02-24T01:23:01.402+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:22:00+00:00 exited with status queued for try_number 1 2024-02-24T01:23:01.420358620Z [2024-02-24T01:23:01.419+0000] {scheduler_job.py:635} INFO - Setting external_id for to 753a4315-c846-44e9-b37e-411991a9c2cc 2024-02-24T01:23:01.420540859Z [2024-02-24T01:23:01.420+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5f1b3b7a-de6b-41d1-a6c8-c4ba1f07885d 2024-02-24T01:23:01.420734686Z [2024-02-24T01:23:01.420+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7d75cd5-0a5a-4ae0-92ea-0f0729c6fab5 2024-02-24T01:23:02.617556309Z [2024-02-24T01:23:02.617+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:23:02.617967496Z [2024-02-24T01:23:02.617+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:22:00+00:00, run_id=scheduled__2024-02-24T01:22:00+00:00, run_start_date=2024-02-24 01:23:00.958393+00:00, run_end_date=2024-02-24 01:23:02.617473+00:00, run_duration=1.65908, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:22:00+00:00, data_interval_end=2024-02-24 01:23:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:23:02.630770697Z [2024-02-24T01:23:02.630+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:23:00+00:00, run_after=2024-02-24T01:24:00+00:00 2024-02-24T01:23:02.706084427Z [2024-02-24T01:23:02.705+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:22:00+00:00 exited with status success for try_number 1 2024-02-24T01:23:02.731323452Z [2024-02-24T01:23:02.730+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:22:00+00:00, map_index=-1, run_start_date=2024-02-24 01:23:02.025452+00:00, run_end_date=2024-02-24 01:23:02.470300+00:00, run_duration=0.444848, state=success, executor_state=success, try_number=1, max_tries=1, job_id=496, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:23:01.040899+00:00, queued_by_job_id=2, pid=7283 2024-02-24T01:23:05.971497899Z [2024-02-24T01:23:05.970+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:23:05.971572544Z [2024-02-24T01:23:05.971+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:22:00+00:00, run_id=scheduled__2024-02-24T01:22:00+00:00, run_start_date=2024-02-24 01:23:00.959633+00:00, run_end_date=2024-02-24 01:23:05.971222+00:00, run_duration=5.011589, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:22:00+00:00, data_interval_end=2024-02-24 01:23:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:23:05.982076711Z [2024-02-24T01:23:05.981+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:23:00+00:00, run_after=2024-02-24T01:24:00+00:00 2024-02-24T01:23:05.991732541Z [2024-02-24T01:23:05.991+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:23:05.992005905Z [2024-02-24T01:23:05.991+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:22:00+00:00, run_id=scheduled__2024-02-24T01:22:00+00:00, run_start_date=2024-02-24 01:23:00.960709+00:00, run_end_date=2024-02-24 01:23:05.991533+00:00, run_duration=5.030824, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:22:00+00:00, data_interval_end=2024-02-24 01:23:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:23:06.003022476Z [2024-02-24T01:23:06.002+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:23:00+00:00, run_after=2024-02-24T01:24:00+00:00 2024-02-24T01:23:06.052395648Z [2024-02-24T01:23:06.051+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:22:00+00:00 exited with status success for try_number 1 2024-02-24T01:23:06.052589986Z [2024-02-24T01:23:06.052+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:22:00+00:00 exited with status success for try_number 1 2024-02-24T01:23:06.062051874Z [2024-02-24T01:23:06.061+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:22:00+00:00, map_index=-1, run_start_date=2024-02-24 01:23:03.051312+00:00, run_end_date=2024-02-24 01:23:05.363007+00:00, run_duration=2.311695, state=success, executor_state=success, try_number=1, max_tries=1, job_id=497, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:23:01.040899+00:00, queued_by_job_id=2, pid=7301 2024-02-24T01:23:06.062321405Z [2024-02-24T01:23:06.061+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:22:00+00:00, map_index=-1, run_start_date=2024-02-24 01:23:03.166541+00:00, run_end_date=2024-02-24 01:23:04.834459+00:00, run_duration=1.667918, state=success, executor_state=success, try_number=1, max_tries=1, job_id=498, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:23:01.040899+00:00, queued_by_job_id=2, pid=7302 2024-02-24T01:24:00.097202574Z [2024-02-24T01:24:00.096+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:24:00.112404140Z [2024-02-24T01:24:00.112+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:24:00+00:00, run_after=2024-02-24T01:25:00+00:00 2024-02-24T01:24:00.124847367Z [2024-02-24T01:24:00.124+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:24:00+00:00, run_after=2024-02-24T01:25:00+00:00 2024-02-24T01:24:00.130940562Z [2024-02-24T01:24:00.130+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:24:00.242688650Z [2024-02-24T01:24:00.242+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T01:24:00.242718473Z 2024-02-24T01:24:00.242724473Z 2024-02-24T01:24:00.242729522Z 2024-02-24T01:24:00.242734518Z 2024-02-24T01:24:00.242760232Z [2024-02-24T01:24:00.242+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T01:24:00.243093169Z [2024-02-24T01:24:00.242+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:24:00.243327100Z [2024-02-24T01:24:00.243+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:24:00.243420494Z [2024-02-24T01:24:00.243+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:24:00.244340071Z [2024-02-24T01:24:00.244+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:24:00.244353539Z 2024-02-24T01:24:00.244359465Z 2024-02-24T01:24:00.244364658Z 2024-02-24T01:24:00.244369633Z 2024-02-24T01:24:00.249164782Z [2024-02-24T01:24:00.248+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:24:00.249274330Z [2024-02-24T01:24:00.249+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T01:24:00.249623224Z [2024-02-24T01:24:00.249+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:24:00.249812880Z [2024-02-24T01:24:00.249+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:24:00.250053270Z [2024-02-24T01:24:00.249+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:24:00.250130874Z [2024-02-24T01:24:00.249+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:24:00.250361777Z [2024-02-24T01:24:00.250+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:24:00.250420225Z [2024-02-24T01:24:00.250+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:24:00.511170339Z [2024-02-24T01:24:00.510+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:22:00+00:00 exited with status queued for try_number 1 2024-02-24T01:24:00.511949423Z [2024-02-24T01:24:00.511+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:23:00+00:00 exited with status queued for try_number 1 2024-02-24T01:24:00.512121816Z [2024-02-24T01:24:00.511+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:23:00+00:00 exited with status queued for try_number 1 2024-02-24T01:24:00.512221729Z [2024-02-24T01:24:00.512+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:23:00+00:00 exited with status queued for try_number 1 2024-02-24T01:24:00.522370382Z [2024-02-24T01:24:00.521+0000] {scheduler_job.py:635} INFO - Setting external_id for to e3fa760c-0142-4040-824f-44cd1f13bb03 2024-02-24T01:24:00.523116016Z [2024-02-24T01:24:00.522+0000] {scheduler_job.py:635} INFO - Setting external_id for to a171b9ff-e262-4509-a4a6-43b2fea8b43d 2024-02-24T01:24:00.525045204Z [2024-02-24T01:24:00.524+0000] {scheduler_job.py:635} INFO - Setting external_id for to 867e41a3-394d-4452-8859-db9b5ca6d0e5 2024-02-24T01:24:00.525247305Z [2024-02-24T01:24:00.525+0000] {scheduler_job.py:635} INFO - Setting external_id for to a73011d7-cf47-48f9-bf0f-acc8a490ff2e 2024-02-24T01:24:02.088894055Z [2024-02-24T01:24:02.088+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:24:02.089187765Z [2024-02-24T01:24:02.088+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 01:22:00+00:00, run_id=scheduled__2024-02-24T01:22:00+00:00, run_start_date=2024-02-24 01:24:00.140356+00:00, run_end_date=2024-02-24 01:24:02.088744+00:00, run_duration=1.948388, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:22:00+00:00, data_interval_end=2024-02-24 01:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T01:24:02.096872668Z [2024-02-24T01:24:02.096+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T01:24:00+00:00, run_after=2024-02-24T01:26:00+00:00 2024-02-24T01:24:02.111599637Z [2024-02-24T01:24:02.111+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:24:02.111842048Z [2024-02-24T01:24:02.111+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:23:00+00:00, run_id=scheduled__2024-02-24T01:23:00+00:00, run_start_date=2024-02-24 01:24:00.141404+00:00, run_end_date=2024-02-24 01:24:02.111491+00:00, run_duration=1.970087, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:23:00+00:00, data_interval_end=2024-02-24 01:24:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:24:02.123088927Z [2024-02-24T01:24:02.122+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:24:00+00:00, run_after=2024-02-24T01:25:00+00:00 2024-02-24T01:24:02.165850463Z [2024-02-24T01:24:02.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:22:00+00:00 exited with status success for try_number 1 2024-02-24T01:24:02.166874692Z [2024-02-24T01:24:02.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:23:00+00:00 exited with status success for try_number 1 2024-02-24T01:24:02.176676264Z [2024-02-24T01:24:02.175+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T01:22:00+00:00, map_index=-1, run_start_date=2024-02-24 01:24:01.102293+00:00, run_end_date=2024-02-24 01:24:01.548661+00:00, run_duration=0.446368, state=success, executor_state=success, try_number=1, max_tries=1, job_id=499, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:24:00.245579+00:00, queued_by_job_id=2, pid=7335 2024-02-24T01:24:02.177152457Z [2024-02-24T01:24:02.176+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:23:00+00:00, map_index=-1, run_start_date=2024-02-24 01:24:01.250041+00:00, run_end_date=2024-02-24 01:24:01.684769+00:00, run_duration=0.434728, state=success, executor_state=success, try_number=1, max_tries=1, job_id=500, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:24:00.245579+00:00, queued_by_job_id=2, pid=7336 2024-02-24T01:24:03.832528798Z [2024-02-24T01:24:03.831+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:24:03.832555067Z [2024-02-24T01:24:03.832+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:23:00+00:00, run_id=scheduled__2024-02-24T01:23:00+00:00, run_start_date=2024-02-24 01:24:00.142400+00:00, run_end_date=2024-02-24 01:24:03.832172+00:00, run_duration=3.689772, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:23:00+00:00, data_interval_end=2024-02-24 01:24:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:24:03.841871870Z [2024-02-24T01:24:03.841+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:24:00+00:00, run_after=2024-02-24T01:25:00+00:00 2024-02-24T01:24:03.891821356Z [2024-02-24T01:24:03.891+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:23:00+00:00 exited with status success for try_number 1 2024-02-24T01:24:03.901534607Z [2024-02-24T01:24:03.901+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:23:00+00:00, map_index=-1, run_start_date=2024-02-24 01:24:02.235814+00:00, run_end_date=2024-02-24 01:24:03.600847+00:00, run_duration=1.365033, state=success, executor_state=success, try_number=1, max_tries=1, job_id=501, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:24:00.245579+00:00, queued_by_job_id=2, pid=7359 2024-02-24T01:24:05.134099752Z [2024-02-24T01:24:05.133+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:24:05.134711221Z [2024-02-24T01:24:05.134+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:23:00+00:00, run_id=scheduled__2024-02-24T01:23:00+00:00, run_start_date=2024-02-24 01:24:00.143373+00:00, run_end_date=2024-02-24 01:24:05.133919+00:00, run_duration=4.990546, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:23:00+00:00, data_interval_end=2024-02-24 01:24:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:24:05.153294224Z [2024-02-24T01:24:05.152+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:24:00+00:00, run_after=2024-02-24T01:25:00+00:00 2024-02-24T01:24:05.186548973Z [2024-02-24T01:24:05.186+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:23:00+00:00 exited with status success for try_number 1 2024-02-24T01:24:05.191864763Z [2024-02-24T01:24:05.191+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:23:00+00:00, map_index=-1, run_start_date=2024-02-24 01:24:02.338830+00:00, run_end_date=2024-02-24 01:24:04.146357+00:00, run_duration=1.807527, state=success, executor_state=success, try_number=1, max_tries=1, job_id=502, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:24:00.245579+00:00, queued_by_job_id=2, pid=7360 2024-02-24T01:25:00.078272987Z [2024-02-24T01:25:00.077+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:25:00.092550856Z [2024-02-24T01:25:00.092+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:25:00+00:00, run_after=2024-02-24T01:26:00+00:00 2024-02-24T01:25:00.102905252Z [2024-02-24T01:25:00.102+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:25:00+00:00, run_after=2024-02-24T01:30:00+00:00 2024-02-24T01:25:00.112237223Z [2024-02-24T01:25:00.111+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:25:00+00:00, run_after=2024-02-24T01:26:00+00:00 2024-02-24T01:25:00.184299835Z [2024-02-24T01:25:00.183+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T01:25:00.184345990Z 2024-02-24T01:25:00.184368023Z 2024-02-24T01:25:00.184378770Z 2024-02-24T01:25:00.184387517Z 2024-02-24T01:25:00.184827410Z [2024-02-24T01:25:00.184+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:25:00.185286998Z [2024-02-24T01:25:00.184+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:25:00.185672155Z [2024-02-24T01:25:00.185+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:25:00.186105522Z [2024-02-24T01:25:00.185+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:25:00.188035643Z [2024-02-24T01:25:00.187+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:25:00.188063904Z 2024-02-24T01:25:00.188076655Z 2024-02-24T01:25:00.188087586Z 2024-02-24T01:25:00.188130471Z 2024-02-24T01:25:00.196978357Z [2024-02-24T01:25:00.196+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T01:25:00.197456070Z [2024-02-24T01:25:00.196+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T01:25:00.198173322Z [2024-02-24T01:25:00.197+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:25:00.198535315Z [2024-02-24T01:25:00.198+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:25:00.199130279Z [2024-02-24T01:25:00.198+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:25:00.199470967Z [2024-02-24T01:25:00.199+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:25:00.200030326Z [2024-02-24T01:25:00.199+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:25:00.200221304Z [2024-02-24T01:25:00.199+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:25:00.718297295Z [2024-02-24T01:25:00.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T01:20:00+00:00 exited with status queued for try_number 1 2024-02-24T01:25:00.718588156Z [2024-02-24T01:25:00.718+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:24:00+00:00 exited with status queued for try_number 1 2024-02-24T01:25:00.718781620Z [2024-02-24T01:25:00.718+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:24:00+00:00 exited with status queued for try_number 1 2024-02-24T01:25:00.718960662Z [2024-02-24T01:25:00.718+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:24:00+00:00 exited with status queued for try_number 1 2024-02-24T01:25:00.730582393Z [2024-02-24T01:25:00.730+0000] {scheduler_job.py:635} INFO - Setting external_id for to 157ff487-9fae-4bea-ae2f-06e276b4e999 2024-02-24T01:25:00.730816906Z [2024-02-24T01:25:00.730+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c34287d-897b-4564-886c-34f8924c465f 2024-02-24T01:25:00.731055936Z [2024-02-24T01:25:00.730+0000] {scheduler_job.py:635} INFO - Setting external_id for to 61100fb4-543d-406a-ac4e-b62c753ef00f 2024-02-24T01:25:00.731246810Z [2024-02-24T01:25:00.731+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b4bbe7f-428a-4804-bad7-245a61fc4294 2024-02-24T01:25:01.914530455Z [2024-02-24T01:25:01.914+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:25:01.914779446Z [2024-02-24T01:25:01.914+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:24:00+00:00, run_id=scheduled__2024-02-24T01:24:00+00:00, run_start_date=2024-02-24 01:25:00.126822+00:00, run_end_date=2024-02-24 01:25:01.914478+00:00, run_duration=1.787656, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:24:00+00:00, data_interval_end=2024-02-24 01:25:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:25:01.926005977Z [2024-02-24T01:25:01.925+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:25:00+00:00, run_after=2024-02-24T01:26:00+00:00 2024-02-24T01:25:01.980005054Z [2024-02-24T01:25:01.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:24:00+00:00 exited with status success for try_number 1 2024-02-24T01:25:01.987232104Z [2024-02-24T01:25:01.986+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:24:00+00:00, map_index=-1, run_start_date=2024-02-24 01:25:01.041362+00:00, run_end_date=2024-02-24 01:25:01.446767+00:00, run_duration=0.405405, state=success, executor_state=success, try_number=1, max_tries=1, job_id=503, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:25:00.191437+00:00, queued_by_job_id=2, pid=7393 2024-02-24T01:25:03.127751837Z [2024-02-24T01:25:03.127+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:25:03.127786107Z 2024-02-24T01:25:03.127834593Z [2024-02-24T01:25:03.127+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:25:03.128793310Z [2024-02-24T01:25:03.128+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:25:03.128837185Z 2024-02-24T01:25:03.132853049Z [2024-02-24T01:25:03.132+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T01:25:03.133003123Z [2024-02-24T01:25:03.132+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T01:25:03.182798815Z [2024-02-24T01:25:03.182+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T01:20:00+00:00 exited with status queued for try_number 1 2024-02-24T01:25:03.182835339Z [2024-02-24T01:25:03.182+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T01:20:00+00:00 exited with status success for try_number 1 2024-02-24T01:25:03.195021833Z [2024-02-24T01:25:03.194+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7dd218b4-bf76-4cfb-af85-9d9818f8e566 2024-02-24T01:25:03.195296657Z [2024-02-24T01:25:03.195+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T01:20:00+00:00, map_index=-1, run_start_date=2024-02-24 01:25:02.084696+00:00, run_end_date=2024-02-24 01:25:02.493476+00:00, run_duration=0.40878, state=success, executor_state=success, try_number=1, max_tries=1, job_id=504, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:25:00.191437+00:00, queued_by_job_id=2, pid=7417 2024-02-24T01:25:04.336570848Z [2024-02-24T01:25:04.336+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:25:04.336968266Z [2024-02-24T01:25:04.336+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:24:00+00:00, run_id=scheduled__2024-02-24T01:24:00+00:00, run_start_date=2024-02-24 01:25:00.128698+00:00, run_end_date=2024-02-24 01:25:04.336440+00:00, run_duration=4.207742, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:24:00+00:00, data_interval_end=2024-02-24 01:25:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:25:04.347712192Z [2024-02-24T01:25:04.347+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:25:00+00:00, run_after=2024-02-24T01:26:00+00:00 2024-02-24T01:25:04.357162808Z [2024-02-24T01:25:04.356+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:25:04.357981501Z [2024-02-24T01:25:04.357+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:24:00+00:00, run_id=scheduled__2024-02-24T01:24:00+00:00, run_start_date=2024-02-24 01:25:00.127755+00:00, run_end_date=2024-02-24 01:25:04.357078+00:00, run_duration=4.229323, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:24:00+00:00, data_interval_end=2024-02-24 01:25:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:25:04.378961621Z [2024-02-24T01:25:04.378+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:25:00+00:00, run_after=2024-02-24T01:26:00+00:00 2024-02-24T01:25:04.441883690Z [2024-02-24T01:25:04.441+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:24:00+00:00 exited with status success for try_number 1 2024-02-24T01:25:04.442142991Z [2024-02-24T01:25:04.441+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:24:00+00:00 exited with status success for try_number 1 2024-02-24T01:25:04.450685949Z [2024-02-24T01:25:04.450+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:24:00+00:00, map_index=-1, run_start_date=2024-02-24 01:25:02.135668+00:00, run_end_date=2024-02-24 01:25:03.454742+00:00, run_duration=1.319074, state=success, executor_state=success, try_number=1, max_tries=1, job_id=505, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:25:00.191437+00:00, queued_by_job_id=2, pid=7418 2024-02-24T01:25:04.451109951Z [2024-02-24T01:25:04.450+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:24:00+00:00, map_index=-1, run_start_date=2024-02-24 01:25:02.229495+00:00, run_end_date=2024-02-24 01:25:04.113966+00:00, run_duration=1.884471, state=success, executor_state=success, try_number=1, max_tries=1, job_id=506, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:25:00.191437+00:00, queued_by_job_id=2, pid=7419 2024-02-24T01:25:05.525610825Z [2024-02-24T01:25:05.525+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:25:05.525654465Z 2024-02-24T01:25:05.525674148Z [2024-02-24T01:25:05.525+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:25:05.526417080Z [2024-02-24T01:25:05.526+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:25:05.526446145Z 2024-02-24T01:25:05.529230613Z [2024-02-24T01:25:05.528+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T01:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T01:25:05.529301336Z [2024-02-24T01:25:05.529+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T01:25:05.579793078Z [2024-02-24T01:25:05.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T01:20:00+00:00 exited with status queued for try_number 1 2024-02-24T01:25:05.580323264Z [2024-02-24T01:25:05.580+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T01:20:00+00:00 exited with status success for try_number 1 2024-02-24T01:25:05.587637505Z [2024-02-24T01:25:05.587+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2084974b-44f1-411c-9c62-dd0a53a2ea6c 2024-02-24T01:25:05.587802982Z [2024-02-24T01:25:05.587+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T01:20:00+00:00, map_index=-1, run_start_date=2024-02-24 01:25:04.945563+00:00, run_end_date=2024-02-24 01:25:05.365819+00:00, run_duration=0.420256, state=success, executor_state=success, try_number=1, max_tries=1, job_id=507, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:25:03.129368+00:00, queued_by_job_id=2, pid=7442 2024-02-24T01:25:08.216043477Z [2024-02-24T01:25:08.215+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:25:08.216074800Z 2024-02-24T01:25:08.216079609Z [2024-02-24T01:25:08.215+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:25:08.217096839Z [2024-02-24T01:25:08.216+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:25:08.217113387Z 2024-02-24T01:25:08.219430596Z [2024-02-24T01:25:08.219+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:25:08.219647426Z [2024-02-24T01:25:08.219+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T01:25:08.297747470Z [2024-02-24T01:25:08.297+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T01:20:00+00:00 exited with status queued for try_number 1 2024-02-24T01:25:08.298079574Z [2024-02-24T01:25:08.297+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T01:20:00+00:00 exited with status success for try_number 1 2024-02-24T01:25:08.304203758Z [2024-02-24T01:25:08.303+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c291304-8c17-4620-8c98-5f7c1885db35 2024-02-24T01:25:08.304468755Z [2024-02-24T01:25:08.304+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T01:20:00+00:00, map_index=0, run_start_date=2024-02-24 01:25:07.240349+00:00, run_end_date=2024-02-24 01:25:07.588557+00:00, run_duration=0.348208, state=success, executor_state=success, try_number=1, max_tries=1, job_id=508, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:25:05.526902+00:00, queued_by_job_id=2, pid=7450 2024-02-24T01:25:10.543445997Z [2024-02-24T01:25:10.543+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:25:10.543814390Z [2024-02-24T01:25:10.543+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:20:00+00:00, run_id=scheduled__2024-02-24T01:20:00+00:00, run_start_date=2024-02-24 01:25:00.122687+00:00, run_end_date=2024-02-24 01:25:10.543333+00:00, run_duration=10.420646, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:20:00+00:00, data_interval_end=2024-02-24 01:25:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T01:25:10.550553408Z [2024-02-24T01:25:10.550+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:25:00+00:00, run_after=2024-02-24T01:30:00+00:00 2024-02-24T01:25:10.599057670Z [2024-02-24T01:25:10.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T01:20:00+00:00 exited with status success for try_number 1 2024-02-24T01:25:10.607469587Z [2024-02-24T01:25:10.607+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T01:20:00+00:00, map_index=-1, run_start_date=2024-02-24 01:25:09.828917+00:00, run_end_date=2024-02-24 01:25:10.164050+00:00, run_duration=0.335133, state=success, executor_state=success, try_number=1, max_tries=1, job_id=509, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:25:08.217477+00:00, queued_by_job_id=2, pid=7458 2024-02-24T01:26:00.126988579Z [2024-02-24T01:26:00.123+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:26:00.142316303Z [2024-02-24T01:26:00.141+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:26:00.157086249Z [2024-02-24T01:26:00.156+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:26:00+00:00, run_after=2024-02-24T01:27:00+00:00 2024-02-24T01:26:00.169335292Z [2024-02-24T01:26:00.168+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:26:00+00:00, run_after=2024-02-24T01:27:00+00:00 2024-02-24T01:26:00.251938783Z [2024-02-24T01:26:00.251+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T01:26:00.251965573Z 2024-02-24T01:26:00.251970953Z 2024-02-24T01:26:00.251975303Z 2024-02-24T01:26:00.251979586Z 2024-02-24T01:26:00.252439982Z [2024-02-24T01:26:00.252+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T01:26:00.253288202Z [2024-02-24T01:26:00.252+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:26:00.253951637Z [2024-02-24T01:26:00.253+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:26:00.254648107Z [2024-02-24T01:26:00.254+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:26:00.256757526Z [2024-02-24T01:26:00.256+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:26:00.256773906Z 2024-02-24T01:26:00.256780373Z 2024-02-24T01:26:00.256786032Z 2024-02-24T01:26:00.256791617Z 2024-02-24T01:26:00.263683674Z [2024-02-24T01:26:00.263+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:26:00.264268488Z [2024-02-24T01:26:00.263+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T01:26:00.265116952Z [2024-02-24T01:26:00.264+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:26:00.265723568Z [2024-02-24T01:26:00.265+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:26:00.266532949Z [2024-02-24T01:26:00.266+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:26:00.267073825Z [2024-02-24T01:26:00.266+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:26:00.267653382Z [2024-02-24T01:26:00.267+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:26:00.268251157Z [2024-02-24T01:26:00.267+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:26:00.642946133Z [2024-02-24T01:26:00.642+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:24:00+00:00 exited with status queued for try_number 1 2024-02-24T01:26:00.645175656Z [2024-02-24T01:26:00.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:25:00+00:00 exited with status queued for try_number 1 2024-02-24T01:26:00.645336703Z [2024-02-24T01:26:00.645+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:25:00+00:00 exited with status queued for try_number 1 2024-02-24T01:26:00.645531817Z [2024-02-24T01:26:00.645+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:25:00+00:00 exited with status queued for try_number 1 2024-02-24T01:26:00.666821123Z [2024-02-24T01:26:00.666+0000] {scheduler_job.py:635} INFO - Setting external_id for to fcc21a63-f9d7-4e1a-99c2-0179082d8dd5 2024-02-24T01:26:00.670327699Z [2024-02-24T01:26:00.669+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ba1dbfe-9b62-4fc1-8e55-66695b45569e 2024-02-24T01:26:00.670631866Z [2024-02-24T01:26:00.670+0000] {scheduler_job.py:635} INFO - Setting external_id for to 83f0f3f5-a952-4962-824a-a3efae1c3837 2024-02-24T01:26:00.670885904Z [2024-02-24T01:26:00.670+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39f8fe14-9a30-42d1-b8da-1a1efc7124e1 2024-02-24T01:26:01.975519059Z [2024-02-24T01:26:01.975+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:26:01.975902423Z [2024-02-24T01:26:01.975+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 01:24:00+00:00, run_id=scheduled__2024-02-24T01:24:00+00:00, run_start_date=2024-02-24 01:26:00.181837+00:00, run_end_date=2024-02-24 01:26:01.975447+00:00, run_duration=1.79361, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:24:00+00:00, data_interval_end=2024-02-24 01:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T01:26:01.988703496Z [2024-02-24T01:26:01.988+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T01:26:00+00:00, run_after=2024-02-24T01:28:00+00:00 2024-02-24T01:26:02.016042449Z [2024-02-24T01:26:02.015+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:26:02.016253651Z [2024-02-24T01:26:02.016+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:25:00+00:00, run_id=scheduled__2024-02-24T01:25:00+00:00, run_start_date=2024-02-24 01:26:00.183427+00:00, run_end_date=2024-02-24 01:26:02.015947+00:00, run_duration=1.83252, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:25:00+00:00, data_interval_end=2024-02-24 01:26:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:26:02.037428222Z [2024-02-24T01:26:02.037+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:26:00+00:00, run_after=2024-02-24T01:27:00+00:00 2024-02-24T01:26:02.101442124Z [2024-02-24T01:26:02.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:24:00+00:00 exited with status success for try_number 1 2024-02-24T01:26:02.101858687Z [2024-02-24T01:26:02.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:25:00+00:00 exited with status success for try_number 1 2024-02-24T01:26:02.114923841Z [2024-02-24T01:26:02.114+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:25:00+00:00, map_index=-1, run_start_date=2024-02-24 01:26:01.144089+00:00, run_end_date=2024-02-24 01:26:01.561584+00:00, run_duration=0.417495, state=success, executor_state=success, try_number=1, max_tries=1, job_id=510, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:26:00.259294+00:00, queued_by_job_id=2, pid=7481 2024-02-24T01:26:02.115398179Z [2024-02-24T01:26:02.115+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T01:24:00+00:00, map_index=-1, run_start_date=2024-02-24 01:26:01.251147+00:00, run_end_date=2024-02-24 01:26:01.720528+00:00, run_duration=0.469381, state=success, executor_state=success, try_number=1, max_tries=1, job_id=511, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:26:00.259294+00:00, queued_by_job_id=2, pid=7482 2024-02-24T01:26:04.165161779Z [2024-02-24T01:26:04.164+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:26:04.165439012Z [2024-02-24T01:26:04.165+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:25:00+00:00, run_id=scheduled__2024-02-24T01:25:00+00:00, run_start_date=2024-02-24 01:26:00.186245+00:00, run_end_date=2024-02-24 01:26:04.165138+00:00, run_duration=3.978893, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:25:00+00:00, data_interval_end=2024-02-24 01:26:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:26:04.174798883Z [2024-02-24T01:26:04.174+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:26:00+00:00, run_after=2024-02-24T01:27:00+00:00 2024-02-24T01:26:04.188818644Z [2024-02-24T01:26:04.188+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:26:04.189441598Z [2024-02-24T01:26:04.189+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:25:00+00:00, run_id=scheduled__2024-02-24T01:25:00+00:00, run_start_date=2024-02-24 01:26:00.184985+00:00, run_end_date=2024-02-24 01:26:04.188846+00:00, run_duration=4.003861, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:25:00+00:00, data_interval_end=2024-02-24 01:26:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:26:04.210526522Z [2024-02-24T01:26:04.209+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:26:00+00:00, run_after=2024-02-24T01:27:00+00:00 2024-02-24T01:26:04.254504039Z [2024-02-24T01:26:04.254+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:25:00+00:00 exited with status success for try_number 1 2024-02-24T01:26:04.254702968Z [2024-02-24T01:26:04.254+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:25:00+00:00 exited with status success for try_number 1 2024-02-24T01:26:04.264127163Z [2024-02-24T01:26:04.263+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:25:00+00:00, map_index=-1, run_start_date=2024-02-24 01:26:02.290835+00:00, run_end_date=2024-02-24 01:26:04.059713+00:00, run_duration=1.768878, state=success, executor_state=success, try_number=1, max_tries=1, job_id=512, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:26:00.259294+00:00, queued_by_job_id=2, pid=7505 2024-02-24T01:26:04.264661927Z [2024-02-24T01:26:04.264+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:25:00+00:00, map_index=-1, run_start_date=2024-02-24 01:26:02.329659+00:00, run_end_date=2024-02-24 01:26:03.882192+00:00, run_duration=1.552533, state=success, executor_state=success, try_number=1, max_tries=1, job_id=513, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:26:00.259294+00:00, queued_by_job_id=2, pid=7506 2024-02-24T01:27:01.081297216Z [2024-02-24T01:27:01.080+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:27:00+00:00, run_after=2024-02-24T01:28:00+00:00 2024-02-24T01:27:01.092948901Z [2024-02-24T01:27:01.092+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:27:01.107501563Z [2024-02-24T01:27:01.107+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:27:00+00:00, run_after=2024-02-24T01:28:00+00:00 2024-02-24T01:27:01.197828749Z [2024-02-24T01:27:01.197+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T01:27:01.197862124Z 2024-02-24T01:27:01.197868470Z 2024-02-24T01:27:01.197874962Z 2024-02-24T01:27:01.198284086Z [2024-02-24T01:27:01.197+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:27:01.198695353Z [2024-02-24T01:27:01.198+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:27:01.199071785Z [2024-02-24T01:27:01.198+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:27:01.200168041Z [2024-02-24T01:27:01.199+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:27:01.200182628Z 2024-02-24T01:27:01.200186254Z 2024-02-24T01:27:01.200189396Z 2024-02-24T01:27:01.206033419Z [2024-02-24T01:27:01.205+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:27:01.206500586Z [2024-02-24T01:27:01.206+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:27:01.209100436Z [2024-02-24T01:27:01.207+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:27:01.211334568Z [2024-02-24T01:27:01.209+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:27:01.211361863Z [2024-02-24T01:27:01.210+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:27:01.214026944Z [2024-02-24T01:27:01.210+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:27:01.472998923Z [2024-02-24T01:27:01.472+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:26:00+00:00 exited with status queued for try_number 1 2024-02-24T01:27:01.473112317Z [2024-02-24T01:27:01.472+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:26:00+00:00 exited with status queued for try_number 1 2024-02-24T01:27:01.473164434Z [2024-02-24T01:27:01.473+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:26:00+00:00 exited with status queued for try_number 1 2024-02-24T01:27:01.480538991Z [2024-02-24T01:27:01.480+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf7f830f-1af5-455d-8cbd-58b0315ac4ee 2024-02-24T01:27:01.480614603Z [2024-02-24T01:27:01.480+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2768016e-3bab-4b97-8821-58679b2fc8ed 2024-02-24T01:27:01.480763685Z [2024-02-24T01:27:01.480+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c01bc63-b141-44e6-9a2f-01d58744c918 2024-02-24T01:27:02.676061058Z [2024-02-24T01:27:02.675+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:27:02.676279103Z [2024-02-24T01:27:02.676+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:26:00+00:00, run_id=scheduled__2024-02-24T01:26:00+00:00, run_start_date=2024-02-24 01:27:01.128656+00:00, run_end_date=2024-02-24 01:27:02.675953+00:00, run_duration=1.547297, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:26:00+00:00, data_interval_end=2024-02-24 01:27:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:27:02.694923788Z [2024-02-24T01:27:02.693+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:27:00+00:00, run_after=2024-02-24T01:28:00+00:00 2024-02-24T01:27:02.745457727Z [2024-02-24T01:27:02.745+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:26:00+00:00 exited with status success for try_number 1 2024-02-24T01:27:02.756263940Z [2024-02-24T01:27:02.755+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:26:00+00:00, map_index=-1, run_start_date=2024-02-24 01:27:01.989939+00:00, run_end_date=2024-02-24 01:27:02.415786+00:00, run_duration=0.425847, state=success, executor_state=success, try_number=1, max_tries=1, job_id=514, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:27:01.201873+00:00, queued_by_job_id=2, pid=7538 2024-02-24T01:27:02.770052259Z [2024-02-24T01:27:02.769+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T01:27:06.289122761Z [2024-02-24T01:27:06.288+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:27:06.289612231Z [2024-02-24T01:27:06.289+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:26:00+00:00, run_id=scheduled__2024-02-24T01:26:00+00:00, run_start_date=2024-02-24 01:27:01.132165+00:00, run_end_date=2024-02-24 01:27:06.288999+00:00, run_duration=5.156834, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:26:00+00:00, data_interval_end=2024-02-24 01:27:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:27:06.302676294Z [2024-02-24T01:27:06.302+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:27:00+00:00, run_after=2024-02-24T01:28:00+00:00 2024-02-24T01:27:06.356529134Z [2024-02-24T01:27:06.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:26:00+00:00 exited with status success for try_number 1 2024-02-24T01:27:06.364275494Z [2024-02-24T01:27:06.363+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:26:00+00:00, map_index=-1, run_start_date=2024-02-24 01:27:03.161987+00:00, run_end_date=2024-02-24 01:27:05.970556+00:00, run_duration=2.808569, state=success, executor_state=success, try_number=1, max_tries=1, job_id=515, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:27:01.201873+00:00, queued_by_job_id=2, pid=7556 2024-02-24T01:27:07.424019584Z [2024-02-24T01:27:07.423+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:27:07.424225070Z [2024-02-24T01:27:07.423+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:26:00+00:00, run_id=scheduled__2024-02-24T01:26:00+00:00, run_start_date=2024-02-24 01:27:01.134076+00:00, run_end_date=2024-02-24 01:27:07.423805+00:00, run_duration=6.289729, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:26:00+00:00, data_interval_end=2024-02-24 01:27:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:27:07.439566399Z [2024-02-24T01:27:07.439+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:27:00+00:00, run_after=2024-02-24T01:28:00+00:00 2024-02-24T01:27:07.482340625Z [2024-02-24T01:27:07.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:26:00+00:00 exited with status success for try_number 1 2024-02-24T01:27:07.490630526Z [2024-02-24T01:27:07.490+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:26:00+00:00, map_index=-1, run_start_date=2024-02-24 01:27:03.193459+00:00, run_end_date=2024-02-24 01:27:07.016902+00:00, run_duration=3.823443, state=success, executor_state=success, try_number=1, max_tries=1, job_id=516, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:27:01.201873+00:00, queued_by_job_id=2, pid=7557 2024-02-24T01:28:00.925629603Z [2024-02-24T01:28:00.925+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:28:00+00:00, run_after=2024-02-24T01:29:00+00:00 2024-02-24T01:28:00.938890432Z [2024-02-24T01:28:00.938+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:28:00.977467855Z [2024-02-24T01:28:00.976+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:28:00+00:00, run_after=2024-02-24T01:29:00+00:00 2024-02-24T01:28:00.991774189Z [2024-02-24T01:28:00.991+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:28:01.089657751Z [2024-02-24T01:28:01.089+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T01:28:01.089710547Z 2024-02-24T01:28:01.089720848Z 2024-02-24T01:28:01.089724761Z 2024-02-24T01:28:01.089728560Z 2024-02-24T01:28:01.089895696Z [2024-02-24T01:28:01.089+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T01:28:01.090359400Z [2024-02-24T01:28:01.089+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:28:01.090738474Z [2024-02-24T01:28:01.090+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:28:01.091046999Z [2024-02-24T01:28:01.090+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:28:01.092232298Z [2024-02-24T01:28:01.091+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:28:01.092260245Z 2024-02-24T01:28:01.092269989Z 2024-02-24T01:28:01.092278186Z 2024-02-24T01:28:01.092286502Z 2024-02-24T01:28:01.099317441Z [2024-02-24T01:28:01.098+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:28:01.099732799Z [2024-02-24T01:28:01.099+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T01:28:01.100354854Z [2024-02-24T01:28:01.100+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:28:01.100721043Z [2024-02-24T01:28:01.100+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:28:01.101139590Z [2024-02-24T01:28:01.100+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:28:01.101369960Z [2024-02-24T01:28:01.101+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:28:01.101649042Z [2024-02-24T01:28:01.101+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:28:01.101919647Z [2024-02-24T01:28:01.101+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:28:01.584778596Z [2024-02-24T01:28:01.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:26:00+00:00 exited with status queued for try_number 1 2024-02-24T01:28:01.584825669Z [2024-02-24T01:28:01.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:27:00+00:00 exited with status queued for try_number 1 2024-02-24T01:28:01.585494530Z [2024-02-24T01:28:01.585+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:27:00+00:00 exited with status queued for try_number 1 2024-02-24T01:28:01.585608253Z [2024-02-24T01:28:01.585+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:27:00+00:00 exited with status queued for try_number 1 2024-02-24T01:28:01.610879148Z [2024-02-24T01:28:01.610+0000] {scheduler_job.py:635} INFO - Setting external_id for to 02bc0c08-7f1a-445b-897c-5ac231568744 2024-02-24T01:28:01.611632258Z [2024-02-24T01:28:01.610+0000] {scheduler_job.py:635} INFO - Setting external_id for to 431b9298-70c1-41bb-824d-8b81e3d2a25e 2024-02-24T01:28:01.612042138Z [2024-02-24T01:28:01.611+0000] {scheduler_job.py:635} INFO - Setting external_id for to c34dd184-3a9f-42a4-b389-645193580a4e 2024-02-24T01:28:01.613537128Z [2024-02-24T01:28:01.613+0000] {scheduler_job.py:635} INFO - Setting external_id for to e68c5488-1248-4ed3-8616-1c69fac17299 2024-02-24T01:28:02.850618619Z [2024-02-24T01:28:02.850+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:28:02.851025986Z [2024-02-24T01:28:02.850+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 01:26:00+00:00, run_id=scheduled__2024-02-24T01:26:00+00:00, run_start_date=2024-02-24 01:28:01.004810+00:00, run_end_date=2024-02-24 01:28:02.850678+00:00, run_duration=1.845868, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:26:00+00:00, data_interval_end=2024-02-24 01:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T01:28:02.858706730Z [2024-02-24T01:28:02.858+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T01:28:00+00:00, run_after=2024-02-24T01:30:00+00:00 2024-02-24T01:28:02.878629868Z [2024-02-24T01:28:02.878+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:28:02.878995688Z [2024-02-24T01:28:02.878+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:27:00+00:00, run_id=scheduled__2024-02-24T01:27:00+00:00, run_start_date=2024-02-24 01:28:01.006265+00:00, run_end_date=2024-02-24 01:28:02.878685+00:00, run_duration=1.87242, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:27:00+00:00, data_interval_end=2024-02-24 01:28:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:28:02.890098604Z [2024-02-24T01:28:02.889+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:28:00+00:00, run_after=2024-02-24T01:29:00+00:00 2024-02-24T01:28:02.936441416Z [2024-02-24T01:28:02.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:26:00+00:00 exited with status success for try_number 1 2024-02-24T01:28:02.936899182Z [2024-02-24T01:28:02.936+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:27:00+00:00 exited with status success for try_number 1 2024-02-24T01:28:02.950026877Z [2024-02-24T01:28:02.949+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T01:26:00+00:00, map_index=-1, run_start_date=2024-02-24 01:28:01.946765+00:00, run_end_date=2024-02-24 01:28:02.350985+00:00, run_duration=0.40422, state=success, executor_state=success, try_number=1, max_tries=1, job_id=517, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:28:01.093669+00:00, queued_by_job_id=2, pid=7590 2024-02-24T01:28:02.950329394Z [2024-02-24T01:28:02.950+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:27:00+00:00, map_index=-1, run_start_date=2024-02-24 01:28:02.142397+00:00, run_end_date=2024-02-24 01:28:02.624448+00:00, run_duration=0.482051, state=success, executor_state=success, try_number=1, max_tries=1, job_id=518, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:28:01.093669+00:00, queued_by_job_id=2, pid=7591 2024-02-24T01:28:05.361972004Z [2024-02-24T01:28:05.361+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:28:05.362638960Z [2024-02-24T01:28:05.362+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:27:00+00:00, run_id=scheduled__2024-02-24T01:27:00+00:00, run_start_date=2024-02-24 01:28:01.007302+00:00, run_end_date=2024-02-24 01:28:05.361872+00:00, run_duration=4.35457, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:27:00+00:00, data_interval_end=2024-02-24 01:28:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:28:05.376513902Z [2024-02-24T01:28:05.376+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:28:00+00:00, run_after=2024-02-24T01:29:00+00:00 2024-02-24T01:28:05.437871387Z [2024-02-24T01:28:05.437+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:27:00+00:00 exited with status success for try_number 1 2024-02-24T01:28:05.446725123Z [2024-02-24T01:28:05.446+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:27:00+00:00, map_index=-1, run_start_date=2024-02-24 01:28:03.314294+00:00, run_end_date=2024-02-24 01:28:05.163236+00:00, run_duration=1.848942, state=success, executor_state=success, try_number=1, max_tries=1, job_id=520, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:28:01.093669+00:00, queued_by_job_id=2, pid=7615 2024-02-24T01:28:05.644720388Z [2024-02-24T01:28:05.644+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:28:05.645218009Z [2024-02-24T01:28:05.644+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:27:00+00:00, run_id=scheduled__2024-02-24T01:27:00+00:00, run_start_date=2024-02-24 01:28:01.008280+00:00, run_end_date=2024-02-24 01:28:05.644574+00:00, run_duration=4.636294, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:27:00+00:00, data_interval_end=2024-02-24 01:28:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:28:05.661749218Z [2024-02-24T01:28:05.661+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:28:00+00:00, run_after=2024-02-24T01:29:00+00:00 2024-02-24T01:28:05.712412041Z [2024-02-24T01:28:05.711+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:27:00+00:00 exited with status success for try_number 1 2024-02-24T01:28:05.719165394Z [2024-02-24T01:28:05.718+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:27:00+00:00, map_index=-1, run_start_date=2024-02-24 01:28:03.273685+00:00, run_end_date=2024-02-24 01:28:05.418117+00:00, run_duration=2.144432, state=success, executor_state=success, try_number=1, max_tries=1, job_id=519, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:28:01.093669+00:00, queued_by_job_id=2, pid=7614 2024-02-24T01:29:00.382861204Z [2024-02-24T01:29:00.382+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:29:00+00:00, run_after=2024-02-24T01:30:00+00:00 2024-02-24T01:29:00.394760934Z [2024-02-24T01:29:00.394+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:29:00.416177158Z [2024-02-24T01:29:00.415+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:29:00+00:00, run_after=2024-02-24T01:30:00+00:00 2024-02-24T01:29:00.506231886Z [2024-02-24T01:29:00.505+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T01:29:00.506277082Z 2024-02-24T01:29:00.506327171Z 2024-02-24T01:29:00.506343050Z 2024-02-24T01:29:00.506444330Z [2024-02-24T01:29:00.506+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:29:00.506707351Z [2024-02-24T01:29:00.506+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:29:00.506970176Z [2024-02-24T01:29:00.506+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:29:00.508180840Z [2024-02-24T01:29:00.507+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:29:00.508195566Z 2024-02-24T01:29:00.508201665Z 2024-02-24T01:29:00.508207264Z 2024-02-24T01:29:00.513940368Z [2024-02-24T01:29:00.513+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:29:00.514388293Z [2024-02-24T01:29:00.514+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:29:00.514901070Z [2024-02-24T01:29:00.514+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:29:00.515149601Z [2024-02-24T01:29:00.514+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:29:00.515579105Z [2024-02-24T01:29:00.515+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:29:00.515848874Z [2024-02-24T01:29:00.515+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:29:00.799052398Z [2024-02-24T01:29:00.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:28:00+00:00 exited with status queued for try_number 1 2024-02-24T01:29:00.799220436Z [2024-02-24T01:29:00.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:28:00+00:00 exited with status queued for try_number 1 2024-02-24T01:29:00.799376638Z [2024-02-24T01:29:00.799+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:28:00+00:00 exited with status queued for try_number 1 2024-02-24T01:29:00.809134029Z [2024-02-24T01:29:00.808+0000] {scheduler_job.py:635} INFO - Setting external_id for to f89727fd-3210-4366-8386-f62d94686e68 2024-02-24T01:29:00.809339247Z [2024-02-24T01:29:00.809+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1ecf05c8-44e2-4cf4-92bc-8892d6539172 2024-02-24T01:29:00.809555546Z [2024-02-24T01:29:00.809+0000] {scheduler_job.py:635} INFO - Setting external_id for to 503e0f67-d886-41a0-8b12-dda1a135e453 2024-02-24T01:29:02.070825150Z [2024-02-24T01:29:02.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:28:00+00:00 exited with status success for try_number 1 2024-02-24T01:29:02.078111514Z [2024-02-24T01:29:02.077+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:28:00+00:00, map_index=-1, run_start_date=2024-02-24 01:29:01.428885+00:00, run_end_date=2024-02-24 01:29:01.884889+00:00, run_duration=0.456004, state=success, executor_state=success, try_number=1, max_tries=1, job_id=521, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:29:00.509642+00:00, queued_by_job_id=2, pid=7647 2024-02-24T01:29:03.145306339Z [2024-02-24T01:29:03.144+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:29:03.145985592Z [2024-02-24T01:29:03.145+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:28:00+00:00, run_id=scheduled__2024-02-24T01:28:00+00:00, run_start_date=2024-02-24 01:29:00.429980+00:00, run_end_date=2024-02-24 01:29:03.145215+00:00, run_duration=2.715235, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:28:00+00:00, data_interval_end=2024-02-24 01:29:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:29:03.156483311Z [2024-02-24T01:29:03.156+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:29:00+00:00, run_after=2024-02-24T01:30:00+00:00 2024-02-24T01:29:04.285377012Z [2024-02-24T01:29:04.285+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:29:04.285705753Z [2024-02-24T01:29:04.285+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:28:00+00:00, run_id=scheduled__2024-02-24T01:28:00+00:00, run_start_date=2024-02-24 01:29:00.431379+00:00, run_end_date=2024-02-24 01:29:04.285271+00:00, run_duration=3.853892, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:28:00+00:00, data_interval_end=2024-02-24 01:29:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:29:04.307949505Z [2024-02-24T01:29:04.307+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:29:00+00:00, run_after=2024-02-24T01:30:00+00:00 2024-02-24T01:29:04.319018075Z [2024-02-24T01:29:04.318+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:29:04.319627621Z [2024-02-24T01:29:04.319+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:28:00+00:00, run_id=scheduled__2024-02-24T01:28:00+00:00, run_start_date=2024-02-24 01:29:00.432613+00:00, run_end_date=2024-02-24 01:29:04.319109+00:00, run_duration=3.886496, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:28:00+00:00, data_interval_end=2024-02-24 01:29:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:29:04.344698155Z [2024-02-24T01:29:04.344+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:29:00+00:00, run_after=2024-02-24T01:30:00+00:00 2024-02-24T01:29:04.393225638Z [2024-02-24T01:29:04.392+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:28:00+00:00 exited with status success for try_number 1 2024-02-24T01:29:04.402180827Z [2024-02-24T01:29:04.401+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:28:00+00:00, map_index=-1, run_start_date=2024-02-24 01:29:02.427610+00:00, run_end_date=2024-02-24 01:29:03.921353+00:00, run_duration=1.493743, state=success, executor_state=success, try_number=1, max_tries=1, job_id=522, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:29:00.509642+00:00, queued_by_job_id=2, pid=7665 2024-02-24T01:29:05.475791172Z [2024-02-24T01:29:05.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:28:00+00:00 exited with status success for try_number 1 2024-02-24T01:29:05.481423428Z [2024-02-24T01:29:05.480+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:28:00+00:00, map_index=-1, run_start_date=2024-02-24 01:29:02.496046+00:00, run_end_date=2024-02-24 01:29:04.250117+00:00, run_duration=1.754071, state=success, executor_state=success, try_number=1, max_tries=1, job_id=523, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:29:00.509642+00:00, queued_by_job_id=2, pid=7666 2024-02-24T01:30:01.010045586Z [2024-02-24T01:30:01.009+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:30:01.029688416Z [2024-02-24T01:30:01.029+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:30:00+00:00, run_after=2024-02-24T01:35:00+00:00 2024-02-24T01:30:01.040074733Z [2024-02-24T01:30:01.039+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:30:01.057587158Z [2024-02-24T01:30:01.057+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:30:00+00:00, run_after=2024-02-24T01:31:00+00:00 2024-02-24T01:30:01.073754201Z [2024-02-24T01:30:01.073+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:30:00+00:00, run_after=2024-02-24T01:31:00+00:00 2024-02-24T01:30:01.219025056Z [2024-02-24T01:30:01.215+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-02-24T01:30:01.219046310Z 2024-02-24T01:30:01.219049854Z 2024-02-24T01:30:01.219053615Z 2024-02-24T01:30:01.219056766Z 2024-02-24T01:30:01.219059910Z 2024-02-24T01:30:01.219062968Z [2024-02-24T01:30:01.215+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:30:01.219066999Z [2024-02-24T01:30:01.215+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T01:30:01.219069972Z [2024-02-24T01:30:01.215+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:30:01.219072907Z [2024-02-24T01:30:01.215+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:30:01.219075918Z [2024-02-24T01:30:01.215+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:30:01.219079048Z [2024-02-24T01:30:01.216+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:30:01.219082133Z 2024-02-24T01:30:01.219085480Z 2024-02-24T01:30:01.219088532Z 2024-02-24T01:30:01.219091546Z 2024-02-24T01:30:01.219094591Z 2024-02-24T01:30:01.221140750Z [2024-02-24T01:30:01.220+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T01:30:01.221298405Z [2024-02-24T01:30:01.221+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T01:30:01.221376625Z [2024-02-24T01:30:01.221+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:30:01.221451077Z [2024-02-24T01:30:01.221+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T01:30:01.223132546Z [2024-02-24T01:30:01.221+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:30:01.223147273Z [2024-02-24T01:30:01.221+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:30:01.223150679Z [2024-02-24T01:30:01.221+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:30:01.223153929Z [2024-02-24T01:30:01.221+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:30:01.223157032Z [2024-02-24T01:30:01.222+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:30:01.223160204Z [2024-02-24T01:30:01.222+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:30:01.699044848Z [2024-02-24T01:30:01.698+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T01:25:00+00:00 exited with status queued for try_number 1 2024-02-24T01:30:01.705714868Z [2024-02-24T01:30:01.698+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:28:00+00:00 exited with status queued for try_number 1 2024-02-24T01:30:01.706027958Z [2024-02-24T01:30:01.705+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:29:00+00:00 exited with status queued for try_number 1 2024-02-24T01:30:01.706236001Z [2024-02-24T01:30:01.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:29:00+00:00 exited with status queued for try_number 1 2024-02-24T01:30:01.706401394Z [2024-02-24T01:30:01.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:29:00+00:00 exited with status queued for try_number 1 2024-02-24T01:30:01.723633831Z [2024-02-24T01:30:01.723+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7eb11ecd-8f44-4e45-a7bc-e923c20942a3 2024-02-24T01:30:01.723776078Z [2024-02-24T01:30:01.723+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e333622-1d5f-4624-97bf-420298e8231e 2024-02-24T01:30:01.723922590Z [2024-02-24T01:30:01.723+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9a8a2e70-dc49-4c1c-97c1-cc5b43d28ce6 2024-02-24T01:30:01.724080269Z [2024-02-24T01:30:01.723+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99531063-33bb-4ccd-ad5e-f515cf8a2002 2024-02-24T01:30:01.724243075Z [2024-02-24T01:30:01.724+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56f03854-d6ea-4f59-9e5a-4735734405f2 2024-02-24T01:30:03.117757480Z [2024-02-24T01:30:03.117+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:30:03.118082953Z [2024-02-24T01:30:03.117+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 01:28:00+00:00, run_id=scheduled__2024-02-24T01:28:00+00:00, run_start_date=2024-02-24 01:30:01.090922+00:00, run_end_date=2024-02-24 01:30:03.117629+00:00, run_duration=2.026707, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:28:00+00:00, data_interval_end=2024-02-24 01:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T01:30:03.127461626Z [2024-02-24T01:30:03.127+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T01:30:00+00:00, run_after=2024-02-24T01:32:00+00:00 2024-02-24T01:30:03.148300108Z [2024-02-24T01:30:03.147+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:30:03.148430542Z [2024-02-24T01:30:03.148+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:29:00+00:00, run_id=scheduled__2024-02-24T01:29:00+00:00, run_start_date=2024-02-24 01:30:01.092442+00:00, run_end_date=2024-02-24 01:30:03.148171+00:00, run_duration=2.055729, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:29:00+00:00, data_interval_end=2024-02-24 01:30:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:30:03.160052054Z [2024-02-24T01:30:03.159+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:30:00+00:00, run_after=2024-02-24T01:31:00+00:00 2024-02-24T01:30:03.195322645Z [2024-02-24T01:30:03.194+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:28:00+00:00 exited with status success for try_number 1 2024-02-24T01:30:03.195425126Z [2024-02-24T01:30:03.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:29:00+00:00 exited with status success for try_number 1 2024-02-24T01:30:03.204183318Z [2024-02-24T01:30:03.203+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T01:28:00+00:00, map_index=-1, run_start_date=2024-02-24 01:30:02.188005+00:00, run_end_date=2024-02-24 01:30:02.718953+00:00, run_duration=0.530948, state=success, executor_state=success, try_number=1, max_tries=1, job_id=524, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:30:01.217581+00:00, queued_by_job_id=2, pid=7700 2024-02-24T01:30:03.204278917Z [2024-02-24T01:30:03.204+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:29:00+00:00, map_index=-1, run_start_date=2024-02-24 01:30:02.412432+00:00, run_end_date=2024-02-24 01:30:02.954844+00:00, run_duration=0.542412, state=success, executor_state=success, try_number=1, max_tries=1, job_id=525, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:30:01.217581+00:00, queued_by_job_id=2, pid=7701 2024-02-24T01:30:05.496511022Z [2024-02-24T01:30:05.496+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:30:05.496574570Z 2024-02-24T01:30:05.496590694Z [2024-02-24T01:30:05.496+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:30:05.497507858Z [2024-02-24T01:30:05.497+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:30:05.497524505Z 2024-02-24T01:30:05.501059777Z [2024-02-24T01:30:05.500+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T01:30:05.501206120Z [2024-02-24T01:30:05.501+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T01:30:05.561951069Z [2024-02-24T01:30:05.561+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T01:25:00+00:00 exited with status queued for try_number 1 2024-02-24T01:30:05.565867728Z [2024-02-24T01:30:05.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T01:25:00+00:00 exited with status success for try_number 1 2024-02-24T01:30:05.572539251Z [2024-02-24T01:30:05.572+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6aff891f-9c2a-45cb-8dcf-93cf06eec8fb 2024-02-24T01:30:05.572828577Z [2024-02-24T01:30:05.572+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T01:25:00+00:00, map_index=-1, run_start_date=2024-02-24 01:30:04.139939+00:00, run_end_date=2024-02-24 01:30:04.616394+00:00, run_duration=0.476455, state=success, executor_state=success, try_number=1, max_tries=1, job_id=528, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:30:01.217581+00:00, queued_by_job_id=2, pid=7732 2024-02-24T01:30:05.615286143Z [2024-02-24T01:30:05.613+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:30:05.615319275Z [2024-02-24T01:30:05.613+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:29:00+00:00, run_id=scheduled__2024-02-24T01:29:00+00:00, run_start_date=2024-02-24 01:30:01.093894+00:00, run_end_date=2024-02-24 01:30:05.613718+00:00, run_duration=4.519824, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:29:00+00:00, data_interval_end=2024-02-24 01:30:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:30:05.623505140Z [2024-02-24T01:30:05.623+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:30:00+00:00, run_after=2024-02-24T01:31:00+00:00 2024-02-24T01:30:05.675262209Z [2024-02-24T01:30:05.674+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:29:00+00:00 exited with status success for try_number 1 2024-02-24T01:30:05.682201702Z [2024-02-24T01:30:05.681+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:29:00+00:00, map_index=-1, run_start_date=2024-02-24 01:30:03.925674+00:00, run_end_date=2024-02-24 01:30:05.500157+00:00, run_duration=1.574483, state=success, executor_state=success, try_number=1, max_tries=1, job_id=526, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:30:01.217581+00:00, queued_by_job_id=2, pid=7730 2024-02-24T01:30:05.946738379Z [2024-02-24T01:30:05.946+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:30:05.946898850Z [2024-02-24T01:30:05.946+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:29:00+00:00, run_id=scheduled__2024-02-24T01:29:00+00:00, run_start_date=2024-02-24 01:30:01.095270+00:00, run_end_date=2024-02-24 01:30:05.946636+00:00, run_duration=4.851366, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:29:00+00:00, data_interval_end=2024-02-24 01:30:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:30:05.961548652Z [2024-02-24T01:30:05.961+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:30:00+00:00, run_after=2024-02-24T01:31:00+00:00 2024-02-24T01:30:06.643232813Z [2024-02-24T01:30:06.642+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:29:00+00:00 exited with status success for try_number 1 2024-02-24T01:30:06.649961162Z [2024-02-24T01:30:06.649+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:29:00+00:00, map_index=-1, run_start_date=2024-02-24 01:30:03.948267+00:00, run_end_date=2024-02-24 01:30:05.897433+00:00, run_duration=1.949166, state=success, executor_state=success, try_number=1, max_tries=1, job_id=527, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:30:01.217581+00:00, queued_by_job_id=2, pid=7731 2024-02-24T01:30:08.248929146Z [2024-02-24T01:30:08.248+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:30:08.249004698Z 2024-02-24T01:30:08.249182468Z [2024-02-24T01:30:08.248+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:30:08.249884648Z [2024-02-24T01:30:08.249+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:30:08.249898710Z 2024-02-24T01:30:08.252134750Z [2024-02-24T01:30:08.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T01:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T01:30:08.252317793Z [2024-02-24T01:30:08.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T01:30:08.296250088Z [2024-02-24T01:30:08.295+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T01:25:00+00:00 exited with status queued for try_number 1 2024-02-24T01:30:08.296525491Z [2024-02-24T01:30:08.296+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T01:25:00+00:00 exited with status success for try_number 1 2024-02-24T01:30:08.303489424Z [2024-02-24T01:30:08.303+0000] {scheduler_job.py:635} INFO - Setting external_id for to 268da403-02f8-4295-a63d-d91205f2d857 2024-02-24T01:30:08.303971900Z [2024-02-24T01:30:08.303+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T01:25:00+00:00, map_index=-1, run_start_date=2024-02-24 01:30:07.228632+00:00, run_end_date=2024-02-24 01:30:07.549351+00:00, run_duration=0.320719, state=success, executor_state=success, try_number=1, max_tries=1, job_id=529, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:30:05.497970+00:00, queued_by_job_id=2, pid=7755 2024-02-24T01:30:10.545744157Z [2024-02-24T01:30:10.545+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:30:10.545793085Z 2024-02-24T01:30:10.545805814Z [2024-02-24T01:30:10.545+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:30:10.547150268Z [2024-02-24T01:30:10.546+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:30:10.547187294Z 2024-02-24T01:30:10.550269247Z [2024-02-24T01:30:10.549+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:30:10.550521779Z [2024-02-24T01:30:10.550+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T01:30:10.604385034Z [2024-02-24T01:30:10.603+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T01:25:00+00:00 exited with status queued for try_number 1 2024-02-24T01:30:10.604821064Z [2024-02-24T01:30:10.604+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T01:25:00+00:00 exited with status success for try_number 1 2024-02-24T01:30:10.611759177Z [2024-02-24T01:30:10.611+0000] {scheduler_job.py:635} INFO - Setting external_id for to 66ed255b-25ef-43fe-ad8e-b9dc5207fd4c 2024-02-24T01:30:10.612099053Z [2024-02-24T01:30:10.611+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T01:25:00+00:00, map_index=0, run_start_date=2024-02-24 01:30:09.819490+00:00, run_end_date=2024-02-24 01:30:10.107997+00:00, run_duration=0.288507, state=success, executor_state=success, try_number=1, max_tries=1, job_id=530, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:30:08.250257+00:00, queued_by_job_id=2, pid=7763 2024-02-24T01:30:13.317044482Z [2024-02-24T01:30:13.316+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:30:13.317418359Z [2024-02-24T01:30:13.317+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:25:00+00:00, run_id=scheduled__2024-02-24T01:25:00+00:00, run_start_date=2024-02-24 01:30:01.089260+00:00, run_end_date=2024-02-24 01:30:13.317065+00:00, run_duration=12.227805, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:25:00+00:00, data_interval_end=2024-02-24 01:30:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T01:30:13.324388950Z [2024-02-24T01:30:13.324+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:30:00+00:00, run_after=2024-02-24T01:35:00+00:00 2024-02-24T01:30:13.357157437Z [2024-02-24T01:30:13.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T01:25:00+00:00 exited with status success for try_number 1 2024-02-24T01:30:13.362783773Z [2024-02-24T01:30:13.362+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T01:25:00+00:00, map_index=-1, run_start_date=2024-02-24 01:30:12.198420+00:00, run_end_date=2024-02-24 01:30:12.541168+00:00, run_duration=0.342748, state=success, executor_state=success, try_number=1, max_tries=1, job_id=531, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:30:10.547688+00:00, queued_by_job_id=2, pid=7771 2024-02-24T01:31:01.019525123Z [2024-02-24T01:31:01.019+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:31:00+00:00, run_after=2024-02-24T01:32:00+00:00 2024-02-24T01:31:01.038543405Z [2024-02-24T01:31:01.038+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:31:00+00:00, run_after=2024-02-24T01:32:00+00:00 2024-02-24T01:31:01.047567263Z [2024-02-24T01:31:01.047+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:31:01.116138764Z [2024-02-24T01:31:01.115+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T01:31:01.116172140Z 2024-02-24T01:31:01.116178566Z 2024-02-24T01:31:01.116183912Z 2024-02-24T01:31:01.116190034Z [2024-02-24T01:31:01.115+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:31:01.116302095Z [2024-02-24T01:31:01.116+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:31:01.116473092Z [2024-02-24T01:31:01.116+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:31:01.117451596Z [2024-02-24T01:31:01.117+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:31:01.117470330Z 2024-02-24T01:31:01.117475798Z 2024-02-24T01:31:01.117480431Z 2024-02-24T01:31:01.121756722Z [2024-02-24T01:31:01.121+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:31:01.121917783Z [2024-02-24T01:31:01.121+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:31:01.122339548Z [2024-02-24T01:31:01.122+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:31:01.122542579Z [2024-02-24T01:31:01.122+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:31:01.122837602Z [2024-02-24T01:31:01.122+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:31:01.123003343Z [2024-02-24T01:31:01.122+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:31:01.517211822Z [2024-02-24T01:31:01.516+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:30:00+00:00 exited with status queued for try_number 1 2024-02-24T01:31:01.520468028Z [2024-02-24T01:31:01.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:30:00+00:00 exited with status queued for try_number 1 2024-02-24T01:31:01.520668990Z [2024-02-24T01:31:01.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:30:00+00:00 exited with status queued for try_number 1 2024-02-24T01:31:01.538021384Z [2024-02-24T01:31:01.536+0000] {scheduler_job.py:635} INFO - Setting external_id for to b79284dd-c707-4b4f-bfe7-5e4616fea67c 2024-02-24T01:31:01.538220344Z [2024-02-24T01:31:01.538+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f0ced18-7e53-4c49-8146-e287f2fd943d 2024-02-24T01:31:01.538378061Z [2024-02-24T01:31:01.538+0000] {scheduler_job.py:635} INFO - Setting external_id for to 960000e3-3c4e-41dc-a823-c3a6594e98aa 2024-02-24T01:31:02.747515736Z [2024-02-24T01:31:02.747+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:31:02.747730511Z [2024-02-24T01:31:02.747+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:30:00+00:00, run_id=scheduled__2024-02-24T01:30:00+00:00, run_start_date=2024-02-24 01:31:01.057669+00:00, run_end_date=2024-02-24 01:31:02.747397+00:00, run_duration=1.689728, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:30:00+00:00, data_interval_end=2024-02-24 01:31:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:31:02.759860134Z [2024-02-24T01:31:02.759+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:31:00+00:00, run_after=2024-02-24T01:32:00+00:00 2024-02-24T01:31:02.843142458Z [2024-02-24T01:31:02.842+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:30:00+00:00 exited with status success for try_number 1 2024-02-24T01:31:02.851856575Z [2024-02-24T01:31:02.851+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:30:00+00:00, map_index=-1, run_start_date=2024-02-24 01:31:02.018756+00:00, run_end_date=2024-02-24 01:31:02.546732+00:00, run_duration=0.527976, state=success, executor_state=success, try_number=1, max_tries=1, job_id=532, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:31:01.118572+00:00, queued_by_job_id=2, pid=7793 2024-02-24T01:31:06.199411829Z [2024-02-24T01:31:06.198+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:31:06.199711275Z [2024-02-24T01:31:06.199+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:30:00+00:00, run_id=scheduled__2024-02-24T01:30:00+00:00, run_start_date=2024-02-24 01:31:01.059362+00:00, run_end_date=2024-02-24 01:31:06.199299+00:00, run_duration=5.139937, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:30:00+00:00, data_interval_end=2024-02-24 01:31:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:31:06.208899687Z [2024-02-24T01:31:06.208+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:31:00+00:00, run_after=2024-02-24T01:32:00+00:00 2024-02-24T01:31:06.217131531Z [2024-02-24T01:31:06.216+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:31:06.217541120Z [2024-02-24T01:31:06.217+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:30:00+00:00, run_id=scheduled__2024-02-24T01:30:00+00:00, run_start_date=2024-02-24 01:31:01.060533+00:00, run_end_date=2024-02-24 01:31:06.217028+00:00, run_duration=5.156495, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:30:00+00:00, data_interval_end=2024-02-24 01:31:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:31:06.228322961Z [2024-02-24T01:31:06.227+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:31:00+00:00, run_after=2024-02-24T01:32:00+00:00 2024-02-24T01:31:06.260351668Z [2024-02-24T01:31:06.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:30:00+00:00 exited with status success for try_number 1 2024-02-24T01:31:06.260585599Z [2024-02-24T01:31:06.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:30:00+00:00 exited with status success for try_number 1 2024-02-24T01:31:06.270253505Z [2024-02-24T01:31:06.269+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:30:00+00:00, map_index=-1, run_start_date=2024-02-24 01:31:03.208348+00:00, run_end_date=2024-02-24 01:31:05.169485+00:00, run_duration=1.961137, state=success, executor_state=success, try_number=1, max_tries=1, job_id=533, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:31:01.118572+00:00, queued_by_job_id=2, pid=7812 2024-02-24T01:31:06.270567190Z [2024-02-24T01:31:06.270+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:30:00+00:00, map_index=-1, run_start_date=2024-02-24 01:31:03.206989+00:00, run_end_date=2024-02-24 01:31:05.390002+00:00, run_duration=2.183013, state=success, executor_state=success, try_number=1, max_tries=1, job_id=534, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:31:01.118572+00:00, queued_by_job_id=2, pid=7811 2024-02-24T01:32:00.755551922Z [2024-02-24T01:32:00.755+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:32:00+00:00, run_after=2024-02-24T01:33:00+00:00 2024-02-24T01:32:00.763679338Z [2024-02-24T01:32:00.763+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:32:00.776305714Z [2024-02-24T01:32:00.775+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:32:00+00:00, run_after=2024-02-24T01:33:00+00:00 2024-02-24T01:32:00.787545932Z [2024-02-24T01:32:00.787+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:32:00.897424663Z [2024-02-24T01:32:00.897+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T01:32:00.897457187Z 2024-02-24T01:32:00.897464988Z 2024-02-24T01:32:00.897470730Z 2024-02-24T01:32:00.897476419Z 2024-02-24T01:32:00.897629800Z [2024-02-24T01:32:00.897+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T01:32:00.899385341Z [2024-02-24T01:32:00.897+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:32:00.899401601Z [2024-02-24T01:32:00.898+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:32:00.899406384Z [2024-02-24T01:32:00.898+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:32:00.899772838Z [2024-02-24T01:32:00.899+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:32:00.899783683Z 2024-02-24T01:32:00.899790743Z 2024-02-24T01:32:00.899795156Z 2024-02-24T01:32:00.899820787Z 2024-02-24T01:32:00.904502262Z [2024-02-24T01:32:00.904+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:32:00.904695699Z [2024-02-24T01:32:00.904+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T01:32:00.905112333Z [2024-02-24T01:32:00.904+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:32:00.905395864Z [2024-02-24T01:32:00.905+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:32:00.905798401Z [2024-02-24T01:32:00.905+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:32:00.906059735Z [2024-02-24T01:32:00.905+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:32:00.906424856Z [2024-02-24T01:32:00.906+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:32:00.906639195Z [2024-02-24T01:32:00.906+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:32:01.292029660Z [2024-02-24T01:32:01.291+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:30:00+00:00 exited with status queued for try_number 1 2024-02-24T01:32:01.292092691Z [2024-02-24T01:32:01.291+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:31:00+00:00 exited with status queued for try_number 1 2024-02-24T01:32:01.292097210Z [2024-02-24T01:32:01.292+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:31:00+00:00 exited with status queued for try_number 1 2024-02-24T01:32:01.292157724Z [2024-02-24T01:32:01.292+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:31:00+00:00 exited with status queued for try_number 1 2024-02-24T01:32:01.306033750Z [2024-02-24T01:32:01.305+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f0d0607-1271-41cc-8d47-ec58fbcf70c9 2024-02-24T01:32:01.306853539Z [2024-02-24T01:32:01.306+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58b1934f-b769-4667-a4e5-0138fcf7bef9 2024-02-24T01:32:01.306870479Z [2024-02-24T01:32:01.306+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3e25311-fc3f-4424-8e61-98bd8ae08eaf 2024-02-24T01:32:01.306875040Z [2024-02-24T01:32:01.306+0000] {scheduler_job.py:635} INFO - Setting external_id for to 802055dc-d3f7-4b04-9e06-bf98e9d81032 2024-02-24T01:32:02.598336586Z [2024-02-24T01:32:02.597+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:32:02.598854041Z [2024-02-24T01:32:02.598+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 01:30:00+00:00, run_id=scheduled__2024-02-24T01:30:00+00:00, run_start_date=2024-02-24 01:32:00.805619+00:00, run_end_date=2024-02-24 01:32:02.598451+00:00, run_duration=1.792832, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:30:00+00:00, data_interval_end=2024-02-24 01:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T01:32:02.613988642Z [2024-02-24T01:32:02.613+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T01:32:00+00:00, run_after=2024-02-24T01:34:00+00:00 2024-02-24T01:32:02.786276142Z [2024-02-24T01:32:02.785+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:30:00+00:00 exited with status success for try_number 1 2024-02-24T01:32:02.801264078Z [2024-02-24T01:32:02.800+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T01:30:00+00:00, map_index=-1, run_start_date=2024-02-24 01:32:01.734064+00:00, run_end_date=2024-02-24 01:32:02.180285+00:00, run_duration=0.446221, state=success, executor_state=success, try_number=1, max_tries=1, job_id=535, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:32:00.901044+00:00, queued_by_job_id=2, pid=7840 2024-02-24T01:32:02.817175270Z [2024-02-24T01:32:02.816+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T01:32:03.695247535Z [2024-02-24T01:32:03.694+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:32:03.695451422Z [2024-02-24T01:32:03.695+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:31:00+00:00, run_id=scheduled__2024-02-24T01:31:00+00:00, run_start_date=2024-02-24 01:32:00.807959+00:00, run_end_date=2024-02-24 01:32:03.695081+00:00, run_duration=2.887122, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:31:00+00:00, data_interval_end=2024-02-24 01:32:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:32:03.711833171Z [2024-02-24T01:32:03.711+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:32:00+00:00, run_after=2024-02-24T01:33:00+00:00 2024-02-24T01:32:03.799594768Z [2024-02-24T01:32:03.799+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:31:00+00:00 exited with status success for try_number 1 2024-02-24T01:32:03.808198608Z [2024-02-24T01:32:03.807+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:31:00+00:00, map_index=-1, run_start_date=2024-02-24 01:32:02.468192+00:00, run_end_date=2024-02-24 01:32:02.939333+00:00, run_duration=0.471141, state=success, executor_state=success, try_number=1, max_tries=1, job_id=536, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:32:00.901044+00:00, queued_by_job_id=2, pid=7852 2024-02-24T01:32:05.957859569Z [2024-02-24T01:32:05.957+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:32:05.958068567Z [2024-02-24T01:32:05.957+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:31:00+00:00, run_id=scheduled__2024-02-24T01:31:00+00:00, run_start_date=2024-02-24 01:32:00.811389+00:00, run_end_date=2024-02-24 01:32:05.957595+00:00, run_duration=5.146206, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:31:00+00:00, data_interval_end=2024-02-24 01:32:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:32:05.968042295Z [2024-02-24T01:32:05.967+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:32:00+00:00, run_after=2024-02-24T01:33:00+00:00 2024-02-24T01:32:05.975762169Z [2024-02-24T01:32:05.975+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:32:05.976345734Z [2024-02-24T01:32:05.975+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:31:00+00:00, run_id=scheduled__2024-02-24T01:31:00+00:00, run_start_date=2024-02-24 01:32:00.809713+00:00, run_end_date=2024-02-24 01:32:05.975627+00:00, run_duration=5.165914, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:31:00+00:00, data_interval_end=2024-02-24 01:32:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:32:05.991488279Z [2024-02-24T01:32:05.990+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:32:00+00:00, run_after=2024-02-24T01:33:00+00:00 2024-02-24T01:32:06.029900162Z [2024-02-24T01:32:06.029+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:31:00+00:00 exited with status success for try_number 1 2024-02-24T01:32:06.032181762Z [2024-02-24T01:32:06.031+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:31:00+00:00 exited with status success for try_number 1 2024-02-24T01:32:06.040769807Z [2024-02-24T01:32:06.040+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:31:00+00:00, map_index=-1, run_start_date=2024-02-24 01:32:03.075761+00:00, run_end_date=2024-02-24 01:32:04.857820+00:00, run_duration=1.782059, state=success, executor_state=success, try_number=1, max_tries=1, job_id=537, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:32:00.901044+00:00, queued_by_job_id=2, pid=7864 2024-02-24T01:32:06.041260732Z [2024-02-24T01:32:06.041+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:31:00+00:00, map_index=-1, run_start_date=2024-02-24 01:32:03.573503+00:00, run_end_date=2024-02-24 01:32:05.185040+00:00, run_duration=1.611537, state=success, executor_state=success, try_number=1, max_tries=1, job_id=538, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:32:00.901044+00:00, queued_by_job_id=2, pid=7875 2024-02-24T01:33:00.588371792Z [2024-02-24T01:33:00.587+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:33:00.614235930Z [2024-02-24T01:33:00.612+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:33:00+00:00, run_after=2024-02-24T01:34:00+00:00 2024-02-24T01:33:00.676001367Z [2024-02-24T01:33:00.675+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-02-24T01:33:00.676043244Z 2024-02-24T01:33:00.676051101Z 2024-02-24T01:33:00.676436498Z [2024-02-24T01:33:00.675+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:33:00.676738608Z [2024-02-24T01:33:00.676+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:33:00.677458142Z [2024-02-24T01:33:00.677+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:33:00.677496171Z 2024-02-24T01:33:00.677504382Z 2024-02-24T01:33:00.680230017Z [2024-02-24T01:33:00.679+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:33:00.680432384Z [2024-02-24T01:33:00.680+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:33:00.680745831Z [2024-02-24T01:33:00.680+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:33:00.680882747Z [2024-02-24T01:33:00.680+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:33:00.890510933Z [2024-02-24T01:33:00.889+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:32:00+00:00 exited with status queued for try_number 1 2024-02-24T01:33:00.890840258Z [2024-02-24T01:33:00.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:32:00+00:00 exited with status queued for try_number 1 2024-02-24T01:33:00.904611221Z [2024-02-24T01:33:00.904+0000] {scheduler_job.py:635} INFO - Setting external_id for to bffad0a8-a647-407b-b45d-7fd2a480a70d 2024-02-24T01:33:00.904945513Z [2024-02-24T01:33:00.904+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8980fd8b-3c5e-4352-a0e8-98c02d48e13c 2024-02-24T01:33:00.958825100Z [2024-02-24T01:33:00.958+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:33:00+00:00, run_after=2024-02-24T01:34:00+00:00 2024-02-24T01:33:01.083351484Z [2024-02-24T01:33:01.082+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:33:01.083376630Z 2024-02-24T01:33:01.083698953Z [2024-02-24T01:33:01.083+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:33:01.084351221Z [2024-02-24T01:33:01.084+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:33:01.084363060Z 2024-02-24T01:33:01.089911898Z [2024-02-24T01:33:01.089+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:33:01.090206081Z [2024-02-24T01:33:01.090+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:33:01.167064806Z [2024-02-24T01:33:01.166+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:32:00+00:00 exited with status queued for try_number 1 2024-02-24T01:33:01.178224371Z [2024-02-24T01:33:01.177+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58bdce01-747d-45c8-bf3a-840466429a9b 2024-02-24T01:33:03.638493238Z [2024-02-24T01:33:03.637+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:33:03.638566884Z [2024-02-24T01:33:03.638+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:32:00+00:00, run_id=scheduled__2024-02-24T01:32:00+00:00, run_start_date=2024-02-24 01:33:00.981359+00:00, run_end_date=2024-02-24 01:33:03.638219+00:00, run_duration=2.65686, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:32:00+00:00, data_interval_end=2024-02-24 01:33:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:33:03.650135230Z [2024-02-24T01:33:03.649+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:33:00+00:00, run_after=2024-02-24T01:34:00+00:00 2024-02-24T01:33:03.728511183Z [2024-02-24T01:33:03.727+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:32:00+00:00 exited with status success for try_number 1 2024-02-24T01:33:03.737579784Z [2024-02-24T01:33:03.737+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:32:00+00:00, map_index=-1, run_start_date=2024-02-24 01:33:02.344759+00:00, run_end_date=2024-02-24 01:33:02.982538+00:00, run_duration=0.637779, state=success, executor_state=success, try_number=1, max_tries=1, job_id=539, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:33:01.087451+00:00, queued_by_job_id=2, pid=7905 2024-02-24T01:33:05.709081853Z [2024-02-24T01:33:05.708+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:33:05.709148761Z [2024-02-24T01:33:05.708+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:32:00+00:00, run_id=scheduled__2024-02-24T01:32:00+00:00, run_start_date=2024-02-24 01:33:00.630628+00:00, run_end_date=2024-02-24 01:33:05.708889+00:00, run_duration=5.078261, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:32:00+00:00, data_interval_end=2024-02-24 01:33:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:33:05.718088698Z [2024-02-24T01:33:05.717+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:33:00+00:00, run_after=2024-02-24T01:34:00+00:00 2024-02-24T01:33:05.724821299Z [2024-02-24T01:33:05.724+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:33:05.725010198Z [2024-02-24T01:33:05.724+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:32:00+00:00, run_id=scheduled__2024-02-24T01:32:00+00:00, run_start_date=2024-02-24 01:33:00.629122+00:00, run_end_date=2024-02-24 01:33:05.724527+00:00, run_duration=5.095405, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:32:00+00:00, data_interval_end=2024-02-24 01:33:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:33:05.735363359Z [2024-02-24T01:33:05.735+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:33:00+00:00, run_after=2024-02-24T01:34:00+00:00 2024-02-24T01:33:05.763095617Z [2024-02-24T01:33:05.762+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:32:00+00:00 exited with status success for try_number 1 2024-02-24T01:33:05.763131317Z [2024-02-24T01:33:05.762+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:32:00+00:00 exited with status success for try_number 1 2024-02-24T01:33:05.769747881Z [2024-02-24T01:33:05.769+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:32:00+00:00, map_index=-1, run_start_date=2024-02-24 01:33:03.032779+00:00, run_end_date=2024-02-24 01:33:04.763821+00:00, run_duration=1.731042, state=success, executor_state=success, try_number=1, max_tries=1, job_id=540, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:33:00.678098+00:00, queued_by_job_id=2, pid=7921 2024-02-24T01:33:05.770255901Z [2024-02-24T01:33:05.769+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:32:00+00:00, map_index=-1, run_start_date=2024-02-24 01:33:03.144407+00:00, run_end_date=2024-02-24 01:33:05.456449+00:00, run_duration=2.312042, state=success, executor_state=success, try_number=1, max_tries=1, job_id=541, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:33:00.678098+00:00, queued_by_job_id=2, pid=7922 2024-02-24T01:34:00.199456567Z [2024-02-24T01:34:00.198+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:34:00.220594219Z [2024-02-24T01:34:00.218+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:34:00+00:00, run_after=2024-02-24T01:35:00+00:00 2024-02-24T01:34:00.235134340Z [2024-02-24T01:34:00.234+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:34:00+00:00, run_after=2024-02-24T01:35:00+00:00 2024-02-24T01:34:00.243101906Z [2024-02-24T01:34:00.242+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:34:00.349341251Z [2024-02-24T01:34:00.348+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T01:34:00.349367938Z 2024-02-24T01:34:00.349378063Z 2024-02-24T01:34:00.349382435Z 2024-02-24T01:34:00.349386568Z 2024-02-24T01:34:00.349740638Z [2024-02-24T01:34:00.349+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T01:34:00.350165533Z [2024-02-24T01:34:00.349+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:34:00.350452281Z [2024-02-24T01:34:00.350+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:34:00.350753033Z [2024-02-24T01:34:00.350+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:34:00.351715336Z [2024-02-24T01:34:00.351+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:34:00.351729707Z 2024-02-24T01:34:00.351734818Z 2024-02-24T01:34:00.351739202Z 2024-02-24T01:34:00.351743436Z 2024-02-24T01:34:00.356284354Z [2024-02-24T01:34:00.356+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:34:00.356622195Z [2024-02-24T01:34:00.356+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T01:34:00.357011990Z [2024-02-24T01:34:00.356+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:34:00.357299721Z [2024-02-24T01:34:00.357+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:34:00.357679237Z [2024-02-24T01:34:00.357+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:34:00.357965070Z [2024-02-24T01:34:00.357+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:34:00.358336302Z [2024-02-24T01:34:00.358+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:34:00.358658028Z [2024-02-24T01:34:00.358+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:34:00.744784049Z [2024-02-24T01:34:00.742+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:32:00+00:00 exited with status queued for try_number 1 2024-02-24T01:34:00.745335408Z [2024-02-24T01:34:00.744+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:33:00+00:00 exited with status queued for try_number 1 2024-02-24T01:34:00.745645549Z [2024-02-24T01:34:00.745+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:33:00+00:00 exited with status queued for try_number 1 2024-02-24T01:34:00.745894645Z [2024-02-24T01:34:00.745+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:33:00+00:00 exited with status queued for try_number 1 2024-02-24T01:34:00.767298761Z [2024-02-24T01:34:00.766+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64a7ce20-add7-4ed9-8e34-ac79720cf350 2024-02-24T01:34:00.767611264Z [2024-02-24T01:34:00.767+0000] {scheduler_job.py:635} INFO - Setting external_id for to 19914eb5-e71b-4a2e-ae23-8e8bf0cb7519 2024-02-24T01:34:00.767830456Z [2024-02-24T01:34:00.767+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8667a1b8-62af-430f-b25f-a3cd6ac70fc5 2024-02-24T01:34:00.768046908Z [2024-02-24T01:34:00.767+0000] {scheduler_job.py:635} INFO - Setting external_id for to f47b97d3-819d-4ec1-8053-63dc3ee2c494 2024-02-24T01:34:02.040309833Z [2024-02-24T01:34:02.039+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:34:02.040552914Z [2024-02-24T01:34:02.040+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 01:32:00+00:00, run_id=scheduled__2024-02-24T01:32:00+00:00, run_start_date=2024-02-24 01:34:00.257714+00:00, run_end_date=2024-02-24 01:34:02.040236+00:00, run_duration=1.782522, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:32:00+00:00, data_interval_end=2024-02-24 01:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T01:34:02.048578691Z [2024-02-24T01:34:02.048+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T01:34:00+00:00, run_after=2024-02-24T01:36:00+00:00 2024-02-24T01:34:02.067412709Z [2024-02-24T01:34:02.067+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:34:02.067557143Z [2024-02-24T01:34:02.067+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:33:00+00:00, run_id=scheduled__2024-02-24T01:33:00+00:00, run_start_date=2024-02-24 01:34:00.259274+00:00, run_end_date=2024-02-24 01:34:02.067331+00:00, run_duration=1.808057, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:33:00+00:00, data_interval_end=2024-02-24 01:34:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:34:02.078785941Z [2024-02-24T01:34:02.078+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:34:00+00:00, run_after=2024-02-24T01:35:00+00:00 2024-02-24T01:34:02.115644131Z [2024-02-24T01:34:02.115+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:32:00+00:00 exited with status success for try_number 1 2024-02-24T01:34:02.115668498Z [2024-02-24T01:34:02.115+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:33:00+00:00 exited with status success for try_number 1 2024-02-24T01:34:02.123871230Z [2024-02-24T01:34:02.123+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T01:32:00+00:00, map_index=-1, run_start_date=2024-02-24 01:34:01.208947+00:00, run_end_date=2024-02-24 01:34:01.692867+00:00, run_duration=0.48392, state=success, executor_state=success, try_number=1, max_tries=1, job_id=543, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:34:00.353172+00:00, queued_by_job_id=2, pid=7955 2024-02-24T01:34:02.123965177Z [2024-02-24T01:34:02.123+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:33:00+00:00, map_index=-1, run_start_date=2024-02-24 01:34:01.252090+00:00, run_end_date=2024-02-24 01:34:01.768772+00:00, run_duration=0.516682, state=success, executor_state=success, try_number=1, max_tries=1, job_id=542, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:34:00.353172+00:00, queued_by_job_id=2, pid=7956 2024-02-24T01:34:05.423929814Z [2024-02-24T01:34:05.423+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:34:05.424121576Z [2024-02-24T01:34:05.423+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:33:00+00:00, run_id=scheduled__2024-02-24T01:33:00+00:00, run_start_date=2024-02-24 01:34:00.262064+00:00, run_end_date=2024-02-24 01:34:05.423735+00:00, run_duration=5.161671, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:33:00+00:00, data_interval_end=2024-02-24 01:34:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:34:05.433051958Z [2024-02-24T01:34:05.432+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:34:00+00:00, run_after=2024-02-24T01:35:00+00:00 2024-02-24T01:34:05.439956206Z [2024-02-24T01:34:05.439+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:34:05.440030187Z [2024-02-24T01:34:05.439+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:33:00+00:00, run_id=scheduled__2024-02-24T01:33:00+00:00, run_start_date=2024-02-24 01:34:00.260686+00:00, run_end_date=2024-02-24 01:34:05.439780+00:00, run_duration=5.179094, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:33:00+00:00, data_interval_end=2024-02-24 01:34:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:34:05.449325613Z [2024-02-24T01:34:05.448+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:34:00+00:00, run_after=2024-02-24T01:35:00+00:00 2024-02-24T01:34:05.508756178Z [2024-02-24T01:34:05.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:33:00+00:00 exited with status success for try_number 1 2024-02-24T01:34:05.509103603Z [2024-02-24T01:34:05.508+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:33:00+00:00 exited with status success for try_number 1 2024-02-24T01:34:05.522899662Z [2024-02-24T01:34:05.522+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:33:00+00:00, map_index=-1, run_start_date=2024-02-24 01:34:02.991689+00:00, run_end_date=2024-02-24 01:34:04.963940+00:00, run_duration=1.972251, state=success, executor_state=success, try_number=1, max_tries=1, job_id=544, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:34:00.353172+00:00, queued_by_job_id=2, pid=7980 2024-02-24T01:34:05.523257651Z [2024-02-24T01:34:05.522+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:33:00+00:00, map_index=-1, run_start_date=2024-02-24 01:34:02.996188+00:00, run_end_date=2024-02-24 01:34:04.503184+00:00, run_duration=1.506996, state=success, executor_state=success, try_number=1, max_tries=1, job_id=545, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:34:00.353172+00:00, queued_by_job_id=2, pid=7979 2024-02-24T01:35:00.678913154Z [2024-02-24T01:35:00.678+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:35:00.696728642Z [2024-02-24T01:35:00.696+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:35:00+00:00, run_after=2024-02-24T01:36:00+00:00 2024-02-24T01:35:00.714172622Z [2024-02-24T01:35:00.713+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:35:00+00:00, run_after=2024-02-24T01:36:00+00:00 2024-02-24T01:35:00.732065343Z [2024-02-24T01:35:00.731+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:35:00+00:00, run_after=2024-02-24T01:40:00+00:00 2024-02-24T01:35:00.858231082Z [2024-02-24T01:35:00.857+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T01:35:00.858267177Z 2024-02-24T01:35:00.858292970Z 2024-02-24T01:35:00.858300222Z 2024-02-24T01:35:00.858305553Z 2024-02-24T01:35:00.858457616Z [2024-02-24T01:35:00.858+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:35:00.858715867Z [2024-02-24T01:35:00.858+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:35:00.858901644Z [2024-02-24T01:35:00.858+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:35:00.859087068Z [2024-02-24T01:35:00.858+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:35:00.859914194Z [2024-02-24T01:35:00.859+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:35:00.859943519Z 2024-02-24T01:35:00.859953420Z 2024-02-24T01:35:00.859962354Z 2024-02-24T01:35:00.859971707Z 2024-02-24T01:35:00.864234395Z [2024-02-24T01:35:00.863+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T01:35:00.864462282Z [2024-02-24T01:35:00.864+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T01:35:00.864752494Z [2024-02-24T01:35:00.864+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:35:00.864927475Z [2024-02-24T01:35:00.864+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:35:00.865223117Z [2024-02-24T01:35:00.865+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:35:00.865428813Z [2024-02-24T01:35:00.865+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:35:00.865722896Z [2024-02-24T01:35:00.865+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:35:00.865876241Z [2024-02-24T01:35:00.865+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:35:01.441283063Z [2024-02-24T01:35:01.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T01:30:00+00:00 exited with status queued for try_number 1 2024-02-24T01:35:01.441425864Z [2024-02-24T01:35:01.441+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:34:00+00:00 exited with status queued for try_number 1 2024-02-24T01:35:01.441873319Z [2024-02-24T01:35:01.441+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:34:00+00:00 exited with status queued for try_number 1 2024-02-24T01:35:01.442194277Z [2024-02-24T01:35:01.441+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:34:00+00:00 exited with status queued for try_number 1 2024-02-24T01:35:01.454364008Z [2024-02-24T01:35:01.453+0000] {scheduler_job.py:635} INFO - Setting external_id for to 14db5997-8f8b-4fbf-b012-ea5221c91180 2024-02-24T01:35:01.454400783Z [2024-02-24T01:35:01.454+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c117266-9957-49a4-ab5e-86570a69a9c1 2024-02-24T01:35:01.454552295Z [2024-02-24T01:35:01.454+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa3d53cc-4e49-46bc-b1c2-e7b18597b528 2024-02-24T01:35:01.454622578Z [2024-02-24T01:35:01.454+0000] {scheduler_job.py:635} INFO - Setting external_id for to b250a5e6-4bde-4c0a-8ed1-61cd7d889a6c 2024-02-24T01:35:02.936493323Z [2024-02-24T01:35:02.936+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:35:02.936913258Z [2024-02-24T01:35:02.936+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:34:00+00:00, run_id=scheduled__2024-02-24T01:34:00+00:00, run_start_date=2024-02-24 01:35:00.751637+00:00, run_end_date=2024-02-24 01:35:02.936565+00:00, run_duration=2.184928, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:34:00+00:00, data_interval_end=2024-02-24 01:35:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:35:02.948988105Z [2024-02-24T01:35:02.948+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:35:00+00:00, run_after=2024-02-24T01:36:00+00:00 2024-02-24T01:35:03.008663932Z [2024-02-24T01:35:03.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:34:00+00:00 exited with status success for try_number 1 2024-02-24T01:35:03.016653586Z [2024-02-24T01:35:03.016+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:34:00+00:00, map_index=-1, run_start_date=2024-02-24 01:35:01.930869+00:00, run_end_date=2024-02-24 01:35:02.382838+00:00, run_duration=0.451969, state=success, executor_state=success, try_number=1, max_tries=1, job_id=546, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:35:00.861076+00:00, queued_by_job_id=2, pid=8013 2024-02-24T01:35:04.128359260Z [2024-02-24T01:35:04.127+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:35:04.128398089Z 2024-02-24T01:35:04.128641568Z [2024-02-24T01:35:04.128+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:35:04.130056103Z [2024-02-24T01:35:04.129+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:35:04.130072744Z 2024-02-24T01:35:04.137559708Z [2024-02-24T01:35:04.137+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T01:35:04.137765974Z [2024-02-24T01:35:04.137+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T01:35:04.203018825Z [2024-02-24T01:35:04.202+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T01:30:00+00:00 exited with status queued for try_number 1 2024-02-24T01:35:04.203370453Z [2024-02-24T01:35:04.202+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T01:30:00+00:00 exited with status success for try_number 1 2024-02-24T01:35:04.212237800Z [2024-02-24T01:35:04.211+0000] {scheduler_job.py:635} INFO - Setting external_id for to 606abe6e-a752-43fe-a146-bc2b60f633f2 2024-02-24T01:35:04.212665056Z [2024-02-24T01:35:04.212+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T01:30:00+00:00, map_index=-1, run_start_date=2024-02-24 01:35:03.273477+00:00, run_end_date=2024-02-24 01:35:03.797938+00:00, run_duration=0.524461, state=success, executor_state=success, try_number=1, max_tries=1, job_id=549, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:35:00.861076+00:00, queued_by_job_id=2, pid=8039 2024-02-24T01:35:05.379118492Z [2024-02-24T01:35:05.378+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:35:05.379769172Z [2024-02-24T01:35:05.379+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:34:00+00:00, run_id=scheduled__2024-02-24T01:34:00+00:00, run_start_date=2024-02-24 01:35:00.754584+00:00, run_end_date=2024-02-24 01:35:05.378974+00:00, run_duration=4.62439, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:34:00+00:00, data_interval_end=2024-02-24 01:35:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:35:05.393130440Z [2024-02-24T01:35:05.392+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:35:00+00:00, run_after=2024-02-24T01:36:00+00:00 2024-02-24T01:35:05.401832844Z [2024-02-24T01:35:05.401+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:35:05.402225113Z [2024-02-24T01:35:05.401+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:34:00+00:00, run_id=scheduled__2024-02-24T01:34:00+00:00, run_start_date=2024-02-24 01:35:00.753138+00:00, run_end_date=2024-02-24 01:35:05.401689+00:00, run_duration=4.648551, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:34:00+00:00, data_interval_end=2024-02-24 01:35:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:35:05.413637388Z [2024-02-24T01:35:05.413+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:35:00+00:00, run_after=2024-02-24T01:36:00+00:00 2024-02-24T01:35:05.475033252Z [2024-02-24T01:35:05.474+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:34:00+00:00 exited with status success for try_number 1 2024-02-24T01:35:05.475141560Z [2024-02-24T01:35:05.474+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:34:00+00:00 exited with status success for try_number 1 2024-02-24T01:35:05.483974996Z [2024-02-24T01:35:05.483+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:34:00+00:00, map_index=-1, run_start_date=2024-02-24 01:35:03.145699+00:00, run_end_date=2024-02-24 01:35:04.984076+00:00, run_duration=1.838377, state=success, executor_state=success, try_number=1, max_tries=1, job_id=547, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:35:00.861076+00:00, queued_by_job_id=2, pid=8038 2024-02-24T01:35:05.484032238Z [2024-02-24T01:35:05.483+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:34:00+00:00, map_index=-1, run_start_date=2024-02-24 01:35:03.145024+00:00, run_end_date=2024-02-24 01:35:04.617473+00:00, run_duration=1.472449, state=success, executor_state=success, try_number=1, max_tries=1, job_id=548, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:35:00.861076+00:00, queued_by_job_id=2, pid=8037 2024-02-24T01:35:06.586158619Z [2024-02-24T01:35:06.585+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:35:06.586197985Z 2024-02-24T01:35:06.586520959Z [2024-02-24T01:35:06.586+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:35:06.587778177Z [2024-02-24T01:35:06.587+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:35:06.587818747Z 2024-02-24T01:35:06.591889305Z [2024-02-24T01:35:06.591+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T01:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T01:35:06.592398238Z [2024-02-24T01:35:06.591+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T01:35:06.653871216Z [2024-02-24T01:35:06.653+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T01:30:00+00:00 exited with status queued for try_number 1 2024-02-24T01:35:06.654248046Z [2024-02-24T01:35:06.653+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T01:30:00+00:00 exited with status success for try_number 1 2024-02-24T01:35:06.663021845Z [2024-02-24T01:35:06.662+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa913da0-540f-4cb5-9e71-515f03d9f359 2024-02-24T01:35:06.663545614Z [2024-02-24T01:35:06.663+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T01:30:00+00:00, map_index=-1, run_start_date=2024-02-24 01:35:05.832280+00:00, run_end_date=2024-02-24 01:35:06.208488+00:00, run_duration=0.376208, state=success, executor_state=success, try_number=1, max_tries=1, job_id=550, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:35:04.130559+00:00, queued_by_job_id=2, pid=8062 2024-02-24T01:35:08.662145473Z [2024-02-24T01:35:08.657+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:35:08.662172887Z 2024-02-24T01:35:08.662318767Z [2024-02-24T01:35:08.662+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:35:08.663305236Z [2024-02-24T01:35:08.663+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:35:08.663312257Z 2024-02-24T01:35:08.666860440Z [2024-02-24T01:35:08.666+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:35:08.666927600Z [2024-02-24T01:35:08.666+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T01:35:08.717971171Z [2024-02-24T01:35:08.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T01:30:00+00:00 exited with status queued for try_number 1 2024-02-24T01:35:08.718082742Z [2024-02-24T01:35:08.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T01:30:00+00:00 exited with status success for try_number 1 2024-02-24T01:35:08.723729997Z [2024-02-24T01:35:08.723+0000] {scheduler_job.py:635} INFO - Setting external_id for to be36607e-e32f-408f-b5b1-7fc59d155c72 2024-02-24T01:35:08.724110593Z [2024-02-24T01:35:08.723+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T01:30:00+00:00, map_index=0, run_start_date=2024-02-24 01:35:08.184817+00:00, run_end_date=2024-02-24 01:35:08.556293+00:00, run_duration=0.371476, state=success, executor_state=success, try_number=1, max_tries=1, job_id=551, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:35:06.588375+00:00, queued_by_job_id=2, pid=8070 2024-02-24T01:35:10.969642360Z [2024-02-24T01:35:10.968+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:35:10.969917316Z [2024-02-24T01:35:10.969+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:30:00+00:00, run_id=scheduled__2024-02-24T01:30:00+00:00, run_start_date=2024-02-24 01:35:00.749965+00:00, run_end_date=2024-02-24 01:35:10.969272+00:00, run_duration=10.219307, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:30:00+00:00, data_interval_end=2024-02-24 01:35:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T01:35:10.977973259Z [2024-02-24T01:35:10.977+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:35:00+00:00, run_after=2024-02-24T01:40:00+00:00 2024-02-24T01:35:11.015333886Z [2024-02-24T01:35:11.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T01:30:00+00:00 exited with status success for try_number 1 2024-02-24T01:35:11.022442161Z [2024-02-24T01:35:11.021+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T01:30:00+00:00, map_index=-1, run_start_date=2024-02-24 01:35:10.312988+00:00, run_end_date=2024-02-24 01:35:10.724806+00:00, run_duration=0.411818, state=success, executor_state=success, try_number=1, max_tries=1, job_id=552, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:35:08.664006+00:00, queued_by_job_id=2, pid=8078 2024-02-24T01:36:00.172277243Z [2024-02-24T01:36:00.171+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:36:00+00:00, run_after=2024-02-24T01:37:00+00:00 2024-02-24T01:36:00.179098403Z [2024-02-24T01:36:00.178+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:36:00.185370380Z [2024-02-24T01:36:00.185+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:36:00.205882407Z [2024-02-24T01:36:00.204+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:36:00+00:00, run_after=2024-02-24T01:37:00+00:00 2024-02-24T01:36:00.321023206Z [2024-02-24T01:36:00.320+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T01:36:00.321052330Z 2024-02-24T01:36:00.321057752Z 2024-02-24T01:36:00.321062237Z 2024-02-24T01:36:00.321066256Z 2024-02-24T01:36:00.321382223Z [2024-02-24T01:36:00.321+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T01:36:00.321811029Z [2024-02-24T01:36:00.321+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:36:00.322081411Z [2024-02-24T01:36:00.321+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:36:00.322369997Z [2024-02-24T01:36:00.322+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:36:00.325192060Z [2024-02-24T01:36:00.324+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:36:00.325212099Z 2024-02-24T01:36:00.325218518Z 2024-02-24T01:36:00.325224331Z 2024-02-24T01:36:00.325230006Z 2024-02-24T01:36:00.332058566Z [2024-02-24T01:36:00.331+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:36:00.332332335Z [2024-02-24T01:36:00.332+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T01:36:00.332801401Z [2024-02-24T01:36:00.332+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:36:00.333032031Z [2024-02-24T01:36:00.332+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:36:00.333401432Z [2024-02-24T01:36:00.333+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:36:00.333623125Z [2024-02-24T01:36:00.333+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:36:00.334050850Z [2024-02-24T01:36:00.333+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:36:00.334300860Z [2024-02-24T01:36:00.333+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:36:00.573085130Z [2024-02-24T01:36:00.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:34:00+00:00 exited with status queued for try_number 1 2024-02-24T01:36:00.573385964Z [2024-02-24T01:36:00.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:35:00+00:00 exited with status queued for try_number 1 2024-02-24T01:36:00.573618075Z [2024-02-24T01:36:00.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:35:00+00:00 exited with status queued for try_number 1 2024-02-24T01:36:00.573842501Z [2024-02-24T01:36:00.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:35:00+00:00 exited with status queued for try_number 1 2024-02-24T01:36:00.595172121Z [2024-02-24T01:36:00.594+0000] {scheduler_job.py:635} INFO - Setting external_id for to 378cf407-036a-4584-b9bf-9e53fa03c342 2024-02-24T01:36:00.595320212Z [2024-02-24T01:36:00.595+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30ed779b-86ff-4ded-8dd7-d805a32cd46e 2024-02-24T01:36:00.595452789Z [2024-02-24T01:36:00.595+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0bf3b455-5e8f-4a38-a72d-e1eca6eb1f78 2024-02-24T01:36:00.595609764Z [2024-02-24T01:36:00.595+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e14bc8c-91e9-4cdd-a33d-15fccc9d22b3 2024-02-24T01:36:01.759615600Z [2024-02-24T01:36:01.757+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:36:01.760339348Z [2024-02-24T01:36:01.759+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 01:34:00+00:00, run_id=scheduled__2024-02-24T01:34:00+00:00, run_start_date=2024-02-24 01:36:00.222594+00:00, run_end_date=2024-02-24 01:36:01.759734+00:00, run_duration=1.53714, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:34:00+00:00, data_interval_end=2024-02-24 01:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T01:36:01.774612074Z [2024-02-24T01:36:01.774+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T01:36:00+00:00, run_after=2024-02-24T01:38:00+00:00 2024-02-24T01:36:01.830360929Z [2024-02-24T01:36:01.829+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:36:01.830594991Z [2024-02-24T01:36:01.830+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:35:00+00:00, run_id=scheduled__2024-02-24T01:35:00+00:00, run_start_date=2024-02-24 01:36:00.225576+00:00, run_end_date=2024-02-24 01:36:01.829894+00:00, run_duration=1.604318, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:35:00+00:00, data_interval_end=2024-02-24 01:36:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:36:01.848073375Z [2024-02-24T01:36:01.847+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:36:00+00:00, run_after=2024-02-24T01:37:00+00:00 2024-02-24T01:36:02.935890601Z [2024-02-24T01:36:02.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:34:00+00:00 exited with status success for try_number 1 2024-02-24T01:36:02.936192598Z [2024-02-24T01:36:02.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:35:00+00:00 exited with status success for try_number 1 2024-02-24T01:36:02.948688627Z [2024-02-24T01:36:02.948+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T01:34:00+00:00, map_index=-1, run_start_date=2024-02-24 01:36:01.332550+00:00, run_end_date=2024-02-24 01:36:01.679522+00:00, run_duration=0.346972, state=success, executor_state=success, try_number=1, max_tries=1, job_id=553, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:36:00.327307+00:00, queued_by_job_id=2, pid=8103 2024-02-24T01:36:02.948914437Z [2024-02-24T01:36:02.948+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:35:00+00:00, map_index=-1, run_start_date=2024-02-24 01:36:01.256795+00:00, run_end_date=2024-02-24 01:36:01.802064+00:00, run_duration=0.545269, state=success, executor_state=success, try_number=1, max_tries=1, job_id=554, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:36:00.327307+00:00, queued_by_job_id=2, pid=8101 2024-02-24T01:36:04.015203080Z [2024-02-24T01:36:04.014+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:36:04.015484220Z [2024-02-24T01:36:04.015+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:35:00+00:00, run_id=scheduled__2024-02-24T01:35:00+00:00, run_start_date=2024-02-24 01:36:00.227857+00:00, run_end_date=2024-02-24 01:36:04.014990+00:00, run_duration=3.787133, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:35:00+00:00, data_interval_end=2024-02-24 01:36:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:36:04.024087980Z [2024-02-24T01:36:04.023+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:36:00+00:00, run_after=2024-02-24T01:37:00+00:00 2024-02-24T01:36:04.031290686Z [2024-02-24T01:36:04.030+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:36:04.031641250Z [2024-02-24T01:36:04.031+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:35:00+00:00, run_id=scheduled__2024-02-24T01:35:00+00:00, run_start_date=2024-02-24 01:36:00.230046+00:00, run_end_date=2024-02-24 01:36:04.031155+00:00, run_duration=3.801109, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:35:00+00:00, data_interval_end=2024-02-24 01:36:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:36:04.040896898Z [2024-02-24T01:36:04.040+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:36:00+00:00, run_after=2024-02-24T01:37:00+00:00 2024-02-24T01:36:04.072611540Z [2024-02-24T01:36:04.072+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:35:00+00:00 exited with status success for try_number 1 2024-02-24T01:36:04.077364774Z [2024-02-24T01:36:04.076+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:35:00+00:00, map_index=-1, run_start_date=2024-02-24 01:36:02.182042+00:00, run_end_date=2024-02-24 01:36:03.586822+00:00, run_duration=1.40478, state=success, executor_state=success, try_number=1, max_tries=1, job_id=555, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:36:00.327307+00:00, queued_by_job_id=2, pid=8125 2024-02-24T01:36:05.142090040Z [2024-02-24T01:36:05.141+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:35:00+00:00 exited with status success for try_number 1 2024-02-24T01:36:05.147751545Z [2024-02-24T01:36:05.147+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:35:00+00:00, map_index=-1, run_start_date=2024-02-24 01:36:02.266186+00:00, run_end_date=2024-02-24 01:36:03.945513+00:00, run_duration=1.679327, state=success, executor_state=success, try_number=1, max_tries=1, job_id=556, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:36:00.327307+00:00, queued_by_job_id=2, pid=8126 2024-02-24T01:37:00.673199100Z [2024-02-24T01:37:00.672+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:37:00.698375401Z [2024-02-24T01:37:00.697+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:37:00+00:00, run_after=2024-02-24T01:38:00+00:00 2024-02-24T01:37:00.716766594Z [2024-02-24T01:37:00.716+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:37:00+00:00, run_after=2024-02-24T01:38:00+00:00 2024-02-24T01:37:00.848190321Z [2024-02-24T01:37:00.847+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T01:37:00.848230978Z 2024-02-24T01:37:00.848238900Z 2024-02-24T01:37:00.848245596Z 2024-02-24T01:37:00.848421974Z [2024-02-24T01:37:00.848+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:37:00.848757556Z [2024-02-24T01:37:00.848+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:37:00.848985978Z [2024-02-24T01:37:00.848+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:37:00.850191009Z [2024-02-24T01:37:00.849+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:37:00.850213056Z 2024-02-24T01:37:00.850220246Z 2024-02-24T01:37:00.850227033Z 2024-02-24T01:37:00.854291124Z [2024-02-24T01:37:00.853+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:37:00.854434700Z [2024-02-24T01:37:00.854+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:37:00.854669284Z [2024-02-24T01:37:00.854+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:37:00.854770456Z [2024-02-24T01:37:00.854+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:37:00.855023270Z [2024-02-24T01:37:00.854+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:37:00.855151804Z [2024-02-24T01:37:00.854+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:37:01.099080703Z [2024-02-24T01:37:01.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:36:00+00:00 exited with status queued for try_number 1 2024-02-24T01:37:01.099260844Z [2024-02-24T01:37:01.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:36:00+00:00 exited with status queued for try_number 1 2024-02-24T01:37:01.099416233Z [2024-02-24T01:37:01.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:36:00+00:00 exited with status queued for try_number 1 2024-02-24T01:37:01.110416670Z [2024-02-24T01:37:01.110+0000] {scheduler_job.py:635} INFO - Setting external_id for to 66867d46-ff63-444d-aa24-640a02a0c3fc 2024-02-24T01:37:01.110627309Z [2024-02-24T01:37:01.110+0000] {scheduler_job.py:635} INFO - Setting external_id for to b8e1bd54-a15b-46c5-88ad-33e1674926c5 2024-02-24T01:37:01.110820743Z [2024-02-24T01:37:01.110+0000] {scheduler_job.py:635} INFO - Setting external_id for to 89f0d9bf-e796-455b-bcf1-b94a61fad5d4 2024-02-24T01:37:02.445384649Z [2024-02-24T01:37:02.444+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:37:02.445976707Z [2024-02-24T01:37:02.445+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:36:00+00:00, run_id=scheduled__2024-02-24T01:36:00+00:00, run_start_date=2024-02-24 01:37:00.749139+00:00, run_end_date=2024-02-24 01:37:02.445258+00:00, run_duration=1.696119, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:36:00+00:00, data_interval_end=2024-02-24 01:37:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:37:02.457237437Z [2024-02-24T01:37:02.455+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:37:00+00:00, run_after=2024-02-24T01:38:00+00:00 2024-02-24T01:37:02.495218016Z [2024-02-24T01:37:02.494+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:36:00+00:00 exited with status success for try_number 1 2024-02-24T01:37:02.501613537Z [2024-02-24T01:37:02.501+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:36:00+00:00, map_index=-1, run_start_date=2024-02-24 01:37:01.847277+00:00, run_end_date=2024-02-24 01:37:02.233188+00:00, run_duration=0.385911, state=success, executor_state=success, try_number=1, max_tries=1, job_id=557, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:37:00.850896+00:00, queued_by_job_id=2, pid=8158 2024-02-24T01:37:02.952836562Z [2024-02-24T01:37:02.952+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T01:37:06.059647488Z [2024-02-24T01:37:06.059+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:37:06.060181296Z [2024-02-24T01:37:06.059+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:36:00+00:00, run_id=scheduled__2024-02-24T01:36:00+00:00, run_start_date=2024-02-24 01:37:00.753331+00:00, run_end_date=2024-02-24 01:37:06.059728+00:00, run_duration=5.306397, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:36:00+00:00, data_interval_end=2024-02-24 01:37:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:37:06.074950742Z [2024-02-24T01:37:06.074+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:37:00+00:00, run_after=2024-02-24T01:38:00+00:00 2024-02-24T01:37:06.083181512Z [2024-02-24T01:37:06.082+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:37:06.083465300Z [2024-02-24T01:37:06.083+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:36:00+00:00, run_id=scheduled__2024-02-24T01:36:00+00:00, run_start_date=2024-02-24 01:37:00.751530+00:00, run_end_date=2024-02-24 01:37:06.083104+00:00, run_duration=5.331574, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:36:00+00:00, data_interval_end=2024-02-24 01:37:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:37:06.098002346Z [2024-02-24T01:37:06.097+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:37:00+00:00, run_after=2024-02-24T01:38:00+00:00 2024-02-24T01:37:06.134900334Z [2024-02-24T01:37:06.134+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:36:00+00:00 exited with status success for try_number 1 2024-02-24T01:37:06.134943963Z [2024-02-24T01:37:06.134+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:36:00+00:00 exited with status success for try_number 1 2024-02-24T01:37:06.144171266Z [2024-02-24T01:37:06.143+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:36:00+00:00, map_index=-1, run_start_date=2024-02-24 01:37:03.033391+00:00, run_end_date=2024-02-24 01:37:05.267561+00:00, run_duration=2.23417, state=success, executor_state=success, try_number=1, max_tries=1, job_id=559, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:37:00.850896+00:00, queued_by_job_id=2, pid=8177 2024-02-24T01:37:06.144301480Z [2024-02-24T01:37:06.144+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:36:00+00:00, map_index=-1, run_start_date=2024-02-24 01:37:02.941546+00:00, run_end_date=2024-02-24 01:37:05.575546+00:00, run_duration=2.634, state=success, executor_state=success, try_number=1, max_tries=1, job_id=558, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:37:00.850896+00:00, queued_by_job_id=2, pid=8176 2024-02-24T01:38:00.087678470Z [2024-02-24T01:38:00.087+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:38:00+00:00, run_after=2024-02-24T01:39:00+00:00 2024-02-24T01:38:00.103874611Z [2024-02-24T01:38:00.103+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:38:00+00:00, run_after=2024-02-24T01:39:00+00:00 2024-02-24T01:38:00.111751336Z [2024-02-24T01:38:00.111+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:38:00.120647491Z [2024-02-24T01:38:00.120+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:38:00.233745578Z [2024-02-24T01:38:00.233+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T01:38:00.233825849Z 2024-02-24T01:38:00.233843183Z 2024-02-24T01:38:00.233852024Z 2024-02-24T01:38:00.233860138Z 2024-02-24T01:38:00.234251813Z [2024-02-24T01:38:00.233+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T01:38:00.234721914Z [2024-02-24T01:38:00.234+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:38:00.235155633Z [2024-02-24T01:38:00.234+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:38:00.235543417Z [2024-02-24T01:38:00.235+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:38:00.236647045Z [2024-02-24T01:38:00.236+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:38:00.236705005Z 2024-02-24T01:38:00.236712035Z 2024-02-24T01:38:00.236717355Z 2024-02-24T01:38:00.236722852Z 2024-02-24T01:38:00.242485730Z [2024-02-24T01:38:00.242+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:38:00.242823779Z [2024-02-24T01:38:00.242+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T01:38:00.243328676Z [2024-02-24T01:38:00.243+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:38:00.243635796Z [2024-02-24T01:38:00.243+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:38:00.244096163Z [2024-02-24T01:38:00.243+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:38:00.244364772Z [2024-02-24T01:38:00.244+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:38:00.244829111Z [2024-02-24T01:38:00.244+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:38:00.245037616Z [2024-02-24T01:38:00.244+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:38:00.763152299Z [2024-02-24T01:38:00.762+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:36:00+00:00 exited with status queued for try_number 1 2024-02-24T01:38:00.763195006Z [2024-02-24T01:38:00.763+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:37:00+00:00 exited with status queued for try_number 1 2024-02-24T01:38:00.763318388Z [2024-02-24T01:38:00.763+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:37:00+00:00 exited with status queued for try_number 1 2024-02-24T01:38:00.763426051Z [2024-02-24T01:38:00.763+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:37:00+00:00 exited with status queued for try_number 1 2024-02-24T01:38:00.795043051Z [2024-02-24T01:38:00.794+0000] {scheduler_job.py:635} INFO - Setting external_id for to 04422095-ba2d-4c73-8e48-2854d321dae5 2024-02-24T01:38:00.795160268Z [2024-02-24T01:38:00.795+0000] {scheduler_job.py:635} INFO - Setting external_id for to e07fe510-ddd4-48ef-a40f-565ea914a682 2024-02-24T01:38:00.795261505Z [2024-02-24T01:38:00.795+0000] {scheduler_job.py:635} INFO - Setting external_id for to b4f5dc21-6cdf-46c4-a0c9-349fd86cbfd2 2024-02-24T01:38:00.795340496Z [2024-02-24T01:38:00.795+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c63a90b-c140-44d3-a887-46a371482c4c 2024-02-24T01:38:02.045059963Z [2024-02-24T01:38:02.044+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:38:02.045260931Z [2024-02-24T01:38:02.045+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 01:36:00+00:00, run_id=scheduled__2024-02-24T01:36:00+00:00, run_start_date=2024-02-24 01:38:00.141364+00:00, run_end_date=2024-02-24 01:38:02.044956+00:00, run_duration=1.903592, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:36:00+00:00, data_interval_end=2024-02-24 01:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T01:38:02.053577823Z [2024-02-24T01:38:02.053+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T01:38:00+00:00, run_after=2024-02-24T01:40:00+00:00 2024-02-24T01:38:02.067481467Z [2024-02-24T01:38:02.067+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:38:02.067602816Z [2024-02-24T01:38:02.067+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:37:00+00:00, run_id=scheduled__2024-02-24T01:37:00+00:00, run_start_date=2024-02-24 01:38:00.143564+00:00, run_end_date=2024-02-24 01:38:02.067362+00:00, run_duration=1.923798, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:37:00+00:00, data_interval_end=2024-02-24 01:38:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:38:02.078492106Z [2024-02-24T01:38:02.078+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:38:00+00:00, run_after=2024-02-24T01:39:00+00:00 2024-02-24T01:38:02.122024541Z [2024-02-24T01:38:02.121+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:36:00+00:00 exited with status success for try_number 1 2024-02-24T01:38:02.122084102Z [2024-02-24T01:38:02.121+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:37:00+00:00 exited with status success for try_number 1 2024-02-24T01:38:02.131683447Z [2024-02-24T01:38:02.131+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T01:36:00+00:00, map_index=-1, run_start_date=2024-02-24 01:38:01.112534+00:00, run_end_date=2024-02-24 01:38:01.679484+00:00, run_duration=0.56695, state=success, executor_state=success, try_number=1, max_tries=1, job_id=560, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:38:00.238114+00:00, queued_by_job_id=2, pid=8210 2024-02-24T01:38:02.133168743Z [2024-02-24T01:38:02.131+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:37:00+00:00, map_index=-1, run_start_date=2024-02-24 01:38:01.219760+00:00, run_end_date=2024-02-24 01:38:01.787851+00:00, run_duration=0.568091, state=success, executor_state=success, try_number=1, max_tries=1, job_id=561, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:38:00.238114+00:00, queued_by_job_id=2, pid=8211 2024-02-24T01:38:04.892059678Z [2024-02-24T01:38:04.891+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:38:04.892430790Z [2024-02-24T01:38:04.892+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:37:00+00:00, run_id=scheduled__2024-02-24T01:37:00+00:00, run_start_date=2024-02-24 01:38:00.145418+00:00, run_end_date=2024-02-24 01:38:04.892003+00:00, run_duration=4.746585, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:37:00+00:00, data_interval_end=2024-02-24 01:38:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:38:04.903475323Z [2024-02-24T01:38:04.903+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:38:00+00:00, run_after=2024-02-24T01:39:00+00:00 2024-02-24T01:38:04.956265813Z [2024-02-24T01:38:04.955+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:37:00+00:00 exited with status success for try_number 1 2024-02-24T01:38:04.962460943Z [2024-02-24T01:38:04.962+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:37:00+00:00, map_index=-1, run_start_date=2024-02-24 01:38:02.604858+00:00, run_end_date=2024-02-24 01:38:04.495958+00:00, run_duration=1.8911, state=success, executor_state=success, try_number=1, max_tries=1, job_id=563, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:38:00.238114+00:00, queued_by_job_id=2, pid=8235 2024-02-24T01:38:06.016771232Z [2024-02-24T01:38:06.016+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:38:06.017101285Z [2024-02-24T01:38:06.016+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:37:00+00:00, run_id=scheduled__2024-02-24T01:37:00+00:00, run_start_date=2024-02-24 01:38:00.147126+00:00, run_end_date=2024-02-24 01:38:06.016623+00:00, run_duration=5.869497, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:37:00+00:00, data_interval_end=2024-02-24 01:38:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:38:06.026483616Z [2024-02-24T01:38:06.026+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:38:00+00:00, run_after=2024-02-24T01:39:00+00:00 2024-02-24T01:38:06.071335450Z [2024-02-24T01:38:06.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:37:00+00:00 exited with status success for try_number 1 2024-02-24T01:38:06.077257407Z [2024-02-24T01:38:06.076+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:37:00+00:00, map_index=-1, run_start_date=2024-02-24 01:38:02.522697+00:00, run_end_date=2024-02-24 01:38:05.002056+00:00, run_duration=2.479359, state=success, executor_state=success, try_number=1, max_tries=1, job_id=562, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:38:00.238114+00:00, queued_by_job_id=2, pid=8234 2024-02-24T01:39:00.157708922Z [2024-02-24T01:39:00.157+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:39:00+00:00, run_after=2024-02-24T01:40:00+00:00 2024-02-24T01:39:00.163409613Z [2024-02-24T01:39:00.163+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:39:00.173419548Z [2024-02-24T01:39:00.173+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:39:00+00:00, run_after=2024-02-24T01:40:00+00:00 2024-02-24T01:39:00.227756661Z [2024-02-24T01:39:00.227+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T01:39:00.227793927Z 2024-02-24T01:39:00.227801333Z 2024-02-24T01:39:00.227807714Z 2024-02-24T01:39:00.227833879Z [2024-02-24T01:39:00.227+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:39:00.228266312Z [2024-02-24T01:39:00.227+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:39:00.228746228Z [2024-02-24T01:39:00.228+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:39:00.229855510Z [2024-02-24T01:39:00.229+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:39:00.229879612Z 2024-02-24T01:39:00.229886480Z 2024-02-24T01:39:00.229892836Z 2024-02-24T01:39:00.234939272Z [2024-02-24T01:39:00.234+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:39:00.235183055Z [2024-02-24T01:39:00.234+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:39:00.235881763Z [2024-02-24T01:39:00.235+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:39:00.236065854Z [2024-02-24T01:39:00.235+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:39:00.236664818Z [2024-02-24T01:39:00.236+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:39:00.236923900Z [2024-02-24T01:39:00.236+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:39:00.464135225Z [2024-02-24T01:39:00.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:38:00+00:00 exited with status queued for try_number 1 2024-02-24T01:39:00.464219013Z [2024-02-24T01:39:00.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:38:00+00:00 exited with status queued for try_number 1 2024-02-24T01:39:00.464334431Z [2024-02-24T01:39:00.464+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:38:00+00:00 exited with status queued for try_number 1 2024-02-24T01:39:00.502914875Z [2024-02-24T01:39:00.502+0000] {scheduler_job.py:635} INFO - Setting external_id for to 342f93ab-ced7-401b-bcd0-5a7cccfab018 2024-02-24T01:39:00.503097362Z [2024-02-24T01:39:00.502+0000] {scheduler_job.py:635} INFO - Setting external_id for to 79060368-8ee4-4d32-a0d2-6afabebed7df 2024-02-24T01:39:00.503319657Z [2024-02-24T01:39:00.503+0000] {scheduler_job.py:635} INFO - Setting external_id for to a1f5f1a1-8d1b-4a6a-810d-b42ab7e17190 2024-02-24T01:39:02.495509687Z [2024-02-24T01:39:02.494+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:39:02.496118122Z [2024-02-24T01:39:02.495+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:38:00+00:00, run_id=scheduled__2024-02-24T01:38:00+00:00, run_start_date=2024-02-24 01:39:00.182179+00:00, run_end_date=2024-02-24 01:39:02.495414+00:00, run_duration=2.313235, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:38:00+00:00, data_interval_end=2024-02-24 01:39:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:39:02.513333538Z [2024-02-24T01:39:02.512+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:39:00+00:00, run_after=2024-02-24T01:40:00+00:00 2024-02-24T01:39:02.599823737Z [2024-02-24T01:39:02.599+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:38:00+00:00 exited with status success for try_number 1 2024-02-24T01:39:02.607734943Z [2024-02-24T01:39:02.607+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:38:00+00:00, map_index=-1, run_start_date=2024-02-24 01:39:01.071825+00:00, run_end_date=2024-02-24 01:39:01.575161+00:00, run_duration=0.503336, state=success, executor_state=success, try_number=1, max_tries=1, job_id=564, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:39:00.231371+00:00, queued_by_job_id=2, pid=8267 2024-02-24T01:39:04.770264131Z [2024-02-24T01:39:04.769+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:39:04.770847019Z [2024-02-24T01:39:04.770+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:38:00+00:00, run_id=scheduled__2024-02-24T01:38:00+00:00, run_start_date=2024-02-24 01:39:00.184169+00:00, run_end_date=2024-02-24 01:39:04.770131+00:00, run_duration=4.585962, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:38:00+00:00, data_interval_end=2024-02-24 01:39:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:39:04.786739558Z [2024-02-24T01:39:04.786+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:39:00+00:00, run_after=2024-02-24T01:40:00+00:00 2024-02-24T01:39:04.801180129Z [2024-02-24T01:39:04.800+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:39:04.802124680Z [2024-02-24T01:39:04.801+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:38:00+00:00, run_id=scheduled__2024-02-24T01:38:00+00:00, run_start_date=2024-02-24 01:39:00.183230+00:00, run_end_date=2024-02-24 01:39:04.801181+00:00, run_duration=4.617951, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:38:00+00:00, data_interval_end=2024-02-24 01:39:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:39:04.819671478Z [2024-02-24T01:39:04.819+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:39:00+00:00, run_after=2024-02-24T01:40:00+00:00 2024-02-24T01:39:04.849639966Z [2024-02-24T01:39:04.849+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:38:00+00:00 exited with status success for try_number 1 2024-02-24T01:39:04.849883446Z [2024-02-24T01:39:04.849+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:38:00+00:00 exited with status success for try_number 1 2024-02-24T01:39:04.856351041Z [2024-02-24T01:39:04.855+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:38:00+00:00, map_index=-1, run_start_date=2024-02-24 01:39:02.314576+00:00, run_end_date=2024-02-24 01:39:04.423530+00:00, run_duration=2.108954, state=success, executor_state=success, try_number=1, max_tries=1, job_id=566, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:39:00.231371+00:00, queued_by_job_id=2, pid=8286 2024-02-24T01:39:04.856678893Z [2024-02-24T01:39:04.856+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:38:00+00:00, map_index=-1, run_start_date=2024-02-24 01:39:02.271821+00:00, run_end_date=2024-02-24 01:39:03.712633+00:00, run_duration=1.440812, state=success, executor_state=success, try_number=1, max_tries=1, job_id=565, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:39:00.231371+00:00, queued_by_job_id=2, pid=8285 2024-02-24T01:40:00.143416407Z [2024-02-24T01:40:00.142+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:40:00.168774575Z [2024-02-24T01:40:00.168+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:40:00+00:00, run_after=2024-02-24T01:41:00+00:00 2024-02-24T01:40:00.178042521Z [2024-02-24T01:40:00.177+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:40:00.193200759Z [2024-02-24T01:40:00.192+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:40:00+00:00, run_after=2024-02-24T01:45:00+00:00 2024-02-24T01:40:00.212998562Z [2024-02-24T01:40:00.212+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:40:00+00:00, run_after=2024-02-24T01:41:00+00:00 2024-02-24T01:40:00.299191761Z [2024-02-24T01:40:00.298+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-02-24T01:40:00.299236543Z 2024-02-24T01:40:00.299243703Z 2024-02-24T01:40:00.299250302Z 2024-02-24T01:40:00.299256126Z 2024-02-24T01:40:00.299261961Z 2024-02-24T01:40:00.299332117Z [2024-02-24T01:40:00.299+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:40:00.299565584Z [2024-02-24T01:40:00.299+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T01:40:00.299752138Z [2024-02-24T01:40:00.299+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:40:00.299985792Z [2024-02-24T01:40:00.299+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:40:00.300209423Z [2024-02-24T01:40:00.300+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:40:00.301052252Z [2024-02-24T01:40:00.300+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:40:00.301062342Z 2024-02-24T01:40:00.301066527Z 2024-02-24T01:40:00.301070466Z 2024-02-24T01:40:00.301074302Z 2024-02-24T01:40:00.301078219Z 2024-02-24T01:40:00.305614390Z [2024-02-24T01:40:00.305+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T01:40:00.305941277Z [2024-02-24T01:40:00.305+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T01:40:00.306348365Z [2024-02-24T01:40:00.306+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:40:00.306632515Z [2024-02-24T01:40:00.306+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T01:40:00.307016917Z [2024-02-24T01:40:00.306+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:40:00.307506588Z [2024-02-24T01:40:00.307+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:40:00.307883095Z [2024-02-24T01:40:00.307+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:40:00.308126510Z [2024-02-24T01:40:00.307+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:40:00.308488337Z [2024-02-24T01:40:00.308+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:40:00.308724189Z [2024-02-24T01:40:00.308+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:40:00.906076439Z [2024-02-24T01:40:00.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T01:35:00+00:00 exited with status queued for try_number 1 2024-02-24T01:40:00.906265248Z [2024-02-24T01:40:00.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:38:00+00:00 exited with status queued for try_number 1 2024-02-24T01:40:00.906359518Z [2024-02-24T01:40:00.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:39:00+00:00 exited with status queued for try_number 1 2024-02-24T01:40:00.906540154Z [2024-02-24T01:40:00.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:39:00+00:00 exited with status queued for try_number 1 2024-02-24T01:40:00.906554854Z [2024-02-24T01:40:00.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:39:00+00:00 exited with status queued for try_number 1 2024-02-24T01:40:00.917397221Z [2024-02-24T01:40:00.917+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25f12a4e-0648-4e19-8cb4-6618a5473d69 2024-02-24T01:40:00.917575448Z [2024-02-24T01:40:00.917+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80f7ee22-5b64-4a48-b808-8e9e85e807b8 2024-02-24T01:40:00.917794377Z [2024-02-24T01:40:00.917+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa4c498e-bdcd-4e99-bb6a-5cf4ddeedc6c 2024-02-24T01:40:00.917934984Z [2024-02-24T01:40:00.917+0000] {scheduler_job.py:635} INFO - Setting external_id for to ebc9387d-3548-42cf-89ac-17a0a653e359 2024-02-24T01:40:00.918102939Z [2024-02-24T01:40:00.917+0000] {scheduler_job.py:635} INFO - Setting external_id for to e21f1558-0bd2-4de6-9e5b-350c45054612 2024-02-24T01:40:01.935342310Z [2024-02-24T01:40:01.934+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:40:01.935575881Z [2024-02-24T01:40:01.935+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 01:38:00+00:00, run_id=scheduled__2024-02-24T01:38:00+00:00, run_start_date=2024-02-24 01:40:00.228937+00:00, run_end_date=2024-02-24 01:40:01.935265+00:00, run_duration=1.706328, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:38:00+00:00, data_interval_end=2024-02-24 01:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T01:40:01.943653787Z [2024-02-24T01:40:01.943+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T01:40:00+00:00, run_after=2024-02-24T01:42:00+00:00 2024-02-24T01:40:01.951134962Z [2024-02-24T01:40:01.950+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:40:01.951252934Z [2024-02-24T01:40:01.951+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:39:00+00:00, run_id=scheduled__2024-02-24T01:39:00+00:00, run_start_date=2024-02-24 01:40:00.230187+00:00, run_end_date=2024-02-24 01:40:01.951015+00:00, run_duration=1.720828, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:39:00+00:00, data_interval_end=2024-02-24 01:40:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:40:01.962542748Z [2024-02-24T01:40:01.962+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:40:00+00:00, run_after=2024-02-24T01:41:00+00:00 2024-02-24T01:40:03.190121620Z [2024-02-24T01:40:03.189+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:40:03.190144844Z 2024-02-24T01:40:03.190198973Z [2024-02-24T01:40:03.190+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:40:03.190814898Z [2024-02-24T01:40:03.190+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:40:03.190823661Z 2024-02-24T01:40:03.193692188Z [2024-02-24T01:40:03.193+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T01:40:03.193794210Z [2024-02-24T01:40:03.193+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T01:40:03.267238880Z [2024-02-24T01:40:03.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T01:35:00+00:00 exited with status queued for try_number 1 2024-02-24T01:40:03.267436169Z [2024-02-24T01:40:03.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T01:35:00+00:00 exited with status success for try_number 1 2024-02-24T01:40:03.267610065Z [2024-02-24T01:40:03.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:38:00+00:00 exited with status success for try_number 1 2024-02-24T01:40:03.267886433Z [2024-02-24T01:40:03.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:39:00+00:00 exited with status success for try_number 1 2024-02-24T01:40:03.280265997Z [2024-02-24T01:40:03.279+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T01:35:00+00:00, map_index=-1, run_start_date=2024-02-24 01:40:02.563263+00:00, run_end_date=2024-02-24 01:40:03.002886+00:00, run_duration=0.439623, state=success, executor_state=success, try_number=1, max_tries=1, job_id=569, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:40:00.302369+00:00, queued_by_job_id=2, pid=8350 2024-02-24T01:40:03.280528798Z [2024-02-24T01:40:03.280+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:39:00+00:00, map_index=-1, run_start_date=2024-02-24 01:40:01.440093+00:00, run_end_date=2024-02-24 01:40:01.834552+00:00, run_duration=0.394459, state=success, executor_state=success, try_number=1, max_tries=1, job_id=568, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:40:00.302369+00:00, queued_by_job_id=2, pid=8321 2024-02-24T01:40:03.280543142Z [2024-02-24T01:40:03.280+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T01:38:00+00:00, map_index=-1, run_start_date=2024-02-24 01:40:01.341498+00:00, run_end_date=2024-02-24 01:40:01.882160+00:00, run_duration=0.540662, state=success, executor_state=success, try_number=1, max_tries=1, job_id=567, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:40:00.302369+00:00, queued_by_job_id=2, pid=8320 2024-02-24T01:40:03.280670065Z [2024-02-24T01:40:03.280+0000] {scheduler_job.py:635} INFO - Setting external_id for to c79f2459-d682-43f1-b873-23d0da109978 2024-02-24T01:40:05.561123338Z [2024-02-24T01:40:05.560+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:40:05.561247776Z [2024-02-24T01:40:05.560+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:39:00+00:00, run_id=scheduled__2024-02-24T01:39:00+00:00, run_start_date=2024-02-24 01:40:00.232410+00:00, run_end_date=2024-02-24 01:40:05.560825+00:00, run_duration=5.328415, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:39:00+00:00, data_interval_end=2024-02-24 01:40:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:40:05.570930700Z [2024-02-24T01:40:05.570+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:40:00+00:00, run_after=2024-02-24T01:41:00+00:00 2024-02-24T01:40:05.579162652Z [2024-02-24T01:40:05.578+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:40:05.579275308Z [2024-02-24T01:40:05.579+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:39:00+00:00, run_id=scheduled__2024-02-24T01:39:00+00:00, run_start_date=2024-02-24 01:40:00.231352+00:00, run_end_date=2024-02-24 01:40:05.579017+00:00, run_duration=5.347665, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:39:00+00:00, data_interval_end=2024-02-24 01:40:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:40:05.590978768Z [2024-02-24T01:40:05.590+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:40:00+00:00, run_after=2024-02-24T01:41:00+00:00 2024-02-24T01:40:05.627318204Z [2024-02-24T01:40:05.626+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:40:05.627350013Z 2024-02-24T01:40:05.627360321Z [2024-02-24T01:40:05.627+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:40:05.627907132Z [2024-02-24T01:40:05.627+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:40:05.627913871Z 2024-02-24T01:40:05.631046136Z [2024-02-24T01:40:05.630+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T01:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T01:40:05.631147007Z [2024-02-24T01:40:05.630+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T01:40:05.680241606Z [2024-02-24T01:40:05.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T01:35:00+00:00 exited with status queued for try_number 1 2024-02-24T01:40:05.680676648Z [2024-02-24T01:40:05.680+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:39:00+00:00 exited with status success for try_number 1 2024-02-24T01:40:05.680970395Z [2024-02-24T01:40:05.680+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:39:00+00:00 exited with status success for try_number 1 2024-02-24T01:40:05.681247122Z [2024-02-24T01:40:05.681+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T01:35:00+00:00 exited with status success for try_number 1 2024-02-24T01:40:05.694105085Z [2024-02-24T01:40:05.693+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b52be92-f8ad-4035-a75e-d02f9642a223 2024-02-24T01:40:05.694570481Z [2024-02-24T01:40:05.694+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:39:00+00:00, map_index=-1, run_start_date=2024-02-24 01:40:02.826888+00:00, run_end_date=2024-02-24 01:40:04.743310+00:00, run_duration=1.916422, state=success, executor_state=success, try_number=1, max_tries=1, job_id=571, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:40:00.302369+00:00, queued_by_job_id=2, pid=8352 2024-02-24T01:40:05.695014759Z [2024-02-24T01:40:05.694+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:39:00+00:00, map_index=-1, run_start_date=2024-02-24 01:40:02.699783+00:00, run_end_date=2024-02-24 01:40:04.837573+00:00, run_duration=2.13779, state=success, executor_state=success, try_number=1, max_tries=1, job_id=570, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:40:00.302369+00:00, queued_by_job_id=2, pid=8351 2024-02-24T01:40:05.695479239Z [2024-02-24T01:40:05.695+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T01:35:00+00:00, map_index=-1, run_start_date=2024-02-24 01:40:04.790776+00:00, run_end_date=2024-02-24 01:40:05.217319+00:00, run_duration=0.426543, state=success, executor_state=success, try_number=1, max_tries=1, job_id=572, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:40:03.191169+00:00, queued_by_job_id=2, pid=8375 2024-02-24T01:40:08.238063356Z [2024-02-24T01:40:08.237+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:40:08.238111006Z 2024-02-24T01:40:08.238449987Z [2024-02-24T01:40:08.238+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:40:08.239420123Z [2024-02-24T01:40:08.239+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:40:08.239438678Z 2024-02-24T01:40:08.242970177Z [2024-02-24T01:40:08.242+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:40:08.243321397Z [2024-02-24T01:40:08.243+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T01:40:08.302963317Z [2024-02-24T01:40:08.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T01:35:00+00:00 exited with status queued for try_number 1 2024-02-24T01:40:08.303283559Z [2024-02-24T01:40:08.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T01:35:00+00:00 exited with status success for try_number 1 2024-02-24T01:40:08.309731879Z [2024-02-24T01:40:08.309+0000] {scheduler_job.py:635} INFO - Setting external_id for to 57ce934d-7a16-4efb-8203-d3d1d08c0273 2024-02-24T01:40:08.310084268Z [2024-02-24T01:40:08.309+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T01:35:00+00:00, map_index=0, run_start_date=2024-02-24 01:40:07.201497+00:00, run_end_date=2024-02-24 01:40:07.548161+00:00, run_duration=0.346664, state=success, executor_state=success, try_number=1, max_tries=1, job_id=573, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:40:05.628329+00:00, queued_by_job_id=2, pid=8383 2024-02-24T01:40:10.726915059Z [2024-02-24T01:40:10.726+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:40:10.727389870Z [2024-02-24T01:40:10.727+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:35:00+00:00, run_id=scheduled__2024-02-24T01:35:00+00:00, run_start_date=2024-02-24 01:40:00.227430+00:00, run_end_date=2024-02-24 01:40:10.726802+00:00, run_duration=10.499372, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:35:00+00:00, data_interval_end=2024-02-24 01:40:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T01:40:10.737387010Z [2024-02-24T01:40:10.737+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:40:00+00:00, run_after=2024-02-24T01:45:00+00:00 2024-02-24T01:40:10.777816682Z [2024-02-24T01:40:10.777+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T01:35:00+00:00 exited with status success for try_number 1 2024-02-24T01:40:10.784336510Z [2024-02-24T01:40:10.783+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T01:35:00+00:00, map_index=-1, run_start_date=2024-02-24 01:40:09.799787+00:00, run_end_date=2024-02-24 01:40:10.154868+00:00, run_duration=0.355081, state=success, executor_state=success, try_number=1, max_tries=1, job_id=574, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:40:08.240219+00:00, queued_by_job_id=2, pid=8391 2024-02-24T01:41:01.098115951Z [2024-02-24T01:41:01.097+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:41:00+00:00, run_after=2024-02-24T01:42:00+00:00 2024-02-24T01:41:01.114956304Z [2024-02-24T01:41:01.114+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:41:00+00:00, run_after=2024-02-24T01:42:00+00:00 2024-02-24T01:41:01.125313907Z [2024-02-24T01:41:01.124+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:41:01.205750368Z [2024-02-24T01:41:01.205+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T01:41:01.205801043Z 2024-02-24T01:41:01.205805285Z 2024-02-24T01:41:01.205808393Z 2024-02-24T01:41:01.205924582Z [2024-02-24T01:41:01.205+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:41:01.206085012Z [2024-02-24T01:41:01.205+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:41:01.206159168Z [2024-02-24T01:41:01.206+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:41:01.210079972Z [2024-02-24T01:41:01.209+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:41:01.210119451Z 2024-02-24T01:41:01.210149486Z 2024-02-24T01:41:01.210158443Z 2024-02-24T01:41:01.218003278Z [2024-02-24T01:41:01.217+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:41:01.218921990Z [2024-02-24T01:41:01.217+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:41:01.220898366Z [2024-02-24T01:41:01.218+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:41:01.220911235Z [2024-02-24T01:41:01.219+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:41:01.220918613Z [2024-02-24T01:41:01.220+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:41:01.220922255Z [2024-02-24T01:41:01.220+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:41:01.477591562Z [2024-02-24T01:41:01.476+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:40:00+00:00 exited with status queued for try_number 1 2024-02-24T01:41:01.477911408Z [2024-02-24T01:41:01.477+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:40:00+00:00 exited with status queued for try_number 1 2024-02-24T01:41:01.478234969Z [2024-02-24T01:41:01.478+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:40:00+00:00 exited with status queued for try_number 1 2024-02-24T01:41:01.488150264Z [2024-02-24T01:41:01.487+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54b5fb44-2119-41d8-a977-d21dfba62bac 2024-02-24T01:41:01.488547036Z [2024-02-24T01:41:01.488+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4acde3ad-d7ae-401c-8a20-c4fb4dce4bca 2024-02-24T01:41:01.488807880Z [2024-02-24T01:41:01.488+0000] {scheduler_job.py:635} INFO - Setting external_id for to bca83be3-21d3-42ec-b65f-b9995d586387 2024-02-24T01:41:02.527334787Z [2024-02-24T01:41:02.526+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:41:02.527776994Z [2024-02-24T01:41:02.527+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:40:00+00:00, run_id=scheduled__2024-02-24T01:40:00+00:00, run_start_date=2024-02-24 01:41:01.143218+00:00, run_end_date=2024-02-24 01:41:02.527364+00:00, run_duration=1.384146, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:40:00+00:00, data_interval_end=2024-02-24 01:41:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:41:02.539455928Z [2024-02-24T01:41:02.539+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:41:00+00:00, run_after=2024-02-24T01:42:00+00:00 2024-02-24T01:41:03.004499754Z [2024-02-24T01:41:03.004+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:40:00+00:00 exited with status success for try_number 1 2024-02-24T01:41:03.017051070Z [2024-02-24T01:41:03.016+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:40:00+00:00, map_index=-1, run_start_date=2024-02-24 01:41:02.043879+00:00, run_end_date=2024-02-24 01:41:02.489230+00:00, run_duration=0.445351, state=success, executor_state=success, try_number=1, max_tries=1, job_id=575, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:41:01.212115+00:00, queued_by_job_id=2, pid=8412 2024-02-24T01:41:05.215383108Z [2024-02-24T01:41:05.214+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:41:05.215873857Z [2024-02-24T01:41:05.215+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:40:00+00:00, run_id=scheduled__2024-02-24T01:40:00+00:00, run_start_date=2024-02-24 01:41:01.144691+00:00, run_end_date=2024-02-24 01:41:05.215443+00:00, run_duration=4.070752, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:40:00+00:00, data_interval_end=2024-02-24 01:41:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:41:05.227091385Z [2024-02-24T01:41:05.226+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:41:00+00:00, run_after=2024-02-24T01:42:00+00:00 2024-02-24T01:41:05.271933655Z [2024-02-24T01:41:05.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:40:00+00:00 exited with status success for try_number 1 2024-02-24T01:41:05.276750913Z [2024-02-24T01:41:05.276+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:40:00+00:00, map_index=-1, run_start_date=2024-02-24 01:41:03.159245+00:00, run_end_date=2024-02-24 01:41:05.067737+00:00, run_duration=1.908492, state=success, executor_state=success, try_number=1, max_tries=1, job_id=576, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:41:01.212115+00:00, queued_by_job_id=2, pid=8430 2024-02-24T01:41:06.332321341Z [2024-02-24T01:41:06.331+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:41:06.332608953Z [2024-02-24T01:41:06.332+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:40:00+00:00, run_id=scheduled__2024-02-24T01:40:00+00:00, run_start_date=2024-02-24 01:41:01.146079+00:00, run_end_date=2024-02-24 01:41:06.332189+00:00, run_duration=5.18611, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:40:00+00:00, data_interval_end=2024-02-24 01:41:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:41:06.340798977Z [2024-02-24T01:41:06.340+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:41:00+00:00, run_after=2024-02-24T01:42:00+00:00 2024-02-24T01:41:06.381385124Z [2024-02-24T01:41:06.380+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:40:00+00:00 exited with status success for try_number 1 2024-02-24T01:41:06.387727890Z [2024-02-24T01:41:06.387+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:40:00+00:00, map_index=-1, run_start_date=2024-02-24 01:41:03.347002+00:00, run_end_date=2024-02-24 01:41:05.851566+00:00, run_duration=2.504564, state=success, executor_state=success, try_number=1, max_tries=1, job_id=577, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:41:01.212115+00:00, queued_by_job_id=2, pid=8431 2024-02-24T01:42:01.037635369Z [2024-02-24T01:42:01.037+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:42:01.045216006Z [2024-02-24T01:42:01.044+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:42:01.071631658Z [2024-02-24T01:42:01.071+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:42:00+00:00, run_after=2024-02-24T01:43:00+00:00 2024-02-24T01:42:01.084535622Z [2024-02-24T01:42:01.084+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:42:00+00:00, run_after=2024-02-24T01:43:00+00:00 2024-02-24T01:42:01.188575201Z [2024-02-24T01:42:01.188+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T01:42:01.188619292Z 2024-02-24T01:42:01.188628462Z 2024-02-24T01:42:01.188631998Z 2024-02-24T01:42:01.188635506Z 2024-02-24T01:42:01.189114873Z [2024-02-24T01:42:01.188+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T01:42:01.189471485Z [2024-02-24T01:42:01.189+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:42:01.189813328Z [2024-02-24T01:42:01.189+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:42:01.190173721Z [2024-02-24T01:42:01.189+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:42:01.191644608Z [2024-02-24T01:42:01.191+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:42:01.191649960Z 2024-02-24T01:42:01.191653097Z 2024-02-24T01:42:01.191656150Z 2024-02-24T01:42:01.191675338Z 2024-02-24T01:42:01.197876195Z [2024-02-24T01:42:01.197+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:42:01.198180091Z [2024-02-24T01:42:01.197+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T01:42:01.198700751Z [2024-02-24T01:42:01.198+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:42:01.198977287Z [2024-02-24T01:42:01.198+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:42:01.199282358Z [2024-02-24T01:42:01.199+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:42:01.199512424Z [2024-02-24T01:42:01.199+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:42:01.199909568Z [2024-02-24T01:42:01.199+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:42:01.200073982Z [2024-02-24T01:42:01.199+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:42:01.601276138Z [2024-02-24T01:42:01.600+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:40:00+00:00 exited with status queued for try_number 1 2024-02-24T01:42:01.601569232Z [2024-02-24T01:42:01.601+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:41:00+00:00 exited with status queued for try_number 1 2024-02-24T01:42:01.601854591Z [2024-02-24T01:42:01.601+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:41:00+00:00 exited with status queued for try_number 1 2024-02-24T01:42:01.602106869Z [2024-02-24T01:42:01.601+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:41:00+00:00 exited with status queued for try_number 1 2024-02-24T01:42:01.623287588Z [2024-02-24T01:42:01.622+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0f04a4c-c97d-4025-bc41-f0a096cf4002 2024-02-24T01:42:01.623321260Z [2024-02-24T01:42:01.623+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1ff6b890-2c99-450f-8d7d-d69e524c1e19 2024-02-24T01:42:01.623420586Z [2024-02-24T01:42:01.623+0000] {scheduler_job.py:635} INFO - Setting external_id for to cf787226-692e-43c5-ae7c-b6df9cdaa04f 2024-02-24T01:42:01.623563707Z [2024-02-24T01:42:01.623+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25e1d1f0-ee2d-49c5-86c7-41da5724e2cc 2024-02-24T01:42:02.955692419Z [2024-02-24T01:42:02.955+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:42:02.955828087Z [2024-02-24T01:42:02.955+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 01:40:00+00:00, run_id=scheduled__2024-02-24T01:40:00+00:00, run_start_date=2024-02-24 01:42:01.096561+00:00, run_end_date=2024-02-24 01:42:02.955537+00:00, run_duration=1.858976, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:40:00+00:00, data_interval_end=2024-02-24 01:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T01:42:02.964400517Z [2024-02-24T01:42:02.964+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T01:42:00+00:00, run_after=2024-02-24T01:44:00+00:00 2024-02-24T01:42:02.984222055Z [2024-02-24T01:42:02.983+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:42:02.984320436Z [2024-02-24T01:42:02.984+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:41:00+00:00, run_id=scheduled__2024-02-24T01:41:00+00:00, run_start_date=2024-02-24 01:42:01.098442+00:00, run_end_date=2024-02-24 01:42:02.984086+00:00, run_duration=1.885644, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:41:00+00:00, data_interval_end=2024-02-24 01:42:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:42:02.995028806Z [2024-02-24T01:42:02.994+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:42:00+00:00, run_after=2024-02-24T01:43:00+00:00 2024-02-24T01:42:03.048315909Z [2024-02-24T01:42:03.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:40:00+00:00 exited with status success for try_number 1 2024-02-24T01:42:03.048412010Z [2024-02-24T01:42:03.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:41:00+00:00 exited with status success for try_number 1 2024-02-24T01:42:03.059736834Z [2024-02-24T01:42:03.059+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T01:40:00+00:00, map_index=-1, run_start_date=2024-02-24 01:42:02.239463+00:00, run_end_date=2024-02-24 01:42:02.673625+00:00, run_duration=0.434162, state=success, executor_state=success, try_number=1, max_tries=1, job_id=579, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:42:01.193660+00:00, queued_by_job_id=2, pid=8465 2024-02-24T01:42:03.061424591Z [2024-02-24T01:42:03.059+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:41:00+00:00, map_index=-1, run_start_date=2024-02-24 01:42:02.194407+00:00, run_end_date=2024-02-24 01:42:02.727368+00:00, run_duration=0.532961, state=success, executor_state=success, try_number=1, max_tries=1, job_id=578, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:42:01.193660+00:00, queued_by_job_id=2, pid=8464 2024-02-24T01:42:03.073457386Z [2024-02-24T01:42:03.073+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T01:42:06.236436553Z [2024-02-24T01:42:06.236+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:42:06.237188667Z [2024-02-24T01:42:06.236+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:41:00+00:00, run_id=scheduled__2024-02-24T01:41:00+00:00, run_start_date=2024-02-24 01:42:01.099978+00:00, run_end_date=2024-02-24 01:42:06.236724+00:00, run_duration=5.136746, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:41:00+00:00, data_interval_end=2024-02-24 01:42:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:42:06.247467287Z [2024-02-24T01:42:06.247+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:42:00+00:00, run_after=2024-02-24T01:43:00+00:00 2024-02-24T01:42:06.294618732Z [2024-02-24T01:42:06.293+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:41:00+00:00 exited with status success for try_number 1 2024-02-24T01:42:06.303253285Z [2024-02-24T01:42:06.302+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:41:00+00:00, map_index=-1, run_start_date=2024-02-24 01:42:03.579362+00:00, run_end_date=2024-02-24 01:42:05.268061+00:00, run_duration=1.688699, state=success, executor_state=success, try_number=1, max_tries=1, job_id=580, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:42:01.193660+00:00, queued_by_job_id=2, pid=8488 2024-02-24T01:42:07.367110599Z [2024-02-24T01:42:07.366+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:42:07.368315612Z [2024-02-24T01:42:07.367+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:41:00+00:00, run_id=scheduled__2024-02-24T01:41:00+00:00, run_start_date=2024-02-24 01:42:01.101545+00:00, run_end_date=2024-02-24 01:42:07.366954+00:00, run_duration=6.265409, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:41:00+00:00, data_interval_end=2024-02-24 01:42:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:42:07.382341388Z [2024-02-24T01:42:07.381+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:42:00+00:00, run_after=2024-02-24T01:43:00+00:00 2024-02-24T01:42:07.431255049Z [2024-02-24T01:42:07.430+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:41:00+00:00 exited with status success for try_number 1 2024-02-24T01:42:07.440528463Z [2024-02-24T01:42:07.439+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:41:00+00:00, map_index=-1, run_start_date=2024-02-24 01:42:03.586018+00:00, run_end_date=2024-02-24 01:42:06.310995+00:00, run_duration=2.724977, state=success, executor_state=success, try_number=1, max_tries=1, job_id=581, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:42:01.193660+00:00, queued_by_job_id=2, pid=8489 2024-02-24T01:43:01.039322631Z [2024-02-24T01:43:01.038+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:43:00+00:00, run_after=2024-02-24T01:44:00+00:00 2024-02-24T01:43:01.050424753Z [2024-02-24T01:43:01.049+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:43:01.074702520Z [2024-02-24T01:43:01.074+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:43:00+00:00, run_after=2024-02-24T01:44:00+00:00 2024-02-24T01:43:01.183272458Z [2024-02-24T01:43:01.182+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T01:43:01.183308933Z 2024-02-24T01:43:01.183312726Z 2024-02-24T01:43:01.183316135Z 2024-02-24T01:43:01.183374154Z [2024-02-24T01:43:01.183+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:43:01.183541402Z [2024-02-24T01:43:01.183+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:43:01.183670945Z [2024-02-24T01:43:01.183+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:43:01.184839138Z [2024-02-24T01:43:01.184+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:43:01.184859936Z 2024-02-24T01:43:01.184866068Z 2024-02-24T01:43:01.184871533Z 2024-02-24T01:43:01.189870545Z [2024-02-24T01:43:01.189+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:43:01.189926924Z [2024-02-24T01:43:01.189+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:43:01.190213637Z [2024-02-24T01:43:01.190+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:43:01.190274863Z [2024-02-24T01:43:01.190+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:43:01.190497762Z [2024-02-24T01:43:01.190+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:43:01.190569097Z [2024-02-24T01:43:01.190+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:43:01.542936132Z [2024-02-24T01:43:01.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:42:00+00:00 exited with status queued for try_number 1 2024-02-24T01:43:01.543307823Z [2024-02-24T01:43:01.542+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:42:00+00:00 exited with status queued for try_number 1 2024-02-24T01:43:01.543498790Z [2024-02-24T01:43:01.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:42:00+00:00 exited with status queued for try_number 1 2024-02-24T01:43:01.576815607Z [2024-02-24T01:43:01.575+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9ddfc5d6-182d-4174-91aa-3d7babe09e52 2024-02-24T01:43:01.577731419Z [2024-02-24T01:43:01.577+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3cc3c76-140b-4544-9bd6-0392b6bad403 2024-02-24T01:43:01.578762329Z [2024-02-24T01:43:01.578+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca938698-4d7d-4db3-8669-6500eb3f1a7f 2024-02-24T01:43:02.868878654Z [2024-02-24T01:43:02.867+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:43:02.869211605Z [2024-02-24T01:43:02.869+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:42:00+00:00, run_id=scheduled__2024-02-24T01:42:00+00:00, run_start_date=2024-02-24 01:43:01.091744+00:00, run_end_date=2024-02-24 01:43:02.868797+00:00, run_duration=1.777053, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:42:00+00:00, data_interval_end=2024-02-24 01:43:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:43:02.879708351Z [2024-02-24T01:43:02.879+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:43:00+00:00, run_after=2024-02-24T01:44:00+00:00 2024-02-24T01:43:02.927650647Z [2024-02-24T01:43:02.927+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:42:00+00:00 exited with status success for try_number 1 2024-02-24T01:43:02.933951490Z [2024-02-24T01:43:02.933+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:42:00+00:00, map_index=-1, run_start_date=2024-02-24 01:43:02.117601+00:00, run_end_date=2024-02-24 01:43:02.574247+00:00, run_duration=0.456646, state=success, executor_state=success, try_number=1, max_tries=1, job_id=582, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:43:01.186023+00:00, queued_by_job_id=2, pid=8521 2024-02-24T01:43:06.184115993Z [2024-02-24T01:43:06.183+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:43:06.184689253Z [2024-02-24T01:43:06.184+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:42:00+00:00, run_id=scheduled__2024-02-24T01:42:00+00:00, run_start_date=2024-02-24 01:43:01.093552+00:00, run_end_date=2024-02-24 01:43:06.184253+00:00, run_duration=5.090701, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:42:00+00:00, data_interval_end=2024-02-24 01:43:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:43:06.196239222Z [2024-02-24T01:43:06.195+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:43:00+00:00, run_after=2024-02-24T01:44:00+00:00 2024-02-24T01:43:06.252256073Z [2024-02-24T01:43:06.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:42:00+00:00 exited with status success for try_number 1 2024-02-24T01:43:06.259013578Z [2024-02-24T01:43:06.258+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:42:00+00:00, map_index=-1, run_start_date=2024-02-24 01:43:03.285050+00:00, run_end_date=2024-02-24 01:43:05.344174+00:00, run_duration=2.059124, state=success, executor_state=success, try_number=1, max_tries=1, job_id=583, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:43:01.186023+00:00, queued_by_job_id=2, pid=8539 2024-02-24T01:43:07.302694814Z [2024-02-24T01:43:07.302+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:43:07.302825814Z [2024-02-24T01:43:07.302+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:42:00+00:00, run_id=scheduled__2024-02-24T01:42:00+00:00, run_start_date=2024-02-24 01:43:01.095137+00:00, run_end_date=2024-02-24 01:43:07.302430+00:00, run_duration=6.207293, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:42:00+00:00, data_interval_end=2024-02-24 01:43:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:43:07.310898816Z [2024-02-24T01:43:07.310+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:43:00+00:00, run_after=2024-02-24T01:44:00+00:00 2024-02-24T01:43:07.344195984Z [2024-02-24T01:43:07.343+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:42:00+00:00 exited with status success for try_number 1 2024-02-24T01:43:07.351209149Z [2024-02-24T01:43:07.350+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:42:00+00:00, map_index=-1, run_start_date=2024-02-24 01:43:03.388947+00:00, run_end_date=2024-02-24 01:43:06.629728+00:00, run_duration=3.240781, state=success, executor_state=success, try_number=1, max_tries=1, job_id=584, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:43:01.186023+00:00, queued_by_job_id=2, pid=8540 2024-02-24T01:44:00.200977892Z [2024-02-24T01:44:00.200+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:44:00.212029462Z [2024-02-24T01:44:00.211+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:44:00.230632989Z [2024-02-24T01:44:00.230+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:44:00+00:00, run_after=2024-02-24T01:45:00+00:00 2024-02-24T01:44:00.243262199Z [2024-02-24T01:44:00.242+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:44:00+00:00, run_after=2024-02-24T01:45:00+00:00 2024-02-24T01:44:00.341737946Z [2024-02-24T01:44:00.341+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T01:44:00.341765784Z 2024-02-24T01:44:00.341809477Z 2024-02-24T01:44:00.341815490Z 2024-02-24T01:44:00.341819694Z 2024-02-24T01:44:00.342129184Z [2024-02-24T01:44:00.341+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T01:44:00.342528034Z [2024-02-24T01:44:00.342+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:44:00.342772910Z [2024-02-24T01:44:00.342+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:44:00.343100197Z [2024-02-24T01:44:00.342+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:44:00.344021282Z [2024-02-24T01:44:00.343+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:44:00.344090328Z 2024-02-24T01:44:00.344109301Z 2024-02-24T01:44:00.344114242Z 2024-02-24T01:44:00.344118375Z 2024-02-24T01:44:00.349012748Z [2024-02-24T01:44:00.348+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:44:00.349384402Z [2024-02-24T01:44:00.349+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T01:44:00.349844363Z [2024-02-24T01:44:00.349+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:44:00.350142629Z [2024-02-24T01:44:00.349+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:44:00.350442439Z [2024-02-24T01:44:00.350+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:44:00.350685102Z [2024-02-24T01:44:00.350+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:44:00.350980272Z [2024-02-24T01:44:00.350+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:44:00.351201301Z [2024-02-24T01:44:00.351+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:44:00.704384587Z [2024-02-24T01:44:00.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:42:00+00:00 exited with status queued for try_number 1 2024-02-24T01:44:00.704505488Z [2024-02-24T01:44:00.704+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:43:00+00:00 exited with status queued for try_number 1 2024-02-24T01:44:00.704609758Z [2024-02-24T01:44:00.704+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:43:00+00:00 exited with status queued for try_number 1 2024-02-24T01:44:00.704684622Z [2024-02-24T01:44:00.704+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:43:00+00:00 exited with status queued for try_number 1 2024-02-24T01:44:00.719087702Z [2024-02-24T01:44:00.718+0000] {scheduler_job.py:635} INFO - Setting external_id for to f38bebcd-aa6d-44bb-a30c-c19e11f71401 2024-02-24T01:44:00.719148572Z [2024-02-24T01:44:00.719+0000] {scheduler_job.py:635} INFO - Setting external_id for to c0016367-86b2-443e-b8d4-fa07975e9f9b 2024-02-24T01:44:00.719282862Z [2024-02-24T01:44:00.719+0000] {scheduler_job.py:635} INFO - Setting external_id for to d6a79d4d-2059-466b-9f10-e192e37a6fee 2024-02-24T01:44:00.719380422Z [2024-02-24T01:44:00.719+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1e18fff-156c-42e3-ac16-226fe19c04a1 2024-02-24T01:44:02.217322672Z [2024-02-24T01:44:02.216+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:44:02.217761239Z [2024-02-24T01:44:02.217+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 01:42:00+00:00, run_id=scheduled__2024-02-24T01:42:00+00:00, run_start_date=2024-02-24 01:44:00.254997+00:00, run_end_date=2024-02-24 01:44:02.217401+00:00, run_duration=1.962404, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:42:00+00:00, data_interval_end=2024-02-24 01:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T01:44:02.229092788Z [2024-02-24T01:44:02.228+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T01:44:00+00:00, run_after=2024-02-24T01:46:00+00:00 2024-02-24T01:44:02.253757896Z [2024-02-24T01:44:02.253+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:44:02.254170840Z [2024-02-24T01:44:02.253+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:43:00+00:00, run_id=scheduled__2024-02-24T01:43:00+00:00, run_start_date=2024-02-24 01:44:00.256220+00:00, run_end_date=2024-02-24 01:44:02.253764+00:00, run_duration=1.997544, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:43:00+00:00, data_interval_end=2024-02-24 01:44:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:44:02.265633127Z [2024-02-24T01:44:02.265+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:44:00+00:00, run_after=2024-02-24T01:45:00+00:00 2024-02-24T01:44:02.313242592Z [2024-02-24T01:44:02.312+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:42:00+00:00 exited with status success for try_number 1 2024-02-24T01:44:02.313266496Z [2024-02-24T01:44:02.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:43:00+00:00 exited with status success for try_number 1 2024-02-24T01:44:02.326617982Z [2024-02-24T01:44:02.326+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T01:42:00+00:00, map_index=-1, run_start_date=2024-02-24 01:44:01.050958+00:00, run_end_date=2024-02-24 01:44:01.492491+00:00, run_duration=0.441533, state=success, executor_state=success, try_number=1, max_tries=1, job_id=585, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:44:00.346051+00:00, queued_by_job_id=2, pid=8568 2024-02-24T01:44:02.327015056Z [2024-02-24T01:44:02.326+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:43:00+00:00, map_index=-1, run_start_date=2024-02-24 01:44:01.430097+00:00, run_end_date=2024-02-24 01:44:01.856294+00:00, run_duration=0.426197, state=success, executor_state=success, try_number=1, max_tries=1, job_id=586, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:44:00.346051+00:00, queued_by_job_id=2, pid=8579 2024-02-24T01:44:03.967186167Z [2024-02-24T01:44:03.966+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:44:03.967456510Z [2024-02-24T01:44:03.967+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:43:00+00:00, run_id=scheduled__2024-02-24T01:43:00+00:00, run_start_date=2024-02-24 01:44:00.257415+00:00, run_end_date=2024-02-24 01:44:03.966976+00:00, run_duration=3.709561, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:43:00+00:00, data_interval_end=2024-02-24 01:44:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:44:03.977758774Z [2024-02-24T01:44:03.977+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:44:00+00:00, run_after=2024-02-24T01:45:00+00:00 2024-02-24T01:44:04.034490042Z [2024-02-24T01:44:04.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:43:00+00:00 exited with status success for try_number 1 2024-02-24T01:44:04.040430614Z [2024-02-24T01:44:04.039+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:43:00+00:00, map_index=-1, run_start_date=2024-02-24 01:44:02.380239+00:00, run_end_date=2024-02-24 01:44:03.747930+00:00, run_duration=1.367691, state=success, executor_state=success, try_number=1, max_tries=1, job_id=587, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:44:00.346051+00:00, queued_by_job_id=2, pid=8598 2024-02-24T01:44:05.111336336Z [2024-02-24T01:44:05.110+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:44:05.112047022Z [2024-02-24T01:44:05.111+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:43:00+00:00, run_id=scheduled__2024-02-24T01:43:00+00:00, run_start_date=2024-02-24 01:44:00.258593+00:00, run_end_date=2024-02-24 01:44:05.110956+00:00, run_duration=4.852363, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:43:00+00:00, data_interval_end=2024-02-24 01:44:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:44:05.129438606Z [2024-02-24T01:44:05.128+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:44:00+00:00, run_after=2024-02-24T01:45:00+00:00 2024-02-24T01:44:05.173631194Z [2024-02-24T01:44:05.173+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:43:00+00:00 exited with status success for try_number 1 2024-02-24T01:44:05.181419884Z [2024-02-24T01:44:05.180+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:43:00+00:00, map_index=-1, run_start_date=2024-02-24 01:44:02.365291+00:00, run_end_date=2024-02-24 01:44:04.766547+00:00, run_duration=2.401256, state=success, executor_state=success, try_number=1, max_tries=1, job_id=588, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:44:00.346051+00:00, queued_by_job_id=2, pid=8597 2024-02-24T01:44:50.059250559Z [2024-02-24T01:44:50.058+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a to 2024-02-24T01:44:00+00:00, run_after=2024-02-24T01:45:00+00:00 2024-02-24T01:44:50.119241878Z [2024-02-24T01:44:50.118+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:44:50.119285744Z 2024-02-24T01:44:50.119500331Z [2024-02-24T01:44:50.119+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a has 0/16 running and queued tasks 2024-02-24T01:44:50.120234714Z [2024-02-24T01:44:50.119+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:44:50.120253898Z 2024-02-24T01:44:50.123015829Z [2024-02-24T01:44:50.122+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:44:50.123359758Z [2024-02-24T01:44:50.123+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:44:50.180972966Z [2024-02-24T01:44:50.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:43:00+00:00 exited with status queued for try_number 1 2024-02-24T01:44:50.186089651Z [2024-02-24T01:44:50.185+0000] {scheduler_job.py:635} INFO - Setting external_id for to da40bf00-fc70-4f41-b7b2-98201b20e92e 2024-02-24T01:44:51.312217553Z [2024-02-24T01:44:51.311+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:44:51.312486598Z [2024-02-24T01:44:51.312+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a, execution_date=2024-02-24 01:43:00+00:00, run_id=scheduled__2024-02-24T01:43:00+00:00, run_start_date=2024-02-24 01:44:50.076416+00:00, run_end_date=2024-02-24 01:44:51.312041+00:00, run_duration=1.235625, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:43:00+00:00, data_interval_end=2024-02-24 01:44:00+00:00, dag_hash=41537f102683813c984380f19c849c40 2024-02-24T01:44:51.321323593Z [2024-02-24T01:44:51.320+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a to 2024-02-24T01:44:00+00:00, run_after=2024-02-24T01:45:00+00:00 2024-02-24T01:44:52.003259628Z [2024-02-24T01:44:52.002+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:43:00+00:00 exited with status success for try_number 1 2024-02-24T01:44:52.013495934Z [2024-02-24T01:44:52.012+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:43:00+00:00, map_index=-1, run_start_date=2024-02-24 01:44:50.832763+00:00, run_end_date=2024-02-24 01:44:51.277353+00:00, run_duration=0.44459, state=success, executor_state=success, try_number=1, max_tries=1, job_id=589, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:44:50.120683+00:00, queued_by_job_id=2, pid=8628 2024-02-24T01:45:00.325485627Z [2024-02-24T01:45:00.325+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:45:00+00:00, run_after=2024-02-24T01:46:00+00:00 2024-02-24T01:45:00.345368786Z [2024-02-24T01:45:00.344+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:45:00+00:00, run_after=2024-02-24T01:50:00+00:00 2024-02-24T01:45:00.358684355Z [2024-02-24T01:45:00.358+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:45:00+00:00, run_after=2024-02-24T01:46:00+00:00 2024-02-24T01:45:00.365431650Z [2024-02-24T01:45:00.365+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:45:00.380703428Z [2024-02-24T01:45:00.380+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a to 2024-02-24T01:45:00+00:00, run_after=2024-02-24T01:46:00+00:00 2024-02-24T01:45:00.475271006Z [2024-02-24T01:45:00.474+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-02-24T01:45:00.475301684Z 2024-02-24T01:45:00.475309801Z 2024-02-24T01:45:00.475314039Z 2024-02-24T01:45:00.475318151Z 2024-02-24T01:45:00.475322544Z 2024-02-24T01:45:00.475594471Z [2024-02-24T01:45:00.475+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:45:00.475726263Z [2024-02-24T01:45:00.475+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a has 0/16 running and queued tasks 2024-02-24T01:45:00.476231373Z [2024-02-24T01:45:00.475+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:45:00.476650778Z [2024-02-24T01:45:00.476+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:45:00.476989290Z [2024-02-24T01:45:00.476+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:45:00.478560093Z [2024-02-24T01:45:00.478+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:45:00.478575791Z 2024-02-24T01:45:00.478580208Z 2024-02-24T01:45:00.478589854Z 2024-02-24T01:45:00.478594755Z 2024-02-24T01:45:00.478599082Z 2024-02-24T01:45:00.485230093Z [2024-02-24T01:45:00.484+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T01:45:00.485450658Z [2024-02-24T01:45:00.485+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T01:45:00.485902985Z [2024-02-24T01:45:00.485+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:45:00.486083756Z [2024-02-24T01:45:00.485+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:45:00.486479276Z [2024-02-24T01:45:00.486+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:45:00.486669179Z [2024-02-24T01:45:00.486+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:45:00.487001259Z [2024-02-24T01:45:00.486+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:45:00.487154723Z [2024-02-24T01:45:00.486+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:45:00.487471357Z [2024-02-24T01:45:00.487+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:45:00.487658550Z [2024-02-24T01:45:00.487+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:45:00.838854416Z [2024-02-24T01:45:00.838+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T01:40:00+00:00 exited with status queued for try_number 1 2024-02-24T01:45:00.838954427Z [2024-02-24T01:45:00.838+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:44:00+00:00 exited with status queued for try_number 1 2024-02-24T01:45:00.839159104Z [2024-02-24T01:45:00.838+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:44:00+00:00 exited with status queued for try_number 1 2024-02-24T01:45:00.839249226Z [2024-02-24T01:45:00.839+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:44:00+00:00 exited with status queued for try_number 1 2024-02-24T01:45:00.839390065Z [2024-02-24T01:45:00.839+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:44:00+00:00 exited with status queued for try_number 1 2024-02-24T01:45:00.855267157Z [2024-02-24T01:45:00.854+0000] {scheduler_job.py:635} INFO - Setting external_id for to 26b16a53-95a7-4da0-9a5c-e1b8f357125b 2024-02-24T01:45:00.855455896Z [2024-02-24T01:45:00.855+0000] {scheduler_job.py:635} INFO - Setting external_id for to a01b7746-0415-4e8e-b527-63d0b8fc53fe 2024-02-24T01:45:00.855605794Z [2024-02-24T01:45:00.855+0000] {scheduler_job.py:635} INFO - Setting external_id for to b9daba11-4c34-4694-bc77-86b9ced25507 2024-02-24T01:45:00.855752713Z [2024-02-24T01:45:00.855+0000] {scheduler_job.py:635} INFO - Setting external_id for to 896bb107-465a-4e1e-929e-cd9efab2f62f 2024-02-24T01:45:00.855905572Z [2024-02-24T01:45:00.855+0000] {scheduler_job.py:635} INFO - Setting external_id for to 29abf659-7eef-4ec2-9ee8-8053ab227416 2024-02-24T01:45:03.550452483Z [2024-02-24T01:45:03.550+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:45:03.550739305Z [2024-02-24T01:45:03.550+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:44:00+00:00, run_id=scheduled__2024-02-24T01:44:00+00:00, run_start_date=2024-02-24 01:45:00.394475+00:00, run_end_date=2024-02-24 01:45:03.550400+00:00, run_duration=3.155925, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:44:00+00:00, data_interval_end=2024-02-24 01:45:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:45:03.597939468Z [2024-02-24T01:45:03.596+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:45:00+00:00, run_after=2024-02-24T01:46:00+00:00 2024-02-24T01:45:03.613907744Z [2024-02-24T01:45:03.612+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:45:03.613940442Z [2024-02-24T01:45:03.612+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a, execution_date=2024-02-24 01:44:00+00:00, run_id=scheduled__2024-02-24T01:44:00+00:00, run_start_date=2024-02-24 01:45:00.393341+00:00, run_end_date=2024-02-24 01:45:03.612377+00:00, run_duration=3.219036, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:44:00+00:00, data_interval_end=2024-02-24 01:45:00+00:00, dag_hash=41537f102683813c984380f19c849c40 2024-02-24T01:45:03.625889496Z [2024-02-24T01:45:03.625+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a to 2024-02-24T01:45:00+00:00, run_after=2024-02-24T01:46:00+00:00 2024-02-24T01:45:03.709007223Z [2024-02-24T01:45:03.707+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:45:03.709027382Z 2024-02-24T01:45:03.709043637Z [2024-02-24T01:45:03.708+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:45:03.709050477Z [2024-02-24T01:45:03.708+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:45:03.709054747Z 2024-02-24T01:45:03.713304051Z [2024-02-24T01:45:03.711+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T01:45:03.713321683Z [2024-02-24T01:45:03.711+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T01:45:03.761886283Z [2024-02-24T01:45:03.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T01:40:00+00:00 exited with status queued for try_number 1 2024-02-24T01:45:03.761908014Z [2024-02-24T01:45:03.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T01:40:00+00:00 exited with status success for try_number 1 2024-02-24T01:45:03.761919400Z [2024-02-24T01:45:03.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:44:00+00:00 exited with status success for try_number 1 2024-02-24T01:45:03.761923302Z [2024-02-24T01:45:03.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:44:00+00:00 exited with status success for try_number 1 2024-02-24T01:45:03.772802376Z [2024-02-24T01:45:03.772+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T01:40:00+00:00, map_index=-1, run_start_date=2024-02-24 01:45:03.000691+00:00, run_end_date=2024-02-24 01:45:03.395262+00:00, run_duration=0.394571, state=success, executor_state=success, try_number=1, max_tries=1, job_id=593, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:45:00.480949+00:00, queued_by_job_id=2, pid=8675 2024-02-24T01:45:03.772834660Z [2024-02-24T01:45:03.772+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a392d9a-dcee-418f-887e-a5070aa3d808 2024-02-24T01:45:03.772852196Z [2024-02-24T01:45:03.772+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:44:00+00:00, map_index=-1, run_start_date=2024-02-24 01:45:01.705183+00:00, run_end_date=2024-02-24 01:45:02.316472+00:00, run_duration=0.611289, state=success, executor_state=success, try_number=1, max_tries=1, job_id=590, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:45:00.480949+00:00, queued_by_job_id=2, pid=8649 2024-02-24T01:45:03.772855666Z [2024-02-24T01:45:03.772+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:44:00+00:00, map_index=-1, run_start_date=2024-02-24 01:45:01.861431+00:00, run_end_date=2024-02-24 01:45:02.349301+00:00, run_duration=0.48787, state=success, executor_state=success, try_number=1, max_tries=1, job_id=591, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:45:00.480949+00:00, queued_by_job_id=2, pid=8652 2024-02-24T01:45:05.571500256Z [2024-02-24T01:45:05.570+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:45:05.572153422Z [2024-02-24T01:45:05.571+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:44:00+00:00, run_id=scheduled__2024-02-24T01:44:00+00:00, run_start_date=2024-02-24 01:45:00.395478+00:00, run_end_date=2024-02-24 01:45:05.571683+00:00, run_duration=5.176205, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:44:00+00:00, data_interval_end=2024-02-24 01:45:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:45:05.584512874Z [2024-02-24T01:45:05.584+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:45:00+00:00, run_after=2024-02-24T01:46:00+00:00 2024-02-24T01:45:05.593502205Z [2024-02-24T01:45:05.592+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:45:05.594072743Z [2024-02-24T01:45:05.593+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:44:00+00:00, run_id=scheduled__2024-02-24T01:44:00+00:00, run_start_date=2024-02-24 01:45:00.396413+00:00, run_end_date=2024-02-24 01:45:05.593332+00:00, run_duration=5.196919, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:44:00+00:00, data_interval_end=2024-02-24 01:45:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:45:05.608891631Z [2024-02-24T01:45:05.608+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:45:00+00:00, run_after=2024-02-24T01:46:00+00:00 2024-02-24T01:45:05.675894738Z [2024-02-24T01:45:05.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:44:00+00:00 exited with status success for try_number 1 2024-02-24T01:45:05.676318941Z [2024-02-24T01:45:05.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:44:00+00:00 exited with status success for try_number 1 2024-02-24T01:45:05.684076949Z [2024-02-24T01:45:05.683+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:44:00+00:00, map_index=-1, run_start_date=2024-02-24 01:45:02.898433+00:00, run_end_date=2024-02-24 01:45:04.360682+00:00, run_duration=1.462249, state=success, executor_state=success, try_number=1, max_tries=1, job_id=592, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:45:00.480949+00:00, queued_by_job_id=2, pid=8674 2024-02-24T01:45:05.684449493Z [2024-02-24T01:45:05.684+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:44:00+00:00, map_index=-1, run_start_date=2024-02-24 01:45:03.287553+00:00, run_end_date=2024-02-24 01:45:04.606704+00:00, run_duration=1.319151, state=success, executor_state=success, try_number=1, max_tries=1, job_id=594, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:45:00.480949+00:00, queued_by_job_id=2, pid=8686 2024-02-24T01:45:06.789862350Z [2024-02-24T01:45:06.789+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:45:06.789970046Z 2024-02-24T01:45:06.789990575Z [2024-02-24T01:45:06.789+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:45:06.790899729Z [2024-02-24T01:45:06.790+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:45:06.790917934Z 2024-02-24T01:45:06.795239227Z [2024-02-24T01:45:06.794+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T01:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T01:45:06.795369528Z [2024-02-24T01:45:06.795+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T01:45:06.866522009Z [2024-02-24T01:45:06.865+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T01:40:00+00:00 exited with status queued for try_number 1 2024-02-24T01:45:06.866996285Z [2024-02-24T01:45:06.866+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T01:40:00+00:00 exited with status success for try_number 1 2024-02-24T01:45:06.876183602Z [2024-02-24T01:45:06.875+0000] {scheduler_job.py:635} INFO - Setting external_id for to d81c8824-bda8-4840-8941-1044ad8cb81e 2024-02-24T01:45:06.876789987Z [2024-02-24T01:45:06.876+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T01:40:00+00:00, map_index=-1, run_start_date=2024-02-24 01:45:05.441751+00:00, run_end_date=2024-02-24 01:45:05.844830+00:00, run_duration=0.403079, state=success, executor_state=success, try_number=1, max_tries=1, job_id=595, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:45:03.709311+00:00, queued_by_job_id=2, pid=8704 2024-02-24T01:45:09.752020536Z [2024-02-24T01:45:09.751+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:45:09.752068389Z 2024-02-24T01:45:09.752682930Z [2024-02-24T01:45:09.752+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:45:09.754273434Z [2024-02-24T01:45:09.753+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:45:09.754303352Z 2024-02-24T01:45:09.760472930Z [2024-02-24T01:45:09.760+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:45:09.760784524Z [2024-02-24T01:45:09.760+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T01:45:09.816507299Z [2024-02-24T01:45:09.816+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T01:40:00+00:00 exited with status queued for try_number 1 2024-02-24T01:45:09.817077124Z [2024-02-24T01:45:09.816+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T01:40:00+00:00 exited with status success for try_number 1 2024-02-24T01:45:09.824137170Z [2024-02-24T01:45:09.823+0000] {scheduler_job.py:635} INFO - Setting external_id for to 86bb99ca-32c4-4c0e-be4c-97dded35e99e 2024-02-24T01:45:09.824526939Z [2024-02-24T01:45:09.824+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T01:40:00+00:00, map_index=0, run_start_date=2024-02-24 01:45:08.404982+00:00, run_end_date=2024-02-24 01:45:08.729547+00:00, run_duration=0.324565, state=success, executor_state=success, try_number=1, max_tries=1, job_id=596, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:45:06.791501+00:00, queued_by_job_id=2, pid=8712 2024-02-24T01:45:12.276279509Z [2024-02-24T01:45:12.275+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:45:12.276594189Z [2024-02-24T01:45:12.276+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:40:00+00:00, run_id=scheduled__2024-02-24T01:40:00+00:00, run_start_date=2024-02-24 01:45:00.392143+00:00, run_end_date=2024-02-24 01:45:12.276185+00:00, run_duration=11.884042, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:40:00+00:00, data_interval_end=2024-02-24 01:45:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T01:45:12.282978542Z [2024-02-24T01:45:12.282+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:45:00+00:00, run_after=2024-02-24T01:50:00+00:00 2024-02-24T01:45:12.325027362Z [2024-02-24T01:45:12.324+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T01:40:00+00:00 exited with status success for try_number 1 2024-02-24T01:45:12.332776266Z [2024-02-24T01:45:12.332+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T01:40:00+00:00, map_index=-1, run_start_date=2024-02-24 01:45:11.348088+00:00, run_end_date=2024-02-24 01:45:11.664725+00:00, run_duration=0.316637, state=success, executor_state=success, try_number=1, max_tries=1, job_id=597, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:45:09.755660+00:00, queued_by_job_id=2, pid=8720 2024-02-24T01:46:00.369083948Z [2024-02-24T01:46:00.368+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:46:00+00:00, run_after=2024-02-24T01:47:00+00:00 2024-02-24T01:46:00.377016540Z [2024-02-24T01:46:00.376+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:46:00.391599768Z [2024-02-24T01:46:00.391+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:46:00+00:00, run_after=2024-02-24T01:47:00+00:00 2024-02-24T01:46:00.403847099Z [2024-02-24T01:46:00.403+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a to 2024-02-24T01:46:00+00:00, run_after=2024-02-24T01:47:00+00:00 2024-02-24T01:46:00.411830830Z [2024-02-24T01:46:00.411+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:46:00.530998168Z [2024-02-24T01:46:00.530+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-02-24T01:46:00.531028164Z 2024-02-24T01:46:00.531032446Z 2024-02-24T01:46:00.531036166Z 2024-02-24T01:46:00.531039421Z 2024-02-24T01:46:00.531042602Z 2024-02-24T01:46:00.531216140Z [2024-02-24T01:46:00.530+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T01:46:00.531537155Z [2024-02-24T01:46:00.531+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:46:00.531671750Z [2024-02-24T01:46:00.531+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a has 0/16 running and queued tasks 2024-02-24T01:46:00.531897980Z [2024-02-24T01:46:00.531+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:46:00.532125030Z [2024-02-24T01:46:00.531+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:46:00.533008540Z [2024-02-24T01:46:00.532+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:46:00.533022569Z 2024-02-24T01:46:00.533027421Z 2024-02-24T01:46:00.533031743Z 2024-02-24T01:46:00.533035789Z 2024-02-24T01:46:00.533040081Z 2024-02-24T01:46:00.537662527Z [2024-02-24T01:46:00.537+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:46:00.538048644Z [2024-02-24T01:46:00.537+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T01:46:00.538438085Z [2024-02-24T01:46:00.538+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:46:00.538672585Z [2024-02-24T01:46:00.538+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:46:00.538991357Z [2024-02-24T01:46:00.538+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:46:00.539245244Z [2024-02-24T01:46:00.539+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:46:00.539617408Z [2024-02-24T01:46:00.539+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:46:00.539866752Z [2024-02-24T01:46:00.539+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:46:00.540122104Z [2024-02-24T01:46:00.539+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:46:00.540343421Z [2024-02-24T01:46:00.540+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:46:01.078978018Z [2024-02-24T01:46:01.075+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:44:00+00:00 exited with status queued for try_number 1 2024-02-24T01:46:01.079341365Z [2024-02-24T01:46:01.079+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:45:00+00:00 exited with status queued for try_number 1 2024-02-24T01:46:01.079620445Z [2024-02-24T01:46:01.079+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:45:00+00:00 exited with status queued for try_number 1 2024-02-24T01:46:01.079837899Z [2024-02-24T01:46:01.079+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:45:00+00:00 exited with status queued for try_number 1 2024-02-24T01:46:01.080038844Z [2024-02-24T01:46:01.079+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:45:00+00:00 exited with status queued for try_number 1 2024-02-24T01:46:01.101725957Z [2024-02-24T01:46:01.101+0000] {scheduler_job.py:635} INFO - Setting external_id for to 38da50a4-9ea5-46d3-8a90-a3ab540ac887 2024-02-24T01:46:01.105127136Z [2024-02-24T01:46:01.104+0000] {scheduler_job.py:635} INFO - Setting external_id for to be1b456a-6631-4bbd-8c1a-c55d0cb6bdf4 2024-02-24T01:46:01.105522498Z [2024-02-24T01:46:01.105+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8c506c7-a7a4-40d2-b7d9-cd2722501ee9 2024-02-24T01:46:01.106016106Z [2024-02-24T01:46:01.105+0000] {scheduler_job.py:635} INFO - Setting external_id for to 431505df-88b5-4a26-b6fa-bdf03b0da3b7 2024-02-24T01:46:01.106335503Z [2024-02-24T01:46:01.106+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e7a69c4-6361-4039-9a32-e99a5a3ace16 2024-02-24T01:46:02.443752429Z [2024-02-24T01:46:02.443+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:46:02.444440834Z [2024-02-24T01:46:02.444+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 01:44:00+00:00, run_id=scheduled__2024-02-24T01:44:00+00:00, run_start_date=2024-02-24 01:46:00.423874+00:00, run_end_date=2024-02-24 01:46:02.443665+00:00, run_duration=2.019791, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:44:00+00:00, data_interval_end=2024-02-24 01:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T01:46:02.452922028Z [2024-02-24T01:46:02.452+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T01:46:00+00:00, run_after=2024-02-24T01:48:00+00:00 2024-02-24T01:46:02.467168053Z [2024-02-24T01:46:02.466+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:46:02.467563097Z [2024-02-24T01:46:02.467+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:45:00+00:00, run_id=scheduled__2024-02-24T01:45:00+00:00, run_start_date=2024-02-24 01:46:00.427243+00:00, run_end_date=2024-02-24 01:46:02.467080+00:00, run_duration=2.039837, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:45:00+00:00, data_interval_end=2024-02-24 01:46:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:46:02.478842921Z [2024-02-24T01:46:02.478+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:46:00+00:00, run_after=2024-02-24T01:47:00+00:00 2024-02-24T01:46:02.530652831Z [2024-02-24T01:46:02.530+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:44:00+00:00 exited with status success for try_number 1 2024-02-24T01:46:02.530723413Z [2024-02-24T01:46:02.530+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:45:00+00:00 exited with status failed for try_number 1 2024-02-24T01:46:02.530892510Z [2024-02-24T01:46:02.530+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:45:00+00:00 exited with status success for try_number 1 2024-02-24T01:46:02.539250920Z [2024-02-24T01:46:02.538+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:45:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:46:00.534399+00:00, queued_by_job_id=2, pid=None 2024-02-24T01:46:02.539855537Z [2024-02-24T01:46:02.539+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-24T01:46:02.542266659Z [2024-02-24T01:46:02.541+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-24T01:46:02.556913536Z [2024-02-24T01:46:02.556+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a, task_id=get_sdnc_status_and_send_to_prometheus, execution_date=20240224T014500, start_date=, end_date=20240224T014602 2024-02-24T01:46:02.568032452Z [2024-02-24T01:46:02.567+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:45:00+00:00, map_index=-1, run_start_date=2024-02-24 01:46:01.554460+00:00, run_end_date=2024-02-24 01:46:01.973832+00:00, run_duration=0.419372, state=success, executor_state=success, try_number=1, max_tries=1, job_id=598, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:46:00.534399+00:00, queued_by_job_id=2, pid=8754 2024-02-24T01:46:02.568414358Z [2024-02-24T01:46:02.568+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T01:44:00+00:00, map_index=-1, run_start_date=2024-02-24 01:46:01.710721+00:00, run_end_date=2024-02-24 01:46:02.147749+00:00, run_duration=0.437028, state=success, executor_state=success, try_number=1, max_tries=1, job_id=599, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:46:00.534399+00:00, queued_by_job_id=2, pid=8755 2024-02-24T01:46:04.496805854Z [2024-02-24T01:46:04.496+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:46:04.501477845Z [2024-02-24T01:46:04.499+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:45:00+00:00, run_id=scheduled__2024-02-24T01:45:00+00:00, run_start_date=2024-02-24 01:46:00.429136+00:00, run_end_date=2024-02-24 01:46:04.499356+00:00, run_duration=4.07022, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:45:00+00:00, data_interval_end=2024-02-24 01:46:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:46:04.515383080Z [2024-02-24T01:46:04.515+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:46:00+00:00, run_after=2024-02-24T01:47:00+00:00 2024-02-24T01:46:04.536090413Z [2024-02-24T01:46:04.535+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:46:04.536954807Z [2024-02-24T01:46:04.536+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:45:00+00:00, run_id=scheduled__2024-02-24T01:45:00+00:00, run_start_date=2024-02-24 01:46:00.431006+00:00, run_end_date=2024-02-24 01:46:04.536289+00:00, run_duration=4.105283, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:45:00+00:00, data_interval_end=2024-02-24 01:46:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:46:04.557110842Z [2024-02-24T01:46:04.556+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:46:00+00:00, run_after=2024-02-24T01:47:00+00:00 2024-02-24T01:46:04.609148914Z [2024-02-24T01:46:04.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:45:00+00:00 exited with status success for try_number 1 2024-02-24T01:46:04.617952804Z [2024-02-24T01:46:04.616+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:45:00+00:00, map_index=-1, run_start_date=2024-02-24 01:46:03.067139+00:00, run_end_date=2024-02-24 01:46:04.341364+00:00, run_duration=1.274225, state=success, executor_state=success, try_number=1, max_tries=1, job_id=601, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:46:00.534399+00:00, queued_by_job_id=2, pid=8779 2024-02-24T01:46:04.891308985Z [2024-02-24T01:46:04.889+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:45:00+00:00 exited with status success for try_number 1 2024-02-24T01:46:04.897918172Z [2024-02-24T01:46:04.897+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:45:00+00:00, map_index=-1, run_start_date=2024-02-24 01:46:02.870024+00:00, run_end_date=2024-02-24 01:46:04.444221+00:00, run_duration=1.574197, state=success, executor_state=success, try_number=1, max_tries=1, job_id=600, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:46:00.534399+00:00, queued_by_job_id=2, pid=8778 2024-02-24T01:46:12.953179378Z [2024-02-24T01:46:12.952+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:46:12.953225039Z 2024-02-24T01:46:12.953464166Z [2024-02-24T01:46:12.953+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a has 0/16 running and queued tasks 2024-02-24T01:46:12.955385622Z [2024-02-24T01:46:12.954+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:46:12.955409866Z 2024-02-24T01:46:12.957184694Z [2024-02-24T01:46:12.956+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:45:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:46:12.957419694Z [2024-02-24T01:46:12.957+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:46:13.003548744Z [2024-02-24T01:46:13.003+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:45:00+00:00 exited with status queued for try_number 2 2024-02-24T01:46:13.009869580Z [2024-02-24T01:46:13.009+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f6d39a6-1125-408c-9a28-83946678e40d 2024-02-24T01:46:13.557033675Z [2024-02-24T01:46:13.556+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:45:00+00:00 exited with status failed for try_number 2 2024-02-24T01:46:13.565067668Z [2024-02-24T01:46:13.564+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:45:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-02-24 01:46:02.545077+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:46:12.954780+00:00, queued_by_job_id=2, pid=None 2024-02-24T01:46:13.565577794Z [2024-02-24T01:46:13.565+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-24T01:46:13.568289571Z [2024-02-24T01:46:13.568+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-24T01:46:13.582145752Z [2024-02-24T01:46:13.581+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a, task_id=get_sdnc_status_and_send_to_prometheus, execution_date=20240224T014500, start_date=, end_date=20240224T014613 2024-02-24T01:46:14.643642549Z [2024-02-24T01:46:14.643+0000] {dagrun.py:586} ERROR - Marking run failed 2024-02-24T01:46:14.643862411Z [2024-02-24T01:46:14.643+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a, execution_date=2024-02-24 01:45:00+00:00, run_id=scheduled__2024-02-24T01:45:00+00:00, run_start_date=2024-02-24 01:46:00.425566+00:00, run_end_date=2024-02-24 01:46:14.643590+00:00, run_duration=14.218024, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:45:00+00:00, data_interval_end=2024-02-24 01:46:00+00:00, dag_hash=41537f102683813c984380f19c849c40 2024-02-24T01:46:14.656854406Z [2024-02-24T01:46:14.656+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a to 2024-02-24T01:46:00+00:00, run_after=2024-02-24T01:47:00+00:00 2024-02-24T01:47:00.267928742Z [2024-02-24T01:47:00.267+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:47:00+00:00, run_after=2024-02-24T01:48:00+00:00 2024-02-24T01:47:00.286547527Z [2024-02-24T01:47:00.285+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:47:00+00:00, run_after=2024-02-24T01:48:00+00:00 2024-02-24T01:47:00.294650211Z [2024-02-24T01:47:00.294+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:47:00.364546097Z [2024-02-24T01:47:00.364+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T01:47:00.364581689Z 2024-02-24T01:47:00.364587544Z 2024-02-24T01:47:00.364593054Z 2024-02-24T01:47:00.364598525Z [2024-02-24T01:47:00.364+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:47:00.364990694Z [2024-02-24T01:47:00.364+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:47:00.365056756Z [2024-02-24T01:47:00.364+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:47:00.365866984Z [2024-02-24T01:47:00.365+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:47:00.365882368Z 2024-02-24T01:47:00.365886414Z 2024-02-24T01:47:00.365890381Z 2024-02-24T01:47:00.369355923Z [2024-02-24T01:47:00.368+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:47:00.369395379Z [2024-02-24T01:47:00.369+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:47:00.369602014Z [2024-02-24T01:47:00.369+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:47:00.369848160Z [2024-02-24T01:47:00.369+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:47:00.370221208Z [2024-02-24T01:47:00.369+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:47:00.370415520Z [2024-02-24T01:47:00.370+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:47:00.661936307Z [2024-02-24T01:47:00.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:46:00+00:00 exited with status queued for try_number 1 2024-02-24T01:47:00.662034529Z [2024-02-24T01:47:00.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:46:00+00:00 exited with status queued for try_number 1 2024-02-24T01:47:00.662173080Z [2024-02-24T01:47:00.662+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:46:00+00:00 exited with status queued for try_number 1 2024-02-24T01:47:00.679504729Z [2024-02-24T01:47:00.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8576e771-687b-44b0-8d7b-9358879312ed 2024-02-24T01:47:00.679605560Z [2024-02-24T01:47:00.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0800fbbf-539b-4b37-91c6-a49bb79c9e87 2024-02-24T01:47:00.679688761Z [2024-02-24T01:47:00.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to f30ac8fe-0eb4-40f6-b0c1-bc08b24aa8bb 2024-02-24T01:47:01.882140313Z [2024-02-24T01:47:01.881+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:47:01.882361115Z [2024-02-24T01:47:01.882+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:46:00+00:00, run_id=scheduled__2024-02-24T01:46:00+00:00, run_start_date=2024-02-24 01:47:00.309411+00:00, run_end_date=2024-02-24 01:47:01.882060+00:00, run_duration=1.572649, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:46:00+00:00, data_interval_end=2024-02-24 01:47:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:47:01.892038828Z [2024-02-24T01:47:01.891+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:47:00+00:00, run_after=2024-02-24T01:48:00+00:00 2024-02-24T01:47:01.934333480Z [2024-02-24T01:47:01.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:46:00+00:00 exited with status success for try_number 1 2024-02-24T01:47:01.939334279Z [2024-02-24T01:47:01.938+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:46:00+00:00, map_index=-1, run_start_date=2024-02-24 01:47:01.196400+00:00, run_end_date=2024-02-24 01:47:01.573093+00:00, run_duration=0.376693, state=success, executor_state=success, try_number=1, max_tries=1, job_id=602, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:47:00.366582+00:00, queued_by_job_id=2, pid=8821 2024-02-24T01:47:03.185823130Z [2024-02-24T01:47:03.185+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T01:47:04.248073309Z [2024-02-24T01:47:04.247+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:47:04.248731494Z [2024-02-24T01:47:04.248+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:46:00+00:00, run_id=scheduled__2024-02-24T01:46:00+00:00, run_start_date=2024-02-24 01:47:00.310904+00:00, run_end_date=2024-02-24 01:47:04.248228+00:00, run_duration=3.937324, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:46:00+00:00, data_interval_end=2024-02-24 01:47:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:47:04.259160662Z [2024-02-24T01:47:04.258+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:47:00+00:00, run_after=2024-02-24T01:48:00+00:00 2024-02-24T01:47:04.271618740Z [2024-02-24T01:47:04.271+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:47:04.272066823Z [2024-02-24T01:47:04.271+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:46:00+00:00, run_id=scheduled__2024-02-24T01:46:00+00:00, run_start_date=2024-02-24 01:47:00.312385+00:00, run_end_date=2024-02-24 01:47:04.271690+00:00, run_duration=3.959305, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:46:00+00:00, data_interval_end=2024-02-24 01:47:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:47:04.283206431Z [2024-02-24T01:47:04.282+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:47:00+00:00, run_after=2024-02-24T01:48:00+00:00 2024-02-24T01:47:04.329911770Z [2024-02-24T01:47:04.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:46:00+00:00 exited with status success for try_number 1 2024-02-24T01:47:04.330652534Z [2024-02-24T01:47:04.330+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:46:00+00:00 exited with status success for try_number 1 2024-02-24T01:47:04.343923663Z [2024-02-24T01:47:04.343+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:46:00+00:00, map_index=-1, run_start_date=2024-02-24 01:47:02.189540+00:00, run_end_date=2024-02-24 01:47:03.919202+00:00, run_duration=1.729662, state=success, executor_state=success, try_number=1, max_tries=1, job_id=603, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:47:00.366582+00:00, queued_by_job_id=2, pid=8839 2024-02-24T01:47:04.344775843Z [2024-02-24T01:47:04.344+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:46:00+00:00, map_index=-1, run_start_date=2024-02-24 01:47:02.443713+00:00, run_end_date=2024-02-24 01:47:03.937473+00:00, run_duration=1.49376, state=success, executor_state=success, try_number=1, max_tries=1, job_id=604, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:47:00.366582+00:00, queued_by_job_id=2, pid=8840 2024-02-24T01:48:00.149849819Z [2024-02-24T01:48:00.149+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:48:00.166043903Z [2024-02-24T01:48:00.165+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:48:00+00:00, run_after=2024-02-24T01:49:00+00:00 2024-02-24T01:48:00.172652103Z [2024-02-24T01:48:00.172+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:48:00.183429386Z [2024-02-24T01:48:00.183+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:48:00+00:00, run_after=2024-02-24T01:49:00+00:00 2024-02-24T01:48:00.249195074Z [2024-02-24T01:48:00.248+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T01:48:00.249219230Z 2024-02-24T01:48:00.249223589Z 2024-02-24T01:48:00.249227553Z 2024-02-24T01:48:00.249230713Z 2024-02-24T01:48:00.249395333Z [2024-02-24T01:48:00.249+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T01:48:00.249511439Z [2024-02-24T01:48:00.249+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:48:00.249678293Z [2024-02-24T01:48:00.249+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:48:00.249800022Z [2024-02-24T01:48:00.249+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:48:00.250523350Z [2024-02-24T01:48:00.250+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:48:00.250545900Z 2024-02-24T01:48:00.250555872Z 2024-02-24T01:48:00.250563554Z 2024-02-24T01:48:00.250571905Z 2024-02-24T01:48:00.254156965Z [2024-02-24T01:48:00.253+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:48:00.254229291Z [2024-02-24T01:48:00.254+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T01:48:00.254529029Z [2024-02-24T01:48:00.254+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:48:00.254579496Z [2024-02-24T01:48:00.254+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:48:00.254785515Z [2024-02-24T01:48:00.254+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:48:00.254882065Z [2024-02-24T01:48:00.254+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:48:00.255053783Z [2024-02-24T01:48:00.254+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:48:00.255300855Z [2024-02-24T01:48:00.255+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:48:00.670842228Z [2024-02-24T01:48:00.670+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:46:00+00:00 exited with status queued for try_number 1 2024-02-24T01:48:00.672838292Z [2024-02-24T01:48:00.670+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:47:00+00:00 exited with status queued for try_number 1 2024-02-24T01:48:00.673151870Z [2024-02-24T01:48:00.672+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:47:00+00:00 exited with status queued for try_number 1 2024-02-24T01:48:00.673374658Z [2024-02-24T01:48:00.673+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:47:00+00:00 exited with status queued for try_number 1 2024-02-24T01:48:00.691476104Z [2024-02-24T01:48:00.691+0000] {scheduler_job.py:635} INFO - Setting external_id for to 12bc69f8-a842-4003-94d5-b4bb9620410e 2024-02-24T01:48:00.691824555Z [2024-02-24T01:48:00.691+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e5c7365-4a26-4a6e-b592-324424173534 2024-02-24T01:48:00.692164765Z [2024-02-24T01:48:00.691+0000] {scheduler_job.py:635} INFO - Setting external_id for to e897e34b-1ef9-4f35-b897-6bb22485916d 2024-02-24T01:48:00.692504400Z [2024-02-24T01:48:00.692+0000] {scheduler_job.py:635} INFO - Setting external_id for to 95ca52d0-2477-4080-9884-6fa9224252cd 2024-02-24T01:48:01.874317709Z [2024-02-24T01:48:01.873+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:48:01.874615897Z [2024-02-24T01:48:01.874+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 01:46:00+00:00, run_id=scheduled__2024-02-24T01:46:00+00:00, run_start_date=2024-02-24 01:48:00.193048+00:00, run_end_date=2024-02-24 01:48:01.874148+00:00, run_duration=1.6811, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:46:00+00:00, data_interval_end=2024-02-24 01:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T01:48:01.883779678Z [2024-02-24T01:48:01.883+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T01:48:00+00:00, run_after=2024-02-24T01:50:00+00:00 2024-02-24T01:48:01.897687680Z [2024-02-24T01:48:01.897+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:48:01.897955245Z [2024-02-24T01:48:01.897+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:47:00+00:00, run_id=scheduled__2024-02-24T01:47:00+00:00, run_start_date=2024-02-24 01:48:00.194177+00:00, run_end_date=2024-02-24 01:48:01.897488+00:00, run_duration=1.703311, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:47:00+00:00, data_interval_end=2024-02-24 01:48:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:48:01.921251050Z [2024-02-24T01:48:01.920+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:48:00+00:00, run_after=2024-02-24T01:49:00+00:00 2024-02-24T01:48:01.978732885Z [2024-02-24T01:48:01.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:46:00+00:00 exited with status success for try_number 1 2024-02-24T01:48:01.978783683Z [2024-02-24T01:48:01.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:47:00+00:00 exited with status success for try_number 1 2024-02-24T01:48:01.985708369Z [2024-02-24T01:48:01.985+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T01:46:00+00:00, map_index=-1, run_start_date=2024-02-24 01:48:01.046316+00:00, run_end_date=2024-02-24 01:48:01.488105+00:00, run_duration=0.441789, state=success, executor_state=success, try_number=1, max_tries=1, job_id=605, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:48:00.251109+00:00, queued_by_job_id=2, pid=8873 2024-02-24T01:48:01.985863560Z [2024-02-24T01:48:01.985+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:47:00+00:00, map_index=-1, run_start_date=2024-02-24 01:48:01.089500+00:00, run_end_date=2024-02-24 01:48:01.481112+00:00, run_duration=0.391612, state=success, executor_state=success, try_number=1, max_tries=1, job_id=606, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:48:00.251109+00:00, queued_by_job_id=2, pid=8874 2024-02-24T01:48:04.144519451Z [2024-02-24T01:48:04.144+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:48:04.144919707Z [2024-02-24T01:48:04.144+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:47:00+00:00, run_id=scheduled__2024-02-24T01:47:00+00:00, run_start_date=2024-02-24 01:48:00.196182+00:00, run_end_date=2024-02-24 01:48:04.144388+00:00, run_duration=3.948206, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:47:00+00:00, data_interval_end=2024-02-24 01:48:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:48:04.153982061Z [2024-02-24T01:48:04.153+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:48:00+00:00, run_after=2024-02-24T01:49:00+00:00 2024-02-24T01:48:04.161521493Z [2024-02-24T01:48:04.161+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:48:04.161974779Z [2024-02-24T01:48:04.161+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:47:00+00:00, run_id=scheduled__2024-02-24T01:47:00+00:00, run_start_date=2024-02-24 01:48:00.195180+00:00, run_end_date=2024-02-24 01:48:04.161427+00:00, run_duration=3.966247, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:47:00+00:00, data_interval_end=2024-02-24 01:48:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:48:04.172164325Z [2024-02-24T01:48:04.171+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:48:00+00:00, run_after=2024-02-24T01:49:00+00:00 2024-02-24T01:48:04.210981404Z [2024-02-24T01:48:04.210+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:47:00+00:00 exited with status success for try_number 1 2024-02-24T01:48:04.211041042Z [2024-02-24T01:48:04.210+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:47:00+00:00 exited with status success for try_number 1 2024-02-24T01:48:04.220739689Z [2024-02-24T01:48:04.220+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:47:00+00:00, map_index=-1, run_start_date=2024-02-24 01:48:02.404684+00:00, run_end_date=2024-02-24 01:48:03.935618+00:00, run_duration=1.530934, state=success, executor_state=success, try_number=1, max_tries=1, job_id=608, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:48:00.251109+00:00, queued_by_job_id=2, pid=8898 2024-02-24T01:48:04.220881624Z [2024-02-24T01:48:04.220+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:47:00+00:00, map_index=-1, run_start_date=2024-02-24 01:48:02.145067+00:00, run_end_date=2024-02-24 01:48:03.979416+00:00, run_duration=1.834349, state=success, executor_state=success, try_number=1, max_tries=1, job_id=607, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:48:00.251109+00:00, queued_by_job_id=2, pid=8892 2024-02-24T01:49:00.853585941Z [2024-02-24T01:49:00.853+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:49:00+00:00, run_after=2024-02-24T01:50:00+00:00 2024-02-24T01:49:00.870392015Z [2024-02-24T01:49:00.869+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:49:00+00:00, run_after=2024-02-24T01:50:00+00:00 2024-02-24T01:49:00.878181182Z [2024-02-24T01:49:00.877+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:49:00.964158849Z [2024-02-24T01:49:00.963+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T01:49:00.964189569Z 2024-02-24T01:49:00.964213429Z 2024-02-24T01:49:00.964218131Z 2024-02-24T01:49:00.964641023Z [2024-02-24T01:49:00.964+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:49:00.964861828Z [2024-02-24T01:49:00.964+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:49:00.965089478Z [2024-02-24T01:49:00.964+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:49:00.966091815Z [2024-02-24T01:49:00.965+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:49:00.966107335Z 2024-02-24T01:49:00.966112250Z 2024-02-24T01:49:00.966117076Z 2024-02-24T01:49:00.970813197Z [2024-02-24T01:49:00.970+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:49:00.971095046Z [2024-02-24T01:49:00.970+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:49:00.971393107Z [2024-02-24T01:49:00.971+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:49:00.971558463Z [2024-02-24T01:49:00.971+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:49:00.971864406Z [2024-02-24T01:49:00.971+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:49:00.972112858Z [2024-02-24T01:49:00.971+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:49:01.343121963Z [2024-02-24T01:49:01.342+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:48:00+00:00 exited with status queued for try_number 1 2024-02-24T01:49:01.346699940Z [2024-02-24T01:49:01.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:48:00+00:00 exited with status queued for try_number 1 2024-02-24T01:49:01.347016114Z [2024-02-24T01:49:01.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:48:00+00:00 exited with status queued for try_number 1 2024-02-24T01:49:01.359927730Z [2024-02-24T01:49:01.359+0000] {scheduler_job.py:635} INFO - Setting external_id for to 963229e5-2671-4361-8f23-385a9e50bb56 2024-02-24T01:49:01.360219654Z [2024-02-24T01:49:01.360+0000] {scheduler_job.py:635} INFO - Setting external_id for to df3cdc14-701a-4024-aa4b-8ee9ddecfc32 2024-02-24T01:49:01.360423494Z [2024-02-24T01:49:01.360+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17635b28-bd9d-4743-893e-b42e277f1fbe 2024-02-24T01:49:02.816302121Z [2024-02-24T01:49:02.815+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:49:02.816531307Z [2024-02-24T01:49:02.816+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:48:00+00:00, run_id=scheduled__2024-02-24T01:48:00+00:00, run_start_date=2024-02-24 01:49:00.888457+00:00, run_end_date=2024-02-24 01:49:02.816190+00:00, run_duration=1.927733, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:48:00+00:00, data_interval_end=2024-02-24 01:49:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:49:02.826622006Z [2024-02-24T01:49:02.826+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:49:00+00:00, run_after=2024-02-24T01:50:00+00:00 2024-02-24T01:49:02.886602853Z [2024-02-24T01:49:02.886+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:48:00+00:00 exited with status success for try_number 1 2024-02-24T01:49:02.894650732Z [2024-02-24T01:49:02.894+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:48:00+00:00, map_index=-1, run_start_date=2024-02-24 01:49:01.863395+00:00, run_end_date=2024-02-24 01:49:02.246212+00:00, run_duration=0.382817, state=success, executor_state=success, try_number=1, max_tries=1, job_id=609, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:49:00.967177+00:00, queued_by_job_id=2, pid=8930 2024-02-24T01:49:05.054643953Z [2024-02-24T01:49:05.054+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:49:05.055087710Z [2024-02-24T01:49:05.054+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:48:00+00:00, run_id=scheduled__2024-02-24T01:48:00+00:00, run_start_date=2024-02-24 01:49:00.889723+00:00, run_end_date=2024-02-24 01:49:05.054734+00:00, run_duration=4.165011, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:48:00+00:00, data_interval_end=2024-02-24 01:49:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:49:05.063804060Z [2024-02-24T01:49:05.063+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:49:00+00:00, run_after=2024-02-24T01:50:00+00:00 2024-02-24T01:49:05.105370520Z [2024-02-24T01:49:05.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:48:00+00:00 exited with status success for try_number 1 2024-02-24T01:49:05.110884888Z [2024-02-24T01:49:05.110+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:48:00+00:00, map_index=-1, run_start_date=2024-02-24 01:49:03.059010+00:00, run_end_date=2024-02-24 01:49:04.450226+00:00, run_duration=1.391216, state=success, executor_state=success, try_number=1, max_tries=1, job_id=610, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:49:00.967177+00:00, queued_by_job_id=2, pid=8948 2024-02-24T01:49:06.040851134Z [2024-02-24T01:49:06.040+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:49:06.041292127Z [2024-02-24T01:49:06.040+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:48:00+00:00, run_id=scheduled__2024-02-24T01:48:00+00:00, run_start_date=2024-02-24 01:49:00.890827+00:00, run_end_date=2024-02-24 01:49:06.040713+00:00, run_duration=5.149886, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:48:00+00:00, data_interval_end=2024-02-24 01:49:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:49:06.061171056Z [2024-02-24T01:49:06.060+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:49:00+00:00, run_after=2024-02-24T01:50:00+00:00 2024-02-24T01:49:06.106332470Z [2024-02-24T01:49:06.105+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:48:00+00:00 exited with status success for try_number 1 2024-02-24T01:49:06.114503458Z [2024-02-24T01:49:06.113+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:48:00+00:00, map_index=-1, run_start_date=2024-02-24 01:49:03.112288+00:00, run_end_date=2024-02-24 01:49:05.617232+00:00, run_duration=2.504944, state=success, executor_state=success, try_number=1, max_tries=1, job_id=611, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:49:00.967177+00:00, queued_by_job_id=2, pid=8949 2024-02-24T01:50:00.765467774Z [2024-02-24T01:50:00.764+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:50:00+00:00, run_after=2024-02-24T01:55:00+00:00 2024-02-24T01:50:00.788911716Z [2024-02-24T01:50:00.786+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:50:00+00:00, run_after=2024-02-24T01:51:00+00:00 2024-02-24T01:50:00.798378287Z [2024-02-24T01:50:00.798+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:50:00.812898943Z [2024-02-24T01:50:00.812+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:50:00+00:00, run_after=2024-02-24T01:51:00+00:00 2024-02-24T01:50:00.821720384Z [2024-02-24T01:50:00.821+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:50:00.958850451Z [2024-02-24T01:50:00.958+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-02-24T01:50:00.958884020Z 2024-02-24T01:50:00.958889900Z 2024-02-24T01:50:00.958895947Z 2024-02-24T01:50:00.958930995Z 2024-02-24T01:50:00.958940574Z 2024-02-24T01:50:00.959030149Z [2024-02-24T01:50:00.958+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:50:00.959114321Z [2024-02-24T01:50:00.958+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T01:50:00.959127620Z [2024-02-24T01:50:00.958+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:50:00.959238678Z [2024-02-24T01:50:00.959+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:50:00.959380787Z [2024-02-24T01:50:00.959+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:50:00.960183552Z [2024-02-24T01:50:00.959+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:50:00.960199952Z 2024-02-24T01:50:00.960205881Z 2024-02-24T01:50:00.960212098Z 2024-02-24T01:50:00.960217195Z 2024-02-24T01:50:00.960222053Z 2024-02-24T01:50:00.966816723Z [2024-02-24T01:50:00.966+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T01:50:00.966951997Z [2024-02-24T01:50:00.966+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T01:50:00.967284185Z [2024-02-24T01:50:00.967+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:50:00.967416611Z [2024-02-24T01:50:00.967+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T01:50:00.967723132Z [2024-02-24T01:50:00.967+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:50:00.967866149Z [2024-02-24T01:50:00.967+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:50:00.968167147Z [2024-02-24T01:50:00.967+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:50:00.968307187Z [2024-02-24T01:50:00.968+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:50:00.968674958Z [2024-02-24T01:50:00.968+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:50:00.968848226Z [2024-02-24T01:50:00.968+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:50:01.520247139Z [2024-02-24T01:50:01.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T01:45:00+00:00 exited with status queued for try_number 1 2024-02-24T01:50:01.520451995Z [2024-02-24T01:50:01.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:48:00+00:00 exited with status queued for try_number 1 2024-02-24T01:50:01.520547314Z [2024-02-24T01:50:01.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:49:00+00:00 exited with status queued for try_number 1 2024-02-24T01:50:01.520645204Z [2024-02-24T01:50:01.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:49:00+00:00 exited with status queued for try_number 1 2024-02-24T01:50:01.520717520Z [2024-02-24T01:50:01.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:49:00+00:00 exited with status queued for try_number 1 2024-02-24T01:50:01.540574560Z [2024-02-24T01:50:01.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc2073a6-8e82-47e3-baf7-48348afb8a57 2024-02-24T01:50:01.540653857Z [2024-02-24T01:50:01.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9ac0ada3-5086-4a4a-bf83-f3247b1ccb21 2024-02-24T01:50:01.540759970Z [2024-02-24T01:50:01.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to 743baeb4-f68c-4226-aa7a-498b98645ec9 2024-02-24T01:50:01.540892469Z [2024-02-24T01:50:01.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to b29c7d5d-c0b7-415a-aa6e-81148e592fb0 2024-02-24T01:50:01.541039209Z [2024-02-24T01:50:01.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0ac7d709-7314-440c-a404-efce6262c471 2024-02-24T01:50:02.974812836Z [2024-02-24T01:50:02.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:48:00+00:00 exited with status success for try_number 1 2024-02-24T01:50:02.980545459Z [2024-02-24T01:50:02.980+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T01:48:00+00:00, map_index=-1, run_start_date=2024-02-24 01:50:02.099504+00:00, run_end_date=2024-02-24 01:50:02.537958+00:00, run_duration=0.438454, state=success, executor_state=success, try_number=1, max_tries=1, job_id=612, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:50:00.962119+00:00, queued_by_job_id=2, pid=8982 2024-02-24T01:50:04.068564746Z [2024-02-24T01:50:04.068+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:50:04.069342026Z [2024-02-24T01:50:04.069+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 01:48:00+00:00, run_id=scheduled__2024-02-24T01:48:00+00:00, run_start_date=2024-02-24 01:50:00.853636+00:00, run_end_date=2024-02-24 01:50:04.068457+00:00, run_duration=3.214821, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:48:00+00:00, data_interval_end=2024-02-24 01:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T01:50:04.078369653Z [2024-02-24T01:50:04.078+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T01:50:00+00:00, run_after=2024-02-24T01:52:00+00:00 2024-02-24T01:50:04.085533210Z [2024-02-24T01:50:04.085+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:50:04.086070733Z [2024-02-24T01:50:04.085+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:49:00+00:00, run_id=scheduled__2024-02-24T01:49:00+00:00, run_start_date=2024-02-24 01:50:00.854699+00:00, run_end_date=2024-02-24 01:50:04.085424+00:00, run_duration=3.230725, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:49:00+00:00, data_interval_end=2024-02-24 01:50:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:50:04.095988637Z [2024-02-24T01:50:04.095+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:50:00+00:00, run_after=2024-02-24T01:51:00+00:00 2024-02-24T01:50:04.163840192Z [2024-02-24T01:50:04.163+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:49:00+00:00 exited with status success for try_number 1 2024-02-24T01:50:04.169986612Z [2024-02-24T01:50:04.169+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:49:00+00:00, map_index=-1, run_start_date=2024-02-24 01:50:02.578275+00:00, run_end_date=2024-02-24 01:50:03.261312+00:00, run_duration=0.683037, state=success, executor_state=success, try_number=1, max_tries=1, job_id=613, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:50:00.962119+00:00, queued_by_job_id=2, pid=8988 2024-02-24T01:50:05.232991225Z [2024-02-24T01:50:05.232+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:50:05.233363888Z [2024-02-24T01:50:05.233+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:49:00+00:00, run_id=scheduled__2024-02-24T01:49:00+00:00, run_start_date=2024-02-24 01:50:00.856138+00:00, run_end_date=2024-02-24 01:50:05.232885+00:00, run_duration=4.376747, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:49:00+00:00, data_interval_end=2024-02-24 01:50:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:50:05.243828686Z [2024-02-24T01:50:05.243+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:50:00+00:00, run_after=2024-02-24T01:51:00+00:00 2024-02-24T01:50:05.271730817Z [2024-02-24T01:50:05.271+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:50:05.271762138Z 2024-02-24T01:50:05.272052401Z [2024-02-24T01:50:05.271+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:50:05.273488273Z [2024-02-24T01:50:05.273+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:50:05.273526993Z 2024-02-24T01:50:05.277068557Z [2024-02-24T01:50:05.276+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T01:50:05.277155555Z [2024-02-24T01:50:05.276+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T01:50:05.341547957Z [2024-02-24T01:50:05.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T01:45:00+00:00 exited with status queued for try_number 1 2024-02-24T01:50:05.341590392Z [2024-02-24T01:50:05.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T01:45:00+00:00 exited with status success for try_number 1 2024-02-24T01:50:05.357324855Z [2024-02-24T01:50:05.356+0000] {scheduler_job.py:635} INFO - Setting external_id for to 513b54a7-2c8c-447e-b3ee-0e3cfe243999 2024-02-24T01:50:05.359069714Z [2024-02-24T01:50:05.357+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T01:45:00+00:00, map_index=-1, run_start_date=2024-02-24 01:50:04.114955+00:00, run_end_date=2024-02-24 01:50:04.539284+00:00, run_duration=0.424329, state=success, executor_state=success, try_number=1, max_tries=1, job_id=616, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:50:00.962119+00:00, queued_by_job_id=2, pid=9014 2024-02-24T01:50:05.478714803Z [2024-02-24T01:50:05.478+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:49:00+00:00 exited with status success for try_number 1 2024-02-24T01:50:05.488105363Z [2024-02-24T01:50:05.487+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:49:00+00:00, map_index=-1, run_start_date=2024-02-24 01:50:03.912133+00:00, run_end_date=2024-02-24 01:50:05.192201+00:00, run_duration=1.280068, state=success, executor_state=success, try_number=1, max_tries=1, job_id=614, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:50:00.962119+00:00, queued_by_job_id=2, pid=9012 2024-02-24T01:50:06.549238917Z [2024-02-24T01:50:06.548+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:50:06.549801687Z [2024-02-24T01:50:06.549+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:49:00+00:00, run_id=scheduled__2024-02-24T01:49:00+00:00, run_start_date=2024-02-24 01:50:00.857699+00:00, run_end_date=2024-02-24 01:50:06.549315+00:00, run_duration=5.691616, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:49:00+00:00, data_interval_end=2024-02-24 01:50:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:50:06.566000872Z [2024-02-24T01:50:06.565+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:50:00+00:00, run_after=2024-02-24T01:51:00+00:00 2024-02-24T01:50:06.624719016Z [2024-02-24T01:50:06.624+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:49:00+00:00 exited with status success for try_number 1 2024-02-24T01:50:06.632703377Z [2024-02-24T01:50:06.632+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:49:00+00:00, map_index=-1, run_start_date=2024-02-24 01:50:04.067099+00:00, run_end_date=2024-02-24 01:50:05.754565+00:00, run_duration=1.687466, state=success, executor_state=success, try_number=1, max_tries=1, job_id=615, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:50:00.962119+00:00, queued_by_job_id=2, pid=9013 2024-02-24T01:50:07.759257413Z [2024-02-24T01:50:07.758+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:50:07.759292757Z 2024-02-24T01:50:07.759815957Z [2024-02-24T01:50:07.759+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:50:07.761853544Z [2024-02-24T01:50:07.761+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:50:07.761874898Z 2024-02-24T01:50:07.766656529Z [2024-02-24T01:50:07.766+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T01:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T01:50:07.766913616Z [2024-02-24T01:50:07.766+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T01:50:07.843847352Z [2024-02-24T01:50:07.843+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T01:45:00+00:00 exited with status queued for try_number 1 2024-02-24T01:50:07.843975389Z [2024-02-24T01:50:07.843+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T01:45:00+00:00 exited with status success for try_number 1 2024-02-24T01:50:07.852488014Z [2024-02-24T01:50:07.851+0000] {scheduler_job.py:635} INFO - Setting external_id for to c2be22b0-3097-4822-bc01-d8c22bdaf34f 2024-02-24T01:50:07.853188091Z [2024-02-24T01:50:07.852+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T01:45:00+00:00, map_index=-1, run_start_date=2024-02-24 01:50:07.027433+00:00, run_end_date=2024-02-24 01:50:07.396449+00:00, run_duration=0.369016, state=success, executor_state=success, try_number=1, max_tries=1, job_id=617, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:50:05.273821+00:00, queued_by_job_id=2, pid=9037 2024-02-24T01:50:10.303615662Z [2024-02-24T01:50:10.303+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:50:10.303667716Z 2024-02-24T01:50:10.303887070Z [2024-02-24T01:50:10.303+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:50:10.304825322Z [2024-02-24T01:50:10.304+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:50:10.304841216Z 2024-02-24T01:50:10.307679465Z [2024-02-24T01:50:10.307+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:50:10.307931668Z [2024-02-24T01:50:10.307+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T01:50:10.364825990Z [2024-02-24T01:50:10.364+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T01:45:00+00:00 exited with status queued for try_number 1 2024-02-24T01:50:10.364922142Z [2024-02-24T01:50:10.364+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T01:45:00+00:00 exited with status success for try_number 1 2024-02-24T01:50:10.377120013Z [2024-02-24T01:50:10.376+0000] {scheduler_job.py:635} INFO - Setting external_id for to b70bb5a4-df73-4544-bedf-b524149f58a3 2024-02-24T01:50:10.377447459Z [2024-02-24T01:50:10.377+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T01:45:00+00:00, map_index=0, run_start_date=2024-02-24 01:50:09.411031+00:00, run_end_date=2024-02-24 01:50:09.784117+00:00, run_duration=0.373086, state=success, executor_state=success, try_number=1, max_tries=1, job_id=618, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:50:07.762783+00:00, queued_by_job_id=2, pid=9045 2024-02-24T01:50:12.430386959Z [2024-02-24T01:50:12.429+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:50:12.430518053Z [2024-02-24T01:50:12.430+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:45:00+00:00, run_id=scheduled__2024-02-24T01:45:00+00:00, run_start_date=2024-02-24 01:50:00.852273+00:00, run_end_date=2024-02-24 01:50:12.430266+00:00, run_duration=11.577993, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:45:00+00:00, data_interval_end=2024-02-24 01:50:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T01:50:12.438223497Z [2024-02-24T01:50:12.437+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:50:00+00:00, run_after=2024-02-24T01:55:00+00:00 2024-02-24T01:50:13.215494635Z [2024-02-24T01:50:13.215+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T01:45:00+00:00 exited with status success for try_number 1 2024-02-24T01:50:13.220782393Z [2024-02-24T01:50:13.220+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T01:45:00+00:00, map_index=-1, run_start_date=2024-02-24 01:50:11.927149+00:00, run_end_date=2024-02-24 01:50:12.367364+00:00, run_duration=0.440215, state=success, executor_state=success, try_number=1, max_tries=1, job_id=619, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:50:10.305275+00:00, queued_by_job_id=2, pid=9053 2024-02-24T01:51:00.993543196Z [2024-02-24T01:51:00.993+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:51:00+00:00, run_after=2024-02-24T01:52:00+00:00 2024-02-24T01:51:01.008820029Z [2024-02-24T01:51:01.008+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:51:00+00:00, run_after=2024-02-24T01:52:00+00:00 2024-02-24T01:51:01.018304019Z [2024-02-24T01:51:01.017+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:51:01.125925533Z [2024-02-24T01:51:01.125+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T01:51:01.125963271Z 2024-02-24T01:51:01.125971967Z 2024-02-24T01:51:01.125978914Z 2024-02-24T01:51:01.126438329Z [2024-02-24T01:51:01.126+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:51:01.126921811Z [2024-02-24T01:51:01.126+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:51:01.127370151Z [2024-02-24T01:51:01.127+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:51:01.128761254Z [2024-02-24T01:51:01.128+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:51:01.128779918Z 2024-02-24T01:51:01.128787620Z 2024-02-24T01:51:01.128795084Z 2024-02-24T01:51:01.134309860Z [2024-02-24T01:51:01.133+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:51:01.134644356Z [2024-02-24T01:51:01.134+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:51:01.135078536Z [2024-02-24T01:51:01.134+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:51:01.135356115Z [2024-02-24T01:51:01.135+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:51:01.135714552Z [2024-02-24T01:51:01.135+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:51:01.135962092Z [2024-02-24T01:51:01.135+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:51:01.461608425Z [2024-02-24T01:51:01.460+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:50:00+00:00 exited with status queued for try_number 1 2024-02-24T01:51:01.461641633Z [2024-02-24T01:51:01.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:50:00+00:00 exited with status queued for try_number 1 2024-02-24T01:51:01.461731753Z [2024-02-24T01:51:01.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:50:00+00:00 exited with status queued for try_number 1 2024-02-24T01:51:01.471899631Z [2024-02-24T01:51:01.471+0000] {scheduler_job.py:635} INFO - Setting external_id for to 10a92056-e73c-429e-8878-e33f8647bff2 2024-02-24T01:51:01.471930822Z [2024-02-24T01:51:01.471+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4967e070-c6ac-4d27-9d3f-1630714a2c91 2024-02-24T01:51:01.472053748Z [2024-02-24T01:51:01.471+0000] {scheduler_job.py:635} INFO - Setting external_id for to 800a4a3b-80b4-4bf8-bf42-f10822e9c1b9 2024-02-24T01:51:02.621361481Z [2024-02-24T01:51:02.620+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:51:02.622319054Z [2024-02-24T01:51:02.621+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:50:00+00:00, run_id=scheduled__2024-02-24T01:50:00+00:00, run_start_date=2024-02-24 01:51:01.034560+00:00, run_end_date=2024-02-24 01:51:02.621288+00:00, run_duration=1.586728, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:50:00+00:00, data_interval_end=2024-02-24 01:51:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:51:02.648681524Z [2024-02-24T01:51:02.646+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:51:00+00:00, run_after=2024-02-24T01:52:00+00:00 2024-02-24T01:51:02.798447410Z [2024-02-24T01:51:02.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:50:00+00:00 exited with status success for try_number 1 2024-02-24T01:51:02.805895707Z [2024-02-24T01:51:02.805+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:50:00+00:00, map_index=-1, run_start_date=2024-02-24 01:51:02.007424+00:00, run_end_date=2024-02-24 01:51:02.381244+00:00, run_duration=0.37382, state=success, executor_state=success, try_number=1, max_tries=1, job_id=620, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:51:01.130453+00:00, queued_by_job_id=2, pid=9076 2024-02-24T01:51:04.994603511Z [2024-02-24T01:51:04.994+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:51:04.994737784Z [2024-02-24T01:51:04.994+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:50:00+00:00, run_id=scheduled__2024-02-24T01:50:00+00:00, run_start_date=2024-02-24 01:51:01.038646+00:00, run_end_date=2024-02-24 01:51:04.994475+00:00, run_duration=3.955829, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:50:00+00:00, data_interval_end=2024-02-24 01:51:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:51:05.004998329Z [2024-02-24T01:51:05.004+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:51:00+00:00, run_after=2024-02-24T01:52:00+00:00 2024-02-24T01:51:05.096529694Z [2024-02-24T01:51:05.096+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:50:00+00:00 exited with status success for try_number 1 2024-02-24T01:51:05.102473268Z [2024-02-24T01:51:05.102+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:50:00+00:00, map_index=-1, run_start_date=2024-02-24 01:51:03.072877+00:00, run_end_date=2024-02-24 01:51:04.760556+00:00, run_duration=1.687679, state=success, executor_state=success, try_number=1, max_tries=1, job_id=621, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:51:01.130453+00:00, queued_by_job_id=2, pid=9094 2024-02-24T01:51:06.160089453Z [2024-02-24T01:51:06.159+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:51:06.160711747Z [2024-02-24T01:51:06.160+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:50:00+00:00, run_id=scheduled__2024-02-24T01:50:00+00:00, run_start_date=2024-02-24 01:51:01.040234+00:00, run_end_date=2024-02-24 01:51:06.159973+00:00, run_duration=5.119739, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:50:00+00:00, data_interval_end=2024-02-24 01:51:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:51:06.173430590Z [2024-02-24T01:51:06.173+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:51:00+00:00, run_after=2024-02-24T01:52:00+00:00 2024-02-24T01:51:06.220421270Z [2024-02-24T01:51:06.219+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:50:00+00:00 exited with status success for try_number 1 2024-02-24T01:51:06.229460716Z [2024-02-24T01:51:06.229+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:50:00+00:00, map_index=-1, run_start_date=2024-02-24 01:51:03.144608+00:00, run_end_date=2024-02-24 01:51:05.658435+00:00, run_duration=2.513827, state=success, executor_state=success, try_number=1, max_tries=1, job_id=622, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:51:01.130453+00:00, queued_by_job_id=2, pid=9095 2024-02-24T01:52:00.850610194Z [2024-02-24T01:52:00.850+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:52:00+00:00, run_after=2024-02-24T01:53:00+00:00 2024-02-24T01:52:00.862469960Z [2024-02-24T01:52:00.862+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:52:00.874489067Z [2024-02-24T01:52:00.874+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:52:00.906823915Z [2024-02-24T01:52:00.906+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:52:00+00:00, run_after=2024-02-24T01:53:00+00:00 2024-02-24T01:52:00.998862291Z [2024-02-24T01:52:00.998+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T01:52:00.998887925Z 2024-02-24T01:52:00.998894993Z 2024-02-24T01:52:00.998898350Z 2024-02-24T01:52:00.998901664Z 2024-02-24T01:52:00.999115356Z [2024-02-24T01:52:00.998+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T01:52:00.999454285Z [2024-02-24T01:52:00.999+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:52:00.999756225Z [2024-02-24T01:52:00.999+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:52:01.000069390Z [2024-02-24T01:52:00.999+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:52:01.002972504Z [2024-02-24T01:52:01.002+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:52:01.002998392Z 2024-02-24T01:52:01.003006485Z 2024-02-24T01:52:01.003041392Z 2024-02-24T01:52:01.003049559Z 2024-02-24T01:52:01.008142262Z [2024-02-24T01:52:01.007+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:52:01.008434257Z [2024-02-24T01:52:01.008+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T01:52:01.008962033Z [2024-02-24T01:52:01.008+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:52:01.009220171Z [2024-02-24T01:52:01.008+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:52:01.009619016Z [2024-02-24T01:52:01.009+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:52:01.009852982Z [2024-02-24T01:52:01.009+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:52:01.010416856Z [2024-02-24T01:52:01.010+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:52:01.010713614Z [2024-02-24T01:52:01.010+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:52:01.545756469Z [2024-02-24T01:52:01.545+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:50:00+00:00 exited with status queued for try_number 1 2024-02-24T01:52:01.547907401Z [2024-02-24T01:52:01.545+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:51:00+00:00 exited with status queued for try_number 1 2024-02-24T01:52:01.548036258Z [2024-02-24T01:52:01.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:51:00+00:00 exited with status queued for try_number 1 2024-02-24T01:52:01.548173158Z [2024-02-24T01:52:01.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:51:00+00:00 exited with status queued for try_number 1 2024-02-24T01:52:01.571280556Z [2024-02-24T01:52:01.570+0000] {scheduler_job.py:635} INFO - Setting external_id for to 090fb86a-b65d-4247-95f2-7b454a636cb9 2024-02-24T01:52:01.571441856Z [2024-02-24T01:52:01.571+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2e0fc6c-e6fb-40a0-89e7-f729e06509ea 2024-02-24T01:52:01.571662997Z [2024-02-24T01:52:01.571+0000] {scheduler_job.py:635} INFO - Setting external_id for to 794d421d-827a-4f8a-ad45-7f3d07df2429 2024-02-24T01:52:01.571818084Z [2024-02-24T01:52:01.571+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0883c0cd-166f-4755-adf0-91ecc8c57cd7 2024-02-24T01:52:02.884280976Z [2024-02-24T01:52:02.883+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:52:02.885043734Z [2024-02-24T01:52:02.884+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 01:50:00+00:00, run_id=scheduled__2024-02-24T01:50:00+00:00, run_start_date=2024-02-24 01:52:00.921254+00:00, run_end_date=2024-02-24 01:52:02.884191+00:00, run_duration=1.962937, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:50:00+00:00, data_interval_end=2024-02-24 01:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T01:52:02.895781574Z [2024-02-24T01:52:02.895+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T01:52:00+00:00, run_after=2024-02-24T01:54:00+00:00 2024-02-24T01:52:02.908664902Z [2024-02-24T01:52:02.907+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:52:02.908700034Z [2024-02-24T01:52:02.907+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:51:00+00:00, run_id=scheduled__2024-02-24T01:51:00+00:00, run_start_date=2024-02-24 01:52:00.922586+00:00, run_end_date=2024-02-24 01:52:02.907690+00:00, run_duration=1.985104, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:51:00+00:00, data_interval_end=2024-02-24 01:52:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:52:02.927508347Z [2024-02-24T01:52:02.927+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:52:00+00:00, run_after=2024-02-24T01:53:00+00:00 2024-02-24T01:52:03.019546656Z [2024-02-24T01:52:03.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:50:00+00:00 exited with status success for try_number 1 2024-02-24T01:52:03.019988403Z [2024-02-24T01:52:03.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:51:00+00:00 exited with status success for try_number 1 2024-02-24T01:52:03.039592029Z [2024-02-24T01:52:03.039+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T01:50:00+00:00, map_index=-1, run_start_date=2024-02-24 01:52:01.839742+00:00, run_end_date=2024-02-24 01:52:02.164927+00:00, run_duration=0.325185, state=success, executor_state=success, try_number=1, max_tries=1, job_id=623, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:52:01.004280+00:00, queued_by_job_id=2, pid=9129 2024-02-24T01:52:03.040445498Z [2024-02-24T01:52:03.039+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:51:00+00:00, map_index=-1, run_start_date=2024-02-24 01:52:01.962449+00:00, run_end_date=2024-02-24 01:52:02.383977+00:00, run_duration=0.421528, state=success, executor_state=success, try_number=1, max_tries=1, job_id=624, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:52:01.004280+00:00, queued_by_job_id=2, pid=9130 2024-02-24T01:52:03.342216961Z [2024-02-24T01:52:03.341+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T01:52:04.859473604Z [2024-02-24T01:52:04.858+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:52:04.861217658Z [2024-02-24T01:52:04.860+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:51:00+00:00, run_id=scheduled__2024-02-24T01:51:00+00:00, run_start_date=2024-02-24 01:52:00.923677+00:00, run_end_date=2024-02-24 01:52:04.859404+00:00, run_duration=3.935727, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:51:00+00:00, data_interval_end=2024-02-24 01:52:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:52:04.881912682Z [2024-02-24T01:52:04.881+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:52:00+00:00, run_after=2024-02-24T01:53:00+00:00 2024-02-24T01:52:04.950143708Z [2024-02-24T01:52:04.949+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:51:00+00:00 exited with status success for try_number 1 2024-02-24T01:52:04.958463838Z [2024-02-24T01:52:04.957+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:51:00+00:00, map_index=-1, run_start_date=2024-02-24 01:52:03.396809+00:00, run_end_date=2024-02-24 01:52:04.732044+00:00, run_duration=1.335235, state=success, executor_state=success, try_number=1, max_tries=1, job_id=626, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:52:01.004280+00:00, queued_by_job_id=2, pid=9154 2024-02-24T01:52:06.035579164Z [2024-02-24T01:52:06.034+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:52:06.035606851Z [2024-02-24T01:52:06.035+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:51:00+00:00, run_id=scheduled__2024-02-24T01:51:00+00:00, run_start_date=2024-02-24 01:52:00.924763+00:00, run_end_date=2024-02-24 01:52:06.034925+00:00, run_duration=5.110162, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:51:00+00:00, data_interval_end=2024-02-24 01:52:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:52:06.047849996Z [2024-02-24T01:52:06.047+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:52:00+00:00, run_after=2024-02-24T01:53:00+00:00 2024-02-24T01:52:06.086571301Z [2024-02-24T01:52:06.086+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:51:00+00:00 exited with status success for try_number 1 2024-02-24T01:52:06.092803943Z [2024-02-24T01:52:06.092+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:51:00+00:00, map_index=-1, run_start_date=2024-02-24 01:52:03.251419+00:00, run_end_date=2024-02-24 01:52:04.946360+00:00, run_duration=1.694941, state=success, executor_state=success, try_number=1, max_tries=1, job_id=625, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:52:01.004280+00:00, queued_by_job_id=2, pid=9153 2024-02-24T01:53:00.832072488Z [2024-02-24T01:53:00.831+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:53:00.853265574Z [2024-02-24T01:53:00.852+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:53:00+00:00, run_after=2024-02-24T01:54:00+00:00 2024-02-24T01:53:00.866892496Z [2024-02-24T01:53:00.866+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:53:00+00:00, run_after=2024-02-24T01:54:00+00:00 2024-02-24T01:53:00.962974040Z [2024-02-24T01:53:00.962+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T01:53:00.963023864Z 2024-02-24T01:53:00.963034742Z 2024-02-24T01:53:00.963043414Z 2024-02-24T01:53:00.963072392Z [2024-02-24T01:53:00.962+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:53:00.963203690Z [2024-02-24T01:53:00.962+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:53:00.963276331Z [2024-02-24T01:53:00.963+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:53:00.963974920Z [2024-02-24T01:53:00.963+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:53:00.963991461Z 2024-02-24T01:53:00.963995231Z 2024-02-24T01:53:00.963998781Z 2024-02-24T01:53:00.967953370Z [2024-02-24T01:53:00.967+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:53:00.968073580Z [2024-02-24T01:53:00.967+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:53:00.968344011Z [2024-02-24T01:53:00.968+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:53:00.968448949Z [2024-02-24T01:53:00.968+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:53:00.968706317Z [2024-02-24T01:53:00.968+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:53:00.968813933Z [2024-02-24T01:53:00.968+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:53:01.183094829Z [2024-02-24T01:53:01.182+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:52:00+00:00 exited with status queued for try_number 1 2024-02-24T01:53:01.183142000Z [2024-02-24T01:53:01.182+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:52:00+00:00 exited with status queued for try_number 1 2024-02-24T01:53:01.183279539Z [2024-02-24T01:53:01.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:52:00+00:00 exited with status queued for try_number 1 2024-02-24T01:53:01.191272027Z [2024-02-24T01:53:01.190+0000] {scheduler_job.py:635} INFO - Setting external_id for to 752609a4-857b-4505-b80e-6ffcbb6dbf3f 2024-02-24T01:53:01.191333752Z [2024-02-24T01:53:01.191+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1497b1e1-b92d-43c5-a238-ab5c154031b7 2024-02-24T01:53:01.191445369Z [2024-02-24T01:53:01.191+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39201c41-2d5d-41b3-b894-29c649364836 2024-02-24T01:53:02.441838978Z [2024-02-24T01:53:02.441+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:53:02.442187470Z [2024-02-24T01:53:02.441+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:52:00+00:00, run_id=scheduled__2024-02-24T01:52:00+00:00, run_start_date=2024-02-24 01:53:00.884155+00:00, run_end_date=2024-02-24 01:53:02.441744+00:00, run_duration=1.557589, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:52:00+00:00, data_interval_end=2024-02-24 01:53:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:53:02.463081087Z [2024-02-24T01:53:02.462+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:53:00+00:00, run_after=2024-02-24T01:54:00+00:00 2024-02-24T01:53:02.523205999Z [2024-02-24T01:53:02.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:52:00+00:00 exited with status success for try_number 1 2024-02-24T01:53:02.529491873Z [2024-02-24T01:53:02.529+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:52:00+00:00, map_index=-1, run_start_date=2024-02-24 01:53:01.888259+00:00, run_end_date=2024-02-24 01:53:02.281112+00:00, run_duration=0.392853, state=success, executor_state=success, try_number=1, max_tries=1, job_id=627, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:53:00.964839+00:00, queued_by_job_id=2, pid=9187 2024-02-24T01:53:05.756467988Z [2024-02-24T01:53:05.756+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:53:05.756925326Z [2024-02-24T01:53:05.756+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:52:00+00:00, run_id=scheduled__2024-02-24T01:52:00+00:00, run_start_date=2024-02-24 01:53:00.887598+00:00, run_end_date=2024-02-24 01:53:05.756586+00:00, run_duration=4.868988, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:52:00+00:00, data_interval_end=2024-02-24 01:53:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:53:05.766783068Z [2024-02-24T01:53:05.766+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:53:00+00:00, run_after=2024-02-24T01:54:00+00:00 2024-02-24T01:53:05.774155099Z [2024-02-24T01:53:05.773+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:53:05.774501775Z [2024-02-24T01:53:05.774+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:52:00+00:00, run_id=scheduled__2024-02-24T01:52:00+00:00, run_start_date=2024-02-24 01:53:00.885995+00:00, run_end_date=2024-02-24 01:53:05.774124+00:00, run_duration=4.888129, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:52:00+00:00, data_interval_end=2024-02-24 01:53:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:53:05.786031852Z [2024-02-24T01:53:05.785+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:53:00+00:00, run_after=2024-02-24T01:54:00+00:00 2024-02-24T01:53:05.819456798Z [2024-02-24T01:53:05.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:52:00+00:00 exited with status success for try_number 1 2024-02-24T01:53:05.819619639Z [2024-02-24T01:53:05.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:52:00+00:00 exited with status success for try_number 1 2024-02-24T01:53:05.826518724Z [2024-02-24T01:53:05.826+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:52:00+00:00, map_index=-1, run_start_date=2024-02-24 01:53:03.039810+00:00, run_end_date=2024-02-24 01:53:04.673126+00:00, run_duration=1.633316, state=success, executor_state=success, try_number=1, max_tries=1, job_id=628, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:53:00.964839+00:00, queued_by_job_id=2, pid=9205 2024-02-24T01:53:05.826828023Z [2024-02-24T01:53:05.826+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:52:00+00:00, map_index=-1, run_start_date=2024-02-24 01:53:03.168979+00:00, run_end_date=2024-02-24 01:53:05.494607+00:00, run_duration=2.325628, state=success, executor_state=success, try_number=1, max_tries=1, job_id=629, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:53:00.964839+00:00, queued_by_job_id=2, pid=9206 2024-02-24T01:54:00.359948308Z [2024-02-24T01:54:00.359+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:54:00.390874997Z [2024-02-24T01:54:00.390+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:54:00+00:00, run_after=2024-02-24T01:55:00+00:00 2024-02-24T01:54:00.409232325Z [2024-02-24T01:54:00.408+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:54:00+00:00, run_after=2024-02-24T01:55:00+00:00 2024-02-24T01:54:00.417732666Z [2024-02-24T01:54:00.417+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:54:00.517542879Z [2024-02-24T01:54:00.516+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T01:54:00.517599978Z 2024-02-24T01:54:00.517616390Z 2024-02-24T01:54:00.517631148Z 2024-02-24T01:54:00.517646371Z 2024-02-24T01:54:00.518162877Z [2024-02-24T01:54:00.517+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T01:54:00.518635404Z [2024-02-24T01:54:00.518+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:54:00.519089407Z [2024-02-24T01:54:00.518+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:54:00.519595761Z [2024-02-24T01:54:00.519+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:54:00.521066651Z [2024-02-24T01:54:00.520+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:54:00.521092199Z 2024-02-24T01:54:00.521102885Z 2024-02-24T01:54:00.521111455Z 2024-02-24T01:54:00.521119841Z 2024-02-24T01:54:00.527158453Z [2024-02-24T01:54:00.526+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:54:00.527572531Z [2024-02-24T01:54:00.527+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T01:54:00.528172181Z [2024-02-24T01:54:00.527+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:54:00.528518310Z [2024-02-24T01:54:00.528+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:54:00.529272698Z [2024-02-24T01:54:00.528+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:54:00.529699621Z [2024-02-24T01:54:00.529+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:54:00.530340488Z [2024-02-24T01:54:00.530+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:54:00.530601831Z [2024-02-24T01:54:00.530+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:54:01.003412570Z [2024-02-24T01:54:01.002+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:52:00+00:00 exited with status queued for try_number 1 2024-02-24T01:54:01.003714540Z [2024-02-24T01:54:01.003+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:53:00+00:00 exited with status queued for try_number 1 2024-02-24T01:54:01.003968261Z [2024-02-24T01:54:01.003+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:53:00+00:00 exited with status queued for try_number 1 2024-02-24T01:54:01.004200646Z [2024-02-24T01:54:01.003+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:53:00+00:00 exited with status queued for try_number 1 2024-02-24T01:54:01.029733046Z [2024-02-24T01:54:01.029+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ebd4ba6-7df9-4412-9bdc-727de09d6aa3 2024-02-24T01:54:01.030015055Z [2024-02-24T01:54:01.029+0000] {scheduler_job.py:635} INFO - Setting external_id for to b9e31f48-a6e9-49b9-9a71-66d6c6c3c1cc 2024-02-24T01:54:01.030314658Z [2024-02-24T01:54:01.030+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b463466-4b7b-4e80-8bff-7df2f6b1639f 2024-02-24T01:54:01.031728156Z [2024-02-24T01:54:01.031+0000] {scheduler_job.py:635} INFO - Setting external_id for to f665a5f6-ab37-4e1f-a58d-a09565a584e7 2024-02-24T01:54:03.301957643Z [2024-02-24T01:54:03.301+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:54:03.303327374Z [2024-02-24T01:54:03.302+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 01:52:00+00:00, run_id=scheduled__2024-02-24T01:52:00+00:00, run_start_date=2024-02-24 01:54:00.431863+00:00, run_end_date=2024-02-24 01:54:03.301868+00:00, run_duration=2.870005, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:52:00+00:00, data_interval_end=2024-02-24 01:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T01:54:03.317513113Z [2024-02-24T01:54:03.317+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T01:54:00+00:00, run_after=2024-02-24T01:56:00+00:00 2024-02-24T01:54:03.327033791Z [2024-02-24T01:54:03.326+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:54:03.327421200Z [2024-02-24T01:54:03.327+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:53:00+00:00, run_id=scheduled__2024-02-24T01:53:00+00:00, run_start_date=2024-02-24 01:54:00.433454+00:00, run_end_date=2024-02-24 01:54:03.327060+00:00, run_duration=2.893606, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:53:00+00:00, data_interval_end=2024-02-24 01:54:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:54:03.344026147Z [2024-02-24T01:54:03.343+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:54:00+00:00, run_after=2024-02-24T01:55:00+00:00 2024-02-24T01:54:03.414794498Z [2024-02-24T01:54:03.414+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:52:00+00:00 exited with status success for try_number 1 2024-02-24T01:54:03.415083646Z [2024-02-24T01:54:03.414+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:53:00+00:00 exited with status success for try_number 1 2024-02-24T01:54:03.424556677Z [2024-02-24T01:54:03.424+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T01:52:00+00:00, map_index=-1, run_start_date=2024-02-24 01:54:01.830692+00:00, run_end_date=2024-02-24 01:54:02.251985+00:00, run_duration=0.421293, state=success, executor_state=success, try_number=1, max_tries=1, job_id=631, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:54:00.523380+00:00, queued_by_job_id=2, pid=9240 2024-02-24T01:54:03.424660914Z [2024-02-24T01:54:03.424+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:53:00+00:00, map_index=-1, run_start_date=2024-02-24 01:54:01.636052+00:00, run_end_date=2024-02-24 01:54:02.169551+00:00, run_duration=0.533499, state=success, executor_state=success, try_number=1, max_tries=1, job_id=630, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:54:00.523380+00:00, queued_by_job_id=2, pid=9239 2024-02-24T01:54:06.705401625Z [2024-02-24T01:54:06.704+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:54:06.706225232Z [2024-02-24T01:54:06.705+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:53:00+00:00, run_id=scheduled__2024-02-24T01:53:00+00:00, run_start_date=2024-02-24 01:54:00.436393+00:00, run_end_date=2024-02-24 01:54:06.705522+00:00, run_duration=6.269129, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:53:00+00:00, data_interval_end=2024-02-24 01:54:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:54:06.727112822Z [2024-02-24T01:54:06.726+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:54:00+00:00, run_after=2024-02-24T01:55:00+00:00 2024-02-24T01:54:06.737661158Z [2024-02-24T01:54:06.737+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:54:06.738036001Z [2024-02-24T01:54:06.737+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:53:00+00:00, run_id=scheduled__2024-02-24T01:53:00+00:00, run_start_date=2024-02-24 01:54:00.435091+00:00, run_end_date=2024-02-24 01:54:06.737525+00:00, run_duration=6.302434, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:53:00+00:00, data_interval_end=2024-02-24 01:54:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:54:06.748386403Z [2024-02-24T01:54:06.747+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:54:00+00:00, run_after=2024-02-24T01:55:00+00:00 2024-02-24T01:54:06.794883887Z [2024-02-24T01:54:06.794+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:53:00+00:00 exited with status success for try_number 1 2024-02-24T01:54:06.795194933Z [2024-02-24T01:54:06.794+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:53:00+00:00 exited with status success for try_number 1 2024-02-24T01:54:06.806457382Z [2024-02-24T01:54:06.805+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:53:00+00:00, map_index=-1, run_start_date=2024-02-24 01:54:03.179994+00:00, run_end_date=2024-02-24 01:54:06.332739+00:00, run_duration=3.152745, state=success, executor_state=success, try_number=1, max_tries=1, job_id=632, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:54:00.523380+00:00, queued_by_job_id=2, pid=9263 2024-02-24T01:54:06.807235290Z [2024-02-24T01:54:06.806+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:53:00+00:00, map_index=-1, run_start_date=2024-02-24 01:54:03.239510+00:00, run_end_date=2024-02-24 01:54:06.146953+00:00, run_duration=2.907443, state=success, executor_state=success, try_number=1, max_tries=1, job_id=633, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:54:00.523380+00:00, queued_by_job_id=2, pid=9264 2024-02-24T01:55:00.890559369Z [2024-02-24T01:55:00.890+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:55:00+00:00, run_after=2024-02-24T01:56:00+00:00 2024-02-24T01:55:00.901406030Z [2024-02-24T01:55:00.900+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:55:00.919839604Z [2024-02-24T01:55:00.919+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:55:00+00:00, run_after=2024-02-24T01:56:00+00:00 2024-02-24T01:55:00.935327031Z [2024-02-24T01:55:00.934+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:55:00+00:00, run_after=2024-02-24T02:00:00+00:00 2024-02-24T01:55:01.025161335Z [2024-02-24T01:55:01.024+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T01:55:01.025194384Z 2024-02-24T01:55:01.025200966Z 2024-02-24T01:55:01.025205769Z 2024-02-24T01:55:01.025218091Z 2024-02-24T01:55:01.026588363Z [2024-02-24T01:55:01.025+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:55:01.028335459Z [2024-02-24T01:55:01.027+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:55:01.029702866Z [2024-02-24T01:55:01.028+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:55:01.034110710Z [2024-02-24T01:55:01.030+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:55:01.034958951Z [2024-02-24T01:55:01.034+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:55:01.034983226Z 2024-02-24T01:55:01.034991143Z 2024-02-24T01:55:01.034997721Z 2024-02-24T01:55:01.035004677Z 2024-02-24T01:55:01.041413440Z [2024-02-24T01:55:01.041+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T01:55:01.041736075Z [2024-02-24T01:55:01.041+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T01:55:01.042279940Z [2024-02-24T01:55:01.042+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:55:01.042654149Z [2024-02-24T01:55:01.042+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:55:01.043120542Z [2024-02-24T01:55:01.042+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:55:01.043631621Z [2024-02-24T01:55:01.043+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:55:01.044118573Z [2024-02-24T01:55:01.043+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:55:01.044560270Z [2024-02-24T01:55:01.044+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:55:01.599061370Z [2024-02-24T01:55:01.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T01:50:00+00:00 exited with status queued for try_number 1 2024-02-24T01:55:01.599122972Z [2024-02-24T01:55:01.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:54:00+00:00 exited with status queued for try_number 1 2024-02-24T01:55:01.599252283Z [2024-02-24T01:55:01.599+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:54:00+00:00 exited with status queued for try_number 1 2024-02-24T01:55:01.599360156Z [2024-02-24T01:55:01.599+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:54:00+00:00 exited with status queued for try_number 1 2024-02-24T01:55:01.620745830Z [2024-02-24T01:55:01.620+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4aeaf45-563f-4764-8f70-96c2cbe684f5 2024-02-24T01:55:01.627268955Z [2024-02-24T01:55:01.625+0000] {scheduler_job.py:635} INFO - Setting external_id for to 59bf4df5-d73c-45f2-a767-5ae86d37285e 2024-02-24T01:55:01.627296244Z [2024-02-24T01:55:01.626+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56b143d2-d15a-42c0-ad1b-dd97242bbffa 2024-02-24T01:55:01.627410178Z [2024-02-24T01:55:01.626+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5943bfc-b37b-4ab0-b46b-b8dafab8f348 2024-02-24T01:55:02.907809405Z [2024-02-24T01:55:02.907+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:55:02.909104418Z [2024-02-24T01:55:02.908+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:54:00+00:00, run_id=scheduled__2024-02-24T01:54:00+00:00, run_start_date=2024-02-24 01:55:00.953444+00:00, run_end_date=2024-02-24 01:55:02.908208+00:00, run_duration=1.954764, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:54:00+00:00, data_interval_end=2024-02-24 01:55:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:55:02.932672962Z [2024-02-24T01:55:02.932+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:55:00+00:00, run_after=2024-02-24T01:56:00+00:00 2024-02-24T01:55:03.046686435Z [2024-02-24T01:55:03.046+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:54:00+00:00 exited with status success for try_number 1 2024-02-24T01:55:03.053845617Z [2024-02-24T01:55:03.053+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:54:00+00:00, map_index=-1, run_start_date=2024-02-24 01:55:02.114488+00:00, run_end_date=2024-02-24 01:55:02.572406+00:00, run_duration=0.457918, state=success, executor_state=success, try_number=1, max_tries=1, job_id=634, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:55:01.036266+00:00, queued_by_job_id=2, pid=9297 2024-02-24T01:55:05.315424044Z [2024-02-24T01:55:05.314+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:55:05.315822501Z [2024-02-24T01:55:05.315+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:54:00+00:00, run_id=scheduled__2024-02-24T01:54:00+00:00, run_start_date=2024-02-24 01:55:00.954664+00:00, run_end_date=2024-02-24 01:55:05.315487+00:00, run_duration=4.360823, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:54:00+00:00, data_interval_end=2024-02-24 01:55:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:55:05.326571760Z [2024-02-24T01:55:05.326+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:55:00+00:00, run_after=2024-02-24T01:56:00+00:00 2024-02-24T01:55:05.359004005Z [2024-02-24T01:55:05.358+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:55:05.359045759Z 2024-02-24T01:55:05.359445473Z [2024-02-24T01:55:05.359+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:55:05.360719232Z [2024-02-24T01:55:05.360+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:55:05.360738584Z 2024-02-24T01:55:05.366331595Z [2024-02-24T01:55:05.365+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T01:55:05.366732093Z [2024-02-24T01:55:05.366+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T01:55:05.432825449Z [2024-02-24T01:55:05.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T01:50:00+00:00 exited with status queued for try_number 1 2024-02-24T01:55:05.433129364Z [2024-02-24T01:55:05.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T01:50:00+00:00 exited with status success for try_number 1 2024-02-24T01:55:05.433316116Z [2024-02-24T01:55:05.433+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:54:00+00:00 exited with status success for try_number 1 2024-02-24T01:55:05.441859901Z [2024-02-24T01:55:05.441+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:54:00+00:00, map_index=-1, run_start_date=2024-02-24 01:55:03.477955+00:00, run_end_date=2024-02-24 01:55:05.055239+00:00, run_duration=1.577284, state=success, executor_state=success, try_number=1, max_tries=1, job_id=635, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:55:01.036266+00:00, queued_by_job_id=2, pid=9316 2024-02-24T01:55:05.442341129Z [2024-02-24T01:55:05.442+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T01:50:00+00:00, map_index=-1, run_start_date=2024-02-24 01:55:04.276139+00:00, run_end_date=2024-02-24 01:55:04.666620+00:00, run_duration=0.390481, state=success, executor_state=success, try_number=1, max_tries=1, job_id=637, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:55:01.036266+00:00, queued_by_job_id=2, pid=9328 2024-02-24T01:55:05.442642123Z [2024-02-24T01:55:05.442+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c63772b-af3d-4e6b-9004-d43b8547f2c2 2024-02-24T01:55:06.581630658Z [2024-02-24T01:55:06.581+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:55:06.582352684Z [2024-02-24T01:55:06.581+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:54:00+00:00, run_id=scheduled__2024-02-24T01:54:00+00:00, run_start_date=2024-02-24 01:55:00.955911+00:00, run_end_date=2024-02-24 01:55:06.581736+00:00, run_duration=5.625825, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:54:00+00:00, data_interval_end=2024-02-24 01:55:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:55:06.601465193Z [2024-02-24T01:55:06.600+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:55:00+00:00, run_after=2024-02-24T01:56:00+00:00 2024-02-24T01:55:06.669575558Z [2024-02-24T01:55:06.668+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:54:00+00:00 exited with status success for try_number 1 2024-02-24T01:55:06.682267672Z [2024-02-24T01:55:06.681+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:54:00+00:00, map_index=-1, run_start_date=2024-02-24 01:55:03.866080+00:00, run_end_date=2024-02-24 01:55:05.767808+00:00, run_duration=1.901728, state=success, executor_state=success, try_number=1, max_tries=1, job_id=636, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:55:01.036266+00:00, queued_by_job_id=2, pid=9321 2024-02-24T01:55:07.758570862Z [2024-02-24T01:55:07.758+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:55:07.758601570Z 2024-02-24T01:55:07.758857232Z [2024-02-24T01:55:07.758+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:55:07.759684644Z [2024-02-24T01:55:07.759+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:55:07.759708506Z 2024-02-24T01:55:07.762850257Z [2024-02-24T01:55:07.762+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T01:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T01:55:07.763084252Z [2024-02-24T01:55:07.762+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T01:55:07.825585697Z [2024-02-24T01:55:07.825+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T01:50:00+00:00 exited with status queued for try_number 1 2024-02-24T01:55:07.825616574Z [2024-02-24T01:55:07.825+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T01:50:00+00:00 exited with status success for try_number 1 2024-02-24T01:55:07.831720934Z [2024-02-24T01:55:07.831+0000] {scheduler_job.py:635} INFO - Setting external_id for to 21cfd391-28f8-40df-b64e-02097d91d665 2024-02-24T01:55:07.831850321Z [2024-02-24T01:55:07.831+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T01:50:00+00:00, map_index=-1, run_start_date=2024-02-24 01:55:07.052399+00:00, run_end_date=2024-02-24 01:55:07.404764+00:00, run_duration=0.352365, state=success, executor_state=success, try_number=1, max_tries=1, job_id=638, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:55:05.361530+00:00, queued_by_job_id=2, pid=9346 2024-02-24T01:55:09.899133701Z [2024-02-24T01:55:09.898+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T01:55:09.899159986Z 2024-02-24T01:55:09.899244432Z [2024-02-24T01:55:09.899+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:55:09.899816383Z [2024-02-24T01:55:09.899+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:55:09.899825020Z 2024-02-24T01:55:09.902415790Z [2024-02-24T01:55:09.902+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:55:09.902580591Z [2024-02-24T01:55:09.902+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T01:55:09.957988874Z [2024-02-24T01:55:09.957+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T01:50:00+00:00 exited with status queued for try_number 1 2024-02-24T01:55:09.958609241Z [2024-02-24T01:55:09.958+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T01:50:00+00:00 exited with status success for try_number 1 2024-02-24T01:55:09.968848957Z [2024-02-24T01:55:09.968+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7a93654-705f-4148-a3fc-ae9687386869 2024-02-24T01:55:09.969268817Z [2024-02-24T01:55:09.969+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T01:50:00+00:00, map_index=0, run_start_date=2024-02-24 01:55:09.397478+00:00, run_end_date=2024-02-24 01:55:09.736390+00:00, run_duration=0.338912, state=success, executor_state=success, try_number=1, max_tries=1, job_id=639, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:55:07.760342+00:00, queued_by_job_id=2, pid=9354 2024-02-24T01:55:12.191818749Z [2024-02-24T01:55:12.191+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:55:12.194475867Z [2024-02-24T01:55:12.194+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:50:00+00:00, run_id=scheduled__2024-02-24T01:50:00+00:00, run_start_date=2024-02-24 01:55:00.952118+00:00, run_end_date=2024-02-24 01:55:12.194004+00:00, run_duration=11.241886, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:50:00+00:00, data_interval_end=2024-02-24 01:55:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T01:55:12.209428855Z [2024-02-24T01:55:12.209+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:55:00+00:00, run_after=2024-02-24T02:00:00+00:00 2024-02-24T01:55:12.271181986Z [2024-02-24T01:55:12.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T01:50:00+00:00 exited with status success for try_number 1 2024-02-24T01:55:12.280549081Z [2024-02-24T01:55:12.279+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T01:50:00+00:00, map_index=-1, run_start_date=2024-02-24 01:55:11.651443+00:00, run_end_date=2024-02-24 01:55:12.055949+00:00, run_duration=0.404506, state=success, executor_state=success, try_number=1, max_tries=1, job_id=640, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:55:09.900234+00:00, queued_by_job_id=2, pid=9362 2024-02-24T01:56:00.287558999Z [2024-02-24T01:56:00.286+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:56:00+00:00, run_after=2024-02-24T01:57:00+00:00 2024-02-24T01:56:00.296537014Z [2024-02-24T01:56:00.295+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:56:00.310204519Z [2024-02-24T01:56:00.309+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:56:00+00:00, run_after=2024-02-24T01:57:00+00:00 2024-02-24T01:56:00.320809638Z [2024-02-24T01:56:00.320+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:56:00.419059010Z [2024-02-24T01:56:00.418+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T01:56:00.419103240Z 2024-02-24T01:56:00.419113984Z 2024-02-24T01:56:00.419122929Z 2024-02-24T01:56:00.419131286Z 2024-02-24T01:56:00.419441056Z [2024-02-24T01:56:00.418+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T01:56:00.419731420Z [2024-02-24T01:56:00.419+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:56:00.420024490Z [2024-02-24T01:56:00.419+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:56:00.420307744Z [2024-02-24T01:56:00.419+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:56:00.421320798Z [2024-02-24T01:56:00.420+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:56:00.421337915Z 2024-02-24T01:56:00.421343544Z 2024-02-24T01:56:00.421348380Z 2024-02-24T01:56:00.421352871Z 2024-02-24T01:56:00.425575553Z [2024-02-24T01:56:00.425+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:56:00.425885444Z [2024-02-24T01:56:00.425+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T01:56:00.426340990Z [2024-02-24T01:56:00.426+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:56:00.426572022Z [2024-02-24T01:56:00.426+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:56:00.426985999Z [2024-02-24T01:56:00.426+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:56:00.427241348Z [2024-02-24T01:56:00.426+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:56:00.427631146Z [2024-02-24T01:56:00.427+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:56:00.427906163Z [2024-02-24T01:56:00.427+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:56:00.822862660Z [2024-02-24T01:56:00.822+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:54:00+00:00 exited with status queued for try_number 1 2024-02-24T01:56:00.822889571Z [2024-02-24T01:56:00.822+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:55:00+00:00 exited with status queued for try_number 1 2024-02-24T01:56:00.822914264Z [2024-02-24T01:56:00.822+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:55:00+00:00 exited with status queued for try_number 1 2024-02-24T01:56:00.822984489Z [2024-02-24T01:56:00.822+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:55:00+00:00 exited with status queued for try_number 1 2024-02-24T01:56:00.839223071Z [2024-02-24T01:56:00.838+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4afdb27d-74ac-43ce-a3ff-261f80bf2e88 2024-02-24T01:56:00.839252881Z [2024-02-24T01:56:00.839+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81e314fa-1a80-475b-b92a-8e52d2ec4b7e 2024-02-24T01:56:00.839329345Z [2024-02-24T01:56:00.839+0000] {scheduler_job.py:635} INFO - Setting external_id for to a0ab7d68-435c-486a-8cfb-3b18ff81d4aa 2024-02-24T01:56:00.839441465Z [2024-02-24T01:56:00.839+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d6a345f-5226-4606-bbef-271b613d7879 2024-02-24T01:56:02.119740246Z [2024-02-24T01:56:02.119+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:56:02.120227738Z [2024-02-24T01:56:02.119+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 01:54:00+00:00, run_id=scheduled__2024-02-24T01:54:00+00:00, run_start_date=2024-02-24 01:56:00.339529+00:00, run_end_date=2024-02-24 01:56:02.119621+00:00, run_duration=1.780092, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:54:00+00:00, data_interval_end=2024-02-24 01:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T01:56:02.128847175Z [2024-02-24T01:56:02.128+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T01:56:00+00:00, run_after=2024-02-24T01:58:00+00:00 2024-02-24T01:56:02.137355663Z [2024-02-24T01:56:02.136+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:56:02.137648281Z [2024-02-24T01:56:02.137+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:55:00+00:00, run_id=scheduled__2024-02-24T01:55:00+00:00, run_start_date=2024-02-24 01:56:00.341328+00:00, run_end_date=2024-02-24 01:56:02.137352+00:00, run_duration=1.796024, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:55:00+00:00, data_interval_end=2024-02-24 01:56:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:56:02.148145067Z [2024-02-24T01:56:02.147+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:56:00+00:00, run_after=2024-02-24T01:57:00+00:00 2024-02-24T01:56:02.217289926Z [2024-02-24T01:56:02.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:54:00+00:00 exited with status success for try_number 1 2024-02-24T01:56:02.217757290Z [2024-02-24T01:56:02.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:55:00+00:00 exited with status success for try_number 1 2024-02-24T01:56:02.231759140Z [2024-02-24T01:56:02.231+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T01:54:00+00:00, map_index=-1, run_start_date=2024-02-24 01:56:01.229951+00:00, run_end_date=2024-02-24 01:56:01.629029+00:00, run_duration=0.399078, state=success, executor_state=success, try_number=1, max_tries=1, job_id=641, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:56:00.422649+00:00, queued_by_job_id=2, pid=9384 2024-02-24T01:56:02.232305125Z [2024-02-24T01:56:02.232+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:55:00+00:00, map_index=-1, run_start_date=2024-02-24 01:56:01.330173+00:00, run_end_date=2024-02-24 01:56:01.730050+00:00, run_duration=0.399877, state=success, executor_state=success, try_number=1, max_tries=1, job_id=642, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:56:00.422649+00:00, queued_by_job_id=2, pid=9385 2024-02-24T01:56:04.051299054Z [2024-02-24T01:56:04.050+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:56:04.051762452Z [2024-02-24T01:56:04.051+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:55:00+00:00, run_id=scheduled__2024-02-24T01:55:00+00:00, run_start_date=2024-02-24 01:56:00.343211+00:00, run_end_date=2024-02-24 01:56:04.051351+00:00, run_duration=3.70814, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:55:00+00:00, data_interval_end=2024-02-24 01:56:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:56:04.072396759Z [2024-02-24T01:56:04.071+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:56:00+00:00, run_after=2024-02-24T01:57:00+00:00 2024-02-24T01:56:05.217230571Z [2024-02-24T01:56:05.216+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:56:05.217548968Z [2024-02-24T01:56:05.217+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:55:00+00:00, run_id=scheduled__2024-02-24T01:55:00+00:00, run_start_date=2024-02-24 01:56:00.345413+00:00, run_end_date=2024-02-24 01:56:05.217046+00:00, run_duration=4.871633, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:55:00+00:00, data_interval_end=2024-02-24 01:56:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:56:05.227551218Z [2024-02-24T01:56:05.227+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:56:00+00:00, run_after=2024-02-24T01:57:00+00:00 2024-02-24T01:56:05.278879525Z [2024-02-24T01:56:05.278+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:55:00+00:00 exited with status success for try_number 1 2024-02-24T01:56:05.281996372Z [2024-02-24T01:56:05.278+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:55:00+00:00 exited with status success for try_number 1 2024-02-24T01:56:05.288412261Z [2024-02-24T01:56:05.288+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:55:00+00:00, map_index=-1, run_start_date=2024-02-24 01:56:02.498820+00:00, run_end_date=2024-02-24 01:56:04.013379+00:00, run_duration=1.514559, state=success, executor_state=success, try_number=1, max_tries=1, job_id=643, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:56:00.422649+00:00, queued_by_job_id=2, pid=9408 2024-02-24T01:56:05.288736074Z [2024-02-24T01:56:05.288+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:55:00+00:00, map_index=-1, run_start_date=2024-02-24 01:56:02.643974+00:00, run_end_date=2024-02-24 01:56:04.754938+00:00, run_duration=2.110964, state=success, executor_state=success, try_number=1, max_tries=1, job_id=644, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:56:00.422649+00:00, queued_by_job_id=2, pid=9409 2024-02-24T01:57:00.135759167Z [2024-02-24T01:57:00.135+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:57:00.165088673Z [2024-02-24T01:57:00.164+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:57:00+00:00, run_after=2024-02-24T01:58:00+00:00 2024-02-24T01:57:00.185203561Z [2024-02-24T01:57:00.184+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:57:00+00:00, run_after=2024-02-24T01:58:00+00:00 2024-02-24T01:57:00.263843315Z [2024-02-24T01:57:00.263+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T01:57:00.263880134Z 2024-02-24T01:57:00.263887724Z 2024-02-24T01:57:00.263894262Z 2024-02-24T01:57:00.263901182Z [2024-02-24T01:57:00.263+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:57:00.263919201Z [2024-02-24T01:57:00.263+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:57:00.264025446Z [2024-02-24T01:57:00.263+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:57:00.264607784Z [2024-02-24T01:57:00.264+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:57:00.264618399Z 2024-02-24T01:57:00.264622825Z 2024-02-24T01:57:00.264626858Z 2024-02-24T01:57:00.268061688Z [2024-02-24T01:57:00.267+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:57:00.268081528Z [2024-02-24T01:57:00.267+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:57:00.268319060Z [2024-02-24T01:57:00.268+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:57:00.268492573Z [2024-02-24T01:57:00.268+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:57:00.268684082Z [2024-02-24T01:57:00.268+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:57:00.269008496Z [2024-02-24T01:57:00.268+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:57:00.498858179Z [2024-02-24T01:57:00.498+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:56:00+00:00 exited with status queued for try_number 1 2024-02-24T01:57:00.499056779Z [2024-02-24T01:57:00.498+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:56:00+00:00 exited with status queued for try_number 1 2024-02-24T01:57:00.499197091Z [2024-02-24T01:57:00.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:56:00+00:00 exited with status queued for try_number 1 2024-02-24T01:57:00.506448843Z [2024-02-24T01:57:00.506+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8455882-b121-4da9-a975-033718baca1b 2024-02-24T01:57:00.506646055Z [2024-02-24T01:57:00.506+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f435b71-df67-4652-8305-7ec504e9436f 2024-02-24T01:57:00.506848634Z [2024-02-24T01:57:00.506+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b3ead9b-c846-44f7-a59f-1b6215529c10 2024-02-24T01:57:01.673481081Z [2024-02-24T01:57:01.673+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:57:01.673682888Z [2024-02-24T01:57:01.673+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:56:00+00:00, run_id=scheduled__2024-02-24T01:56:00+00:00, run_start_date=2024-02-24 01:57:00.198653+00:00, run_end_date=2024-02-24 01:57:01.673381+00:00, run_duration=1.474728, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:56:00+00:00, data_interval_end=2024-02-24 01:57:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:57:01.684704355Z [2024-02-24T01:57:01.684+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:57:00+00:00, run_after=2024-02-24T01:58:00+00:00 2024-02-24T01:57:02.830985834Z [2024-02-24T01:57:02.830+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:56:00+00:00 exited with status success for try_number 1 2024-02-24T01:57:02.837126910Z [2024-02-24T01:57:02.836+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:56:00+00:00, map_index=-1, run_start_date=2024-02-24 01:57:01.117691+00:00, run_end_date=2024-02-24 01:57:01.628181+00:00, run_duration=0.51049, state=success, executor_state=success, try_number=1, max_tries=1, job_id=645, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:57:00.265262+00:00, queued_by_job_id=2, pid=9441 2024-02-24T01:57:03.444206216Z [2024-02-24T01:57:03.443+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T01:57:04.501238676Z [2024-02-24T01:57:04.500+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:57:04.501656765Z [2024-02-24T01:57:04.501+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:56:00+00:00, run_id=scheduled__2024-02-24T01:56:00+00:00, run_start_date=2024-02-24 01:57:00.201112+00:00, run_end_date=2024-02-24 01:57:04.501102+00:00, run_duration=4.29999, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:56:00+00:00, data_interval_end=2024-02-24 01:57:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:57:04.515567965Z [2024-02-24T01:57:04.515+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:57:00+00:00, run_after=2024-02-24T01:58:00+00:00 2024-02-24T01:57:04.532941586Z [2024-02-24T01:57:04.532+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:57:04.533302619Z [2024-02-24T01:57:04.532+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:56:00+00:00, run_id=scheduled__2024-02-24T01:56:00+00:00, run_start_date=2024-02-24 01:57:00.199912+00:00, run_end_date=2024-02-24 01:57:04.532787+00:00, run_duration=4.332875, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:56:00+00:00, data_interval_end=2024-02-24 01:57:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:57:04.547668392Z [2024-02-24T01:57:04.547+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:57:00+00:00, run_after=2024-02-24T01:58:00+00:00 2024-02-24T01:57:04.593748816Z [2024-02-24T01:57:04.593+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:56:00+00:00 exited with status success for try_number 1 2024-02-24T01:57:04.593938479Z [2024-02-24T01:57:04.593+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:56:00+00:00 exited with status success for try_number 1 2024-02-24T01:57:04.602170227Z [2024-02-24T01:57:04.601+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:56:00+00:00, map_index=-1, run_start_date=2024-02-24 01:57:02.208457+00:00, run_end_date=2024-02-24 01:57:04.025266+00:00, run_duration=1.816809, state=success, executor_state=success, try_number=1, max_tries=1, job_id=647, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:57:00.265262+00:00, queued_by_job_id=2, pid=9460 2024-02-24T01:57:04.602547306Z [2024-02-24T01:57:04.602+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:56:00+00:00, map_index=-1, run_start_date=2024-02-24 01:57:02.170924+00:00, run_end_date=2024-02-24 01:57:04.123145+00:00, run_duration=1.952221, state=success, executor_state=success, try_number=1, max_tries=1, job_id=646, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:57:00.265262+00:00, queued_by_job_id=2, pid=9459 2024-02-24T01:58:00.106094427Z [2024-02-24T01:58:00.105+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:58:00+00:00, run_after=2024-02-24T01:59:00+00:00 2024-02-24T01:58:00.114754009Z [2024-02-24T01:58:00.114+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:58:00.140026961Z [2024-02-24T01:58:00.139+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:58:00+00:00, run_after=2024-02-24T01:59:00+00:00 2024-02-24T01:58:00.150317292Z [2024-02-24T01:58:00.149+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:58:00.279573971Z [2024-02-24T01:58:00.278+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T01:58:00.279603939Z 2024-02-24T01:58:00.279608068Z 2024-02-24T01:58:00.279611342Z 2024-02-24T01:58:00.279614429Z 2024-02-24T01:58:00.280070452Z [2024-02-24T01:58:00.279+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T01:58:00.280485335Z [2024-02-24T01:58:00.280+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:58:00.280839785Z [2024-02-24T01:58:00.280+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:58:00.281201180Z [2024-02-24T01:58:00.280+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:58:00.282354582Z [2024-02-24T01:58:00.282+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:58:00.282363836Z 2024-02-24T01:58:00.282368372Z 2024-02-24T01:58:00.282372420Z 2024-02-24T01:58:00.282376452Z 2024-02-24T01:58:00.289479147Z [2024-02-24T01:58:00.289+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:58:00.290058378Z [2024-02-24T01:58:00.289+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T01:58:00.290672793Z [2024-02-24T01:58:00.290+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:58:00.291003398Z [2024-02-24T01:58:00.290+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:58:00.291493064Z [2024-02-24T01:58:00.291+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:58:00.291759196Z [2024-02-24T01:58:00.291+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:58:00.292159895Z [2024-02-24T01:58:00.291+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:58:00.292434330Z [2024-02-24T01:58:00.292+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:58:00.607369690Z [2024-02-24T01:58:00.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:56:00+00:00 exited with status queued for try_number 1 2024-02-24T01:58:00.607572427Z [2024-02-24T01:58:00.607+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:57:00+00:00 exited with status queued for try_number 1 2024-02-24T01:58:00.607780475Z [2024-02-24T01:58:00.607+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:57:00+00:00 exited with status queued for try_number 1 2024-02-24T01:58:00.607934601Z [2024-02-24T01:58:00.607+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:57:00+00:00 exited with status queued for try_number 1 2024-02-24T01:58:00.629368566Z [2024-02-24T01:58:00.628+0000] {scheduler_job.py:635} INFO - Setting external_id for to 540ab50c-3a51-49a3-bce2-81046f020812 2024-02-24T01:58:00.630085637Z [2024-02-24T01:58:00.629+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee96006f-d9c2-4216-9d83-30b5c0f3dab4 2024-02-24T01:58:00.630602404Z [2024-02-24T01:58:00.630+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c688ee7-4529-4ac6-99b3-e27146fcce18 2024-02-24T01:58:00.631517591Z [2024-02-24T01:58:00.631+0000] {scheduler_job.py:635} INFO - Setting external_id for to 072d67e2-5b3f-49d0-a30d-acf36aedff64 2024-02-24T01:58:02.719317448Z [2024-02-24T01:58:02.718+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:58:02.722425489Z [2024-02-24T01:58:02.722+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:57:00+00:00, run_id=scheduled__2024-02-24T01:57:00+00:00, run_start_date=2024-02-24 01:58:00.166636+00:00, run_end_date=2024-02-24 01:58:02.721874+00:00, run_duration=2.555238, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:57:00+00:00, data_interval_end=2024-02-24 01:58:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:58:02.740017239Z [2024-02-24T01:58:02.739+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:58:00+00:00, run_after=2024-02-24T01:59:00+00:00 2024-02-24T01:58:02.755517099Z [2024-02-24T01:58:02.755+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:58:02.761063667Z [2024-02-24T01:58:02.755+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 01:56:00+00:00, run_id=scheduled__2024-02-24T01:56:00+00:00, run_start_date=2024-02-24 01:58:00.165157+00:00, run_end_date=2024-02-24 01:58:02.755426+00:00, run_duration=2.590269, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:56:00+00:00, data_interval_end=2024-02-24 01:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T01:58:02.773246548Z [2024-02-24T01:58:02.772+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T01:58:00+00:00, run_after=2024-02-24T02:00:00+00:00 2024-02-24T01:58:02.870878889Z [2024-02-24T01:58:02.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:56:00+00:00 exited with status success for try_number 1 2024-02-24T01:58:02.870963222Z [2024-02-24T01:58:02.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:57:00+00:00 exited with status success for try_number 1 2024-02-24T01:58:02.881158486Z [2024-02-24T01:58:02.880+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T01:56:00+00:00, map_index=-1, run_start_date=2024-02-24 01:58:01.383627+00:00, run_end_date=2024-02-24 01:58:01.873735+00:00, run_duration=0.490108, state=success, executor_state=success, try_number=1, max_tries=1, job_id=648, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:58:00.284734+00:00, queued_by_job_id=2, pid=9493 2024-02-24T01:58:02.881345225Z [2024-02-24T01:58:02.881+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:57:00+00:00, map_index=-1, run_start_date=2024-02-24 01:58:01.528244+00:00, run_end_date=2024-02-24 01:58:01.908355+00:00, run_duration=0.380111, state=success, executor_state=success, try_number=1, max_tries=1, job_id=649, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:58:00.284734+00:00, queued_by_job_id=2, pid=9494 2024-02-24T01:58:03.950556263Z [2024-02-24T01:58:03.949+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:58:03.951334760Z [2024-02-24T01:58:03.950+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:57:00+00:00, run_id=scheduled__2024-02-24T01:57:00+00:00, run_start_date=2024-02-24 01:58:00.167939+00:00, run_end_date=2024-02-24 01:58:03.950448+00:00, run_duration=3.782509, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:57:00+00:00, data_interval_end=2024-02-24 01:58:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:58:03.972146349Z [2024-02-24T01:58:03.971+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:58:00+00:00, run_after=2024-02-24T01:59:00+00:00 2024-02-24T01:58:05.095900535Z [2024-02-24T01:58:05.095+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:58:05.096486955Z [2024-02-24T01:58:05.096+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:57:00+00:00, run_id=scheduled__2024-02-24T01:57:00+00:00, run_start_date=2024-02-24 01:58:00.169403+00:00, run_end_date=2024-02-24 01:58:05.095812+00:00, run_duration=4.926409, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:57:00+00:00, data_interval_end=2024-02-24 01:58:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:58:05.111247042Z [2024-02-24T01:58:05.110+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:58:00+00:00, run_after=2024-02-24T01:59:00+00:00 2024-02-24T01:58:05.162650715Z [2024-02-24T01:58:05.162+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:57:00+00:00 exited with status success for try_number 1 2024-02-24T01:58:05.163006452Z [2024-02-24T01:58:05.162+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:57:00+00:00 exited with status success for try_number 1 2024-02-24T01:58:05.171534411Z [2024-02-24T01:58:05.171+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:57:00+00:00, map_index=-1, run_start_date=2024-02-24 01:58:02.592744+00:00, run_end_date=2024-02-24 01:58:03.927821+00:00, run_duration=1.335077, state=success, executor_state=success, try_number=1, max_tries=1, job_id=651, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:58:00.284734+00:00, queued_by_job_id=2, pid=9518 2024-02-24T01:58:05.172087257Z [2024-02-24T01:58:05.171+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:57:00+00:00, map_index=-1, run_start_date=2024-02-24 01:58:02.463882+00:00, run_end_date=2024-02-24 01:58:04.206579+00:00, run_duration=1.742697, state=success, executor_state=success, try_number=1, max_tries=1, job_id=650, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:58:00.284734+00:00, queued_by_job_id=2, pid=9517 2024-02-24T01:59:00.876153544Z [2024-02-24T01:59:00.875+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:59:00+00:00, run_after=2024-02-24T02:00:00+00:00 2024-02-24T01:59:00.890968292Z [2024-02-24T01:59:00.890+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:59:00+00:00, run_after=2024-02-24T02:00:00+00:00 2024-02-24T01:59:00.901158164Z [2024-02-24T01:59:00.900+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T01:59:00.960620070Z [2024-02-24T01:59:00.959+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T01:59:00.960672040Z 2024-02-24T01:59:00.960675972Z 2024-02-24T01:59:00.960679351Z 2024-02-24T01:59:00.961454476Z [2024-02-24T01:59:00.960+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:59:00.962374103Z [2024-02-24T01:59:00.961+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T01:59:00.963014704Z [2024-02-24T01:59:00.962+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T01:59:00.964426254Z [2024-02-24T01:59:00.963+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T01:59:00.964449267Z 2024-02-24T01:59:00.964457811Z 2024-02-24T01:59:00.964465542Z 2024-02-24T01:59:00.970526095Z [2024-02-24T01:59:00.970+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:59:00.971056312Z [2024-02-24T01:59:00.970+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T01:59:00.971747242Z [2024-02-24T01:59:00.971+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:59:00.972195337Z [2024-02-24T01:59:00.971+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T01:59:00.972699029Z [2024-02-24T01:59:00.972+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T01:59:00.973558601Z [2024-02-24T01:59:00.973+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T01:59:01.259869385Z [2024-02-24T01:59:01.250+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:58:00+00:00 exited with status queued for try_number 1 2024-02-24T01:59:01.259897132Z [2024-02-24T01:59:01.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:58:00+00:00 exited with status queued for try_number 1 2024-02-24T01:59:01.259900809Z [2024-02-24T01:59:01.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:58:00+00:00 exited with status queued for try_number 1 2024-02-24T01:59:01.265877140Z [2024-02-24T01:59:01.260+0000] {scheduler_job.py:635} INFO - Setting external_id for to 732a51dc-73ce-4d1c-ad15-a933643da7db 2024-02-24T01:59:01.265898466Z [2024-02-24T01:59:01.261+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0c606f54-6785-449a-9bd2-cb38d659b1c5 2024-02-24T01:59:01.265902446Z [2024-02-24T01:59:01.261+0000] {scheduler_job.py:635} INFO - Setting external_id for to 88d7656c-3221-4e6d-8ae5-f1c0f5807077 2024-02-24T01:59:02.481287237Z [2024-02-24T01:59:02.479+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:59:02.481333231Z [2024-02-24T01:59:02.480+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:58:00+00:00, run_id=scheduled__2024-02-24T01:58:00+00:00, run_start_date=2024-02-24 01:59:00.911572+00:00, run_end_date=2024-02-24 01:59:02.479931+00:00, run_duration=1.568359, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:58:00+00:00, data_interval_end=2024-02-24 01:59:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T01:59:02.497749505Z [2024-02-24T01:59:02.497+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T01:59:00+00:00, run_after=2024-02-24T02:00:00+00:00 2024-02-24T01:59:02.609881576Z [2024-02-24T01:59:02.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:58:00+00:00 exited with status success for try_number 1 2024-02-24T01:59:02.620017280Z [2024-02-24T01:59:02.619+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:58:00+00:00, map_index=-1, run_start_date=2024-02-24 01:59:02.006404+00:00, run_end_date=2024-02-24 01:59:02.418674+00:00, run_duration=0.41227, state=success, executor_state=success, try_number=1, max_tries=1, job_id=652, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:59:00.966300+00:00, queued_by_job_id=2, pid=9551 2024-02-24T01:59:06.022324570Z [2024-02-24T01:59:06.021+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:59:06.022456148Z [2024-02-24T01:59:06.022+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:58:00+00:00, run_id=scheduled__2024-02-24T01:58:00+00:00, run_start_date=2024-02-24 01:59:00.912749+00:00, run_end_date=2024-02-24 01:59:06.022031+00:00, run_duration=5.109282, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:58:00+00:00, data_interval_end=2024-02-24 01:59:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T01:59:06.042536248Z [2024-02-24T01:59:06.041+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:59:00+00:00, run_after=2024-02-24T02:00:00+00:00 2024-02-24T01:59:06.052186698Z [2024-02-24T01:59:06.051+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T01:59:06.052362435Z [2024-02-24T01:59:06.052+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:58:00+00:00, run_id=scheduled__2024-02-24T01:58:00+00:00, run_start_date=2024-02-24 01:59:00.913767+00:00, run_end_date=2024-02-24 01:59:06.052039+00:00, run_duration=5.138272, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:58:00+00:00, data_interval_end=2024-02-24 01:59:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T01:59:06.063309171Z [2024-02-24T01:59:06.062+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T01:59:00+00:00, run_after=2024-02-24T02:00:00+00:00 2024-02-24T01:59:06.112457256Z [2024-02-24T01:59:06.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:58:00+00:00 exited with status success for try_number 1 2024-02-24T01:59:06.112543924Z [2024-02-24T01:59:06.112+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:58:00+00:00 exited with status success for try_number 1 2024-02-24T01:59:06.127660438Z [2024-02-24T01:59:06.126+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:58:00+00:00, map_index=-1, run_start_date=2024-02-24 01:59:03.393733+00:00, run_end_date=2024-02-24 01:59:05.266204+00:00, run_duration=1.872471, state=success, executor_state=success, try_number=1, max_tries=1, job_id=654, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:59:00.966300+00:00, queued_by_job_id=2, pid=9569 2024-02-24T01:59:06.127830734Z [2024-02-24T01:59:06.127+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:58:00+00:00, map_index=-1, run_start_date=2024-02-24 01:59:03.392762+00:00, run_end_date=2024-02-24 01:59:04.869690+00:00, run_duration=1.476928, state=success, executor_state=success, try_number=1, max_tries=1, job_id=653, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 01:59:00.966300+00:00, queued_by_job_id=2, pid=9570 2024-02-24T02:00:00.104899216Z [2024-02-24T02:00:00.104+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:00:00.114864601Z [2024-02-24T02:00:00.114+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:00:00.140174686Z [2024-02-24T02:00:00.139+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:00:00+00:00, run_after=2024-02-24T02:05:00+00:00 2024-02-24T02:00:00.160650869Z [2024-02-24T02:00:00.160+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:00:00+00:00, run_after=2024-02-24T02:01:00+00:00 2024-02-24T02:00:00.174225652Z [2024-02-24T02:00:00.173+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:00:00+00:00, run_after=2024-02-24T02:01:00+00:00 2024-02-24T02:00:00.310438290Z [2024-02-24T02:00:00.309+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-02-24T02:00:00.310518196Z 2024-02-24T02:00:00.310528270Z 2024-02-24T02:00:00.310537624Z 2024-02-24T02:00:00.310616463Z 2024-02-24T02:00:00.310626818Z 2024-02-24T02:00:00.310635471Z [2024-02-24T02:00:00.310+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:00:00.310724686Z [2024-02-24T02:00:00.310+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T02:00:00.311140933Z [2024-02-24T02:00:00.310+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:00:00.311410520Z [2024-02-24T02:00:00.311+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:00:00.311664014Z [2024-02-24T02:00:00.311+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:00:00.312702447Z [2024-02-24T02:00:00.312+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:00:00.312756974Z 2024-02-24T02:00:00.312773804Z 2024-02-24T02:00:00.312835903Z 2024-02-24T02:00:00.312850225Z 2024-02-24T02:00:00.312865493Z 2024-02-24T02:00:00.320280699Z [2024-02-24T02:00:00.319+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T02:00:00.320348294Z [2024-02-24T02:00:00.320+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:00:00.320758554Z [2024-02-24T02:00:00.320+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:00:00.321009768Z [2024-02-24T02:00:00.320+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T02:00:00.321303214Z [2024-02-24T02:00:00.321+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:00:00.321443397Z [2024-02-24T02:00:00.321+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:00:00.321931765Z [2024-02-24T02:00:00.321+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:00:00.322139904Z [2024-02-24T02:00:00.321+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:00:00.322458353Z [2024-02-24T02:00:00.322+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:00:00.322626100Z [2024-02-24T02:00:00.322+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:00:00.668473656Z [2024-02-24T02:00:00.667+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T01:55:00+00:00 exited with status queued for try_number 1 2024-02-24T02:00:00.670089315Z [2024-02-24T02:00:00.668+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:58:00+00:00 exited with status queued for try_number 1 2024-02-24T02:00:00.670320238Z [2024-02-24T02:00:00.670+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:59:00+00:00 exited with status queued for try_number 1 2024-02-24T02:00:00.670458704Z [2024-02-24T02:00:00.670+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:59:00+00:00 exited with status queued for try_number 1 2024-02-24T02:00:00.670599539Z [2024-02-24T02:00:00.670+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:59:00+00:00 exited with status queued for try_number 1 2024-02-24T02:00:00.682788691Z [2024-02-24T02:00:00.682+0000] {scheduler_job.py:635} INFO - Setting external_id for to 32e3dcea-cf8b-4a99-b77f-327ff311efd8 2024-02-24T02:00:00.683099528Z [2024-02-24T02:00:00.682+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9acce40-2ed0-4ed8-938b-e2099b284b03 2024-02-24T02:00:00.683312933Z [2024-02-24T02:00:00.683+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3537fca-69f0-4faa-b89d-e16e39a64fef 2024-02-24T02:00:00.683504031Z [2024-02-24T02:00:00.683+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8f0aa829-1b21-4265-9b9d-c3846315dce3 2024-02-24T02:00:00.683686825Z [2024-02-24T02:00:00.683+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ab09ebf-665f-4a67-97de-f459cf9d5796 2024-02-24T02:00:01.691802507Z [2024-02-24T02:00:01.691+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:00:01.692188836Z [2024-02-24T02:00:01.691+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 01:58:00+00:00, run_id=scheduled__2024-02-24T01:58:00+00:00, run_start_date=2024-02-24 02:00:00.192170+00:00, run_end_date=2024-02-24 02:00:01.691785+00:00, run_duration=1.499615, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:58:00+00:00, data_interval_end=2024-02-24 02:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T02:00:01.710479620Z [2024-02-24T02:00:01.710+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T02:00:00+00:00, run_after=2024-02-24T02:02:00+00:00 2024-02-24T02:00:02.895283943Z [2024-02-24T02:00:02.894+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:00:02.896074588Z [2024-02-24T02:00:02.895+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 01:59:00+00:00, run_id=scheduled__2024-02-24T01:59:00+00:00, run_start_date=2024-02-24 02:00:00.193310+00:00, run_end_date=2024-02-24 02:00:02.895185+00:00, run_duration=2.701875, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:59:00+00:00, data_interval_end=2024-02-24 02:00:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:00:02.919520727Z [2024-02-24T02:00:02.919+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:00:00+00:00, run_after=2024-02-24T02:01:00+00:00 2024-02-24T02:00:03.000757369Z [2024-02-24T02:00:03.000+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T01:58:00+00:00 exited with status success for try_number 1 2024-02-24T02:00:03.002103012Z [2024-02-24T02:00:03.000+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:59:00+00:00 exited with status success for try_number 1 2024-02-24T02:00:03.011813101Z [2024-02-24T02:00:03.011+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T01:58:00+00:00, map_index=-1, run_start_date=2024-02-24 02:00:01.179258+00:00, run_end_date=2024-02-24 02:00:01.640556+00:00, run_duration=0.461298, state=success, executor_state=success, try_number=1, max_tries=1, job_id=655, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:00:00.316010+00:00, queued_by_job_id=2, pid=9599 2024-02-24T02:00:03.013177888Z [2024-02-24T02:00:03.012+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:59:00+00:00, map_index=-1, run_start_date=2024-02-24 02:00:01.767891+00:00, run_end_date=2024-02-24 02:00:02.183773+00:00, run_duration=0.415882, state=success, executor_state=success, try_number=1, max_tries=1, job_id=656, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:00:00.316010+00:00, queued_by_job_id=2, pid=9610 2024-02-24T02:00:03.666460288Z [2024-02-24T02:00:03.665+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:00:03.666495318Z 2024-02-24T02:00:03.666703952Z [2024-02-24T02:00:03.666+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:00:03.667692560Z [2024-02-24T02:00:03.667+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:00:03.667701643Z 2024-02-24T02:00:03.673878513Z [2024-02-24T02:00:03.673+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T02:00:03.674293820Z [2024-02-24T02:00:03.673+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:00:03.755310812Z [2024-02-24T02:00:03.754+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T01:55:00+00:00 exited with status queued for try_number 1 2024-02-24T02:00:03.755539098Z [2024-02-24T02:00:03.755+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T01:55:00+00:00 exited with status success for try_number 1 2024-02-24T02:00:03.763278679Z [2024-02-24T02:00:03.762+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97302ce5-5c41-4119-aae4-13ad659c5f06 2024-02-24T02:00:03.764296920Z [2024-02-24T02:00:03.763+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T01:55:00+00:00, map_index=-1, run_start_date=2024-02-24 02:00:02.941455+00:00, run_end_date=2024-02-24 02:00:03.332582+00:00, run_duration=0.391127, state=success, executor_state=success, try_number=1, max_tries=1, job_id=657, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:00:00.316010+00:00, queued_by_job_id=2, pid=9634 2024-02-24T02:00:04.949267277Z [2024-02-24T02:00:04.948+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:00:04.950048726Z [2024-02-24T02:00:04.949+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:59:00+00:00, run_id=scheduled__2024-02-24T01:59:00+00:00, run_start_date=2024-02-24 02:00:00.195439+00:00, run_end_date=2024-02-24 02:00:04.949064+00:00, run_duration=4.753625, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:59:00+00:00, data_interval_end=2024-02-24 02:00:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:00:04.966164159Z [2024-02-24T02:00:04.965+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:00:00+00:00, run_after=2024-02-24T02:01:00+00:00 2024-02-24T02:00:04.978823529Z [2024-02-24T02:00:04.978+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:00:04.979339603Z [2024-02-24T02:00:04.978+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:59:00+00:00, run_id=scheduled__2024-02-24T01:59:00+00:00, run_start_date=2024-02-24 02:00:00.194409+00:00, run_end_date=2024-02-24 02:00:04.978635+00:00, run_duration=4.784226, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:59:00+00:00, data_interval_end=2024-02-24 02:00:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:00:04.997604511Z [2024-02-24T02:00:04.997+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:00:00+00:00, run_after=2024-02-24T02:01:00+00:00 2024-02-24T02:00:05.073105512Z [2024-02-24T02:00:05.072+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:59:00+00:00 exited with status success for try_number 1 2024-02-24T02:00:05.073536665Z [2024-02-24T02:00:05.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T01:59:00+00:00 exited with status success for try_number 1 2024-02-24T02:00:05.081954061Z [2024-02-24T02:00:05.081+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:59:00+00:00, map_index=-1, run_start_date=2024-02-24 02:00:03.008189+00:00, run_end_date=2024-02-24 02:00:04.309707+00:00, run_duration=1.301518, state=success, executor_state=success, try_number=1, max_tries=1, job_id=658, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:00:00.316010+00:00, queued_by_job_id=2, pid=9635 2024-02-24T02:00:05.082548086Z [2024-02-24T02:00:05.082+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T01:59:00+00:00, map_index=-1, run_start_date=2024-02-24 02:00:03.040839+00:00, run_end_date=2024-02-24 02:00:04.729254+00:00, run_duration=1.688415, state=success, executor_state=success, try_number=1, max_tries=1, job_id=659, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:00:00.316010+00:00, queued_by_job_id=2, pid=9636 2024-02-24T02:00:06.173072683Z [2024-02-24T02:00:06.172+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:00:06.173108892Z 2024-02-24T02:00:06.173443815Z [2024-02-24T02:00:06.173+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:00:06.174930947Z [2024-02-24T02:00:06.174+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:00:06.174970545Z 2024-02-24T02:00:06.178900907Z [2024-02-24T02:00:06.178+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T01:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T02:00:06.179070795Z [2024-02-24T02:00:06.178+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T02:00:06.231790007Z [2024-02-24T02:00:06.231+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T01:55:00+00:00 exited with status queued for try_number 1 2024-02-24T02:00:06.232131075Z [2024-02-24T02:00:06.231+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T01:55:00+00:00 exited with status success for try_number 1 2024-02-24T02:00:06.240717249Z [2024-02-24T02:00:06.240+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5aa94d6-42a0-44c2-b2fa-f4d0fb5674cc 2024-02-24T02:00:06.241138470Z [2024-02-24T02:00:06.240+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T01:55:00+00:00, map_index=-1, run_start_date=2024-02-24 02:00:05.381118+00:00, run_end_date=2024-02-24 02:00:05.755571+00:00, run_duration=0.374453, state=success, executor_state=success, try_number=1, max_tries=1, job_id=660, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:00:03.668525+00:00, queued_by_job_id=2, pid=9659 2024-02-24T02:00:08.490611735Z [2024-02-24T02:00:08.490+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:00:08.490641989Z 2024-02-24T02:00:08.490650601Z [2024-02-24T02:00:08.490+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:00:08.491523540Z [2024-02-24T02:00:08.491+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:00:08.491538754Z 2024-02-24T02:00:08.494089720Z [2024-02-24T02:00:08.493+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:00:08.494224383Z [2024-02-24T02:00:08.494+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:00:08.535438247Z [2024-02-24T02:00:08.535+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T01:55:00+00:00 exited with status queued for try_number 1 2024-02-24T02:00:08.535777544Z [2024-02-24T02:00:08.535+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T01:55:00+00:00 exited with status success for try_number 1 2024-02-24T02:00:08.542728433Z [2024-02-24T02:00:08.542+0000] {scheduler_job.py:635} INFO - Setting external_id for to e79f6c9c-a1a1-4ada-bfde-36458d1793eb 2024-02-24T02:00:08.543109497Z [2024-02-24T02:00:08.542+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T01:55:00+00:00, map_index=0, run_start_date=2024-02-24 02:00:07.819273+00:00, run_end_date=2024-02-24 02:00:08.147264+00:00, run_duration=0.327991, state=success, executor_state=success, try_number=1, max_tries=1, job_id=661, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:00:06.175714+00:00, queued_by_job_id=2, pid=9667 2024-02-24T02:00:10.995391136Z [2024-02-24T02:00:10.994+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:00:10.995739330Z [2024-02-24T02:00:10.995+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 01:55:00+00:00, run_id=scheduled__2024-02-24T01:55:00+00:00, run_start_date=2024-02-24 02:00:00.190512+00:00, run_end_date=2024-02-24 02:00:10.995261+00:00, run_duration=10.804749, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 01:55:00+00:00, data_interval_end=2024-02-24 02:00:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T02:00:11.005142327Z [2024-02-24T02:00:11.004+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:00:00+00:00, run_after=2024-02-24T02:05:00+00:00 2024-02-24T02:00:11.048313787Z [2024-02-24T02:00:11.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T01:55:00+00:00 exited with status success for try_number 1 2024-02-24T02:00:11.054005341Z [2024-02-24T02:00:11.053+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T01:55:00+00:00, map_index=-1, run_start_date=2024-02-24 02:00:10.226459+00:00, run_end_date=2024-02-24 02:00:10.554460+00:00, run_duration=0.328001, state=success, executor_state=success, try_number=1, max_tries=1, job_id=662, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:00:08.491929+00:00, queued_by_job_id=2, pid=9675 2024-02-24T02:01:00.509908787Z [2024-02-24T02:01:00.509+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:01:00.524280860Z [2024-02-24T02:01:00.523+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:01:00+00:00, run_after=2024-02-24T02:02:00+00:00 2024-02-24T02:01:00.538144751Z [2024-02-24T02:01:00.537+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:01:00+00:00, run_after=2024-02-24T02:02:00+00:00 2024-02-24T02:01:00.642694730Z [2024-02-24T02:01:00.642+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T02:01:00.642723829Z 2024-02-24T02:01:00.642727511Z 2024-02-24T02:01:00.642730730Z 2024-02-24T02:01:00.642877281Z [2024-02-24T02:01:00.642+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:01:00.643070232Z [2024-02-24T02:01:00.642+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:01:00.643254444Z [2024-02-24T02:01:00.643+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:01:00.644082618Z [2024-02-24T02:01:00.643+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:01:00.644096269Z 2024-02-24T02:01:00.644101465Z 2024-02-24T02:01:00.644126543Z 2024-02-24T02:01:00.648445757Z [2024-02-24T02:01:00.648+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:01:00.648843568Z [2024-02-24T02:01:00.648+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:01:00.649309613Z [2024-02-24T02:01:00.649+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:01:00.649517561Z [2024-02-24T02:01:00.649+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:01:00.649826622Z [2024-02-24T02:01:00.649+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:01:00.650013388Z [2024-02-24T02:01:00.649+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:01:00.903034649Z [2024-02-24T02:01:00.902+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:00:00+00:00 exited with status queued for try_number 1 2024-02-24T02:01:00.903138829Z [2024-02-24T02:01:00.903+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:00:00+00:00 exited with status queued for try_number 1 2024-02-24T02:01:00.903269344Z [2024-02-24T02:01:00.903+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:00:00+00:00 exited with status queued for try_number 1 2024-02-24T02:01:00.910979788Z [2024-02-24T02:01:00.910+0000] {scheduler_job.py:635} INFO - Setting external_id for to c4a6e64d-9383-4afa-b6f4-0afb19534ac3 2024-02-24T02:01:00.911152586Z [2024-02-24T02:01:00.910+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f924d88-84fb-4da9-a4b8-f4cdfe46d2c8 2024-02-24T02:01:00.911335270Z [2024-02-24T02:01:00.911+0000] {scheduler_job.py:635} INFO - Setting external_id for to 990cc3a2-5984-4325-8019-e5ae5afd1c0b 2024-02-24T02:01:02.079648496Z [2024-02-24T02:01:02.079+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:01:02.080018595Z [2024-02-24T02:01:02.079+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:00:00+00:00, run_id=scheduled__2024-02-24T02:00:00+00:00, run_start_date=2024-02-24 02:01:00.558567+00:00, run_end_date=2024-02-24 02:01:02.079610+00:00, run_duration=1.521043, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:00:00+00:00, data_interval_end=2024-02-24 02:01:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:01:02.092612112Z [2024-02-24T02:01:02.092+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:01:00+00:00, run_after=2024-02-24T02:02:00+00:00 2024-02-24T02:01:02.157257374Z [2024-02-24T02:01:02.156+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:00:00+00:00 exited with status success for try_number 1 2024-02-24T02:01:02.168307868Z [2024-02-24T02:01:02.167+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:00:00+00:00, map_index=-1, run_start_date=2024-02-24 02:01:01.490438+00:00, run_end_date=2024-02-24 02:01:01.875172+00:00, run_duration=0.384734, state=success, executor_state=success, try_number=1, max_tries=1, job_id=663, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:01:00.645398+00:00, queued_by_job_id=2, pid=9697 2024-02-24T02:01:04.326379611Z [2024-02-24T02:01:04.325+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:01:04.326566737Z [2024-02-24T02:01:04.326+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:00:00+00:00, run_id=scheduled__2024-02-24T02:00:00+00:00, run_start_date=2024-02-24 02:01:00.564008+00:00, run_end_date=2024-02-24 02:01:04.326146+00:00, run_duration=3.762138, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:00:00+00:00, data_interval_end=2024-02-24 02:01:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:01:04.344860399Z [2024-02-24T02:01:04.344+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:01:00+00:00, run_after=2024-02-24T02:02:00+00:00 2024-02-24T02:01:04.353049418Z [2024-02-24T02:01:04.352+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:01:04.353389134Z [2024-02-24T02:01:04.353+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:00:00+00:00, run_id=scheduled__2024-02-24T02:00:00+00:00, run_start_date=2024-02-24 02:01:00.561490+00:00, run_end_date=2024-02-24 02:01:04.352930+00:00, run_duration=3.79144, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:00:00+00:00, data_interval_end=2024-02-24 02:01:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:01:04.364318038Z [2024-02-24T02:01:04.363+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:01:00+00:00, run_after=2024-02-24T02:02:00+00:00 2024-02-24T02:01:04.395334874Z [2024-02-24T02:01:04.394+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:00:00+00:00 exited with status success for try_number 1 2024-02-24T02:01:04.395421924Z [2024-02-24T02:01:04.395+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:00:00+00:00 exited with status success for try_number 1 2024-02-24T02:01:04.405595314Z [2024-02-24T02:01:04.405+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:00:00+00:00, map_index=-1, run_start_date=2024-02-24 02:01:02.454473+00:00, run_end_date=2024-02-24 02:01:03.855588+00:00, run_duration=1.401115, state=success, executor_state=success, try_number=1, max_tries=1, job_id=664, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:01:00.645398+00:00, queued_by_job_id=2, pid=9715 2024-02-24T02:01:04.406105827Z [2024-02-24T02:01:04.405+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:00:00+00:00, map_index=-1, run_start_date=2024-02-24 02:01:02.485237+00:00, run_end_date=2024-02-24 02:01:04.135750+00:00, run_duration=1.650513, state=success, executor_state=success, try_number=1, max_tries=1, job_id=665, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:01:00.645398+00:00, queued_by_job_id=2, pid=9716 2024-02-24T02:02:00.380291181Z [2024-02-24T02:02:00.379+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:02:00+00:00, run_after=2024-02-24T02:03:00+00:00 2024-02-24T02:02:00.401322781Z [2024-02-24T02:02:00.399+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:02:00+00:00, run_after=2024-02-24T02:03:00+00:00 2024-02-24T02:02:00.409646716Z [2024-02-24T02:02:00.409+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:02:00.422867447Z [2024-02-24T02:02:00.421+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:02:00.513245591Z [2024-02-24T02:02:00.510+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T02:02:00.513272495Z 2024-02-24T02:02:00.513278576Z 2024-02-24T02:02:00.513283333Z 2024-02-24T02:02:00.513287883Z 2024-02-24T02:02:00.513308635Z [2024-02-24T02:02:00.511+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T02:02:00.513313549Z [2024-02-24T02:02:00.512+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:02:00.513317900Z [2024-02-24T02:02:00.512+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:02:00.515186812Z [2024-02-24T02:02:00.513+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:02:00.515203777Z [2024-02-24T02:02:00.514+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:02:00.515209038Z 2024-02-24T02:02:00.515213528Z 2024-02-24T02:02:00.515217595Z 2024-02-24T02:02:00.515221806Z 2024-02-24T02:02:00.524197975Z [2024-02-24T02:02:00.523+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:02:00.525659972Z [2024-02-24T02:02:00.525+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T02:02:00.526409855Z [2024-02-24T02:02:00.526+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:02:00.526784614Z [2024-02-24T02:02:00.526+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:02:00.527402069Z [2024-02-24T02:02:00.527+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:02:00.527755273Z [2024-02-24T02:02:00.527+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:02:00.528404127Z [2024-02-24T02:02:00.528+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:02:00.528781502Z [2024-02-24T02:02:00.528+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:02:01.009862485Z [2024-02-24T02:02:01.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:00:00+00:00 exited with status queued for try_number 1 2024-02-24T02:02:01.010215862Z [2024-02-24T02:02:01.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:01:00+00:00 exited with status queued for try_number 1 2024-02-24T02:02:01.010437902Z [2024-02-24T02:02:01.010+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:01:00+00:00 exited with status queued for try_number 1 2024-02-24T02:02:01.010710558Z [2024-02-24T02:02:01.010+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:01:00+00:00 exited with status queued for try_number 1 2024-02-24T02:02:01.019486852Z [2024-02-24T02:02:01.019+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0b0f2ea-9708-43ef-8908-e05b74dc492b 2024-02-24T02:02:01.019950165Z [2024-02-24T02:02:01.019+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9548d361-1554-4698-af51-8ea7cec0c1f4 2024-02-24T02:02:01.020187863Z [2024-02-24T02:02:01.020+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6323f3ec-ffdc-4c19-8e45-1365ae99e0f1 2024-02-24T02:02:01.020386174Z [2024-02-24T02:02:01.020+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8f9b8383-eb15-41ae-b3a9-ea2d258f544d 2024-02-24T02:02:02.194053146Z [2024-02-24T02:02:02.193+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:02:02.194487628Z [2024-02-24T02:02:02.194+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 02:00:00+00:00, run_id=scheduled__2024-02-24T02:00:00+00:00, run_start_date=2024-02-24 02:02:00.437132+00:00, run_end_date=2024-02-24 02:02:02.193963+00:00, run_duration=1.756831, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:00:00+00:00, data_interval_end=2024-02-24 02:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T02:02:02.202552916Z [2024-02-24T02:02:02.202+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T02:02:00+00:00, run_after=2024-02-24T02:04:00+00:00 2024-02-24T02:02:02.216157577Z [2024-02-24T02:02:02.215+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:02:02.216454244Z [2024-02-24T02:02:02.216+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:01:00+00:00, run_id=scheduled__2024-02-24T02:01:00+00:00, run_start_date=2024-02-24 02:02:00.438945+00:00, run_end_date=2024-02-24 02:02:02.216057+00:00, run_duration=1.777112, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:01:00+00:00, data_interval_end=2024-02-24 02:02:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:02:02.233759163Z [2024-02-24T02:02:02.233+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:02:00+00:00, run_after=2024-02-24T02:03:00+00:00 2024-02-24T02:02:02.276413159Z [2024-02-24T02:02:02.275+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:00:00+00:00 exited with status success for try_number 1 2024-02-24T02:02:02.276494258Z [2024-02-24T02:02:02.276+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:01:00+00:00 exited with status success for try_number 1 2024-02-24T02:02:02.285016604Z [2024-02-24T02:02:02.284+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T02:00:00+00:00, map_index=-1, run_start_date=2024-02-24 02:02:01.362880+00:00, run_end_date=2024-02-24 02:02:01.730368+00:00, run_duration=0.367488, state=success, executor_state=success, try_number=1, max_tries=1, job_id=666, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:02:00.518157+00:00, queued_by_job_id=2, pid=9749 2024-02-24T02:02:02.285268383Z [2024-02-24T02:02:02.285+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:01:00+00:00, map_index=-1, run_start_date=2024-02-24 02:02:01.505454+00:00, run_end_date=2024-02-24 02:02:01.896782+00:00, run_duration=0.391328, state=success, executor_state=success, try_number=1, max_tries=1, job_id=667, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:02:00.518157+00:00, queued_by_job_id=2, pid=9750 2024-02-24T02:02:03.572982670Z [2024-02-24T02:02:03.571+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T02:02:04.640312079Z [2024-02-24T02:02:04.639+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:02:04.640630100Z [2024-02-24T02:02:04.640+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:01:00+00:00, run_id=scheduled__2024-02-24T02:01:00+00:00, run_start_date=2024-02-24 02:02:00.440027+00:00, run_end_date=2024-02-24 02:02:04.640175+00:00, run_duration=4.200148, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:01:00+00:00, data_interval_end=2024-02-24 02:02:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:02:04.656136660Z [2024-02-24T02:02:04.655+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:02:00+00:00, run_after=2024-02-24T02:03:00+00:00 2024-02-24T02:02:04.665718093Z [2024-02-24T02:02:04.665+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:02:04.666120084Z [2024-02-24T02:02:04.665+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:01:00+00:00, run_id=scheduled__2024-02-24T02:01:00+00:00, run_start_date=2024-02-24 02:02:00.446022+00:00, run_end_date=2024-02-24 02:02:04.665715+00:00, run_duration=4.219693, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:01:00+00:00, data_interval_end=2024-02-24 02:02:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:02:04.675974664Z [2024-02-24T02:02:04.675+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:02:00+00:00, run_after=2024-02-24T02:03:00+00:00 2024-02-24T02:02:04.709728407Z [2024-02-24T02:02:04.709+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:01:00+00:00 exited with status success for try_number 1 2024-02-24T02:02:04.709965251Z [2024-02-24T02:02:04.709+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:01:00+00:00 exited with status success for try_number 1 2024-02-24T02:02:04.717764581Z [2024-02-24T02:02:04.717+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:01:00+00:00, map_index=-1, run_start_date=2024-02-24 02:02:02.686584+00:00, run_end_date=2024-02-24 02:02:04.424147+00:00, run_duration=1.737563, state=success, executor_state=success, try_number=1, max_tries=1, job_id=669, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:02:00.518157+00:00, queued_by_job_id=2, pid=9774 2024-02-24T02:02:04.718053842Z [2024-02-24T02:02:04.717+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:01:00+00:00, map_index=-1, run_start_date=2024-02-24 02:02:02.460474+00:00, run_end_date=2024-02-24 02:02:03.847669+00:00, run_duration=1.387195, state=success, executor_state=success, try_number=1, max_tries=1, job_id=668, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:02:00.518157+00:00, queued_by_job_id=2, pid=9770 2024-02-24T02:03:00.853795354Z [2024-02-24T02:03:00.853+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:03:00+00:00, run_after=2024-02-24T02:04:00+00:00 2024-02-24T02:03:00.861428561Z [2024-02-24T02:03:00.861+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:03:00.873072327Z [2024-02-24T02:03:00.872+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:03:00+00:00, run_after=2024-02-24T02:04:00+00:00 2024-02-24T02:03:00.953059891Z [2024-02-24T02:03:00.952+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T02:03:00.953090740Z 2024-02-24T02:03:00.953110177Z 2024-02-24T02:03:00.953113616Z 2024-02-24T02:03:00.953481285Z [2024-02-24T02:03:00.953+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:03:00.954473325Z [2024-02-24T02:03:00.953+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:03:00.954974746Z [2024-02-24T02:03:00.954+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:03:00.956684740Z [2024-02-24T02:03:00.956+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:03:00.956695185Z 2024-02-24T02:03:00.956698483Z 2024-02-24T02:03:00.956701693Z 2024-02-24T02:03:00.963132869Z [2024-02-24T02:03:00.962+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:03:00.963540439Z [2024-02-24T02:03:00.962+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:03:00.964186903Z [2024-02-24T02:03:00.963+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:03:00.964617698Z [2024-02-24T02:03:00.964+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:03:00.965288255Z [2024-02-24T02:03:00.964+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:03:00.965720503Z [2024-02-24T02:03:00.965+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:03:01.187001990Z [2024-02-24T02:03:01.186+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:02:00+00:00 exited with status queued for try_number 1 2024-02-24T02:03:01.187049585Z [2024-02-24T02:03:01.186+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:02:00+00:00 exited with status queued for try_number 1 2024-02-24T02:03:01.189077799Z [2024-02-24T02:03:01.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:02:00+00:00 exited with status queued for try_number 1 2024-02-24T02:03:01.211397169Z [2024-02-24T02:03:01.210+0000] {scheduler_job.py:635} INFO - Setting external_id for to 73849494-97a4-48e8-8bbd-63563fbb3a88 2024-02-24T02:03:01.211417654Z [2024-02-24T02:03:01.210+0000] {scheduler_job.py:635} INFO - Setting external_id for to f94caa2e-a67b-4b94-b4b2-6be6707b152e 2024-02-24T02:03:01.211423319Z [2024-02-24T02:03:01.210+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9e658fc-3cd2-4337-b5e5-4c8b104e5d03 2024-02-24T02:03:02.878931633Z [2024-02-24T02:03:02.878+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:03:02.879543427Z [2024-02-24T02:03:02.879+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:02:00+00:00, run_id=scheduled__2024-02-24T02:02:00+00:00, run_start_date=2024-02-24 02:03:00.885025+00:00, run_end_date=2024-02-24 02:03:02.879108+00:00, run_duration=1.994083, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:02:00+00:00, data_interval_end=2024-02-24 02:03:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:03:02.890239051Z [2024-02-24T02:03:02.889+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:03:00+00:00, run_after=2024-02-24T02:04:00+00:00 2024-02-24T02:03:02.938880031Z [2024-02-24T02:03:02.938+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:02:00+00:00 exited with status success for try_number 1 2024-02-24T02:03:02.947069366Z [2024-02-24T02:03:02.946+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:02:00+00:00, map_index=-1, run_start_date=2024-02-24 02:03:01.921342+00:00, run_end_date=2024-02-24 02:03:02.399609+00:00, run_duration=0.478267, state=success, executor_state=success, try_number=1, max_tries=1, job_id=670, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:03:00.958411+00:00, queued_by_job_id=2, pid=9807 2024-02-24T02:03:05.105490451Z [2024-02-24T02:03:05.105+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:03:05.106034548Z [2024-02-24T02:03:05.105+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:02:00+00:00, run_id=scheduled__2024-02-24T02:02:00+00:00, run_start_date=2024-02-24 02:03:00.886470+00:00, run_end_date=2024-02-24 02:03:05.105345+00:00, run_duration=4.218875, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:02:00+00:00, data_interval_end=2024-02-24 02:03:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:03:05.116164653Z [2024-02-24T02:03:05.115+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:03:00+00:00, run_after=2024-02-24T02:04:00+00:00 2024-02-24T02:03:05.125545623Z [2024-02-24T02:03:05.125+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:03:05.125959373Z [2024-02-24T02:03:05.125+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:02:00+00:00, run_id=scheduled__2024-02-24T02:02:00+00:00, run_start_date=2024-02-24 02:03:00.887810+00:00, run_end_date=2024-02-24 02:03:05.125455+00:00, run_duration=4.237645, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:02:00+00:00, data_interval_end=2024-02-24 02:03:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:03:05.138186869Z [2024-02-24T02:03:05.137+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:03:00+00:00, run_after=2024-02-24T02:04:00+00:00 2024-02-24T02:03:05.172490981Z [2024-02-24T02:03:05.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:02:00+00:00 exited with status success for try_number 1 2024-02-24T02:03:05.172730860Z [2024-02-24T02:03:05.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:02:00+00:00 exited with status success for try_number 1 2024-02-24T02:03:05.181818576Z [2024-02-24T02:03:05.181+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:02:00+00:00, map_index=-1, run_start_date=2024-02-24 02:03:03.010173+00:00, run_end_date=2024-02-24 02:03:04.589061+00:00, run_duration=1.578888, state=success, executor_state=success, try_number=1, max_tries=1, job_id=671, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:03:00.958411+00:00, queued_by_job_id=2, pid=9826 2024-02-24T02:03:05.182222115Z [2024-02-24T02:03:05.181+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:02:00+00:00, map_index=-1, run_start_date=2024-02-24 02:03:03.013606+00:00, run_end_date=2024-02-24 02:03:04.365146+00:00, run_duration=1.35154, state=success, executor_state=success, try_number=1, max_tries=1, job_id=672, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:03:00.958411+00:00, queued_by_job_id=2, pid=9825 2024-02-24T02:04:01.094847805Z [2024-02-24T02:04:01.094+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:04:01.120440467Z [2024-02-24T02:04:01.120+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:04:00+00:00, run_after=2024-02-24T02:05:00+00:00 2024-02-24T02:04:01.135103043Z [2024-02-24T02:04:01.134+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:04:00+00:00, run_after=2024-02-24T02:05:00+00:00 2024-02-24T02:04:01.143838938Z [2024-02-24T02:04:01.143+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:04:01.275129339Z [2024-02-24T02:04:01.273+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T02:04:01.275151821Z 2024-02-24T02:04:01.275179435Z 2024-02-24T02:04:01.275183069Z 2024-02-24T02:04:01.275186071Z 2024-02-24T02:04:01.275196396Z [2024-02-24T02:04:01.273+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T02:04:01.275199585Z [2024-02-24T02:04:01.274+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:04:01.275202629Z [2024-02-24T02:04:01.274+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:04:01.275206035Z [2024-02-24T02:04:01.274+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:04:01.276052136Z [2024-02-24T02:04:01.275+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:04:01.276062114Z 2024-02-24T02:04:01.276066164Z 2024-02-24T02:04:01.276069401Z 2024-02-24T02:04:01.276072508Z 2024-02-24T02:04:01.280186698Z [2024-02-24T02:04:01.279+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:04:01.280316978Z [2024-02-24T02:04:01.280+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T02:04:01.280541298Z [2024-02-24T02:04:01.280+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:04:01.280551627Z [2024-02-24T02:04:01.280+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:04:01.280723292Z [2024-02-24T02:04:01.280+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:04:01.280812613Z [2024-02-24T02:04:01.280+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:04:01.281350371Z [2024-02-24T02:04:01.280+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:04:01.281725957Z [2024-02-24T02:04:01.281+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:04:01.617808079Z [2024-02-24T02:04:01.617+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:02:00+00:00 exited with status queued for try_number 1 2024-02-24T02:04:01.620248340Z [2024-02-24T02:04:01.619+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:03:00+00:00 exited with status queued for try_number 1 2024-02-24T02:04:01.620321740Z [2024-02-24T02:04:01.620+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:03:00+00:00 exited with status queued for try_number 1 2024-02-24T02:04:01.620415007Z [2024-02-24T02:04:01.620+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:03:00+00:00 exited with status queued for try_number 1 2024-02-24T02:04:01.633621024Z [2024-02-24T02:04:01.633+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3e0d23fc-0058-4da6-a21d-a33e72650e42 2024-02-24T02:04:01.635650804Z [2024-02-24T02:04:01.635+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ef75871-8a78-40a1-bb05-f6ca08e872d6 2024-02-24T02:04:01.635807332Z [2024-02-24T02:04:01.635+0000] {scheduler_job.py:635} INFO - Setting external_id for to e80d8fdf-a0e3-4a97-baf3-c578571409b4 2024-02-24T02:04:01.635984163Z [2024-02-24T02:04:01.635+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff78ff8a-71d7-4414-9ff2-3d9b722e0942 2024-02-24T02:04:02.895784130Z [2024-02-24T02:04:02.895+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:04:02.896413813Z [2024-02-24T02:04:02.896+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 02:02:00+00:00, run_id=scheduled__2024-02-24T02:02:00+00:00, run_start_date=2024-02-24 02:04:01.155639+00:00, run_end_date=2024-02-24 02:04:02.895892+00:00, run_duration=1.740253, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:02:00+00:00, data_interval_end=2024-02-24 02:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T02:04:02.905996828Z [2024-02-24T02:04:02.905+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T02:04:00+00:00, run_after=2024-02-24T02:06:00+00:00 2024-02-24T02:04:02.928672371Z [2024-02-24T02:04:02.928+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:04:02.929009704Z [2024-02-24T02:04:02.928+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:03:00+00:00, run_id=scheduled__2024-02-24T02:03:00+00:00, run_start_date=2024-02-24 02:04:01.156880+00:00, run_end_date=2024-02-24 02:04:02.928708+00:00, run_duration=1.771828, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:03:00+00:00, data_interval_end=2024-02-24 02:04:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:04:02.940515469Z [2024-02-24T02:04:02.940+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:04:00+00:00, run_after=2024-02-24T02:05:00+00:00 2024-02-24T02:04:03.013482280Z [2024-02-24T02:04:03.013+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:02:00+00:00 exited with status success for try_number 1 2024-02-24T02:04:03.019242811Z [2024-02-24T02:04:03.018+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T02:02:00+00:00, map_index=-1, run_start_date=2024-02-24 02:04:02.084740+00:00, run_end_date=2024-02-24 02:04:02.554872+00:00, run_duration=0.470132, state=success, executor_state=success, try_number=1, max_tries=1, job_id=673, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:04:01.277085+00:00, queued_by_job_id=2, pid=9859 2024-02-24T02:04:03.417439938Z [2024-02-24T02:04:03.417+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:03:00+00:00 exited with status success for try_number 1 2024-02-24T02:04:03.422870437Z [2024-02-24T02:04:03.422+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:03:00+00:00, map_index=-1, run_start_date=2024-02-24 02:04:02.286205+00:00, run_end_date=2024-02-24 02:04:02.849376+00:00, run_duration=0.563171, state=success, executor_state=success, try_number=1, max_tries=1, job_id=674, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:04:01.277085+00:00, queued_by_job_id=2, pid=9860 2024-02-24T02:04:05.621443174Z [2024-02-24T02:04:05.620+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:04:05.621921214Z [2024-02-24T02:04:05.621+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:03:00+00:00, run_id=scheduled__2024-02-24T02:03:00+00:00, run_start_date=2024-02-24 02:04:01.158060+00:00, run_end_date=2024-02-24 02:04:05.621431+00:00, run_duration=4.463371, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:03:00+00:00, data_interval_end=2024-02-24 02:04:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:04:05.634670469Z [2024-02-24T02:04:05.634+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:04:00+00:00, run_after=2024-02-24T02:05:00+00:00 2024-02-24T02:04:05.673221184Z [2024-02-24T02:04:05.672+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:03:00+00:00 exited with status success for try_number 1 2024-02-24T02:04:05.678588931Z [2024-02-24T02:04:05.678+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:03:00+00:00, map_index=-1, run_start_date=2024-02-24 02:04:03.471992+00:00, run_end_date=2024-02-24 02:04:05.041458+00:00, run_duration=1.569466, state=success, executor_state=success, try_number=1, max_tries=1, job_id=675, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:04:01.277085+00:00, queued_by_job_id=2, pid=9883 2024-02-24T02:04:06.736518685Z [2024-02-24T02:04:06.735+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:04:06.737054362Z [2024-02-24T02:04:06.736+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:03:00+00:00, run_id=scheduled__2024-02-24T02:03:00+00:00, run_start_date=2024-02-24 02:04:01.159053+00:00, run_end_date=2024-02-24 02:04:06.736389+00:00, run_duration=5.577336, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:03:00+00:00, data_interval_end=2024-02-24 02:04:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:04:06.748230537Z [2024-02-24T02:04:06.747+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:04:00+00:00, run_after=2024-02-24T02:05:00+00:00 2024-02-24T02:04:06.796951238Z [2024-02-24T02:04:06.796+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:03:00+00:00 exited with status success for try_number 1 2024-02-24T02:04:06.805076665Z [2024-02-24T02:04:06.804+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:03:00+00:00, map_index=-1, run_start_date=2024-02-24 02:04:03.604337+00:00, run_end_date=2024-02-24 02:04:06.349649+00:00, run_duration=2.745312, state=success, executor_state=success, try_number=1, max_tries=1, job_id=676, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:04:01.277085+00:00, queued_by_job_id=2, pid=9884 2024-02-24T02:05:00.336037576Z [2024-02-24T02:05:00.335+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:05:00+00:00, run_after=2024-02-24T02:06:00+00:00 2024-02-24T02:05:00.358743281Z [2024-02-24T02:05:00.358+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:05:00+00:00, run_after=2024-02-24T02:10:00+00:00 2024-02-24T02:05:00.375532522Z [2024-02-24T02:05:00.375+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:05:00+00:00, run_after=2024-02-24T02:06:00+00:00 2024-02-24T02:05:00.384526537Z [2024-02-24T02:05:00.384+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:05:00.490231138Z [2024-02-24T02:05:00.489+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T02:05:00.490256751Z 2024-02-24T02:05:00.490265594Z 2024-02-24T02:05:00.490269705Z 2024-02-24T02:05:00.490274729Z 2024-02-24T02:05:00.490443576Z [2024-02-24T02:05:00.490+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:05:00.490679134Z [2024-02-24T02:05:00.490+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:05:00.490838370Z [2024-02-24T02:05:00.490+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:05:00.491059159Z [2024-02-24T02:05:00.490+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:05:00.492343850Z [2024-02-24T02:05:00.491+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:05:00.492360192Z 2024-02-24T02:05:00.492366557Z 2024-02-24T02:05:00.492371811Z 2024-02-24T02:05:00.492376764Z 2024-02-24T02:05:00.497962261Z [2024-02-24T02:05:00.497+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T02:05:00.498193579Z [2024-02-24T02:05:00.497+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:05:00.498489969Z [2024-02-24T02:05:00.498+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:05:00.498632335Z [2024-02-24T02:05:00.498+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:05:00.498979072Z [2024-02-24T02:05:00.498+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:05:00.499140761Z [2024-02-24T02:05:00.498+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:05:00.499406682Z [2024-02-24T02:05:00.499+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:05:00.499633916Z [2024-02-24T02:05:00.499+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:05:01.072891098Z [2024-02-24T02:05:01.072+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T02:00:00+00:00 exited with status queued for try_number 1 2024-02-24T02:05:01.073069860Z [2024-02-24T02:05:01.072+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:04:00+00:00 exited with status queued for try_number 1 2024-02-24T02:05:01.074198285Z [2024-02-24T02:05:01.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:04:00+00:00 exited with status queued for try_number 1 2024-02-24T02:05:01.074349331Z [2024-02-24T02:05:01.074+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:04:00+00:00 exited with status queued for try_number 1 2024-02-24T02:05:01.106147392Z [2024-02-24T02:05:01.105+0000] {scheduler_job.py:635} INFO - Setting external_id for to 629f68bd-c4f6-4821-84e8-433093bc26fe 2024-02-24T02:05:01.106455348Z [2024-02-24T02:05:01.106+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3801276-b895-4d40-b2b2-9507dab220a0 2024-02-24T02:05:01.106651714Z [2024-02-24T02:05:01.106+0000] {scheduler_job.py:635} INFO - Setting external_id for to 732c2616-c4d0-43be-a770-67833f5fddc1 2024-02-24T02:05:01.106891042Z [2024-02-24T02:05:01.106+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34b02159-3a47-49db-a854-b8216f52b107 2024-02-24T02:05:02.451349668Z [2024-02-24T02:05:02.449+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:05:02.451663940Z [2024-02-24T02:05:02.451+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:04:00+00:00, run_id=scheduled__2024-02-24T02:04:00+00:00, run_start_date=2024-02-24 02:05:00.397420+00:00, run_end_date=2024-02-24 02:05:02.451204+00:00, run_duration=2.053784, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:04:00+00:00, data_interval_end=2024-02-24 02:05:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:05:02.464281493Z [2024-02-24T02:05:02.463+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:05:00+00:00, run_after=2024-02-24T02:06:00+00:00 2024-02-24T02:05:02.575222310Z [2024-02-24T02:05:02.574+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:04:00+00:00 exited with status success for try_number 1 2024-02-24T02:05:02.592533020Z [2024-02-24T02:05:02.592+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:04:00+00:00, map_index=-1, run_start_date=2024-02-24 02:05:01.432991+00:00, run_end_date=2024-02-24 02:05:01.810509+00:00, run_duration=0.377518, state=success, executor_state=success, try_number=1, max_tries=1, job_id=677, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:05:00.494724+00:00, queued_by_job_id=2, pid=9917 2024-02-24T02:05:03.717519219Z [2024-02-24T02:05:03.717+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:05:03.717566425Z 2024-02-24T02:05:03.717598179Z [2024-02-24T02:05:03.717+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:05:03.718421390Z [2024-02-24T02:05:03.718+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:05:03.718459202Z 2024-02-24T02:05:03.722087254Z [2024-02-24T02:05:03.721+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T02:05:03.722281487Z [2024-02-24T02:05:03.721+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:05:03.781539429Z [2024-02-24T02:05:03.781+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T02:00:00+00:00 exited with status queued for try_number 1 2024-02-24T02:05:03.781690860Z [2024-02-24T02:05:03.781+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T02:00:00+00:00 exited with status success for try_number 1 2024-02-24T02:05:03.787460724Z [2024-02-24T02:05:03.787+0000] {scheduler_job.py:635} INFO - Setting external_id for to 70210b4b-05a9-45b2-ace7-e6eb2243942d 2024-02-24T02:05:03.787774858Z [2024-02-24T02:05:03.787+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T02:00:00+00:00, map_index=-1, run_start_date=2024-02-24 02:05:02.500256+00:00, run_end_date=2024-02-24 02:05:02.968397+00:00, run_duration=0.468141, state=success, executor_state=success, try_number=1, max_tries=1, job_id=679, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:05:00.494724+00:00, queued_by_job_id=2, pid=9941 2024-02-24T02:05:05.047342525Z [2024-02-24T02:05:05.046+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:05:05.047492195Z [2024-02-24T02:05:05.047+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:04:00+00:00, run_id=scheduled__2024-02-24T02:04:00+00:00, run_start_date=2024-02-24 02:05:00.399843+00:00, run_end_date=2024-02-24 02:05:05.047198+00:00, run_duration=4.647355, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:04:00+00:00, data_interval_end=2024-02-24 02:05:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:05:05.060470953Z [2024-02-24T02:05:05.060+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:05:00+00:00, run_after=2024-02-24T02:06:00+00:00 2024-02-24T02:05:05.068998771Z [2024-02-24T02:05:05.068+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:05:05.069126868Z [2024-02-24T02:05:05.068+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:04:00+00:00, run_id=scheduled__2024-02-24T02:04:00+00:00, run_start_date=2024-02-24 02:05:00.398831+00:00, run_end_date=2024-02-24 02:05:05.068824+00:00, run_duration=4.669993, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:04:00+00:00, data_interval_end=2024-02-24 02:05:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:05:05.086267124Z [2024-02-24T02:05:05.085+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:05:00+00:00, run_after=2024-02-24T02:06:00+00:00 2024-02-24T02:05:05.155871458Z [2024-02-24T02:05:05.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:04:00+00:00 exited with status success for try_number 1 2024-02-24T02:05:05.156268905Z [2024-02-24T02:05:05.156+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:04:00+00:00 exited with status success for try_number 1 2024-02-24T02:05:05.166513145Z [2024-02-24T02:05:05.165+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:04:00+00:00, map_index=-1, run_start_date=2024-02-24 02:05:02.731717+00:00, run_end_date=2024-02-24 02:05:04.148974+00:00, run_duration=1.417257, state=success, executor_state=success, try_number=1, max_tries=1, job_id=680, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:05:00.494724+00:00, queued_by_job_id=2, pid=9943 2024-02-24T02:05:05.167400360Z [2024-02-24T02:05:05.167+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:04:00+00:00, map_index=-1, run_start_date=2024-02-24 02:05:02.503585+00:00, run_end_date=2024-02-24 02:05:04.481020+00:00, run_duration=1.977435, state=success, executor_state=success, try_number=1, max_tries=1, job_id=678, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:05:00.494724+00:00, queued_by_job_id=2, pid=9942 2024-02-24T02:05:06.280802246Z [2024-02-24T02:05:06.280+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:05:06.280873999Z 2024-02-24T02:05:06.281182894Z [2024-02-24T02:05:06.280+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:05:06.282678238Z [2024-02-24T02:05:06.282+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:05:06.282699214Z 2024-02-24T02:05:06.287637806Z [2024-02-24T02:05:06.287+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T02:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T02:05:06.288076284Z [2024-02-24T02:05:06.287+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T02:05:06.359730097Z [2024-02-24T02:05:06.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T02:00:00+00:00 exited with status queued for try_number 1 2024-02-24T02:05:06.360020197Z [2024-02-24T02:05:06.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T02:00:00+00:00 exited with status success for try_number 1 2024-02-24T02:05:06.369242498Z [2024-02-24T02:05:06.368+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0b03ce4-34c8-487d-8c7e-78a07b1432c8 2024-02-24T02:05:06.369694581Z [2024-02-24T02:05:06.369+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T02:00:00+00:00, map_index=-1, run_start_date=2024-02-24 02:05:05.433218+00:00, run_end_date=2024-02-24 02:05:05.830283+00:00, run_duration=0.397065, state=success, executor_state=success, try_number=1, max_tries=1, job_id=681, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:05:03.718922+00:00, queued_by_job_id=2, pid=9966 2024-02-24T02:05:08.688747302Z [2024-02-24T02:05:08.688+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:05:08.688784613Z 2024-02-24T02:05:08.688792543Z [2024-02-24T02:05:08.688+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:05:08.690109382Z [2024-02-24T02:05:08.689+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:05:08.690137286Z 2024-02-24T02:05:08.694421800Z [2024-02-24T02:05:08.693+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:05:08.694447828Z [2024-02-24T02:05:08.694+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:05:08.763619231Z [2024-02-24T02:05:08.763+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T02:00:00+00:00 exited with status queued for try_number 1 2024-02-24T02:05:08.763660752Z [2024-02-24T02:05:08.763+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T02:00:00+00:00 exited with status success for try_number 1 2024-02-24T02:05:08.773104834Z [2024-02-24T02:05:08.772+0000] {scheduler_job.py:635} INFO - Setting external_id for to aecd442b-a1ac-4fc0-ba12-8aa8d2b2a309 2024-02-24T02:05:08.773377031Z [2024-02-24T02:05:08.773+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T02:00:00+00:00, map_index=0, run_start_date=2024-02-24 02:05:08.046081+00:00, run_end_date=2024-02-24 02:05:08.417947+00:00, run_duration=0.371866, state=success, executor_state=success, try_number=1, max_tries=1, job_id=682, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:05:06.283521+00:00, queued_by_job_id=2, pid=9974 2024-02-24T02:05:11.294217902Z [2024-02-24T02:05:11.293+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:05:11.294564757Z [2024-02-24T02:05:11.294+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:00:00+00:00, run_id=scheduled__2024-02-24T02:00:00+00:00, run_start_date=2024-02-24 02:05:00.396154+00:00, run_end_date=2024-02-24 02:05:11.294135+00:00, run_duration=10.897981, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:00:00+00:00, data_interval_end=2024-02-24 02:05:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T02:05:11.300625064Z [2024-02-24T02:05:11.300+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:05:00+00:00, run_after=2024-02-24T02:10:00+00:00 2024-02-24T02:05:11.334126651Z [2024-02-24T02:05:11.333+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T02:00:00+00:00 exited with status success for try_number 1 2024-02-24T02:05:11.339088300Z [2024-02-24T02:05:11.338+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T02:00:00+00:00, map_index=-1, run_start_date=2024-02-24 02:05:10.255439+00:00, run_end_date=2024-02-24 02:05:10.658454+00:00, run_duration=0.403015, state=success, executor_state=success, try_number=1, max_tries=1, job_id=683, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:05:08.690757+00:00, queued_by_job_id=2, pid=9982 2024-02-24T02:06:01.018097181Z [2024-02-24T02:06:01.017+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:06:01.038663872Z [2024-02-24T02:06:01.038+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:06:00+00:00, run_after=2024-02-24T02:07:00+00:00 2024-02-24T02:06:01.046276655Z [2024-02-24T02:06:01.045+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:06:01.060470877Z [2024-02-24T02:06:01.060+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:06:00+00:00, run_after=2024-02-24T02:07:00+00:00 2024-02-24T02:06:01.180328336Z [2024-02-24T02:06:01.180+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T02:06:01.180344656Z 2024-02-24T02:06:01.180351710Z 2024-02-24T02:06:01.180355306Z 2024-02-24T02:06:01.180358601Z 2024-02-24T02:06:01.180621378Z [2024-02-24T02:06:01.180+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T02:06:01.180889402Z [2024-02-24T02:06:01.180+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:06:01.181086850Z [2024-02-24T02:06:01.180+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:06:01.181242251Z [2024-02-24T02:06:01.181+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:06:01.181978946Z [2024-02-24T02:06:01.181+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:06:01.181991050Z 2024-02-24T02:06:01.181994688Z 2024-02-24T02:06:01.181997967Z 2024-02-24T02:06:01.182001115Z 2024-02-24T02:06:01.186226635Z [2024-02-24T02:06:01.185+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:06:01.186475717Z [2024-02-24T02:06:01.186+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T02:06:01.186774593Z [2024-02-24T02:06:01.186+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:06:01.186963563Z [2024-02-24T02:06:01.186+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:06:01.187236940Z [2024-02-24T02:06:01.187+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:06:01.187407358Z [2024-02-24T02:06:01.187+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:06:01.187658551Z [2024-02-24T02:06:01.187+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:06:01.187824857Z [2024-02-24T02:06:01.187+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:06:01.732965074Z [2024-02-24T02:06:01.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:04:00+00:00 exited with status queued for try_number 1 2024-02-24T02:06:01.735169676Z [2024-02-24T02:06:01.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:05:00+00:00 exited with status queued for try_number 1 2024-02-24T02:06:01.735311995Z [2024-02-24T02:06:01.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:05:00+00:00 exited with status queued for try_number 1 2024-02-24T02:06:01.735446686Z [2024-02-24T02:06:01.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:05:00+00:00 exited with status queued for try_number 1 2024-02-24T02:06:01.744530451Z [2024-02-24T02:06:01.744+0000] {scheduler_job.py:635} INFO - Setting external_id for to b390ccdd-1fbe-40b4-a124-40788faf6e5b 2024-02-24T02:06:01.744722373Z [2024-02-24T02:06:01.744+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1cb3c164-c49a-4cb6-9d52-eb0cb2159f90 2024-02-24T02:06:01.744911205Z [2024-02-24T02:06:01.744+0000] {scheduler_job.py:635} INFO - Setting external_id for to 183fa54e-134b-46e3-b3cd-0afb1ab0338e 2024-02-24T02:06:01.745088038Z [2024-02-24T02:06:01.744+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1851cce5-e9d5-4d19-860c-d99ae6517b58 2024-02-24T02:06:02.893342817Z [2024-02-24T02:06:02.892+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:06:02.893814952Z [2024-02-24T02:06:02.893+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 02:04:00+00:00, run_id=scheduled__2024-02-24T02:04:00+00:00, run_start_date=2024-02-24 02:06:01.073214+00:00, run_end_date=2024-02-24 02:06:02.893435+00:00, run_duration=1.820221, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:04:00+00:00, data_interval_end=2024-02-24 02:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T02:06:02.902597615Z [2024-02-24T02:06:02.902+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T02:06:00+00:00, run_after=2024-02-24T02:08:00+00:00 2024-02-24T02:06:02.911324040Z [2024-02-24T02:06:02.910+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:06:02.911564562Z [2024-02-24T02:06:02.911+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:05:00+00:00, run_id=scheduled__2024-02-24T02:05:00+00:00, run_start_date=2024-02-24 02:06:01.077578+00:00, run_end_date=2024-02-24 02:06:02.911225+00:00, run_duration=1.833647, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:05:00+00:00, data_interval_end=2024-02-24 02:06:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:06:02.922364038Z [2024-02-24T02:06:02.922+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:06:00+00:00, run_after=2024-02-24T02:07:00+00:00 2024-02-24T02:06:02.974482183Z [2024-02-24T02:06:02.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:04:00+00:00 exited with status success for try_number 1 2024-02-24T02:06:02.974944322Z [2024-02-24T02:06:02.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:05:00+00:00 exited with status success for try_number 1 2024-02-24T02:06:02.984448433Z [2024-02-24T02:06:02.983+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:05:00+00:00, map_index=-1, run_start_date=2024-02-24 02:06:02.124815+00:00, run_end_date=2024-02-24 02:06:02.615859+00:00, run_duration=0.491044, state=success, executor_state=success, try_number=1, max_tries=1, job_id=684, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:06:01.182945+00:00, queued_by_job_id=2, pid=10005 2024-02-24T02:06:02.985376653Z [2024-02-24T02:06:02.985+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T02:04:00+00:00, map_index=-1, run_start_date=2024-02-24 02:06:02.148645+00:00, run_end_date=2024-02-24 02:06:02.588260+00:00, run_duration=0.439615, state=success, executor_state=success, try_number=1, max_tries=1, job_id=685, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:06:01.182945+00:00, queued_by_job_id=2, pid=10006 2024-02-24T02:06:06.183495393Z [2024-02-24T02:06:06.182+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:06:06.183633810Z [2024-02-24T02:06:06.183+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:05:00+00:00, run_id=scheduled__2024-02-24T02:05:00+00:00, run_start_date=2024-02-24 02:06:01.080662+00:00, run_end_date=2024-02-24 02:06:06.183203+00:00, run_duration=5.102541, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:05:00+00:00, data_interval_end=2024-02-24 02:06:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:06:06.194989612Z [2024-02-24T02:06:06.194+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:06:00+00:00, run_after=2024-02-24T02:07:00+00:00 2024-02-24T02:06:06.203205752Z [2024-02-24T02:06:06.202+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:06:06.203426509Z [2024-02-24T02:06:06.203+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:05:00+00:00, run_id=scheduled__2024-02-24T02:05:00+00:00, run_start_date=2024-02-24 02:06:01.083368+00:00, run_end_date=2024-02-24 02:06:06.203013+00:00, run_duration=5.119645, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:05:00+00:00, data_interval_end=2024-02-24 02:06:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:06:06.212774683Z [2024-02-24T02:06:06.212+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:06:00+00:00, run_after=2024-02-24T02:07:00+00:00 2024-02-24T02:06:06.260006649Z [2024-02-24T02:06:06.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:05:00+00:00 exited with status success for try_number 1 2024-02-24T02:06:06.260353554Z [2024-02-24T02:06:06.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:05:00+00:00 exited with status success for try_number 1 2024-02-24T02:06:06.271736585Z [2024-02-24T02:06:06.271+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:05:00+00:00, map_index=-1, run_start_date=2024-02-24 02:06:03.647082+00:00, run_end_date=2024-02-24 02:06:05.773376+00:00, run_duration=2.126294, state=success, executor_state=success, try_number=1, max_tries=1, job_id=687, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:06:01.182945+00:00, queued_by_job_id=2, pid=10035 2024-02-24T02:06:06.272230238Z [2024-02-24T02:06:06.271+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:05:00+00:00, map_index=-1, run_start_date=2024-02-24 02:06:03.283761+00:00, run_end_date=2024-02-24 02:06:05.938005+00:00, run_duration=2.654244, state=success, executor_state=success, try_number=1, max_tries=1, job_id=686, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:06:01.182945+00:00, queued_by_job_id=2, pid=10024 2024-02-24T02:07:00.178769602Z [2024-02-24T02:07:00.178+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:07:00+00:00, run_after=2024-02-24T02:08:00+00:00 2024-02-24T02:07:00.194522474Z [2024-02-24T02:07:00.194+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:07:00+00:00, run_after=2024-02-24T02:08:00+00:00 2024-02-24T02:07:00.203539875Z [2024-02-24T02:07:00.203+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:07:00.317322773Z [2024-02-24T02:07:00.316+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T02:07:00.317389309Z 2024-02-24T02:07:00.317396244Z 2024-02-24T02:07:00.317402339Z 2024-02-24T02:07:00.317462415Z [2024-02-24T02:07:00.317+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:07:00.317759360Z [2024-02-24T02:07:00.317+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:07:00.318525139Z [2024-02-24T02:07:00.317+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:07:00.319695302Z [2024-02-24T02:07:00.319+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:07:00.319722022Z 2024-02-24T02:07:00.319730945Z 2024-02-24T02:07:00.319739519Z 2024-02-24T02:07:00.327306451Z [2024-02-24T02:07:00.325+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:07:00.327342244Z [2024-02-24T02:07:00.326+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:07:00.327351774Z [2024-02-24T02:07:00.327+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:07:00.327523139Z [2024-02-24T02:07:00.327+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:07:00.327777975Z [2024-02-24T02:07:00.327+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:07:00.328047916Z [2024-02-24T02:07:00.327+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:07:00.594353399Z [2024-02-24T02:07:00.593+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:06:00+00:00 exited with status queued for try_number 1 2024-02-24T02:07:00.594394020Z [2024-02-24T02:07:00.594+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:06:00+00:00 exited with status queued for try_number 1 2024-02-24T02:07:00.594560145Z [2024-02-24T02:07:00.594+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:06:00+00:00 exited with status queued for try_number 1 2024-02-24T02:07:00.602247460Z [2024-02-24T02:07:00.601+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9a002a0b-ca55-499e-bee3-ee7f921c3581 2024-02-24T02:07:00.602282785Z [2024-02-24T02:07:00.602+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f564eeb-9cb9-4ea9-890b-9f23b2827c64 2024-02-24T02:07:00.602436909Z [2024-02-24T02:07:00.602+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a385d26-6e25-4931-b0bb-9c1b8feb7bed 2024-02-24T02:07:01.972984747Z [2024-02-24T02:07:01.972+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:07:01.973292821Z [2024-02-24T02:07:01.973+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:06:00+00:00, run_id=scheduled__2024-02-24T02:06:00+00:00, run_start_date=2024-02-24 02:07:00.221152+00:00, run_end_date=2024-02-24 02:07:01.972895+00:00, run_duration=1.751743, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:06:00+00:00, data_interval_end=2024-02-24 02:07:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:07:01.982947121Z [2024-02-24T02:07:01.982+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:07:00+00:00, run_after=2024-02-24T02:08:00+00:00 2024-02-24T02:07:02.037188047Z [2024-02-24T02:07:02.036+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:06:00+00:00 exited with status success for try_number 1 2024-02-24T02:07:02.042999185Z [2024-02-24T02:07:02.042+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:06:00+00:00, map_index=-1, run_start_date=2024-02-24 02:07:01.142439+00:00, run_end_date=2024-02-24 02:07:01.572454+00:00, run_duration=0.430015, state=success, executor_state=success, try_number=1, max_tries=1, job_id=688, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:07:00.321249+00:00, queued_by_job_id=2, pid=10062 2024-02-24T02:07:03.701346634Z [2024-02-24T02:07:03.700+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T02:07:04.754399320Z [2024-02-24T02:07:04.753+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:07:04.754684779Z [2024-02-24T02:07:04.754+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:06:00+00:00, run_id=scheduled__2024-02-24T02:06:00+00:00, run_start_date=2024-02-24 02:07:00.223276+00:00, run_end_date=2024-02-24 02:07:04.754291+00:00, run_duration=4.531015, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:06:00+00:00, data_interval_end=2024-02-24 02:07:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:07:04.769915759Z [2024-02-24T02:07:04.765+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:07:00+00:00, run_after=2024-02-24T02:08:00+00:00 2024-02-24T02:07:04.774852466Z [2024-02-24T02:07:04.774+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:07:04.775179732Z [2024-02-24T02:07:04.774+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:06:00+00:00, run_id=scheduled__2024-02-24T02:06:00+00:00, run_start_date=2024-02-24 02:07:00.224743+00:00, run_end_date=2024-02-24 02:07:04.774754+00:00, run_duration=4.550011, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:06:00+00:00, data_interval_end=2024-02-24 02:07:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:07:04.784789832Z [2024-02-24T02:07:04.784+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:07:00+00:00, run_after=2024-02-24T02:08:00+00:00 2024-02-24T02:07:04.820549117Z [2024-02-24T02:07:04.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:06:00+00:00 exited with status success for try_number 1 2024-02-24T02:07:04.820632429Z [2024-02-24T02:07:04.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:06:00+00:00 exited with status success for try_number 1 2024-02-24T02:07:04.830316793Z [2024-02-24T02:07:04.829+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:06:00+00:00, map_index=-1, run_start_date=2024-02-24 02:07:02.226045+00:00, run_end_date=2024-02-24 02:07:03.700977+00:00, run_duration=1.474932, state=success, executor_state=success, try_number=1, max_tries=1, job_id=690, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:07:00.321249+00:00, queued_by_job_id=2, pid=10081 2024-02-24T02:07:04.830660348Z [2024-02-24T02:07:04.830+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:06:00+00:00, map_index=-1, run_start_date=2024-02-24 02:07:02.215294+00:00, run_end_date=2024-02-24 02:07:03.921272+00:00, run_duration=1.705978, state=success, executor_state=success, try_number=1, max_tries=1, job_id=689, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:07:00.321249+00:00, queued_by_job_id=2, pid=10080 2024-02-24T02:08:00.135118022Z [2024-02-24T02:08:00.134+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:08:00.155067525Z [2024-02-24T02:08:00.154+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:08:00+00:00, run_after=2024-02-24T02:09:00+00:00 2024-02-24T02:08:00.161341582Z [2024-02-24T02:08:00.160+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:08:00.175346796Z [2024-02-24T02:08:00.174+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:08:00+00:00, run_after=2024-02-24T02:09:00+00:00 2024-02-24T02:08:00.246096781Z [2024-02-24T02:08:00.239+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T02:08:00.246166438Z 2024-02-24T02:08:00.246176904Z 2024-02-24T02:08:00.246185087Z 2024-02-24T02:08:00.246193152Z 2024-02-24T02:08:00.246233657Z [2024-02-24T02:08:00.240+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T02:08:00.246242697Z [2024-02-24T02:08:00.240+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:08:00.246250800Z [2024-02-24T02:08:00.240+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:08:00.246258617Z [2024-02-24T02:08:00.240+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:08:00.246266752Z [2024-02-24T02:08:00.243+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:08:00.246274537Z 2024-02-24T02:08:00.246335160Z 2024-02-24T02:08:00.246343968Z 2024-02-24T02:08:00.246351815Z 2024-02-24T02:08:00.249970088Z [2024-02-24T02:08:00.249+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:08:00.250180592Z [2024-02-24T02:08:00.249+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T02:08:00.250506780Z [2024-02-24T02:08:00.250+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:08:00.250624741Z [2024-02-24T02:08:00.250+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:08:00.251214020Z [2024-02-24T02:08:00.250+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:08:00.251277689Z [2024-02-24T02:08:00.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:08:00.251627958Z [2024-02-24T02:08:00.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:08:00.251769380Z [2024-02-24T02:08:00.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:08:00.536002560Z [2024-02-24T02:08:00.535+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:06:00+00:00 exited with status queued for try_number 1 2024-02-24T02:08:00.536414714Z [2024-02-24T02:08:00.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:07:00+00:00 exited with status queued for try_number 1 2024-02-24T02:08:00.536630123Z [2024-02-24T02:08:00.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:07:00+00:00 exited with status queued for try_number 1 2024-02-24T02:08:00.536737130Z [2024-02-24T02:08:00.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:07:00+00:00 exited with status queued for try_number 1 2024-02-24T02:08:00.547904874Z [2024-02-24T02:08:00.547+0000] {scheduler_job.py:635} INFO - Setting external_id for to c7b63e36-5947-4a40-b8d9-6030be117b6b 2024-02-24T02:08:00.548026977Z [2024-02-24T02:08:00.547+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e50cd58-e904-4e6b-aaaa-63069945c435 2024-02-24T02:08:00.548204830Z [2024-02-24T02:08:00.548+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a5d0961-8fc1-4b23-bc48-2a6cfb5408e8 2024-02-24T02:08:00.548333911Z [2024-02-24T02:08:00.548+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e8e82a5-9602-4dfa-a62c-bf99c5c7d545 2024-02-24T02:08:01.797623922Z [2024-02-24T02:08:01.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:06:00+00:00 exited with status success for try_number 1 2024-02-24T02:08:01.808452165Z [2024-02-24T02:08:01.808+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T02:06:00+00:00, map_index=-1, run_start_date=2024-02-24 02:08:01.077044+00:00, run_end_date=2024-02-24 02:08:01.614565+00:00, run_duration=0.537521, state=success, executor_state=success, try_number=1, max_tries=1, job_id=691, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:08:00.245290+00:00, queued_by_job_id=2, pid=10114 2024-02-24T02:08:01.982081718Z [2024-02-24T02:08:01.981+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:08:01.982699530Z [2024-02-24T02:08:01.982+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 02:06:00+00:00, run_id=scheduled__2024-02-24T02:06:00+00:00, run_start_date=2024-02-24 02:08:00.184060+00:00, run_end_date=2024-02-24 02:08:01.982024+00:00, run_duration=1.797964, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:06:00+00:00, data_interval_end=2024-02-24 02:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T02:08:01.995221971Z [2024-02-24T02:08:01.994+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T02:08:00+00:00, run_after=2024-02-24T02:10:00+00:00 2024-02-24T02:08:02.005664062Z [2024-02-24T02:08:02.005+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:08:02.006186960Z [2024-02-24T02:08:02.005+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:07:00+00:00, run_id=scheduled__2024-02-24T02:07:00+00:00, run_start_date=2024-02-24 02:08:00.185275+00:00, run_end_date=2024-02-24 02:08:02.005592+00:00, run_duration=1.820317, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:07:00+00:00, data_interval_end=2024-02-24 02:08:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:08:02.027367198Z [2024-02-24T02:08:02.026+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:08:00+00:00, run_after=2024-02-24T02:09:00+00:00 2024-02-24T02:08:02.114182879Z [2024-02-24T02:08:02.113+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:07:00+00:00 exited with status success for try_number 1 2024-02-24T02:08:02.122865002Z [2024-02-24T02:08:02.122+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:07:00+00:00, map_index=-1, run_start_date=2024-02-24 02:08:01.107877+00:00, run_end_date=2024-02-24 02:08:01.809671+00:00, run_duration=0.701794, state=success, executor_state=success, try_number=1, max_tries=1, job_id=692, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:08:00.245290+00:00, queued_by_job_id=2, pid=10115 2024-02-24T02:08:04.609582519Z [2024-02-24T02:08:04.609+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:08:04.610028557Z [2024-02-24T02:08:04.609+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:07:00+00:00, run_id=scheduled__2024-02-24T02:07:00+00:00, run_start_date=2024-02-24 02:08:00.186285+00:00, run_end_date=2024-02-24 02:08:04.609587+00:00, run_duration=4.423302, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:07:00+00:00, data_interval_end=2024-02-24 02:08:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:08:04.620204655Z [2024-02-24T02:08:04.619+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:08:00+00:00, run_after=2024-02-24T02:09:00+00:00 2024-02-24T02:08:04.628779941Z [2024-02-24T02:08:04.628+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:08:04.629266493Z [2024-02-24T02:08:04.628+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:07:00+00:00, run_id=scheduled__2024-02-24T02:07:00+00:00, run_start_date=2024-02-24 02:08:00.187380+00:00, run_end_date=2024-02-24 02:08:04.628710+00:00, run_duration=4.44133, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:07:00+00:00, data_interval_end=2024-02-24 02:08:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:08:04.639686662Z [2024-02-24T02:08:04.639+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:08:00+00:00, run_after=2024-02-24T02:09:00+00:00 2024-02-24T02:08:04.674278461Z [2024-02-24T02:08:04.673+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:07:00+00:00 exited with status success for try_number 1 2024-02-24T02:08:04.681044611Z [2024-02-24T02:08:04.680+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:07:00+00:00, map_index=-1, run_start_date=2024-02-24 02:08:02.751476+00:00, run_end_date=2024-02-24 02:08:04.067671+00:00, run_duration=1.316195, state=success, executor_state=success, try_number=1, max_tries=1, job_id=694, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:08:00.245290+00:00, queued_by_job_id=2, pid=10138 2024-02-24T02:08:05.281805968Z [2024-02-24T02:08:05.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:07:00+00:00 exited with status success for try_number 1 2024-02-24T02:08:05.289633479Z [2024-02-24T02:08:05.289+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:07:00+00:00, map_index=-1, run_start_date=2024-02-24 02:08:02.709182+00:00, run_end_date=2024-02-24 02:08:04.581427+00:00, run_duration=1.872245, state=success, executor_state=success, try_number=1, max_tries=1, job_id=693, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:08:00.245290+00:00, queued_by_job_id=2, pid=10139 2024-02-24T02:09:00.140864387Z [2024-02-24T02:09:00.140+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:09:00+00:00, run_after=2024-02-24T02:10:00+00:00 2024-02-24T02:09:00.151408366Z [2024-02-24T02:09:00.150+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:09:00.169682025Z [2024-02-24T02:09:00.169+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:09:00+00:00, run_after=2024-02-24T02:10:00+00:00 2024-02-24T02:09:00.241052599Z [2024-02-24T02:09:00.240+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T02:09:00.241093748Z 2024-02-24T02:09:00.241103779Z 2024-02-24T02:09:00.241112425Z 2024-02-24T02:09:00.241136999Z [2024-02-24T02:09:00.240+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:09:00.241264840Z [2024-02-24T02:09:00.241+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:09:00.241335143Z [2024-02-24T02:09:00.241+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:09:00.242197329Z [2024-02-24T02:09:00.241+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:09:00.242242390Z 2024-02-24T02:09:00.242249922Z 2024-02-24T02:09:00.242255801Z 2024-02-24T02:09:00.246133943Z [2024-02-24T02:09:00.245+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:09:00.246287234Z [2024-02-24T02:09:00.246+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:09:00.246574004Z [2024-02-24T02:09:00.246+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:09:00.246730107Z [2024-02-24T02:09:00.246+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:09:00.247169420Z [2024-02-24T02:09:00.246+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:09:00.247293146Z [2024-02-24T02:09:00.247+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:09:00.454028450Z [2024-02-24T02:09:00.453+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:08:00+00:00 exited with status queued for try_number 1 2024-02-24T02:09:00.454134578Z [2024-02-24T02:09:00.453+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:08:00+00:00 exited with status queued for try_number 1 2024-02-24T02:09:00.454142692Z [2024-02-24T02:09:00.454+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:08:00+00:00 exited with status queued for try_number 1 2024-02-24T02:09:00.460837926Z [2024-02-24T02:09:00.460+0000] {scheduler_job.py:635} INFO - Setting external_id for to 04ee5816-df22-47c4-9c2d-e293f3bda736 2024-02-24T02:09:00.460964160Z [2024-02-24T02:09:00.460+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e9508f6-1fd5-4d54-9d5e-3f4c1b00174b 2024-02-24T02:09:00.461040282Z [2024-02-24T02:09:00.460+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25af9536-114b-482f-bf13-4f3cc4fa9cc2 2024-02-24T02:09:01.610903975Z [2024-02-24T02:09:01.610+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:09:01.611295613Z [2024-02-24T02:09:01.610+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:08:00+00:00, run_id=scheduled__2024-02-24T02:08:00+00:00, run_start_date=2024-02-24 02:09:00.182111+00:00, run_end_date=2024-02-24 02:09:01.610788+00:00, run_duration=1.428677, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:08:00+00:00, data_interval_end=2024-02-24 02:09:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:09:01.622179222Z [2024-02-24T02:09:01.621+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:09:00+00:00, run_after=2024-02-24T02:10:00+00:00 2024-02-24T02:09:01.730327246Z [2024-02-24T02:09:01.729+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:08:00+00:00 exited with status success for try_number 1 2024-02-24T02:09:01.738329308Z [2024-02-24T02:09:01.737+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:08:00+00:00, map_index=-1, run_start_date=2024-02-24 02:09:01.059204+00:00, run_end_date=2024-02-24 02:09:01.541559+00:00, run_duration=0.482355, state=success, executor_state=success, try_number=1, max_tries=1, job_id=695, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:09:00.242896+00:00, queued_by_job_id=2, pid=10171 2024-02-24T02:09:04.166496998Z [2024-02-24T02:09:04.165+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:09:04.167004687Z [2024-02-24T02:09:04.166+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:08:00+00:00, run_id=scheduled__2024-02-24T02:08:00+00:00, run_start_date=2024-02-24 02:09:00.183225+00:00, run_end_date=2024-02-24 02:09:04.166360+00:00, run_duration=3.983135, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:08:00+00:00, data_interval_end=2024-02-24 02:09:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:09:04.180057245Z [2024-02-24T02:09:04.179+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:09:00+00:00, run_after=2024-02-24T02:10:00+00:00 2024-02-24T02:09:04.194415786Z [2024-02-24T02:09:04.193+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:09:04.194771350Z [2024-02-24T02:09:04.194+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:08:00+00:00, run_id=scheduled__2024-02-24T02:08:00+00:00, run_start_date=2024-02-24 02:09:00.184239+00:00, run_end_date=2024-02-24 02:09:04.194242+00:00, run_duration=4.010003, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:08:00+00:00, data_interval_end=2024-02-24 02:09:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:09:04.206173799Z [2024-02-24T02:09:04.205+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:09:00+00:00, run_after=2024-02-24T02:10:00+00:00 2024-02-24T02:09:04.258604208Z [2024-02-24T02:09:04.258+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:08:00+00:00 exited with status success for try_number 1 2024-02-24T02:09:04.268869517Z [2024-02-24T02:09:04.267+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:08:00+00:00, map_index=-1, run_start_date=2024-02-24 02:09:02.142069+00:00, run_end_date=2024-02-24 02:09:03.479311+00:00, run_duration=1.337242, state=success, executor_state=success, try_number=1, max_tries=1, job_id=696, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:09:00.242896+00:00, queued_by_job_id=2, pid=10189 2024-02-24T02:09:05.346668026Z [2024-02-24T02:09:05.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:08:00+00:00 exited with status success for try_number 1 2024-02-24T02:09:05.351972804Z [2024-02-24T02:09:05.351+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:08:00+00:00, map_index=-1, run_start_date=2024-02-24 02:09:02.174605+00:00, run_end_date=2024-02-24 02:09:04.109533+00:00, run_duration=1.934928, state=success, executor_state=success, try_number=1, max_tries=1, job_id=697, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:09:00.242896+00:00, queued_by_job_id=2, pid=10190 2024-02-24T02:10:00.042070668Z [2024-02-24T02:10:00.041+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:10:00.063488883Z [2024-02-24T02:10:00.062+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:10:00+00:00, run_after=2024-02-24T02:11:00+00:00 2024-02-24T02:10:00.087671532Z [2024-02-24T02:10:00.087+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:10:00+00:00, run_after=2024-02-24T02:15:00+00:00 2024-02-24T02:10:00.107136216Z [2024-02-24T02:10:00.106+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:10:00+00:00, run_after=2024-02-24T02:11:00+00:00 2024-02-24T02:10:00.115187232Z [2024-02-24T02:10:00.114+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:10:00.226810396Z [2024-02-24T02:10:00.226+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-02-24T02:10:00.226846946Z 2024-02-24T02:10:00.226854245Z 2024-02-24T02:10:00.226861878Z 2024-02-24T02:10:00.226869175Z 2024-02-24T02:10:00.226875864Z 2024-02-24T02:10:00.227216885Z [2024-02-24T02:10:00.226+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:10:00.227708509Z [2024-02-24T02:10:00.227+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T02:10:00.228145040Z [2024-02-24T02:10:00.227+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:10:00.228552841Z [2024-02-24T02:10:00.228+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:10:00.229016512Z [2024-02-24T02:10:00.228+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:10:00.230658462Z [2024-02-24T02:10:00.230+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:10:00.230688565Z 2024-02-24T02:10:00.230697950Z 2024-02-24T02:10:00.230707372Z 2024-02-24T02:10:00.230715932Z 2024-02-24T02:10:00.230724296Z 2024-02-24T02:10:00.238570815Z [2024-02-24T02:10:00.238+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T02:10:00.238807749Z [2024-02-24T02:10:00.238+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:10:00.239280065Z [2024-02-24T02:10:00.239+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:10:00.239624989Z [2024-02-24T02:10:00.239+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T02:10:00.240176773Z [2024-02-24T02:10:00.239+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:10:00.240446354Z [2024-02-24T02:10:00.240+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:10:00.241082211Z [2024-02-24T02:10:00.240+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:10:00.241193081Z [2024-02-24T02:10:00.240+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:10:00.241539541Z [2024-02-24T02:10:00.241+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:10:00.241832404Z [2024-02-24T02:10:00.241+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:10:00.959176461Z [2024-02-24T02:10:00.958+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T02:05:00+00:00 exited with status queued for try_number 1 2024-02-24T02:10:00.959262618Z [2024-02-24T02:10:00.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:08:00+00:00 exited with status queued for try_number 1 2024-02-24T02:10:00.959289732Z [2024-02-24T02:10:00.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:09:00+00:00 exited with status queued for try_number 1 2024-02-24T02:10:00.959365636Z [2024-02-24T02:10:00.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:09:00+00:00 exited with status queued for try_number 1 2024-02-24T02:10:00.959418849Z [2024-02-24T02:10:00.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:09:00+00:00 exited with status queued for try_number 1 2024-02-24T02:10:00.974325659Z [2024-02-24T02:10:00.973+0000] {scheduler_job.py:635} INFO - Setting external_id for to 592b4bae-4a8d-455e-9186-215d6cce7542 2024-02-24T02:10:00.974428239Z [2024-02-24T02:10:00.974+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0302342-747f-4fb5-908a-643fbae9e7e0 2024-02-24T02:10:00.974543033Z [2024-02-24T02:10:00.974+0000] {scheduler_job.py:635} INFO - Setting external_id for to 06abb934-60d7-424f-a7f4-09149407f1f0 2024-02-24T02:10:00.974637550Z [2024-02-24T02:10:00.974+0000] {scheduler_job.py:635} INFO - Setting external_id for to c87b5f13-f125-4f83-bfb9-88416a623e8b 2024-02-24T02:10:00.974730944Z [2024-02-24T02:10:00.974+0000] {scheduler_job.py:635} INFO - Setting external_id for to 455d4635-aa56-46a3-a8e2-810c7f9de390 2024-02-24T02:10:02.431944958Z [2024-02-24T02:10:02.429+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:10:02.431973489Z [2024-02-24T02:10:02.430+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 02:08:00+00:00, run_id=scheduled__2024-02-24T02:08:00+00:00, run_start_date=2024-02-24 02:10:00.133731+00:00, run_end_date=2024-02-24 02:10:02.430802+00:00, run_duration=2.297071, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:08:00+00:00, data_interval_end=2024-02-24 02:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T02:10:02.444225658Z [2024-02-24T02:10:02.443+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T02:10:00+00:00, run_after=2024-02-24T02:12:00+00:00 2024-02-24T02:10:02.459404799Z [2024-02-24T02:10:02.458+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:10:02.459909060Z [2024-02-24T02:10:02.459+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:09:00+00:00, run_id=scheduled__2024-02-24T02:09:00+00:00, run_start_date=2024-02-24 02:10:00.134804+00:00, run_end_date=2024-02-24 02:10:02.459443+00:00, run_duration=2.324639, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:09:00+00:00, data_interval_end=2024-02-24 02:10:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:10:02.479186683Z [2024-02-24T02:10:02.478+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:10:00+00:00, run_after=2024-02-24T02:11:00+00:00 2024-02-24T02:10:02.569086872Z [2024-02-24T02:10:02.568+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:08:00+00:00 exited with status success for try_number 1 2024-02-24T02:10:02.569123333Z [2024-02-24T02:10:02.568+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:09:00+00:00 exited with status success for try_number 1 2024-02-24T02:10:02.579392672Z [2024-02-24T02:10:02.578+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T02:08:00+00:00, map_index=-1, run_start_date=2024-02-24 02:10:01.067259+00:00, run_end_date=2024-02-24 02:10:01.676017+00:00, run_duration=0.608758, state=success, executor_state=success, try_number=1, max_tries=1, job_id=698, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:10:00.233152+00:00, queued_by_job_id=2, pid=10218 2024-02-24T02:10:02.579425985Z [2024-02-24T02:10:02.579+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:09:00+00:00, map_index=-1, run_start_date=2024-02-24 02:10:01.728092+00:00, run_end_date=2024-02-24 02:10:02.244228+00:00, run_duration=0.516136, state=success, executor_state=success, try_number=1, max_tries=1, job_id=699, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:10:00.233152+00:00, queued_by_job_id=2, pid=10230 2024-02-24T02:10:04.127791796Z [2024-02-24T02:10:04.127+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:10:04.127841644Z 2024-02-24T02:10:04.128678891Z [2024-02-24T02:10:04.128+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:10:04.130211986Z [2024-02-24T02:10:04.129+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:10:04.130231979Z 2024-02-24T02:10:04.137182290Z [2024-02-24T02:10:04.134+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T02:10:04.137889337Z [2024-02-24T02:10:04.137+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:10:04.225394750Z [2024-02-24T02:10:04.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T02:05:00+00:00 exited with status queued for try_number 1 2024-02-24T02:10:04.225709841Z [2024-02-24T02:10:04.225+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T02:05:00+00:00 exited with status success for try_number 1 2024-02-24T02:10:04.235131582Z [2024-02-24T02:10:04.234+0000] {scheduler_job.py:635} INFO - Setting external_id for to ec5c260a-0948-4774-9a3b-2523e2155837 2024-02-24T02:10:04.235643106Z [2024-02-24T02:10:04.235+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T02:05:00+00:00, map_index=-1, run_start_date=2024-02-24 02:10:02.935272+00:00, run_end_date=2024-02-24 02:10:03.463257+00:00, run_duration=0.527985, state=success, executor_state=success, try_number=1, max_tries=1, job_id=702, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:10:00.233152+00:00, queued_by_job_id=2, pid=10255 2024-02-24T02:10:04.316995979Z [2024-02-24T02:10:04.316+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:10:04.317440435Z [2024-02-24T02:10:04.317+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:09:00+00:00, run_id=scheduled__2024-02-24T02:09:00+00:00, run_start_date=2024-02-24 02:10:00.136076+00:00, run_end_date=2024-02-24 02:10:04.317105+00:00, run_duration=4.181029, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:09:00+00:00, data_interval_end=2024-02-24 02:10:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:10:04.327898201Z [2024-02-24T02:10:04.326+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:10:00+00:00, run_after=2024-02-24T02:11:00+00:00 2024-02-24T02:10:04.395065264Z [2024-02-24T02:10:04.394+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:09:00+00:00 exited with status success for try_number 1 2024-02-24T02:10:04.403213642Z [2024-02-24T02:10:04.402+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:09:00+00:00, map_index=-1, run_start_date=2024-02-24 02:10:02.742561+00:00, run_end_date=2024-02-24 02:10:04.166531+00:00, run_duration=1.42397, state=success, executor_state=success, try_number=1, max_tries=1, job_id=701, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:10:00.233152+00:00, queued_by_job_id=2, pid=10254 2024-02-24T02:10:05.457108177Z [2024-02-24T02:10:05.456+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:10:05.457469678Z [2024-02-24T02:10:05.457+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:09:00+00:00, run_id=scheduled__2024-02-24T02:09:00+00:00, run_start_date=2024-02-24 02:10:00.137304+00:00, run_end_date=2024-02-24 02:10:05.456960+00:00, run_duration=5.319656, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:09:00+00:00, data_interval_end=2024-02-24 02:10:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:10:05.471098781Z [2024-02-24T02:10:05.470+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:10:00+00:00, run_after=2024-02-24T02:11:00+00:00 2024-02-24T02:10:05.527061855Z [2024-02-24T02:10:05.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:09:00+00:00 exited with status success for try_number 1 2024-02-24T02:10:05.534348686Z [2024-02-24T02:10:05.533+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:09:00+00:00, map_index=-1, run_start_date=2024-02-24 02:10:02.554602+00:00, run_end_date=2024-02-24 02:10:04.481341+00:00, run_duration=1.926739, state=success, executor_state=success, try_number=1, max_tries=1, job_id=700, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:10:00.233152+00:00, queued_by_job_id=2, pid=10248 2024-02-24T02:10:07.169589334Z [2024-02-24T02:10:07.168+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:10:07.169637913Z 2024-02-24T02:10:07.170177224Z [2024-02-24T02:10:07.169+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:10:07.171800986Z [2024-02-24T02:10:07.171+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:10:07.171829475Z 2024-02-24T02:10:07.176271377Z [2024-02-24T02:10:07.175+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T02:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T02:10:07.176759125Z [2024-02-24T02:10:07.176+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T02:10:07.253745642Z [2024-02-24T02:10:07.253+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T02:05:00+00:00 exited with status queued for try_number 1 2024-02-24T02:10:07.254055637Z [2024-02-24T02:10:07.253+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T02:05:00+00:00 exited with status success for try_number 1 2024-02-24T02:10:07.260786038Z [2024-02-24T02:10:07.260+0000] {scheduler_job.py:635} INFO - Setting external_id for to 188786a0-d004-4982-b688-7aeed6923ff6 2024-02-24T02:10:07.261215019Z [2024-02-24T02:10:07.260+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T02:05:00+00:00, map_index=-1, run_start_date=2024-02-24 02:10:05.877445+00:00, run_end_date=2024-02-24 02:10:06.250182+00:00, run_duration=0.372737, state=success, executor_state=success, try_number=1, max_tries=1, job_id=703, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:10:04.131094+00:00, queued_by_job_id=2, pid=10278 2024-02-24T02:10:09.322448934Z [2024-02-24T02:10:09.319+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:10:09.322479346Z 2024-02-24T02:10:09.322490941Z [2024-02-24T02:10:09.319+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:10:09.322497146Z [2024-02-24T02:10:09.320+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:10:09.322504933Z 2024-02-24T02:10:09.324100812Z [2024-02-24T02:10:09.323+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:10:09.324906808Z [2024-02-24T02:10:09.324+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:10:09.399491063Z [2024-02-24T02:10:09.399+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T02:05:00+00:00 exited with status queued for try_number 1 2024-02-24T02:10:09.399948153Z [2024-02-24T02:10:09.399+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T02:05:00+00:00 exited with status success for try_number 1 2024-02-24T02:10:09.407243447Z [2024-02-24T02:10:09.406+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f238a87-181e-4857-ad60-5c0afd511f20 2024-02-24T02:10:09.407485042Z [2024-02-24T02:10:09.407+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T02:05:00+00:00, map_index=0, run_start_date=2024-02-24 02:10:08.766392+00:00, run_end_date=2024-02-24 02:10:09.094807+00:00, run_duration=0.328415, state=success, executor_state=success, try_number=1, max_tries=1, job_id=704, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:10:07.172826+00:00, queued_by_job_id=2, pid=10286 2024-02-24T02:10:11.622100289Z [2024-02-24T02:10:11.621+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:10:11.622473321Z [2024-02-24T02:10:11.622+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:05:00+00:00, run_id=scheduled__2024-02-24T02:05:00+00:00, run_start_date=2024-02-24 02:10:00.132083+00:00, run_end_date=2024-02-24 02:10:11.621990+00:00, run_duration=11.489907, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:05:00+00:00, data_interval_end=2024-02-24 02:10:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T02:10:11.631304506Z [2024-02-24T02:10:11.630+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:10:00+00:00, run_after=2024-02-24T02:15:00+00:00 2024-02-24T02:10:11.667453401Z [2024-02-24T02:10:11.666+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T02:05:00+00:00 exited with status success for try_number 1 2024-02-24T02:10:11.675256037Z [2024-02-24T02:10:11.674+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T02:05:00+00:00, map_index=-1, run_start_date=2024-02-24 02:10:10.851705+00:00, run_end_date=2024-02-24 02:10:11.217918+00:00, run_duration=0.366213, state=success, executor_state=success, try_number=1, max_tries=1, job_id=705, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:10:09.321098+00:00, queued_by_job_id=2, pid=10294 2024-02-24T02:11:00.246832248Z [2024-02-24T02:11:00.246+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:11:00+00:00, run_after=2024-02-24T02:12:00+00:00 2024-02-24T02:11:00.271291031Z [2024-02-24T02:11:00.270+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:11:00+00:00, run_after=2024-02-24T02:12:00+00:00 2024-02-24T02:11:00.287386401Z [2024-02-24T02:11:00.286+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:11:00.385934443Z [2024-02-24T02:11:00.385+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T02:11:00.385971262Z 2024-02-24T02:11:00.385976908Z 2024-02-24T02:11:00.386001199Z 2024-02-24T02:11:00.386441985Z [2024-02-24T02:11:00.386+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:11:00.386591688Z [2024-02-24T02:11:00.386+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:11:00.386969997Z [2024-02-24T02:11:00.386+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:11:00.387922594Z [2024-02-24T02:11:00.387+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:11:00.387950292Z 2024-02-24T02:11:00.387959632Z 2024-02-24T02:11:00.387969358Z 2024-02-24T02:11:00.393572505Z [2024-02-24T02:11:00.392+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:11:00.393641287Z [2024-02-24T02:11:00.393+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:11:00.393942282Z [2024-02-24T02:11:00.393+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:11:00.394219605Z [2024-02-24T02:11:00.393+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:11:00.394669917Z [2024-02-24T02:11:00.394+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:11:00.394958245Z [2024-02-24T02:11:00.394+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:11:00.630359951Z [2024-02-24T02:11:00.629+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:10:00+00:00 exited with status queued for try_number 1 2024-02-24T02:11:00.630573380Z [2024-02-24T02:11:00.630+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:10:00+00:00 exited with status queued for try_number 1 2024-02-24T02:11:00.630859037Z [2024-02-24T02:11:00.630+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:10:00+00:00 exited with status queued for try_number 1 2024-02-24T02:11:00.640632024Z [2024-02-24T02:11:00.640+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d6e2a33-d10d-4f69-8b9a-a4a405b3b640 2024-02-24T02:11:00.641013981Z [2024-02-24T02:11:00.640+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6816a4b2-57b8-4b92-8281-84e017ead44b 2024-02-24T02:11:00.641330546Z [2024-02-24T02:11:00.641+0000] {scheduler_job.py:635} INFO - Setting external_id for to 13a9ee9a-d7f8-4b22-ab56-5c89783dad56 2024-02-24T02:11:01.811751255Z [2024-02-24T02:11:01.811+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:11:01.812380539Z [2024-02-24T02:11:01.812+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:10:00+00:00, run_id=scheduled__2024-02-24T02:10:00+00:00, run_start_date=2024-02-24 02:11:00.305383+00:00, run_end_date=2024-02-24 02:11:01.811666+00:00, run_duration=1.506283, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:10:00+00:00, data_interval_end=2024-02-24 02:11:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:11:01.830076748Z [2024-02-24T02:11:01.829+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:11:00+00:00, run_after=2024-02-24T02:12:00+00:00 2024-02-24T02:11:01.914874487Z [2024-02-24T02:11:01.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:10:00+00:00 exited with status success for try_number 1 2024-02-24T02:11:01.922737144Z [2024-02-24T02:11:01.922+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:10:00+00:00, map_index=-1, run_start_date=2024-02-24 02:11:01.129286+00:00, run_end_date=2024-02-24 02:11:01.554341+00:00, run_duration=0.425055, state=success, executor_state=success, try_number=1, max_tries=1, job_id=706, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:11:00.388840+00:00, queued_by_job_id=2, pid=10316 2024-02-24T02:11:04.566329979Z [2024-02-24T02:11:04.565+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:11:04.566760352Z [2024-02-24T02:11:04.566+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:10:00+00:00, run_id=scheduled__2024-02-24T02:10:00+00:00, run_start_date=2024-02-24 02:11:00.308165+00:00, run_end_date=2024-02-24 02:11:04.566283+00:00, run_duration=4.258118, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:10:00+00:00, data_interval_end=2024-02-24 02:11:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:11:04.579828672Z [2024-02-24T02:11:04.579+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:11:00+00:00, run_after=2024-02-24T02:12:00+00:00 2024-02-24T02:11:04.589976923Z [2024-02-24T02:11:04.589+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:11:04.590478976Z [2024-02-24T02:11:04.590+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:10:00+00:00, run_id=scheduled__2024-02-24T02:10:00+00:00, run_start_date=2024-02-24 02:11:00.310140+00:00, run_end_date=2024-02-24 02:11:04.589748+00:00, run_duration=4.279608, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:10:00+00:00, data_interval_end=2024-02-24 02:11:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:11:04.604285055Z [2024-02-24T02:11:04.603+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:11:00+00:00, run_after=2024-02-24T02:12:00+00:00 2024-02-24T02:11:04.644322704Z [2024-02-24T02:11:04.643+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:10:00+00:00 exited with status success for try_number 1 2024-02-24T02:11:04.644706851Z [2024-02-24T02:11:04.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:10:00+00:00 exited with status success for try_number 1 2024-02-24T02:11:04.653472869Z [2024-02-24T02:11:04.652+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:10:00+00:00, map_index=-1, run_start_date=2024-02-24 02:11:02.337575+00:00, run_end_date=2024-02-24 02:11:03.818781+00:00, run_duration=1.481206, state=success, executor_state=success, try_number=1, max_tries=1, job_id=708, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:11:00.388840+00:00, queued_by_job_id=2, pid=10335 2024-02-24T02:11:04.653886779Z [2024-02-24T02:11:04.653+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:10:00+00:00, map_index=-1, run_start_date=2024-02-24 02:11:02.295249+00:00, run_end_date=2024-02-24 02:11:04.134826+00:00, run_duration=1.839577, state=success, executor_state=success, try_number=1, max_tries=1, job_id=707, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:11:00.388840+00:00, queued_by_job_id=2, pid=10334 2024-02-24T02:12:00.109371544Z [2024-02-24T02:12:00.108+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:12:00.143427173Z [2024-02-24T02:12:00.142+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:12:00+00:00, run_after=2024-02-24T02:13:00+00:00 2024-02-24T02:12:00.159536229Z [2024-02-24T02:12:00.159+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:12:00+00:00, run_after=2024-02-24T02:13:00+00:00 2024-02-24T02:12:00.166154937Z [2024-02-24T02:12:00.165+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:12:00.264748686Z [2024-02-24T02:12:00.264+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T02:12:00.264779012Z 2024-02-24T02:12:00.264785895Z 2024-02-24T02:12:00.264791251Z 2024-02-24T02:12:00.264796462Z 2024-02-24T02:12:00.265051810Z [2024-02-24T02:12:00.264+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T02:12:00.265296686Z [2024-02-24T02:12:00.265+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:12:00.265554908Z [2024-02-24T02:12:00.265+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:12:00.265815029Z [2024-02-24T02:12:00.265+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:12:00.266827744Z [2024-02-24T02:12:00.266+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:12:00.266844234Z 2024-02-24T02:12:00.266849934Z 2024-02-24T02:12:00.266854834Z 2024-02-24T02:12:00.266859803Z 2024-02-24T02:12:00.271492637Z [2024-02-24T02:12:00.271+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:12:00.271801673Z [2024-02-24T02:12:00.271+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T02:12:00.272224877Z [2024-02-24T02:12:00.272+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:12:00.272496296Z [2024-02-24T02:12:00.272+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:12:00.272931413Z [2024-02-24T02:12:00.272+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:12:00.273263855Z [2024-02-24T02:12:00.272+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:12:00.273678612Z [2024-02-24T02:12:00.273+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:12:00.273973679Z [2024-02-24T02:12:00.273+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:12:00.686631587Z [2024-02-24T02:12:00.686+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:10:00+00:00 exited with status queued for try_number 1 2024-02-24T02:12:00.686908296Z [2024-02-24T02:12:00.686+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:11:00+00:00 exited with status queued for try_number 1 2024-02-24T02:12:00.687134042Z [2024-02-24T02:12:00.686+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:11:00+00:00 exited with status queued for try_number 1 2024-02-24T02:12:00.687369447Z [2024-02-24T02:12:00.687+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:11:00+00:00 exited with status queued for try_number 1 2024-02-24T02:12:00.702505381Z [2024-02-24T02:12:00.702+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4236c495-8c98-46f3-b564-b2b88afc9b9a 2024-02-24T02:12:00.702737235Z [2024-02-24T02:12:00.702+0000] {scheduler_job.py:635} INFO - Setting external_id for to 185ce0d6-7f5d-47d8-bf82-a5084e9e46d0 2024-02-24T02:12:00.703086580Z [2024-02-24T02:12:00.702+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c04b491-3992-4113-87d4-256645423d59 2024-02-24T02:12:00.703339163Z [2024-02-24T02:12:00.703+0000] {scheduler_job.py:635} INFO - Setting external_id for to a3b96b69-f54b-4fb0-b08f-3a24e7101843 2024-02-24T02:12:02.799022965Z [2024-02-24T02:12:02.797+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:12:02.799377329Z [2024-02-24T02:12:02.799+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 02:10:00+00:00, run_id=scheduled__2024-02-24T02:10:00+00:00, run_start_date=2024-02-24 02:12:00.188733+00:00, run_end_date=2024-02-24 02:12:02.798984+00:00, run_duration=2.610251, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:10:00+00:00, data_interval_end=2024-02-24 02:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T02:12:02.811669370Z [2024-02-24T02:12:02.811+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T02:12:00+00:00, run_after=2024-02-24T02:14:00+00:00 2024-02-24T02:12:02.826372158Z [2024-02-24T02:12:02.821+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:12:02.826396978Z [2024-02-24T02:12:02.822+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:11:00+00:00, run_id=scheduled__2024-02-24T02:11:00+00:00, run_start_date=2024-02-24 02:12:00.191208+00:00, run_end_date=2024-02-24 02:12:02.822193+00:00, run_duration=2.630985, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:11:00+00:00, data_interval_end=2024-02-24 02:12:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:12:02.838558523Z [2024-02-24T02:12:02.838+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:12:00+00:00, run_after=2024-02-24T02:13:00+00:00 2024-02-24T02:12:02.898798034Z [2024-02-24T02:12:02.898+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:10:00+00:00 exited with status success for try_number 1 2024-02-24T02:12:02.898833362Z [2024-02-24T02:12:02.898+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:11:00+00:00 exited with status success for try_number 1 2024-02-24T02:12:02.910405078Z [2024-02-24T02:12:02.910+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T02:10:00+00:00, map_index=-1, run_start_date=2024-02-24 02:12:01.170471+00:00, run_end_date=2024-02-24 02:12:01.669087+00:00, run_duration=0.498616, state=success, executor_state=success, try_number=1, max_tries=1, job_id=709, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:12:00.268128+00:00, queued_by_job_id=2, pid=10368 2024-02-24T02:12:02.910857942Z [2024-02-24T02:12:02.910+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:11:00+00:00, map_index=-1, run_start_date=2024-02-24 02:12:01.288508+00:00, run_end_date=2024-02-24 02:12:01.705901+00:00, run_duration=0.417393, state=success, executor_state=success, try_number=1, max_tries=1, job_id=710, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:12:00.268128+00:00, queued_by_job_id=2, pid=10369 2024-02-24T02:12:03.749395026Z [2024-02-24T02:12:03.748+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:12:03.749644638Z [2024-02-24T02:12:03.749+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:11:00+00:00, run_id=scheduled__2024-02-24T02:11:00+00:00, run_start_date=2024-02-24 02:12:00.193089+00:00, run_end_date=2024-02-24 02:12:03.749262+00:00, run_duration=3.556173, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:11:00+00:00, data_interval_end=2024-02-24 02:12:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:12:03.758975865Z [2024-02-24T02:12:03.758+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:12:00+00:00, run_after=2024-02-24T02:13:00+00:00 2024-02-24T02:12:03.823649788Z [2024-02-24T02:12:03.819+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T02:12:04.882586887Z [2024-02-24T02:12:04.881+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:12:04.883011230Z [2024-02-24T02:12:04.882+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:11:00+00:00, run_id=scheduled__2024-02-24T02:11:00+00:00, run_start_date=2024-02-24 02:12:00.194451+00:00, run_end_date=2024-02-24 02:12:04.882516+00:00, run_duration=4.688065, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:11:00+00:00, data_interval_end=2024-02-24 02:12:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:12:04.898015643Z [2024-02-24T02:12:04.897+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:12:00+00:00, run_after=2024-02-24T02:13:00+00:00 2024-02-24T02:12:04.936793380Z [2024-02-24T02:12:04.936+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:11:00+00:00 exited with status success for try_number 1 2024-02-24T02:12:04.937344201Z [2024-02-24T02:12:04.936+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:11:00+00:00 exited with status success for try_number 1 2024-02-24T02:12:04.946073679Z [2024-02-24T02:12:04.945+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:11:00+00:00, map_index=-1, run_start_date=2024-02-24 02:12:02.388662+00:00, run_end_date=2024-02-24 02:12:03.689843+00:00, run_duration=1.301181, state=success, executor_state=success, try_number=1, max_tries=1, job_id=711, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:12:00.268128+00:00, queued_by_job_id=2, pid=10392 2024-02-24T02:12:04.946725652Z [2024-02-24T02:12:04.946+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:11:00+00:00, map_index=-1, run_start_date=2024-02-24 02:12:02.461044+00:00, run_end_date=2024-02-24 02:12:04.624669+00:00, run_duration=2.163625, state=success, executor_state=success, try_number=1, max_tries=1, job_id=712, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:12:00.268128+00:00, queued_by_job_id=2, pid=10393 2024-02-24T02:13:00.722309882Z [2024-02-24T02:13:00.721+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:13:00.735402403Z [2024-02-24T02:13:00.735+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:13:00+00:00, run_after=2024-02-24T02:14:00+00:00 2024-02-24T02:13:00.754961562Z [2024-02-24T02:13:00.754+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:13:00+00:00, run_after=2024-02-24T02:14:00+00:00 2024-02-24T02:13:00.817911736Z [2024-02-24T02:13:00.817+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T02:13:00.817943684Z 2024-02-24T02:13:00.817947479Z 2024-02-24T02:13:00.817950893Z 2024-02-24T02:13:00.817954217Z [2024-02-24T02:13:00.817+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:13:00.818172193Z [2024-02-24T02:13:00.817+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:13:00.818348840Z [2024-02-24T02:13:00.818+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:13:00.818973122Z [2024-02-24T02:13:00.818+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:13:00.818985675Z 2024-02-24T02:13:00.818989482Z 2024-02-24T02:13:00.818992675Z 2024-02-24T02:13:00.822103232Z [2024-02-24T02:13:00.821+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:13:00.822302632Z [2024-02-24T02:13:00.822+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:13:00.822610766Z [2024-02-24T02:13:00.822+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:13:00.822766349Z [2024-02-24T02:13:00.822+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:13:00.822988250Z [2024-02-24T02:13:00.822+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:13:00.823160839Z [2024-02-24T02:13:00.822+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:13:01.037988436Z [2024-02-24T02:13:01.037+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:12:00+00:00 exited with status queued for try_number 1 2024-02-24T02:13:01.038343303Z [2024-02-24T02:13:01.037+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:12:00+00:00 exited with status queued for try_number 1 2024-02-24T02:13:01.038790928Z [2024-02-24T02:13:01.038+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:12:00+00:00 exited with status queued for try_number 1 2024-02-24T02:13:01.046081415Z [2024-02-24T02:13:01.045+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3ac3b5ab-a9b4-43c6-ac0a-f3791b8dcab9 2024-02-24T02:13:01.046392735Z [2024-02-24T02:13:01.046+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2883a59f-e924-4f81-9b3d-0574d5f21763 2024-02-24T02:13:01.046638440Z [2024-02-24T02:13:01.046+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0763cfc3-55c9-4285-8906-0671a29573e8 2024-02-24T02:13:02.597878078Z [2024-02-24T02:13:02.597+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:13:02.598227895Z [2024-02-24T02:13:02.598+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:12:00+00:00, run_id=scheduled__2024-02-24T02:12:00+00:00, run_start_date=2024-02-24 02:13:00.766575+00:00, run_end_date=2024-02-24 02:13:02.597877+00:00, run_duration=1.831302, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:12:00+00:00, data_interval_end=2024-02-24 02:13:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:13:02.610114498Z [2024-02-24T02:13:02.609+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:13:00+00:00, run_after=2024-02-24T02:14:00+00:00 2024-02-24T02:13:02.737006143Z [2024-02-24T02:13:02.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:12:00+00:00 exited with status success for try_number 1 2024-02-24T02:13:02.741081633Z [2024-02-24T02:13:02.740+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:12:00+00:00, map_index=-1, run_start_date=2024-02-24 02:13:01.784413+00:00, run_end_date=2024-02-24 02:13:02.238574+00:00, run_duration=0.454161, state=success, executor_state=success, try_number=1, max_tries=1, job_id=713, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:13:00.819674+00:00, queued_by_job_id=2, pid=10425 2024-02-24T02:13:05.153556004Z [2024-02-24T02:13:05.153+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:13:05.153687978Z [2024-02-24T02:13:05.153+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:12:00+00:00, run_id=scheduled__2024-02-24T02:12:00+00:00, run_start_date=2024-02-24 02:13:00.768734+00:00, run_end_date=2024-02-24 02:13:05.153427+00:00, run_duration=4.384693, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:12:00+00:00, data_interval_end=2024-02-24 02:13:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:13:05.162389371Z [2024-02-24T02:13:05.162+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:13:00+00:00, run_after=2024-02-24T02:14:00+00:00 2024-02-24T02:13:05.171273663Z [2024-02-24T02:13:05.170+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:13:05.171343474Z [2024-02-24T02:13:05.171+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:12:00+00:00, run_id=scheduled__2024-02-24T02:12:00+00:00, run_start_date=2024-02-24 02:13:00.767735+00:00, run_end_date=2024-02-24 02:13:05.170980+00:00, run_duration=4.403245, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:12:00+00:00, data_interval_end=2024-02-24 02:13:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:13:05.181689941Z [2024-02-24T02:13:05.181+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:13:00+00:00, run_after=2024-02-24T02:14:00+00:00 2024-02-24T02:13:05.234871610Z [2024-02-24T02:13:05.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:12:00+00:00 exited with status success for try_number 1 2024-02-24T02:13:05.234911047Z [2024-02-24T02:13:05.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:12:00+00:00 exited with status success for try_number 1 2024-02-24T02:13:05.242462323Z [2024-02-24T02:13:05.242+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:12:00+00:00, map_index=-1, run_start_date=2024-02-24 02:13:02.685592+00:00, run_end_date=2024-02-24 02:13:04.823236+00:00, run_duration=2.137644, state=success, executor_state=success, try_number=1, max_tries=1, job_id=714, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:13:00.819674+00:00, queued_by_job_id=2, pid=10443 2024-02-24T02:13:05.242651493Z [2024-02-24T02:13:05.242+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:12:00+00:00, map_index=-1, run_start_date=2024-02-24 02:13:02.869724+00:00, run_end_date=2024-02-24 02:13:04.831580+00:00, run_duration=1.961856, state=success, executor_state=success, try_number=1, max_tries=1, job_id=715, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:13:00.819674+00:00, queued_by_job_id=2, pid=10444 2024-02-24T02:14:00.802409415Z [2024-02-24T02:14:00.801+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:14:00.817391213Z [2024-02-24T02:14:00.816+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:14:00+00:00, run_after=2024-02-24T02:15:00+00:00 2024-02-24T02:14:00.825321837Z [2024-02-24T02:14:00.824+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:14:00.838700139Z [2024-02-24T02:14:00.838+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:14:00+00:00, run_after=2024-02-24T02:15:00+00:00 2024-02-24T02:14:00.950601367Z [2024-02-24T02:14:00.949+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T02:14:00.950655614Z 2024-02-24T02:14:00.950667425Z 2024-02-24T02:14:00.950675984Z 2024-02-24T02:14:00.950684484Z 2024-02-24T02:14:00.951072571Z [2024-02-24T02:14:00.950+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T02:14:00.951371996Z [2024-02-24T02:14:00.951+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:14:00.951739645Z [2024-02-24T02:14:00.951+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:14:00.952161153Z [2024-02-24T02:14:00.951+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:14:00.957375781Z [2024-02-24T02:14:00.956+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:14:00.957405289Z 2024-02-24T02:14:00.957412432Z 2024-02-24T02:14:00.957417788Z 2024-02-24T02:14:00.957422933Z 2024-02-24T02:14:00.965970792Z [2024-02-24T02:14:00.965+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:14:00.966409072Z [2024-02-24T02:14:00.966+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T02:14:00.966861017Z [2024-02-24T02:14:00.966+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:14:00.967218611Z [2024-02-24T02:14:00.966+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:14:00.967742568Z [2024-02-24T02:14:00.967+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:14:00.968084960Z [2024-02-24T02:14:00.967+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:14:00.968577042Z [2024-02-24T02:14:00.968+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:14:00.968983891Z [2024-02-24T02:14:00.968+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:14:01.384161185Z [2024-02-24T02:14:01.383+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:12:00+00:00 exited with status queued for try_number 1 2024-02-24T02:14:01.384191782Z [2024-02-24T02:14:01.384+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:13:00+00:00 exited with status queued for try_number 1 2024-02-24T02:14:01.384261561Z [2024-02-24T02:14:01.384+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:13:00+00:00 exited with status queued for try_number 1 2024-02-24T02:14:01.384391075Z [2024-02-24T02:14:01.384+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:13:00+00:00 exited with status queued for try_number 1 2024-02-24T02:14:01.394641936Z [2024-02-24T02:14:01.394+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4613d098-4e3e-4e8d-a083-90d2b81d4093 2024-02-24T02:14:01.394770593Z [2024-02-24T02:14:01.394+0000] {scheduler_job.py:635} INFO - Setting external_id for to f3619696-5326-4124-bbca-caf1697ef258 2024-02-24T02:14:01.394931628Z [2024-02-24T02:14:01.394+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e97be54-7385-4681-a3f6-0e184c45da5b 2024-02-24T02:14:01.395076734Z [2024-02-24T02:14:01.394+0000] {scheduler_job.py:635} INFO - Setting external_id for to 41100b77-9d19-4fc8-b625-88d1cbeee23c 2024-02-24T02:14:02.625733695Z [2024-02-24T02:14:02.622+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:14:02.625762455Z [2024-02-24T02:14:02.623+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 02:12:00+00:00, run_id=scheduled__2024-02-24T02:12:00+00:00, run_start_date=2024-02-24 02:14:00.852881+00:00, run_end_date=2024-02-24 02:14:02.623290+00:00, run_duration=1.770409, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:12:00+00:00, data_interval_end=2024-02-24 02:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T02:14:02.658358810Z [2024-02-24T02:14:02.648+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T02:14:00+00:00, run_after=2024-02-24T02:16:00+00:00 2024-02-24T02:14:02.823549962Z [2024-02-24T02:14:02.823+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:12:00+00:00 exited with status success for try_number 1 2024-02-24T02:14:02.883656450Z [2024-02-24T02:14:02.883+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T02:12:00+00:00, map_index=-1, run_start_date=2024-02-24 02:14:01.966476+00:00, run_end_date=2024-02-24 02:14:02.377188+00:00, run_duration=0.410712, state=success, executor_state=success, try_number=1, max_tries=1, job_id=716, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:14:00.959864+00:00, queued_by_job_id=2, pid=10476 2024-02-24T02:14:03.757448144Z [2024-02-24T02:14:03.755+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:14:03.757480324Z [2024-02-24T02:14:03.756+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:13:00+00:00, run_id=scheduled__2024-02-24T02:13:00+00:00, run_start_date=2024-02-24 02:14:00.854282+00:00, run_end_date=2024-02-24 02:14:03.756269+00:00, run_duration=2.901987, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:13:00+00:00, data_interval_end=2024-02-24 02:14:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:14:03.766684771Z [2024-02-24T02:14:03.766+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:14:00+00:00, run_after=2024-02-24T02:15:00+00:00 2024-02-24T02:14:03.860129606Z [2024-02-24T02:14:03.858+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:13:00+00:00 exited with status success for try_number 1 2024-02-24T02:14:03.867248152Z [2024-02-24T02:14:03.866+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:13:00+00:00, map_index=-1, run_start_date=2024-02-24 02:14:02.358486+00:00, run_end_date=2024-02-24 02:14:03.019454+00:00, run_duration=0.660968, state=success, executor_state=success, try_number=1, max_tries=1, job_id=717, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:14:00.959864+00:00, queued_by_job_id=2, pid=10483 2024-02-24T02:14:06.579906757Z [2024-02-24T02:14:06.579+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:14:06.580329737Z [2024-02-24T02:14:06.579+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:13:00+00:00, run_id=scheduled__2024-02-24T02:13:00+00:00, run_start_date=2024-02-24 02:14:00.855407+00:00, run_end_date=2024-02-24 02:14:06.579670+00:00, run_duration=5.724263, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:13:00+00:00, data_interval_end=2024-02-24 02:14:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:14:06.602574842Z [2024-02-24T02:14:06.602+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:14:00+00:00, run_after=2024-02-24T02:15:00+00:00 2024-02-24T02:14:06.652202023Z [2024-02-24T02:14:06.651+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:13:00+00:00 exited with status success for try_number 1 2024-02-24T02:14:06.658901832Z [2024-02-24T02:14:06.658+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:13:00+00:00, map_index=-1, run_start_date=2024-02-24 02:14:03.660677+00:00, run_end_date=2024-02-24 02:14:05.761159+00:00, run_duration=2.100482, state=success, executor_state=success, try_number=1, max_tries=1, job_id=719, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:14:00.959864+00:00, queued_by_job_id=2, pid=10502 2024-02-24T02:14:07.721616229Z [2024-02-24T02:14:07.720+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:14:07.721697275Z [2024-02-24T02:14:07.721+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:13:00+00:00, run_id=scheduled__2024-02-24T02:13:00+00:00, run_start_date=2024-02-24 02:14:00.856434+00:00, run_end_date=2024-02-24 02:14:07.721189+00:00, run_duration=6.864755, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:13:00+00:00, data_interval_end=2024-02-24 02:14:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:14:07.737126612Z [2024-02-24T02:14:07.736+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:14:00+00:00, run_after=2024-02-24T02:15:00+00:00 2024-02-24T02:14:07.792183642Z [2024-02-24T02:14:07.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:13:00+00:00 exited with status success for try_number 1 2024-02-24T02:14:07.805588130Z [2024-02-24T02:14:07.804+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:13:00+00:00, map_index=-1, run_start_date=2024-02-24 02:14:03.453659+00:00, run_end_date=2024-02-24 02:14:06.598050+00:00, run_duration=3.144391, state=success, executor_state=success, try_number=1, max_tries=1, job_id=718, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:14:00.959864+00:00, queued_by_job_id=2, pid=10501 2024-02-24T02:15:00.759843751Z [2024-02-24T02:15:00.759+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:15:00+00:00, run_after=2024-02-24T02:16:00+00:00 2024-02-24T02:15:00.768192604Z [2024-02-24T02:15:00.767+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:15:00.782006717Z [2024-02-24T02:15:00.781+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:15:00+00:00, run_after=2024-02-24T02:16:00+00:00 2024-02-24T02:15:00.797146930Z [2024-02-24T02:15:00.796+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:15:00+00:00, run_after=2024-02-24T02:20:00+00:00 2024-02-24T02:15:00.912739327Z [2024-02-24T02:15:00.912+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T02:15:00.912772659Z 2024-02-24T02:15:00.912778374Z 2024-02-24T02:15:00.912783262Z 2024-02-24T02:15:00.912788028Z 2024-02-24T02:15:00.912803022Z [2024-02-24T02:15:00.912+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:15:00.912838543Z [2024-02-24T02:15:00.912+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:15:00.912971612Z [2024-02-24T02:15:00.912+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:15:00.913032350Z [2024-02-24T02:15:00.912+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:15:00.913726937Z [2024-02-24T02:15:00.913+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:15:00.913745239Z 2024-02-24T02:15:00.913755020Z 2024-02-24T02:15:00.913760046Z 2024-02-24T02:15:00.913765328Z 2024-02-24T02:15:00.918181653Z [2024-02-24T02:15:00.917+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T02:15:00.918308825Z [2024-02-24T02:15:00.918+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:15:00.918466504Z [2024-02-24T02:15:00.918+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:15:00.918581451Z [2024-02-24T02:15:00.918+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:15:00.918733125Z [2024-02-24T02:15:00.918+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:15:00.918786081Z [2024-02-24T02:15:00.918+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:15:00.918997480Z [2024-02-24T02:15:00.918+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:15:00.919131163Z [2024-02-24T02:15:00.918+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:15:01.545065108Z [2024-02-24T02:15:01.542+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T02:10:00+00:00 exited with status queued for try_number 1 2024-02-24T02:15:01.545572129Z [2024-02-24T02:15:01.545+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:14:00+00:00 exited with status queued for try_number 1 2024-02-24T02:15:01.545819254Z [2024-02-24T02:15:01.545+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:14:00+00:00 exited with status queued for try_number 1 2024-02-24T02:15:01.546109818Z [2024-02-24T02:15:01.545+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:14:00+00:00 exited with status queued for try_number 1 2024-02-24T02:15:01.572130836Z [2024-02-24T02:15:01.571+0000] {scheduler_job.py:635} INFO - Setting external_id for to 384a5b33-1798-4a51-94e6-b8899313ee25 2024-02-24T02:15:01.573322210Z [2024-02-24T02:15:01.573+0000] {scheduler_job.py:635} INFO - Setting external_id for to d71b8592-9de7-48e7-a0df-b68641f9ada6 2024-02-24T02:15:01.573623045Z [2024-02-24T02:15:01.573+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6931a876-0bab-4663-9fbe-4578fd24678c 2024-02-24T02:15:01.573881069Z [2024-02-24T02:15:01.573+0000] {scheduler_job.py:635} INFO - Setting external_id for to 531ecd75-eafd-4bd2-94f0-6b6c5324e99d 2024-02-24T02:15:02.935509328Z [2024-02-24T02:15:02.935+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:15:02.935885111Z [2024-02-24T02:15:02.935+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:14:00+00:00, run_id=scheduled__2024-02-24T02:14:00+00:00, run_start_date=2024-02-24 02:15:00.817679+00:00, run_end_date=2024-02-24 02:15:02.935425+00:00, run_duration=2.117746, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:14:00+00:00, data_interval_end=2024-02-24 02:15:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:15:02.965598429Z [2024-02-24T02:15:02.965+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:15:00+00:00, run_after=2024-02-24T02:16:00+00:00 2024-02-24T02:15:03.140669377Z [2024-02-24T02:15:03.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:14:00+00:00 exited with status success for try_number 1 2024-02-24T02:15:03.153671015Z [2024-02-24T02:15:03.153+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:14:00+00:00, map_index=-1, run_start_date=2024-02-24 02:15:01.971888+00:00, run_end_date=2024-02-24 02:15:02.390443+00:00, run_duration=0.418555, state=success, executor_state=success, try_number=1, max_tries=1, job_id=720, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:15:00.914924+00:00, queued_by_job_id=2, pid=10536 2024-02-24T02:15:04.624276582Z [2024-02-24T02:15:04.623+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:15:04.624310665Z 2024-02-24T02:15:04.624483124Z [2024-02-24T02:15:04.624+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:15:04.626231703Z [2024-02-24T02:15:04.625+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:15:04.626257815Z 2024-02-24T02:15:04.629150314Z [2024-02-24T02:15:04.628+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T02:15:04.629519009Z [2024-02-24T02:15:04.629+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:15:04.696913620Z [2024-02-24T02:15:04.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T02:10:00+00:00 exited with status queued for try_number 1 2024-02-24T02:15:04.697202081Z [2024-02-24T02:15:04.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T02:10:00+00:00 exited with status success for try_number 1 2024-02-24T02:15:04.708529732Z [2024-02-24T02:15:04.708+0000] {scheduler_job.py:635} INFO - Setting external_id for to 51cdf256-33b1-4e34-9d28-c5cf8fc32824 2024-02-24T02:15:04.709007846Z [2024-02-24T02:15:04.708+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T02:10:00+00:00, map_index=-1, run_start_date=2024-02-24 02:15:03.917070+00:00, run_end_date=2024-02-24 02:15:04.468122+00:00, run_duration=0.551052, state=success, executor_state=success, try_number=1, max_tries=1, job_id=723, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:15:00.914924+00:00, queued_by_job_id=2, pid=10572 2024-02-24T02:15:05.875004770Z [2024-02-24T02:15:05.874+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:15:05.875696453Z [2024-02-24T02:15:05.875+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:14:00+00:00, run_id=scheduled__2024-02-24T02:14:00+00:00, run_start_date=2024-02-24 02:15:00.819774+00:00, run_end_date=2024-02-24 02:15:05.874862+00:00, run_duration=5.055088, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:14:00+00:00, data_interval_end=2024-02-24 02:15:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:15:05.893019502Z [2024-02-24T02:15:05.892+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:15:00+00:00, run_after=2024-02-24T02:16:00+00:00 2024-02-24T02:15:05.903251020Z [2024-02-24T02:15:05.902+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:15:05.903519717Z [2024-02-24T02:15:05.903+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:14:00+00:00, run_id=scheduled__2024-02-24T02:14:00+00:00, run_start_date=2024-02-24 02:15:00.821960+00:00, run_end_date=2024-02-24 02:15:05.903131+00:00, run_duration=5.081171, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:14:00+00:00, data_interval_end=2024-02-24 02:15:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:15:05.914029041Z [2024-02-24T02:15:05.913+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:15:00+00:00, run_after=2024-02-24T02:16:00+00:00 2024-02-24T02:15:05.985694490Z [2024-02-24T02:15:05.985+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:14:00+00:00 exited with status success for try_number 1 2024-02-24T02:15:05.986336517Z [2024-02-24T02:15:05.986+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:14:00+00:00 exited with status success for try_number 1 2024-02-24T02:15:05.995616218Z [2024-02-24T02:15:05.995+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:14:00+00:00, map_index=-1, run_start_date=2024-02-24 02:15:03.265626+00:00, run_end_date=2024-02-24 02:15:04.806108+00:00, run_duration=1.540482, state=success, executor_state=success, try_number=1, max_tries=1, job_id=721, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:15:00.914924+00:00, queued_by_job_id=2, pid=10555 2024-02-24T02:15:05.995704126Z [2024-02-24T02:15:05.995+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:14:00+00:00, map_index=-1, run_start_date=2024-02-24 02:15:03.313686+00:00, run_end_date=2024-02-24 02:15:05.498865+00:00, run_duration=2.185179, state=success, executor_state=success, try_number=1, max_tries=1, job_id=722, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:15:00.914924+00:00, queued_by_job_id=2, pid=10556 2024-02-24T02:15:07.077136486Z [2024-02-24T02:15:07.076+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:15:07.077173654Z 2024-02-24T02:15:07.077335063Z [2024-02-24T02:15:07.077+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:15:07.078181178Z [2024-02-24T02:15:07.077+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:15:07.078199262Z 2024-02-24T02:15:07.081349493Z [2024-02-24T02:15:07.081+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T02:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T02:15:07.081682648Z [2024-02-24T02:15:07.081+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T02:15:07.135737276Z [2024-02-24T02:15:07.135+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T02:10:00+00:00 exited with status queued for try_number 1 2024-02-24T02:15:07.136052214Z [2024-02-24T02:15:07.135+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T02:10:00+00:00 exited with status success for try_number 1 2024-02-24T02:15:07.142731740Z [2024-02-24T02:15:07.142+0000] {scheduler_job.py:635} INFO - Setting external_id for to 55b8155d-dfb5-4d5a-8e26-f166108407f0 2024-02-24T02:15:07.143244425Z [2024-02-24T02:15:07.142+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T02:10:00+00:00, map_index=-1, run_start_date=2024-02-24 02:15:06.213292+00:00, run_end_date=2024-02-24 02:15:06.555544+00:00, run_duration=0.342252, state=success, executor_state=success, try_number=1, max_tries=1, job_id=724, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:15:04.626622+00:00, queued_by_job_id=2, pid=10585 2024-02-24T02:15:09.352602936Z [2024-02-24T02:15:09.352+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:15:09.352647121Z 2024-02-24T02:15:09.352797876Z [2024-02-24T02:15:09.352+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:15:09.353736428Z [2024-02-24T02:15:09.353+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:15:09.353749035Z 2024-02-24T02:15:09.356778719Z [2024-02-24T02:15:09.356+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:15:09.357000124Z [2024-02-24T02:15:09.356+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:15:09.400849222Z [2024-02-24T02:15:09.400+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T02:10:00+00:00 exited with status queued for try_number 1 2024-02-24T02:15:09.400928519Z [2024-02-24T02:15:09.400+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T02:10:00+00:00 exited with status success for try_number 1 2024-02-24T02:15:09.406297430Z [2024-02-24T02:15:09.405+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c0e8eee-abfc-4f4a-a0e0-26fb452867c6 2024-02-24T02:15:09.406436761Z [2024-02-24T02:15:09.406+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T02:10:00+00:00, map_index=0, run_start_date=2024-02-24 02:15:08.636160+00:00, run_end_date=2024-02-24 02:15:08.949161+00:00, run_duration=0.313001, state=success, executor_state=success, try_number=1, max_tries=1, job_id=725, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:15:07.078659+00:00, queued_by_job_id=2, pid=10593 2024-02-24T02:15:11.962365495Z [2024-02-24T02:15:11.961+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:15:11.962683569Z [2024-02-24T02:15:11.962+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:10:00+00:00, run_id=scheduled__2024-02-24T02:10:00+00:00, run_start_date=2024-02-24 02:15:00.815471+00:00, run_end_date=2024-02-24 02:15:11.962250+00:00, run_duration=11.146779, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:10:00+00:00, data_interval_end=2024-02-24 02:15:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T02:15:11.969699381Z [2024-02-24T02:15:11.969+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:15:00+00:00, run_after=2024-02-24T02:20:00+00:00 2024-02-24T02:15:12.002114548Z [2024-02-24T02:15:12.001+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T02:10:00+00:00 exited with status success for try_number 1 2024-02-24T02:15:12.011885900Z [2024-02-24T02:15:12.011+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T02:10:00+00:00, map_index=-1, run_start_date=2024-02-24 02:15:10.906576+00:00, run_end_date=2024-02-24 02:15:11.210374+00:00, run_duration=0.303798, state=success, executor_state=success, try_number=1, max_tries=1, job_id=726, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:15:09.354224+00:00, queued_by_job_id=2, pid=10601 2024-02-24T02:16:00.473570560Z [2024-02-24T02:16:00.472+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:16:00+00:00, run_after=2024-02-24T02:17:00+00:00 2024-02-24T02:16:00.483941508Z [2024-02-24T02:16:00.483+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:16:00.496702720Z [2024-02-24T02:16:00.496+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:16:00+00:00, run_after=2024-02-24T02:17:00+00:00 2024-02-24T02:16:00.504292357Z [2024-02-24T02:16:00.503+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:16:00.594217961Z [2024-02-24T02:16:00.593+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T02:16:00.594268790Z 2024-02-24T02:16:00.594277645Z 2024-02-24T02:16:00.594281049Z 2024-02-24T02:16:00.594284790Z 2024-02-24T02:16:00.594367892Z [2024-02-24T02:16:00.594+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T02:16:00.594450379Z [2024-02-24T02:16:00.594+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:16:00.594519358Z [2024-02-24T02:16:00.594+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:16:00.594594376Z [2024-02-24T02:16:00.594+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:16:00.595110833Z [2024-02-24T02:16:00.594+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:16:00.595119301Z 2024-02-24T02:16:00.595122932Z 2024-02-24T02:16:00.595126025Z 2024-02-24T02:16:00.595129006Z 2024-02-24T02:16:00.599882865Z [2024-02-24T02:16:00.599+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:16:00.599911259Z [2024-02-24T02:16:00.599+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T02:16:00.600081426Z [2024-02-24T02:16:00.599+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:16:00.600142224Z [2024-02-24T02:16:00.600+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:16:00.600316834Z [2024-02-24T02:16:00.600+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:16:00.600391396Z [2024-02-24T02:16:00.600+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:16:00.600554222Z [2024-02-24T02:16:00.600+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:16:00.600606855Z [2024-02-24T02:16:00.600+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:16:01.000021230Z [2024-02-24T02:16:00.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:14:00+00:00 exited with status queued for try_number 1 2024-02-24T02:16:01.000170523Z [2024-02-24T02:16:00.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:15:00+00:00 exited with status queued for try_number 1 2024-02-24T02:16:01.000404872Z [2024-02-24T02:16:01.000+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:15:00+00:00 exited with status queued for try_number 1 2024-02-24T02:16:01.000620553Z [2024-02-24T02:16:01.000+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:15:00+00:00 exited with status queued for try_number 1 2024-02-24T02:16:01.011287004Z [2024-02-24T02:16:01.010+0000] {scheduler_job.py:635} INFO - Setting external_id for to cafff40f-4aae-4e3c-a0b4-de05c9dbd08f 2024-02-24T02:16:01.011375745Z [2024-02-24T02:16:01.011+0000] {scheduler_job.py:635} INFO - Setting external_id for to da752da4-2d0b-43bc-90c4-a2e412adc0ac 2024-02-24T02:16:01.011579251Z [2024-02-24T02:16:01.011+0000] {scheduler_job.py:635} INFO - Setting external_id for to 466d224d-4156-4f41-bcbb-0acdfabfd03d 2024-02-24T02:16:01.011734631Z [2024-02-24T02:16:01.011+0000] {scheduler_job.py:635} INFO - Setting external_id for to eaf7dcc5-0101-43db-b27e-ffeb6beec24d 2024-02-24T02:16:02.159939092Z [2024-02-24T02:16:02.159+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:16:02.160263168Z [2024-02-24T02:16:02.160+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 02:14:00+00:00, run_id=scheduled__2024-02-24T02:14:00+00:00, run_start_date=2024-02-24 02:16:00.516433+00:00, run_end_date=2024-02-24 02:16:02.159864+00:00, run_duration=1.643431, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:14:00+00:00, data_interval_end=2024-02-24 02:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T02:16:02.169001565Z [2024-02-24T02:16:02.168+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T02:16:00+00:00, run_after=2024-02-24T02:18:00+00:00 2024-02-24T02:16:02.179031866Z [2024-02-24T02:16:02.178+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:16:02.179654946Z [2024-02-24T02:16:02.179+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:15:00+00:00, run_id=scheduled__2024-02-24T02:15:00+00:00, run_start_date=2024-02-24 02:16:00.517955+00:00, run_end_date=2024-02-24 02:16:02.179142+00:00, run_duration=1.661187, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:15:00+00:00, data_interval_end=2024-02-24 02:16:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:16:02.195257904Z [2024-02-24T02:16:02.194+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:16:00+00:00, run_after=2024-02-24T02:17:00+00:00 2024-02-24T02:16:02.252352583Z [2024-02-24T02:16:02.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:14:00+00:00 exited with status success for try_number 1 2024-02-24T02:16:02.254334564Z [2024-02-24T02:16:02.252+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:15:00+00:00 exited with status success for try_number 1 2024-02-24T02:16:02.265869200Z [2024-02-24T02:16:02.264+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:15:00+00:00, map_index=-1, run_start_date=2024-02-24 02:16:01.463024+00:00, run_end_date=2024-02-24 02:16:01.881461+00:00, run_duration=0.418437, state=success, executor_state=success, try_number=1, max_tries=1, job_id=727, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:16:00.595900+00:00, queued_by_job_id=2, pid=10625 2024-02-24T02:16:02.266758465Z [2024-02-24T02:16:02.266+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T02:14:00+00:00, map_index=-1, run_start_date=2024-02-24 02:16:01.566279+00:00, run_end_date=2024-02-24 02:16:02.014016+00:00, run_duration=0.447737, state=success, executor_state=success, try_number=1, max_tries=1, job_id=728, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:16:00.595900+00:00, queued_by_job_id=2, pid=10626 2024-02-24T02:16:04.939987918Z [2024-02-24T02:16:04.939+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:16:04.940479629Z [2024-02-24T02:16:04.940+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:15:00+00:00, run_id=scheduled__2024-02-24T02:15:00+00:00, run_start_date=2024-02-24 02:16:00.519162+00:00, run_end_date=2024-02-24 02:16:04.940135+00:00, run_duration=4.420973, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:15:00+00:00, data_interval_end=2024-02-24 02:16:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:16:04.951872637Z [2024-02-24T02:16:04.951+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:16:00+00:00, run_after=2024-02-24T02:17:00+00:00 2024-02-24T02:16:04.959759457Z [2024-02-24T02:16:04.959+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:16:04.959951817Z [2024-02-24T02:16:04.959+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:15:00+00:00, run_id=scheduled__2024-02-24T02:15:00+00:00, run_start_date=2024-02-24 02:16:00.520251+00:00, run_end_date=2024-02-24 02:16:04.959595+00:00, run_duration=4.439344, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:15:00+00:00, data_interval_end=2024-02-24 02:16:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:16:04.977891447Z [2024-02-24T02:16:04.977+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:16:00+00:00, run_after=2024-02-24T02:17:00+00:00 2024-02-24T02:16:05.012108353Z [2024-02-24T02:16:05.011+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:15:00+00:00 exited with status success for try_number 1 2024-02-24T02:16:05.012267979Z [2024-02-24T02:16:05.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:15:00+00:00 exited with status success for try_number 1 2024-02-24T02:16:05.020511711Z [2024-02-24T02:16:05.020+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:15:00+00:00, map_index=-1, run_start_date=2024-02-24 02:16:03.084031+00:00, run_end_date=2024-02-24 02:16:04.517715+00:00, run_duration=1.433684, state=success, executor_state=success, try_number=1, max_tries=1, job_id=730, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:16:00.595900+00:00, queued_by_job_id=2, pid=10650 2024-02-24T02:16:05.020740903Z [2024-02-24T02:16:05.020+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:15:00+00:00, map_index=-1, run_start_date=2024-02-24 02:16:02.717103+00:00, run_end_date=2024-02-24 02:16:04.564987+00:00, run_duration=1.847884, state=success, executor_state=success, try_number=1, max_tries=1, job_id=729, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:16:00.595900+00:00, queued_by_job_id=2, pid=10645 2024-02-24T02:17:00.983804061Z [2024-02-24T02:17:00.983+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:17:00+00:00, run_after=2024-02-24T02:18:00+00:00 2024-02-24T02:17:00.994639861Z [2024-02-24T02:17:00.994+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:17:01.025214861Z [2024-02-24T02:17:01.024+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:17:00+00:00, run_after=2024-02-24T02:18:00+00:00 2024-02-24T02:17:01.104911483Z [2024-02-24T02:17:01.104+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T02:17:01.104944541Z 2024-02-24T02:17:01.104948454Z 2024-02-24T02:17:01.104951945Z 2024-02-24T02:17:01.104955193Z [2024-02-24T02:17:01.104+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:17:01.104958664Z [2024-02-24T02:17:01.104+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:17:01.105136512Z [2024-02-24T02:17:01.104+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:17:01.105750403Z [2024-02-24T02:17:01.105+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:17:01.105764338Z 2024-02-24T02:17:01.105809060Z 2024-02-24T02:17:01.105813505Z 2024-02-24T02:17:01.109057322Z [2024-02-24T02:17:01.108+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:17:01.109257543Z [2024-02-24T02:17:01.108+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:17:01.109547960Z [2024-02-24T02:17:01.109+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:17:01.109713820Z [2024-02-24T02:17:01.109+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:17:01.110009744Z [2024-02-24T02:17:01.109+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:17:01.110133099Z [2024-02-24T02:17:01.109+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:17:01.499621612Z [2024-02-24T02:17:01.498+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:16:00+00:00 exited with status queued for try_number 1 2024-02-24T02:17:01.499840593Z [2024-02-24T02:17:01.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:16:00+00:00 exited with status queued for try_number 1 2024-02-24T02:17:01.500032035Z [2024-02-24T02:17:01.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:16:00+00:00 exited with status queued for try_number 1 2024-02-24T02:17:01.512367114Z [2024-02-24T02:17:01.512+0000] {scheduler_job.py:635} INFO - Setting external_id for to af77afb2-d911-48db-ae31-19201dbee9ad 2024-02-24T02:17:01.512587003Z [2024-02-24T02:17:01.512+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ad871e2-2364-4382-81a0-98577aa60ec9 2024-02-24T02:17:01.512774849Z [2024-02-24T02:17:01.512+0000] {scheduler_job.py:635} INFO - Setting external_id for to db4d350d-4115-49db-b942-9f81800472cc 2024-02-24T02:17:02.910336794Z [2024-02-24T02:17:02.909+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:17:02.910636355Z [2024-02-24T02:17:02.910+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:16:00+00:00, run_id=scheduled__2024-02-24T02:16:00+00:00, run_start_date=2024-02-24 02:17:01.050211+00:00, run_end_date=2024-02-24 02:17:02.910281+00:00, run_duration=1.86007, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:16:00+00:00, data_interval_end=2024-02-24 02:17:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:17:02.922421163Z [2024-02-24T02:17:02.922+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:17:00+00:00, run_after=2024-02-24T02:18:00+00:00 2024-02-24T02:17:02.979496884Z [2024-02-24T02:17:02.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:16:00+00:00 exited with status success for try_number 1 2024-02-24T02:17:02.986274940Z [2024-02-24T02:17:02.984+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:16:00+00:00, map_index=-1, run_start_date=2024-02-24 02:17:01.997659+00:00, run_end_date=2024-02-24 02:17:02.357193+00:00, run_duration=0.359534, state=success, executor_state=success, try_number=1, max_tries=1, job_id=731, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:17:01.106549+00:00, queued_by_job_id=2, pid=10684 2024-02-24T02:17:03.923142893Z [2024-02-24T02:17:03.922+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T02:17:04.965009509Z [2024-02-24T02:17:04.964+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:17:04.966310440Z [2024-02-24T02:17:04.965+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:16:00+00:00, run_id=scheduled__2024-02-24T02:16:00+00:00, run_start_date=2024-02-24 02:17:01.054036+00:00, run_end_date=2024-02-24 02:17:04.965798+00:00, run_duration=3.911762, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:16:00+00:00, data_interval_end=2024-02-24 02:17:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:17:04.976389314Z [2024-02-24T02:17:04.976+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:17:00+00:00, run_after=2024-02-24T02:18:00+00:00 2024-02-24T02:17:04.983544959Z [2024-02-24T02:17:04.983+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:17:04.984000050Z [2024-02-24T02:17:04.983+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:16:00+00:00, run_id=scheduled__2024-02-24T02:16:00+00:00, run_start_date=2024-02-24 02:17:01.052381+00:00, run_end_date=2024-02-24 02:17:04.983639+00:00, run_duration=3.931258, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:16:00+00:00, data_interval_end=2024-02-24 02:17:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:17:04.994177295Z [2024-02-24T02:17:04.993+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:17:00+00:00, run_after=2024-02-24T02:18:00+00:00 2024-02-24T02:17:05.027982274Z [2024-02-24T02:17:05.027+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:16:00+00:00 exited with status success for try_number 1 2024-02-24T02:17:05.028263962Z [2024-02-24T02:17:05.028+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:16:00+00:00 exited with status success for try_number 1 2024-02-24T02:17:05.035197244Z [2024-02-24T02:17:05.034+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:16:00+00:00, map_index=-1, run_start_date=2024-02-24 02:17:03.164285+00:00, run_end_date=2024-02-24 02:17:04.548448+00:00, run_duration=1.384163, state=success, executor_state=success, try_number=1, max_tries=1, job_id=733, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:17:01.106549+00:00, queued_by_job_id=2, pid=10703 2024-02-24T02:17:05.035656486Z [2024-02-24T02:17:05.035+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:16:00+00:00, map_index=-1, run_start_date=2024-02-24 02:17:02.996486+00:00, run_end_date=2024-02-24 02:17:04.785223+00:00, run_duration=1.788737, state=success, executor_state=success, try_number=1, max_tries=1, job_id=732, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:17:01.106549+00:00, queued_by_job_id=2, pid=10702 2024-02-24T02:18:00.330071122Z [2024-02-24T02:18:00.326+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:18:00.348605372Z [2024-02-24T02:18:00.348+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:18:00+00:00, run_after=2024-02-24T02:19:00+00:00 2024-02-24T02:18:00.355483482Z [2024-02-24T02:18:00.355+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:18:00.366538793Z [2024-02-24T02:18:00.366+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:18:00+00:00, run_after=2024-02-24T02:19:00+00:00 2024-02-24T02:18:00.477755878Z [2024-02-24T02:18:00.477+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T02:18:00.477852681Z 2024-02-24T02:18:00.477867086Z 2024-02-24T02:18:00.477873412Z 2024-02-24T02:18:00.477925845Z 2024-02-24T02:18:00.478108733Z [2024-02-24T02:18:00.477+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T02:18:00.478446531Z [2024-02-24T02:18:00.478+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:18:00.478862114Z [2024-02-24T02:18:00.478+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:18:00.479380255Z [2024-02-24T02:18:00.478+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:18:00.480794857Z [2024-02-24T02:18:00.480+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:18:00.480805470Z 2024-02-24T02:18:00.480809041Z 2024-02-24T02:18:00.480828295Z 2024-02-24T02:18:00.480831685Z 2024-02-24T02:18:00.487701485Z [2024-02-24T02:18:00.487+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:18:00.487986845Z [2024-02-24T02:18:00.487+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T02:18:00.488379146Z [2024-02-24T02:18:00.488+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:18:00.488602112Z [2024-02-24T02:18:00.488+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:18:00.489009830Z [2024-02-24T02:18:00.488+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:18:00.489312032Z [2024-02-24T02:18:00.489+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:18:00.489798596Z [2024-02-24T02:18:00.489+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:18:00.490074872Z [2024-02-24T02:18:00.489+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:18:01.041444320Z [2024-02-24T02:18:01.040+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:16:00+00:00 exited with status queued for try_number 1 2024-02-24T02:18:01.041614095Z [2024-02-24T02:18:01.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:17:00+00:00 exited with status queued for try_number 1 2024-02-24T02:18:01.041811315Z [2024-02-24T02:18:01.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:17:00+00:00 exited with status queued for try_number 1 2024-02-24T02:18:01.042032684Z [2024-02-24T02:18:01.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:17:00+00:00 exited with status queued for try_number 1 2024-02-24T02:18:01.059326146Z [2024-02-24T02:18:01.058+0000] {scheduler_job.py:635} INFO - Setting external_id for to 871f027b-5463-4f75-ab73-dfe65c0bc75d 2024-02-24T02:18:01.059472250Z [2024-02-24T02:18:01.059+0000] {scheduler_job.py:635} INFO - Setting external_id for to 556bfa78-e975-414e-8369-0d1edc109160 2024-02-24T02:18:01.059649851Z [2024-02-24T02:18:01.059+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f98c290-3f09-4cd9-b32c-5c5e13b5552f 2024-02-24T02:18:01.066155729Z [2024-02-24T02:18:01.059+0000] {scheduler_job.py:635} INFO - Setting external_id for to d31af14d-5a53-499f-a9ac-cad494d4bf8f 2024-02-24T02:18:02.295901419Z [2024-02-24T02:18:02.295+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:18:02.296383081Z [2024-02-24T02:18:02.296+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 02:16:00+00:00, run_id=scheduled__2024-02-24T02:16:00+00:00, run_start_date=2024-02-24 02:18:00.378945+00:00, run_end_date=2024-02-24 02:18:02.296000+00:00, run_duration=1.917055, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:16:00+00:00, data_interval_end=2024-02-24 02:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T02:18:02.305662253Z [2024-02-24T02:18:02.305+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T02:18:00+00:00, run_after=2024-02-24T02:20:00+00:00 2024-02-24T02:18:02.314004623Z [2024-02-24T02:18:02.313+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:18:02.314510903Z [2024-02-24T02:18:02.314+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:17:00+00:00, run_id=scheduled__2024-02-24T02:17:00+00:00, run_start_date=2024-02-24 02:18:00.380138+00:00, run_end_date=2024-02-24 02:18:02.313892+00:00, run_duration=1.933754, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:17:00+00:00, data_interval_end=2024-02-24 02:18:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:18:02.325327114Z [2024-02-24T02:18:02.324+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:18:00+00:00, run_after=2024-02-24T02:19:00+00:00 2024-02-24T02:18:02.441267926Z [2024-02-24T02:18:02.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:16:00+00:00 exited with status success for try_number 1 2024-02-24T02:18:02.441505901Z [2024-02-24T02:18:02.441+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:17:00+00:00 exited with status success for try_number 1 2024-02-24T02:18:02.448668239Z [2024-02-24T02:18:02.448+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T02:16:00+00:00, map_index=-1, run_start_date=2024-02-24 02:18:01.355283+00:00, run_end_date=2024-02-24 02:18:01.748855+00:00, run_duration=0.393572, state=success, executor_state=success, try_number=1, max_tries=1, job_id=734, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:18:00.482953+00:00, queued_by_job_id=2, pid=10736 2024-02-24T02:18:02.449052064Z [2024-02-24T02:18:02.448+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:17:00+00:00, map_index=-1, run_start_date=2024-02-24 02:18:01.400755+00:00, run_end_date=2024-02-24 02:18:01.777887+00:00, run_duration=0.377132, state=success, executor_state=success, try_number=1, max_tries=1, job_id=735, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:18:00.482953+00:00, queued_by_job_id=2, pid=10737 2024-02-24T02:18:04.914961325Z [2024-02-24T02:18:04.914+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:18:04.915188104Z [2024-02-24T02:18:04.914+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:17:00+00:00, run_id=scheduled__2024-02-24T02:17:00+00:00, run_start_date=2024-02-24 02:18:00.381302+00:00, run_end_date=2024-02-24 02:18:04.914822+00:00, run_duration=4.53352, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:17:00+00:00, data_interval_end=2024-02-24 02:18:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:18:04.924531089Z [2024-02-24T02:18:04.923+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:18:00+00:00, run_after=2024-02-24T02:19:00+00:00 2024-02-24T02:18:04.976641980Z [2024-02-24T02:18:04.976+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:17:00+00:00 exited with status success for try_number 1 2024-02-24T02:18:04.981728669Z [2024-02-24T02:18:04.981+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:17:00+00:00, map_index=-1, run_start_date=2024-02-24 02:18:02.609377+00:00, run_end_date=2024-02-24 02:18:04.117194+00:00, run_duration=1.507817, state=success, executor_state=success, try_number=1, max_tries=1, job_id=737, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:18:00.482953+00:00, queued_by_job_id=2, pid=10761 2024-02-24T02:18:05.528080187Z [2024-02-24T02:18:05.527+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:18:05.528382271Z [2024-02-24T02:18:05.528+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:17:00+00:00, run_id=scheduled__2024-02-24T02:17:00+00:00, run_start_date=2024-02-24 02:18:00.382451+00:00, run_end_date=2024-02-24 02:18:05.528072+00:00, run_duration=5.145621, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:17:00+00:00, data_interval_end=2024-02-24 02:18:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:18:05.538447841Z [2024-02-24T02:18:05.538+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:18:00+00:00, run_after=2024-02-24T02:19:00+00:00 2024-02-24T02:18:05.588591692Z [2024-02-24T02:18:05.588+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:17:00+00:00 exited with status success for try_number 1 2024-02-24T02:18:05.596314954Z [2024-02-24T02:18:05.594+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:17:00+00:00, map_index=-1, run_start_date=2024-02-24 02:18:02.601644+00:00, run_end_date=2024-02-24 02:18:04.952296+00:00, run_duration=2.350652, state=success, executor_state=success, try_number=1, max_tries=1, job_id=736, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:18:00.482953+00:00, queued_by_job_id=2, pid=10760 2024-02-24T02:19:00.715335789Z [2024-02-24T02:19:00.714+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:19:00.727828782Z [2024-02-24T02:19:00.727+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:19:00+00:00, run_after=2024-02-24T02:20:00+00:00 2024-02-24T02:19:00.747010109Z [2024-02-24T02:19:00.746+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:19:00+00:00, run_after=2024-02-24T02:20:00+00:00 2024-02-24T02:19:00.836646639Z [2024-02-24T02:19:00.836+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T02:19:00.836678655Z 2024-02-24T02:19:00.836683422Z 2024-02-24T02:19:00.836687673Z 2024-02-24T02:19:00.836770167Z [2024-02-24T02:19:00.836+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:19:00.837058671Z [2024-02-24T02:19:00.836+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:19:00.837242596Z [2024-02-24T02:19:00.837+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:19:00.838176792Z [2024-02-24T02:19:00.837+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:19:00.838195914Z 2024-02-24T02:19:00.838201033Z 2024-02-24T02:19:00.838205436Z 2024-02-24T02:19:00.842664578Z [2024-02-24T02:19:00.842+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:19:00.842913929Z [2024-02-24T02:19:00.842+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:19:00.843233934Z [2024-02-24T02:19:00.843+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:19:00.843398402Z [2024-02-24T02:19:00.843+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:19:00.843963808Z [2024-02-24T02:19:00.843+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:19:00.844211893Z [2024-02-24T02:19:00.843+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:19:01.179838676Z [2024-02-24T02:19:01.178+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:18:00+00:00 exited with status queued for try_number 1 2024-02-24T02:19:01.181190534Z [2024-02-24T02:19:01.179+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:18:00+00:00 exited with status queued for try_number 1 2024-02-24T02:19:01.181342793Z [2024-02-24T02:19:01.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:18:00+00:00 exited with status queued for try_number 1 2024-02-24T02:19:01.197991393Z [2024-02-24T02:19:01.197+0000] {scheduler_job.py:635} INFO - Setting external_id for to 50dd0824-9f76-4621-b7e9-0591081dd1c6 2024-02-24T02:19:01.199911785Z [2024-02-24T02:19:01.197+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8404a647-3892-493d-a741-45d5b1562d75 2024-02-24T02:19:01.200214908Z [2024-02-24T02:19:01.200+0000] {scheduler_job.py:635} INFO - Setting external_id for to 313384c0-f146-4f8d-8747-067c70b74de4 2024-02-24T02:19:02.515428623Z [2024-02-24T02:19:02.514+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:19:02.515649312Z [2024-02-24T02:19:02.515+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:18:00+00:00, run_id=scheduled__2024-02-24T02:18:00+00:00, run_start_date=2024-02-24 02:19:00.758468+00:00, run_end_date=2024-02-24 02:19:02.515252+00:00, run_duration=1.756784, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:18:00+00:00, data_interval_end=2024-02-24 02:19:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:19:02.528959038Z [2024-02-24T02:19:02.528+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:19:00+00:00, run_after=2024-02-24T02:20:00+00:00 2024-02-24T02:19:02.607156069Z [2024-02-24T02:19:02.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:18:00+00:00 exited with status success for try_number 1 2024-02-24T02:19:02.620130011Z [2024-02-24T02:19:02.619+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:18:00+00:00, map_index=-1, run_start_date=2024-02-24 02:19:01.787249+00:00, run_end_date=2024-02-24 02:19:02.126129+00:00, run_duration=0.33888, state=success, executor_state=success, try_number=1, max_tries=1, job_id=738, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:19:00.839237+00:00, queued_by_job_id=2, pid=10792 2024-02-24T02:19:04.776481847Z [2024-02-24T02:19:04.775+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:19:04.777071550Z [2024-02-24T02:19:04.776+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:18:00+00:00, run_id=scheduled__2024-02-24T02:18:00+00:00, run_start_date=2024-02-24 02:19:00.760059+00:00, run_end_date=2024-02-24 02:19:04.776544+00:00, run_duration=4.016485, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:18:00+00:00, data_interval_end=2024-02-24 02:19:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:19:04.793628921Z [2024-02-24T02:19:04.792+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:19:00+00:00, run_after=2024-02-24T02:20:00+00:00 2024-02-24T02:19:04.849934041Z [2024-02-24T02:19:04.849+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:18:00+00:00 exited with status success for try_number 1 2024-02-24T02:19:04.859264693Z [2024-02-24T02:19:04.858+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:18:00+00:00, map_index=-1, run_start_date=2024-02-24 02:19:02.739238+00:00, run_end_date=2024-02-24 02:19:04.341530+00:00, run_duration=1.602292, state=success, executor_state=success, try_number=1, max_tries=1, job_id=739, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:19:00.839237+00:00, queued_by_job_id=2, pid=10810 2024-02-24T02:19:05.836809567Z [2024-02-24T02:19:05.836+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:19:05.837403925Z [2024-02-24T02:19:05.837+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:18:00+00:00, run_id=scheduled__2024-02-24T02:18:00+00:00, run_start_date=2024-02-24 02:19:00.761150+00:00, run_end_date=2024-02-24 02:19:05.836987+00:00, run_duration=5.075837, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:18:00+00:00, data_interval_end=2024-02-24 02:19:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:19:05.857582399Z [2024-02-24T02:19:05.857+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:19:00+00:00, run_after=2024-02-24T02:20:00+00:00 2024-02-24T02:19:05.899222864Z [2024-02-24T02:19:05.898+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:18:00+00:00 exited with status success for try_number 1 2024-02-24T02:19:05.906684970Z [2024-02-24T02:19:05.906+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:18:00+00:00, map_index=-1, run_start_date=2024-02-24 02:19:02.842297+00:00, run_end_date=2024-02-24 02:19:05.491131+00:00, run_duration=2.648834, state=success, executor_state=success, try_number=1, max_tries=1, job_id=740, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:19:00.839237+00:00, queued_by_job_id=2, pid=10811 2024-02-24T02:20:00.107001574Z [2024-02-24T02:20:00.106+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:20:00+00:00, run_after=2024-02-24T02:25:00+00:00 2024-02-24T02:20:00.112919014Z [2024-02-24T02:20:00.112+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:20:00.123054411Z [2024-02-24T02:20:00.122+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:20:00+00:00, run_after=2024-02-24T02:21:00+00:00 2024-02-24T02:20:00.142292813Z [2024-02-24T02:20:00.141+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:20:00+00:00, run_after=2024-02-24T02:21:00+00:00 2024-02-24T02:20:00.150025919Z [2024-02-24T02:20:00.149+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:20:00.268116944Z [2024-02-24T02:20:00.267+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-02-24T02:20:00.268142312Z 2024-02-24T02:20:00.268146019Z 2024-02-24T02:20:00.268149600Z 2024-02-24T02:20:00.268152858Z 2024-02-24T02:20:00.268156206Z 2024-02-24T02:20:00.268367658Z [2024-02-24T02:20:00.268+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:20:00.268580138Z [2024-02-24T02:20:00.268+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T02:20:00.268786430Z [2024-02-24T02:20:00.268+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:20:00.269062597Z [2024-02-24T02:20:00.268+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:20:00.269266548Z [2024-02-24T02:20:00.269+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:20:00.270196627Z [2024-02-24T02:20:00.269+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:20:00.270208160Z 2024-02-24T02:20:00.270213287Z 2024-02-24T02:20:00.270218075Z 2024-02-24T02:20:00.270222999Z 2024-02-24T02:20:00.270227212Z 2024-02-24T02:20:00.275048004Z [2024-02-24T02:20:00.274+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T02:20:00.275198661Z [2024-02-24T02:20:00.274+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:20:00.275502619Z [2024-02-24T02:20:00.275+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:20:00.275758480Z [2024-02-24T02:20:00.275+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T02:20:00.276057567Z [2024-02-24T02:20:00.275+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:20:00.276245278Z [2024-02-24T02:20:00.276+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:20:00.276572409Z [2024-02-24T02:20:00.276+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:20:00.276802512Z [2024-02-24T02:20:00.276+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:20:00.277131072Z [2024-02-24T02:20:00.276+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:20:00.277399896Z [2024-02-24T02:20:00.277+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:20:00.837932074Z [2024-02-24T02:20:00.831+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T02:15:00+00:00 exited with status queued for try_number 1 2024-02-24T02:20:00.837961959Z [2024-02-24T02:20:00.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:18:00+00:00 exited with status queued for try_number 1 2024-02-24T02:20:00.837967153Z [2024-02-24T02:20:00.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:19:00+00:00 exited with status queued for try_number 1 2024-02-24T02:20:00.837970707Z [2024-02-24T02:20:00.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:19:00+00:00 exited with status queued for try_number 1 2024-02-24T02:20:00.837974115Z [2024-02-24T02:20:00.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:19:00+00:00 exited with status queued for try_number 1 2024-02-24T02:20:00.857758234Z [2024-02-24T02:20:00.857+0000] {scheduler_job.py:635} INFO - Setting external_id for to e61e50e9-a68f-482e-b6ca-819f595303d4 2024-02-24T02:20:00.857879449Z [2024-02-24T02:20:00.857+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e7580e2-60d3-4f0e-a134-e3bac449d7d3 2024-02-24T02:20:00.858062528Z [2024-02-24T02:20:00.857+0000] {scheduler_job.py:635} INFO - Setting external_id for to d9af133a-3a21-411a-81b4-1010d581ff00 2024-02-24T02:20:00.858289523Z [2024-02-24T02:20:00.858+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad8f39c7-fa62-44a8-ba18-51aaaa8509af 2024-02-24T02:20:00.858452320Z [2024-02-24T02:20:00.858+0000] {scheduler_job.py:635} INFO - Setting external_id for to c161c877-f11c-4a76-9ee9-fd2ed818603f 2024-02-24T02:20:02.184673711Z [2024-02-24T02:20:02.184+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:20:02.184860596Z [2024-02-24T02:20:02.184+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:19:00+00:00, run_id=scheduled__2024-02-24T02:19:00+00:00, run_start_date=2024-02-24 02:20:00.173708+00:00, run_end_date=2024-02-24 02:20:02.184524+00:00, run_duration=2.010816, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:19:00+00:00, data_interval_end=2024-02-24 02:20:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:20:02.199978102Z [2024-02-24T02:20:02.199+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:20:00+00:00, run_after=2024-02-24T02:21:00+00:00 2024-02-24T02:20:02.307857828Z [2024-02-24T02:20:02.307+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:19:00+00:00 exited with status success for try_number 1 2024-02-24T02:20:02.324102548Z [2024-02-24T02:20:02.322+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:19:00+00:00, map_index=-1, run_start_date=2024-02-24 02:20:01.319571+00:00, run_end_date=2024-02-24 02:20:01.935205+00:00, run_duration=0.615634, state=success, executor_state=success, try_number=1, max_tries=1, job_id=741, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:20:00.271616+00:00, queued_by_job_id=2, pid=10845 2024-02-24T02:20:03.383374279Z [2024-02-24T02:20:03.382+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:20:03.383868814Z [2024-02-24T02:20:03.383+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 02:18:00+00:00, run_id=scheduled__2024-02-24T02:18:00+00:00, run_start_date=2024-02-24 02:20:00.171644+00:00, run_end_date=2024-02-24 02:20:03.383354+00:00, run_duration=3.21171, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:18:00+00:00, data_interval_end=2024-02-24 02:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T02:20:03.394151818Z [2024-02-24T02:20:03.393+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T02:20:00+00:00, run_after=2024-02-24T02:22:00+00:00 2024-02-24T02:20:03.482034694Z [2024-02-24T02:20:03.477+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:20:03.482085536Z 2024-02-24T02:20:03.482227937Z [2024-02-24T02:20:03.482+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:20:03.486705282Z [2024-02-24T02:20:03.486+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:20:03.486733434Z 2024-02-24T02:20:03.490424106Z [2024-02-24T02:20:03.490+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T02:20:03.490581324Z [2024-02-24T02:20:03.490+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:20:03.574215451Z [2024-02-24T02:20:03.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T02:15:00+00:00 exited with status queued for try_number 1 2024-02-24T02:20:03.574542761Z [2024-02-24T02:20:03.574+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T02:15:00+00:00 exited with status success for try_number 1 2024-02-24T02:20:03.574766452Z [2024-02-24T02:20:03.574+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:18:00+00:00 exited with status success for try_number 1 2024-02-24T02:20:03.588436407Z [2024-02-24T02:20:03.587+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T02:18:00+00:00, map_index=-1, run_start_date=2024-02-24 02:20:01.717953+00:00, run_end_date=2024-02-24 02:20:02.237438+00:00, run_duration=0.519485, state=success, executor_state=success, try_number=1, max_tries=1, job_id=742, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:20:00.271616+00:00, queued_by_job_id=2, pid=10848 2024-02-24T02:20:03.589412717Z [2024-02-24T02:20:03.589+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T02:15:00+00:00, map_index=-1, run_start_date=2024-02-24 02:20:02.785442+00:00, run_end_date=2024-02-24 02:20:03.324146+00:00, run_duration=0.538704, state=success, executor_state=success, try_number=1, max_tries=1, job_id=744, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:20:00.271616+00:00, queued_by_job_id=2, pid=10876 2024-02-24T02:20:03.589862291Z [2024-02-24T02:20:03.589+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6a81cc76-ba0c-4ec2-b760-396cb77c3dc3 2024-02-24T02:20:05.690493752Z [2024-02-24T02:20:05.690+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:20:05.690643587Z [2024-02-24T02:20:05.690+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:19:00+00:00, run_id=scheduled__2024-02-24T02:19:00+00:00, run_start_date=2024-02-24 02:20:00.175493+00:00, run_end_date=2024-02-24 02:20:05.690329+00:00, run_duration=5.514836, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:19:00+00:00, data_interval_end=2024-02-24 02:20:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:20:05.699869184Z [2024-02-24T02:20:05.699+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:20:00+00:00, run_after=2024-02-24T02:21:00+00:00 2024-02-24T02:20:05.707801330Z [2024-02-24T02:20:05.707+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:20:05.707957912Z [2024-02-24T02:20:05.707+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:19:00+00:00, run_id=scheduled__2024-02-24T02:19:00+00:00, run_start_date=2024-02-24 02:20:00.177458+00:00, run_end_date=2024-02-24 02:20:05.707670+00:00, run_duration=5.530212, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:19:00+00:00, data_interval_end=2024-02-24 02:20:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:20:05.718677735Z [2024-02-24T02:20:05.718+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:20:00+00:00, run_after=2024-02-24T02:21:00+00:00 2024-02-24T02:20:05.795124689Z [2024-02-24T02:20:05.794+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:20:05.795210039Z 2024-02-24T02:20:05.795419708Z [2024-02-24T02:20:05.795+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:20:05.796278149Z [2024-02-24T02:20:05.796+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:20:05.796288561Z 2024-02-24T02:20:05.800415624Z [2024-02-24T02:20:05.799+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T02:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T02:20:05.800586740Z [2024-02-24T02:20:05.800+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T02:20:05.882733827Z [2024-02-24T02:20:05.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T02:15:00+00:00 exited with status queued for try_number 1 2024-02-24T02:20:05.883103917Z [2024-02-24T02:20:05.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:19:00+00:00 exited with status success for try_number 1 2024-02-24T02:20:05.883351800Z [2024-02-24T02:20:05.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:19:00+00:00 exited with status success for try_number 1 2024-02-24T02:20:05.883580763Z [2024-02-24T02:20:05.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T02:15:00+00:00 exited with status success for try_number 1 2024-02-24T02:20:05.892456678Z [2024-02-24T02:20:05.892+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:19:00+00:00, map_index=-1, run_start_date=2024-02-24 02:20:02.552501+00:00, run_end_date=2024-02-24 02:20:04.641753+00:00, run_duration=2.089252, state=success, executor_state=success, try_number=1, max_tries=1, job_id=743, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:20:00.271616+00:00, queued_by_job_id=2, pid=10870 2024-02-24T02:20:05.892867661Z [2024-02-24T02:20:05.892+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:19:00+00:00, map_index=-1, run_start_date=2024-02-24 02:20:03.134195+00:00, run_end_date=2024-02-24 02:20:04.997336+00:00, run_duration=1.863141, state=success, executor_state=success, try_number=1, max_tries=1, job_id=745, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:20:00.271616+00:00, queued_by_job_id=2, pid=10882 2024-02-24T02:20:05.893364377Z [2024-02-24T02:20:05.893+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T02:15:00+00:00, map_index=-1, run_start_date=2024-02-24 02:20:05.297679+00:00, run_end_date=2024-02-24 02:20:05.687372+00:00, run_duration=0.389693, state=success, executor_state=success, try_number=1, max_tries=1, job_id=746, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:20:03.487216+00:00, queued_by_job_id=2, pid=10900 2024-02-24T02:20:05.893650152Z [2024-02-24T02:20:05.893+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6d8a33f2-b45d-4964-8925-356ff92c1e6b 2024-02-24T02:20:08.375993710Z [2024-02-24T02:20:08.375+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:20:08.376089225Z 2024-02-24T02:20:08.376190093Z [2024-02-24T02:20:08.375+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:20:08.376985237Z [2024-02-24T02:20:08.376+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:20:08.377017021Z 2024-02-24T02:20:08.380964508Z [2024-02-24T02:20:08.380+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:20:08.381246543Z [2024-02-24T02:20:08.380+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:20:08.496977407Z [2024-02-24T02:20:08.496+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T02:15:00+00:00 exited with status queued for try_number 1 2024-02-24T02:20:08.497007797Z [2024-02-24T02:20:08.496+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T02:15:00+00:00 exited with status success for try_number 1 2024-02-24T02:20:08.522301967Z [2024-02-24T02:20:08.520+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e421c73-4fb4-40bc-b8e0-fde48fce68a0 2024-02-24T02:20:08.522633029Z [2024-02-24T02:20:08.520+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T02:15:00+00:00, map_index=0, run_start_date=2024-02-24 02:20:07.370903+00:00, run_end_date=2024-02-24 02:20:07.714758+00:00, run_duration=0.343855, state=success, executor_state=success, try_number=1, max_tries=1, job_id=747, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:20:05.796755+00:00, queued_by_job_id=2, pid=10908 2024-02-24T02:20:10.758943278Z [2024-02-24T02:20:10.758+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:20:10.759313534Z [2024-02-24T02:20:10.759+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:15:00+00:00, run_id=scheduled__2024-02-24T02:15:00+00:00, run_start_date=2024-02-24 02:20:00.169032+00:00, run_end_date=2024-02-24 02:20:10.758884+00:00, run_duration=10.589852, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:15:00+00:00, data_interval_end=2024-02-24 02:20:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T02:20:10.767804781Z [2024-02-24T02:20:10.767+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:20:00+00:00, run_after=2024-02-24T02:25:00+00:00 2024-02-24T02:20:10.948066654Z [2024-02-24T02:20:10.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T02:15:00+00:00 exited with status success for try_number 1 2024-02-24T02:20:10.954769284Z [2024-02-24T02:20:10.954+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T02:15:00+00:00, map_index=-1, run_start_date=2024-02-24 02:20:10.331963+00:00, run_end_date=2024-02-24 02:20:10.742740+00:00, run_duration=0.410777, state=success, executor_state=success, try_number=1, max_tries=1, job_id=748, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:20:08.377673+00:00, queued_by_job_id=2, pid=10916 2024-02-24T02:21:00.472870248Z [2024-02-24T02:21:00.472+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:21:00+00:00, run_after=2024-02-24T02:22:00+00:00 2024-02-24T02:21:00.483427838Z [2024-02-24T02:21:00.483+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:21:00.498026211Z [2024-02-24T02:21:00.497+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:21:00+00:00, run_after=2024-02-24T02:22:00+00:00 2024-02-24T02:21:00.586318478Z [2024-02-24T02:21:00.585+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T02:21:00.586366087Z 2024-02-24T02:21:00.586372631Z 2024-02-24T02:21:00.586378447Z 2024-02-24T02:21:00.586696858Z [2024-02-24T02:21:00.586+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:21:00.587082982Z [2024-02-24T02:21:00.586+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:21:00.587426469Z [2024-02-24T02:21:00.587+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:21:00.588631531Z [2024-02-24T02:21:00.588+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:21:00.588650774Z 2024-02-24T02:21:00.588658294Z 2024-02-24T02:21:00.588665451Z 2024-02-24T02:21:00.598816879Z [2024-02-24T02:21:00.598+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:21:00.598966421Z [2024-02-24T02:21:00.598+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:21:00.599204611Z [2024-02-24T02:21:00.599+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:21:00.599279357Z [2024-02-24T02:21:00.599+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:21:00.599446651Z [2024-02-24T02:21:00.599+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:21:00.599464310Z [2024-02-24T02:21:00.599+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:21:00.823177573Z [2024-02-24T02:21:00.822+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:20:00+00:00 exited with status queued for try_number 1 2024-02-24T02:21:00.823336914Z [2024-02-24T02:21:00.823+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:20:00+00:00 exited with status queued for try_number 1 2024-02-24T02:21:00.823507998Z [2024-02-24T02:21:00.823+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:20:00+00:00 exited with status queued for try_number 1 2024-02-24T02:21:00.834129610Z [2024-02-24T02:21:00.833+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71676d3a-9167-4d56-9a2f-8d2ade159a21 2024-02-24T02:21:00.834213018Z [2024-02-24T02:21:00.834+0000] {scheduler_job.py:635} INFO - Setting external_id for to 886181ef-69c1-4237-80e2-c7b7599be5d4 2024-02-24T02:21:00.834321650Z [2024-02-24T02:21:00.834+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6d06f0c7-e70f-4bd3-ac43-27c4d25ddd27 2024-02-24T02:21:02.414517484Z [2024-02-24T02:21:02.413+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:21:02.414553693Z [2024-02-24T02:21:02.413+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:20:00+00:00, run_id=scheduled__2024-02-24T02:20:00+00:00, run_start_date=2024-02-24 02:21:00.511644+00:00, run_end_date=2024-02-24 02:21:02.413845+00:00, run_duration=1.902201, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:20:00+00:00, data_interval_end=2024-02-24 02:21:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:21:02.429001592Z [2024-02-24T02:21:02.428+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:21:00+00:00, run_after=2024-02-24T02:22:00+00:00 2024-02-24T02:21:02.485844559Z [2024-02-24T02:21:02.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:20:00+00:00 exited with status success for try_number 1 2024-02-24T02:21:02.492062315Z [2024-02-24T02:21:02.491+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:20:00+00:00, map_index=-1, run_start_date=2024-02-24 02:21:01.463375+00:00, run_end_date=2024-02-24 02:21:01.857299+00:00, run_duration=0.393924, state=success, executor_state=success, try_number=1, max_tries=1, job_id=749, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:21:00.590099+00:00, queued_by_job_id=2, pid=10939 2024-02-24T02:21:04.633636959Z [2024-02-24T02:21:04.633+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:21:04.634151851Z [2024-02-24T02:21:04.633+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:20:00+00:00, run_id=scheduled__2024-02-24T02:20:00+00:00, run_start_date=2024-02-24 02:21:00.514252+00:00, run_end_date=2024-02-24 02:21:04.633598+00:00, run_duration=4.119346, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:20:00+00:00, data_interval_end=2024-02-24 02:21:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:21:04.646215041Z [2024-02-24T02:21:04.645+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:21:00+00:00, run_after=2024-02-24T02:22:00+00:00 2024-02-24T02:21:04.653232573Z [2024-02-24T02:21:04.652+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:21:04.653476542Z [2024-02-24T02:21:04.653+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:20:00+00:00, run_id=scheduled__2024-02-24T02:20:00+00:00, run_start_date=2024-02-24 02:21:00.513050+00:00, run_end_date=2024-02-24 02:21:04.653181+00:00, run_duration=4.140131, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:20:00+00:00, data_interval_end=2024-02-24 02:21:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:21:04.663162938Z [2024-02-24T02:21:04.662+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:21:00+00:00, run_after=2024-02-24T02:22:00+00:00 2024-02-24T02:21:04.703628643Z [2024-02-24T02:21:04.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:20:00+00:00 exited with status success for try_number 1 2024-02-24T02:21:04.703909772Z [2024-02-24T02:21:04.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:20:00+00:00 exited with status success for try_number 1 2024-02-24T02:21:04.713554886Z [2024-02-24T02:21:04.713+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:20:00+00:00, map_index=-1, run_start_date=2024-02-24 02:21:02.730485+00:00, run_end_date=2024-02-24 02:21:04.360231+00:00, run_duration=1.629746, state=success, executor_state=success, try_number=1, max_tries=1, job_id=751, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:21:00.590099+00:00, queued_by_job_id=2, pid=10958 2024-02-24T02:21:04.714051488Z [2024-02-24T02:21:04.713+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:20:00+00:00, map_index=-1, run_start_date=2024-02-24 02:21:02.458878+00:00, run_end_date=2024-02-24 02:21:04.389007+00:00, run_duration=1.930129, state=success, executor_state=success, try_number=1, max_tries=1, job_id=750, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:21:00.590099+00:00, queued_by_job_id=2, pid=10956 2024-02-24T02:22:01.006107213Z [2024-02-24T02:22:01.005+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:22:00+00:00, run_after=2024-02-24T02:23:00+00:00 2024-02-24T02:22:01.017093849Z [2024-02-24T02:22:01.016+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:22:01.027223644Z [2024-02-24T02:22:01.026+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:22:01.043151541Z [2024-02-24T02:22:01.042+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:22:00+00:00, run_after=2024-02-24T02:23:00+00:00 2024-02-24T02:22:01.152750814Z [2024-02-24T02:22:01.152+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T02:22:01.152783727Z 2024-02-24T02:22:01.152797247Z 2024-02-24T02:22:01.152802442Z 2024-02-24T02:22:01.152807014Z 2024-02-24T02:22:01.153168629Z [2024-02-24T02:22:01.152+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T02:22:01.153401686Z [2024-02-24T02:22:01.153+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:22:01.153611064Z [2024-02-24T02:22:01.153+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:22:01.153828801Z [2024-02-24T02:22:01.153+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:22:01.154970897Z [2024-02-24T02:22:01.154+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:22:01.154986653Z 2024-02-24T02:22:01.154992082Z 2024-02-24T02:22:01.154996722Z 2024-02-24T02:22:01.155001498Z 2024-02-24T02:22:01.160495232Z [2024-02-24T02:22:01.160+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:22:01.160722772Z [2024-02-24T02:22:01.160+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T02:22:01.161228687Z [2024-02-24T02:22:01.160+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:22:01.161547025Z [2024-02-24T02:22:01.161+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:22:01.162000020Z [2024-02-24T02:22:01.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:22:01.162244132Z [2024-02-24T02:22:01.162+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:22:01.162641114Z [2024-02-24T02:22:01.162+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:22:01.162916013Z [2024-02-24T02:22:01.162+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:22:01.828183771Z [2024-02-24T02:22:01.823+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:20:00+00:00 exited with status queued for try_number 1 2024-02-24T02:22:01.828293857Z [2024-02-24T02:22:01.828+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:21:00+00:00 exited with status queued for try_number 1 2024-02-24T02:22:01.828384864Z [2024-02-24T02:22:01.828+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:21:00+00:00 exited with status queued for try_number 1 2024-02-24T02:22:01.828485402Z [2024-02-24T02:22:01.828+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:21:00+00:00 exited with status queued for try_number 1 2024-02-24T02:22:01.839649131Z [2024-02-24T02:22:01.839+0000] {scheduler_job.py:635} INFO - Setting external_id for to bad3162e-bc47-4ef4-9c3a-f88019968c7e 2024-02-24T02:22:01.843557346Z [2024-02-24T02:22:01.839+0000] {scheduler_job.py:635} INFO - Setting external_id for to d820610f-bd8b-42e0-9eb8-518c31b1d9aa 2024-02-24T02:22:01.843800192Z [2024-02-24T02:22:01.843+0000] {scheduler_job.py:635} INFO - Setting external_id for to 403a7753-f069-47b3-9cd4-9df42b64d60e 2024-02-24T02:22:01.843983063Z [2024-02-24T02:22:01.843+0000] {scheduler_job.py:635} INFO - Setting external_id for to 92fbf2a1-0d0d-4fe4-abd2-d5ba0d9b852a 2024-02-24T02:22:03.143994850Z [2024-02-24T02:22:03.143+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:22:03.144707111Z [2024-02-24T02:22:03.144+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 02:20:00+00:00, run_id=scheduled__2024-02-24T02:20:00+00:00, run_start_date=2024-02-24 02:22:01.056251+00:00, run_end_date=2024-02-24 02:22:03.144173+00:00, run_duration=2.087922, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:20:00+00:00, data_interval_end=2024-02-24 02:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T02:22:03.156540659Z [2024-02-24T02:22:03.156+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T02:22:00+00:00, run_after=2024-02-24T02:24:00+00:00 2024-02-24T02:22:03.165636903Z [2024-02-24T02:22:03.165+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:22:03.166128651Z [2024-02-24T02:22:03.165+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:21:00+00:00, run_id=scheduled__2024-02-24T02:21:00+00:00, run_start_date=2024-02-24 02:22:01.058063+00:00, run_end_date=2024-02-24 02:22:03.165746+00:00, run_duration=2.107683, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:21:00+00:00, data_interval_end=2024-02-24 02:22:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:22:03.178236272Z [2024-02-24T02:22:03.177+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:22:00+00:00, run_after=2024-02-24T02:23:00+00:00 2024-02-24T02:22:03.237732171Z [2024-02-24T02:22:03.237+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:20:00+00:00 exited with status success for try_number 1 2024-02-24T02:22:03.238150431Z [2024-02-24T02:22:03.237+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:21:00+00:00 exited with status success for try_number 1 2024-02-24T02:22:03.247194776Z [2024-02-24T02:22:03.246+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:21:00+00:00, map_index=-1, run_start_date=2024-02-24 02:22:02.177428+00:00, run_end_date=2024-02-24 02:22:02.717702+00:00, run_duration=0.540274, state=success, executor_state=success, try_number=1, max_tries=1, job_id=753, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:22:01.156598+00:00, queued_by_job_id=2, pid=10992 2024-02-24T02:22:03.248038910Z [2024-02-24T02:22:03.247+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T02:20:00+00:00, map_index=-1, run_start_date=2024-02-24 02:22:02.070093+00:00, run_end_date=2024-02-24 02:22:02.531815+00:00, run_duration=0.461722, state=success, executor_state=success, try_number=1, max_tries=1, job_id=752, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:22:01.156598+00:00, queued_by_job_id=2, pid=10991 2024-02-24T02:22:04.067782993Z [2024-02-24T02:22:04.067+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T02:22:06.205227662Z [2024-02-24T02:22:06.204+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:22:06.205301973Z [2024-02-24T02:22:06.204+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:21:00+00:00, run_id=scheduled__2024-02-24T02:21:00+00:00, run_start_date=2024-02-24 02:22:01.059633+00:00, run_end_date=2024-02-24 02:22:06.204744+00:00, run_duration=5.145111, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:21:00+00:00, data_interval_end=2024-02-24 02:22:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:22:06.215860950Z [2024-02-24T02:22:06.215+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:22:00+00:00, run_after=2024-02-24T02:23:00+00:00 2024-02-24T02:22:06.273651828Z [2024-02-24T02:22:06.272+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:21:00+00:00 exited with status success for try_number 1 2024-02-24T02:22:06.283485071Z [2024-02-24T02:22:06.282+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:21:00+00:00, map_index=-1, run_start_date=2024-02-24 02:22:03.201606+00:00, run_end_date=2024-02-24 02:22:05.033694+00:00, run_duration=1.832088, state=success, executor_state=success, try_number=1, max_tries=1, job_id=754, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:22:01.156598+00:00, queued_by_job_id=2, pid=11010 2024-02-24T02:22:06.937256115Z [2024-02-24T02:22:06.936+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:22:06.937644386Z [2024-02-24T02:22:06.937+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:21:00+00:00, run_id=scheduled__2024-02-24T02:21:00+00:00, run_start_date=2024-02-24 02:22:01.061075+00:00, run_end_date=2024-02-24 02:22:06.937146+00:00, run_duration=5.876071, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:21:00+00:00, data_interval_end=2024-02-24 02:22:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:22:06.945951840Z [2024-02-24T02:22:06.945+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:22:00+00:00, run_after=2024-02-24T02:23:00+00:00 2024-02-24T02:22:06.981224569Z [2024-02-24T02:22:06.980+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:21:00+00:00 exited with status success for try_number 1 2024-02-24T02:22:06.989583045Z [2024-02-24T02:22:06.988+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:21:00+00:00, map_index=-1, run_start_date=2024-02-24 02:22:03.504924+00:00, run_end_date=2024-02-24 02:22:06.700139+00:00, run_duration=3.195215, state=success, executor_state=success, try_number=1, max_tries=1, job_id=755, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:22:01.156598+00:00, queued_by_job_id=2, pid=11021 2024-02-24T02:23:01.028462130Z [2024-02-24T02:23:01.027+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:23:00+00:00, run_after=2024-02-24T02:24:00+00:00 2024-02-24T02:23:01.050296426Z [2024-02-24T02:23:01.050+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:23:00+00:00, run_after=2024-02-24T02:24:00+00:00 2024-02-24T02:23:01.058433509Z [2024-02-24T02:23:01.058+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:23:01.160504753Z [2024-02-24T02:23:01.159+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T02:23:01.160575025Z 2024-02-24T02:23:01.160586369Z 2024-02-24T02:23:01.160595134Z 2024-02-24T02:23:01.161012980Z [2024-02-24T02:23:01.160+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:23:01.161462364Z [2024-02-24T02:23:01.161+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:23:01.161740584Z [2024-02-24T02:23:01.161+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:23:01.163184910Z [2024-02-24T02:23:01.162+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:23:01.163206983Z 2024-02-24T02:23:01.163235050Z 2024-02-24T02:23:01.163241063Z 2024-02-24T02:23:01.169603155Z [2024-02-24T02:23:01.169+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:23:01.169757953Z [2024-02-24T02:23:01.169+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:23:01.170298772Z [2024-02-24T02:23:01.170+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:23:01.170553648Z [2024-02-24T02:23:01.170+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:23:01.171458441Z [2024-02-24T02:23:01.170+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:23:01.171748523Z [2024-02-24T02:23:01.171+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:23:01.584158395Z [2024-02-24T02:23:01.583+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:22:00+00:00 exited with status queued for try_number 1 2024-02-24T02:23:01.584691044Z [2024-02-24T02:23:01.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:22:00+00:00 exited with status queued for try_number 1 2024-02-24T02:23:01.584983962Z [2024-02-24T02:23:01.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:22:00+00:00 exited with status queued for try_number 1 2024-02-24T02:23:01.597193891Z [2024-02-24T02:23:01.596+0000] {scheduler_job.py:635} INFO - Setting external_id for to 73aec779-2e5a-4d61-ae33-0e4c6bd7b2d6 2024-02-24T02:23:01.597619238Z [2024-02-24T02:23:01.597+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2aef7ccc-db63-4995-8358-3432132fc55e 2024-02-24T02:23:01.597934019Z [2024-02-24T02:23:01.597+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2cbfa4b7-2474-4e7e-b5cf-24cd6d89ec45 2024-02-24T02:23:02.913004280Z [2024-02-24T02:23:02.912+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:23:02.913207192Z [2024-02-24T02:23:02.913+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:22:00+00:00, run_id=scheduled__2024-02-24T02:22:00+00:00, run_start_date=2024-02-24 02:23:01.069417+00:00, run_end_date=2024-02-24 02:23:02.912909+00:00, run_duration=1.843492, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:22:00+00:00, data_interval_end=2024-02-24 02:23:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:23:02.935110752Z [2024-02-24T02:23:02.933+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:23:00+00:00, run_after=2024-02-24T02:24:00+00:00 2024-02-24T02:23:03.011200079Z [2024-02-24T02:23:03.010+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:22:00+00:00 exited with status success for try_number 1 2024-02-24T02:23:03.019189749Z [2024-02-24T02:23:03.018+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:22:00+00:00, map_index=-1, run_start_date=2024-02-24 02:23:02.266226+00:00, run_end_date=2024-02-24 02:23:02.774593+00:00, run_duration=0.508367, state=success, executor_state=success, try_number=1, max_tries=1, job_id=756, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:23:01.164835+00:00, queued_by_job_id=2, pid=11050 2024-02-24T02:23:05.199141498Z [2024-02-24T02:23:05.198+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:23:05.199403701Z [2024-02-24T02:23:05.199+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:22:00+00:00, run_id=scheduled__2024-02-24T02:22:00+00:00, run_start_date=2024-02-24 02:23:01.071202+00:00, run_end_date=2024-02-24 02:23:05.198988+00:00, run_duration=4.127786, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:22:00+00:00, data_interval_end=2024-02-24 02:23:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:23:05.210254619Z [2024-02-24T02:23:05.209+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:23:00+00:00, run_after=2024-02-24T02:24:00+00:00 2024-02-24T02:23:05.262949387Z [2024-02-24T02:23:05.262+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:22:00+00:00 exited with status success for try_number 1 2024-02-24T02:23:05.272344193Z [2024-02-24T02:23:05.271+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:22:00+00:00, map_index=-1, run_start_date=2024-02-24 02:23:03.021866+00:00, run_end_date=2024-02-24 02:23:04.610344+00:00, run_duration=1.588478, state=success, executor_state=success, try_number=1, max_tries=1, job_id=757, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:23:01.164835+00:00, queued_by_job_id=2, pid=11067 2024-02-24T02:23:06.333167815Z [2024-02-24T02:23:06.332+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:23:06.333607451Z [2024-02-24T02:23:06.333+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:22:00+00:00, run_id=scheduled__2024-02-24T02:22:00+00:00, run_start_date=2024-02-24 02:23:01.072439+00:00, run_end_date=2024-02-24 02:23:06.332959+00:00, run_duration=5.26052, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:22:00+00:00, data_interval_end=2024-02-24 02:23:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:23:06.346847030Z [2024-02-24T02:23:06.346+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:23:00+00:00, run_after=2024-02-24T02:24:00+00:00 2024-02-24T02:23:06.394424923Z [2024-02-24T02:23:06.393+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:22:00+00:00 exited with status success for try_number 1 2024-02-24T02:23:06.403067020Z [2024-02-24T02:23:06.402+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:22:00+00:00, map_index=-1, run_start_date=2024-02-24 02:23:03.207959+00:00, run_end_date=2024-02-24 02:23:05.614178+00:00, run_duration=2.406219, state=success, executor_state=success, try_number=1, max_tries=1, job_id=758, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:23:01.164835+00:00, queued_by_job_id=2, pid=11068 2024-02-24T02:24:00.964605656Z [2024-02-24T02:24:00.963+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:24:00+00:00, run_after=2024-02-24T02:25:00+00:00 2024-02-24T02:24:00.974012770Z [2024-02-24T02:24:00.973+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:24:00.983328479Z [2024-02-24T02:24:00.982+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:24:01.004325015Z [2024-02-24T02:24:01.003+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:24:00+00:00, run_after=2024-02-24T02:25:00+00:00 2024-02-24T02:24:01.088358144Z [2024-02-24T02:24:01.087+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T02:24:01.088391597Z 2024-02-24T02:24:01.088424575Z 2024-02-24T02:24:01.088437527Z 2024-02-24T02:24:01.088446816Z 2024-02-24T02:24:01.088527332Z [2024-02-24T02:24:01.088+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T02:24:01.089018668Z [2024-02-24T02:24:01.088+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:24:01.089122372Z [2024-02-24T02:24:01.088+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:24:01.089377549Z [2024-02-24T02:24:01.089+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:24:01.090700306Z [2024-02-24T02:24:01.090+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:24:01.090724702Z 2024-02-24T02:24:01.090756691Z 2024-02-24T02:24:01.090763575Z 2024-02-24T02:24:01.090769655Z 2024-02-24T02:24:01.096734373Z [2024-02-24T02:24:01.096+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:24:01.097079705Z [2024-02-24T02:24:01.096+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T02:24:01.097657235Z [2024-02-24T02:24:01.097+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:24:01.098122741Z [2024-02-24T02:24:01.097+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:24:01.098681630Z [2024-02-24T02:24:01.098+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:24:01.098938039Z [2024-02-24T02:24:01.098+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:24:01.099254582Z [2024-02-24T02:24:01.099+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:24:01.099343895Z [2024-02-24T02:24:01.099+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:24:01.427240842Z [2024-02-24T02:24:01.426+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:22:00+00:00 exited with status queued for try_number 1 2024-02-24T02:24:01.427651040Z [2024-02-24T02:24:01.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:23:00+00:00 exited with status queued for try_number 1 2024-02-24T02:24:01.427905646Z [2024-02-24T02:24:01.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:23:00+00:00 exited with status queued for try_number 1 2024-02-24T02:24:01.428176030Z [2024-02-24T02:24:01.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:23:00+00:00 exited with status queued for try_number 1 2024-02-24T02:24:01.438774784Z [2024-02-24T02:24:01.438+0000] {scheduler_job.py:635} INFO - Setting external_id for to a0aba9e3-8b88-43d8-b915-780fa5133f8b 2024-02-24T02:24:01.439094018Z [2024-02-24T02:24:01.438+0000] {scheduler_job.py:635} INFO - Setting external_id for to d04d93a8-f8fa-40ed-bbd4-51839218cd2a 2024-02-24T02:24:01.439329269Z [2024-02-24T02:24:01.439+0000] {scheduler_job.py:635} INFO - Setting external_id for to b7d57b0c-d091-4753-b9c9-cd8cb9df75e5 2024-02-24T02:24:01.439539213Z [2024-02-24T02:24:01.439+0000] {scheduler_job.py:635} INFO - Setting external_id for to 636c78b5-0445-435e-a3e0-8c63f6d0aa9f 2024-02-24T02:24:02.696813460Z [2024-02-24T02:24:02.684+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:24:02.696838627Z [2024-02-24T02:24:02.687+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 02:22:00+00:00, run_id=scheduled__2024-02-24T02:22:00+00:00, run_start_date=2024-02-24 02:24:01.019479+00:00, run_end_date=2024-02-24 02:24:02.687217+00:00, run_duration=1.667738, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:22:00+00:00, data_interval_end=2024-02-24 02:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T02:24:02.699404114Z [2024-02-24T02:24:02.699+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T02:24:00+00:00, run_after=2024-02-24T02:26:00+00:00 2024-02-24T02:24:02.747387432Z [2024-02-24T02:24:02.747+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:24:02.747565904Z [2024-02-24T02:24:02.747+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:23:00+00:00, run_id=scheduled__2024-02-24T02:23:00+00:00, run_start_date=2024-02-24 02:24:01.021139+00:00, run_end_date=2024-02-24 02:24:02.747305+00:00, run_duration=1.726166, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:23:00+00:00, data_interval_end=2024-02-24 02:24:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:24:02.761193934Z [2024-02-24T02:24:02.760+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:24:00+00:00, run_after=2024-02-24T02:25:00+00:00 2024-02-24T02:24:02.826298722Z [2024-02-24T02:24:02.825+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:22:00+00:00 exited with status success for try_number 1 2024-02-24T02:24:02.833792539Z [2024-02-24T02:24:02.833+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T02:22:00+00:00, map_index=-1, run_start_date=2024-02-24 02:24:01.924281+00:00, run_end_date=2024-02-24 02:24:02.460268+00:00, run_duration=0.535987, state=success, executor_state=success, try_number=1, max_tries=1, job_id=759, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:24:01.092337+00:00, queued_by_job_id=2, pid=11101 2024-02-24T02:24:03.926674385Z [2024-02-24T02:24:03.926+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:23:00+00:00 exited with status success for try_number 1 2024-02-24T02:24:03.932763282Z [2024-02-24T02:24:03.932+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:23:00+00:00, map_index=-1, run_start_date=2024-02-24 02:24:02.001534+00:00, run_end_date=2024-02-24 02:24:02.596141+00:00, run_duration=0.594607, state=success, executor_state=success, try_number=1, max_tries=1, job_id=760, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:24:01.092337+00:00, queued_by_job_id=2, pid=11102 2024-02-24T02:24:05.005259774Z [2024-02-24T02:24:05.004+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:24:05.005957299Z [2024-02-24T02:24:05.005+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:23:00+00:00, run_id=scheduled__2024-02-24T02:23:00+00:00, run_start_date=2024-02-24 02:24:01.022528+00:00, run_end_date=2024-02-24 02:24:05.005317+00:00, run_duration=3.982789, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:23:00+00:00, data_interval_end=2024-02-24 02:24:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:24:05.018933644Z [2024-02-24T02:24:05.018+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:24:00+00:00, run_after=2024-02-24T02:25:00+00:00 2024-02-24T02:24:05.084582531Z [2024-02-24T02:24:05.084+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:23:00+00:00 exited with status success for try_number 1 2024-02-24T02:24:05.091956975Z [2024-02-24T02:24:05.091+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:23:00+00:00, map_index=-1, run_start_date=2024-02-24 02:24:03.318918+00:00, run_end_date=2024-02-24 02:24:04.631359+00:00, run_duration=1.312441, state=success, executor_state=success, try_number=1, max_tries=1, job_id=761, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:24:01.092337+00:00, queued_by_job_id=2, pid=11125 2024-02-24T02:24:06.131713275Z [2024-02-24T02:24:06.131+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:24:06.131770727Z [2024-02-24T02:24:06.131+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:23:00+00:00, run_id=scheduled__2024-02-24T02:23:00+00:00, run_start_date=2024-02-24 02:24:01.023928+00:00, run_end_date=2024-02-24 02:24:06.131503+00:00, run_duration=5.107575, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:23:00+00:00, data_interval_end=2024-02-24 02:24:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:24:06.140237183Z [2024-02-24T02:24:06.139+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:24:00+00:00, run_after=2024-02-24T02:25:00+00:00 2024-02-24T02:24:06.187653161Z [2024-02-24T02:24:06.187+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:23:00+00:00 exited with status success for try_number 1 2024-02-24T02:24:06.195931394Z [2024-02-24T02:24:06.195+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:23:00+00:00, map_index=-1, run_start_date=2024-02-24 02:24:03.345461+00:00, run_end_date=2024-02-24 02:24:05.170563+00:00, run_duration=1.825102, state=success, executor_state=success, try_number=1, max_tries=1, job_id=762, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:24:01.092337+00:00, queued_by_job_id=2, pid=11126 2024-02-24T02:25:00.902057848Z [2024-02-24T02:25:00.901+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:25:00.937569218Z [2024-02-24T02:25:00.937+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:25:00+00:00, run_after=2024-02-24T02:26:00+00:00 2024-02-24T02:25:00.961666821Z [2024-02-24T02:25:00.961+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:25:00+00:00, run_after=2024-02-24T02:30:00+00:00 2024-02-24T02:25:00.977036442Z [2024-02-24T02:25:00.976+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:25:00+00:00, run_after=2024-02-24T02:26:00+00:00 2024-02-24T02:25:01.056251952Z [2024-02-24T02:25:01.055+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T02:25:01.056283756Z 2024-02-24T02:25:01.056311722Z 2024-02-24T02:25:01.056317257Z 2024-02-24T02:25:01.056323035Z 2024-02-24T02:25:01.056635105Z [2024-02-24T02:25:01.056+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:25:01.057029898Z [2024-02-24T02:25:01.056+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:25:01.057324040Z [2024-02-24T02:25:01.057+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:25:01.057702802Z [2024-02-24T02:25:01.057+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:25:01.058673458Z [2024-02-24T02:25:01.058+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:25:01.058693598Z 2024-02-24T02:25:01.058702751Z 2024-02-24T02:25:01.058707777Z 2024-02-24T02:25:01.058712715Z 2024-02-24T02:25:01.064105371Z [2024-02-24T02:25:01.063+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T02:25:01.064476748Z [2024-02-24T02:25:01.064+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:25:01.065099619Z [2024-02-24T02:25:01.064+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:25:01.065328752Z [2024-02-24T02:25:01.064+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:25:01.065690038Z [2024-02-24T02:25:01.065+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:25:01.066033663Z [2024-02-24T02:25:01.065+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:25:01.066556347Z [2024-02-24T02:25:01.066+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:25:01.066900953Z [2024-02-24T02:25:01.066+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:25:01.636755612Z [2024-02-24T02:25:01.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T02:20:00+00:00 exited with status queued for try_number 1 2024-02-24T02:25:01.636918982Z [2024-02-24T02:25:01.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:24:00+00:00 exited with status queued for try_number 1 2024-02-24T02:25:01.637064991Z [2024-02-24T02:25:01.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:24:00+00:00 exited with status queued for try_number 1 2024-02-24T02:25:01.637214939Z [2024-02-24T02:25:01.637+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:24:00+00:00 exited with status queued for try_number 1 2024-02-24T02:25:01.663462613Z [2024-02-24T02:25:01.663+0000] {scheduler_job.py:635} INFO - Setting external_id for to 505ec90c-504f-4a50-9515-1773592d9c98 2024-02-24T02:25:01.664017398Z [2024-02-24T02:25:01.663+0000] {scheduler_job.py:635} INFO - Setting external_id for to efe53d68-be64-4703-8a42-2943bd462321 2024-02-24T02:25:01.664195297Z [2024-02-24T02:25:01.664+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd72e1cc-ebac-4cf5-8184-6c5eac7c2f00 2024-02-24T02:25:01.664352718Z [2024-02-24T02:25:01.664+0000] {scheduler_job.py:635} INFO - Setting external_id for to 203f4bc4-6d64-4ffe-9372-0c6d1509d705 2024-02-24T02:25:04.255932560Z [2024-02-24T02:25:04.255+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:25:04.256516805Z [2024-02-24T02:25:04.256+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:24:00+00:00, run_id=scheduled__2024-02-24T02:24:00+00:00, run_start_date=2024-02-24 02:25:00.989942+00:00, run_end_date=2024-02-24 02:25:04.256046+00:00, run_duration=3.266104, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:24:00+00:00, data_interval_end=2024-02-24 02:25:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:25:04.266631280Z [2024-02-24T02:25:04.266+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:25:00+00:00, run_after=2024-02-24T02:26:00+00:00 2024-02-24T02:25:04.342012504Z [2024-02-24T02:25:04.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:24:00+00:00 exited with status success for try_number 1 2024-02-24T02:25:04.349618083Z [2024-02-24T02:25:04.349+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:24:00+00:00, map_index=-1, run_start_date=2024-02-24 02:25:02.318359+00:00, run_end_date=2024-02-24 02:25:03.106806+00:00, run_duration=0.788447, state=success, executor_state=success, try_number=1, max_tries=1, job_id=763, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:25:01.060224+00:00, queued_by_job_id=2, pid=11159 2024-02-24T02:25:04.970635519Z [2024-02-24T02:25:04.970+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:25:04.970669090Z 2024-02-24T02:25:04.970925373Z [2024-02-24T02:25:04.970+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:25:04.971639347Z [2024-02-24T02:25:04.971+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:25:04.971654120Z 2024-02-24T02:25:04.974389944Z [2024-02-24T02:25:04.974+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T02:25:04.974664275Z [2024-02-24T02:25:04.974+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:25:05.038424201Z [2024-02-24T02:25:05.038+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T02:20:00+00:00 exited with status queued for try_number 1 2024-02-24T02:25:05.048710096Z [2024-02-24T02:25:05.048+0000] {scheduler_job.py:635} INFO - Setting external_id for to 455bea7a-bf37-4e7a-bb58-d92ec95d9396 2024-02-24T02:25:05.208542497Z [2024-02-24T02:25:05.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T02:20:00+00:00 exited with status success for try_number 1 2024-02-24T02:25:05.217222989Z [2024-02-24T02:25:05.216+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T02:20:00+00:00, map_index=-1, run_start_date=2024-02-24 02:25:04.457284+00:00, run_end_date=2024-02-24 02:25:04.856863+00:00, run_duration=0.399579, state=success, executor_state=success, try_number=1, max_tries=1, job_id=766, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:25:01.060224+00:00, queued_by_job_id=2, pid=11190 2024-02-24T02:25:06.264784434Z [2024-02-24T02:25:06.264+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:25:06.265543733Z [2024-02-24T02:25:06.265+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:24:00+00:00, run_id=scheduled__2024-02-24T02:24:00+00:00, run_start_date=2024-02-24 02:25:00.990926+00:00, run_end_date=2024-02-24 02:25:06.264686+00:00, run_duration=5.27376, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:24:00+00:00, data_interval_end=2024-02-24 02:25:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:25:06.289190937Z [2024-02-24T02:25:06.288+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:25:00+00:00, run_after=2024-02-24T02:26:00+00:00 2024-02-24T02:25:06.302562680Z [2024-02-24T02:25:06.302+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:25:06.302990789Z [2024-02-24T02:25:06.302+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:24:00+00:00, run_id=scheduled__2024-02-24T02:24:00+00:00, run_start_date=2024-02-24 02:25:00.991854+00:00, run_end_date=2024-02-24 02:25:06.302455+00:00, run_duration=5.310601, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:24:00+00:00, data_interval_end=2024-02-24 02:25:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:25:06.315927587Z [2024-02-24T02:25:06.315+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:25:00+00:00, run_after=2024-02-24T02:26:00+00:00 2024-02-24T02:25:06.380841430Z [2024-02-24T02:25:06.380+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:24:00+00:00 exited with status success for try_number 1 2024-02-24T02:25:06.381038620Z [2024-02-24T02:25:06.380+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:24:00+00:00 exited with status success for try_number 1 2024-02-24T02:25:06.392447982Z [2024-02-24T02:25:06.391+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:24:00+00:00, map_index=-1, run_start_date=2024-02-24 02:25:04.310586+00:00, run_end_date=2024-02-24 02:25:05.873293+00:00, run_duration=1.562707, state=success, executor_state=success, try_number=1, max_tries=1, job_id=765, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:25:01.060224+00:00, queued_by_job_id=2, pid=11189 2024-02-24T02:25:06.392837181Z [2024-02-24T02:25:06.392+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:24:00+00:00, map_index=-1, run_start_date=2024-02-24 02:25:03.940599+00:00, run_end_date=2024-02-24 02:25:05.388759+00:00, run_duration=1.44816, state=success, executor_state=success, try_number=1, max_tries=1, job_id=764, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:25:01.060224+00:00, queued_by_job_id=2, pid=11173 2024-02-24T02:25:07.482707644Z [2024-02-24T02:25:07.482+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:25:07.482741460Z 2024-02-24T02:25:07.483015450Z [2024-02-24T02:25:07.482+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:25:07.484032473Z [2024-02-24T02:25:07.483+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:25:07.484049519Z 2024-02-24T02:25:07.487318240Z [2024-02-24T02:25:07.487+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T02:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T02:25:07.487709229Z [2024-02-24T02:25:07.487+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T02:25:07.594458870Z [2024-02-24T02:25:07.594+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T02:20:00+00:00 exited with status queued for try_number 1 2024-02-24T02:25:07.594499609Z [2024-02-24T02:25:07.594+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T02:20:00+00:00 exited with status success for try_number 1 2024-02-24T02:25:07.603369049Z [2024-02-24T02:25:07.602+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05a9a940-bc03-45af-bc25-e0d4f610dd7c 2024-02-24T02:25:07.603496133Z [2024-02-24T02:25:07.603+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T02:20:00+00:00, map_index=-1, run_start_date=2024-02-24 02:25:06.600306+00:00, run_end_date=2024-02-24 02:25:07.010427+00:00, run_duration=0.410121, state=success, executor_state=success, try_number=1, max_tries=1, job_id=767, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:25:04.972161+00:00, queued_by_job_id=2, pid=11208 2024-02-24T02:25:09.902007329Z [2024-02-24T02:25:09.901+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:25:09.902078332Z 2024-02-24T02:25:09.902229526Z [2024-02-24T02:25:09.901+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:25:09.902971921Z [2024-02-24T02:25:09.902+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:25:09.902993924Z 2024-02-24T02:25:09.905862343Z [2024-02-24T02:25:09.905+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:25:09.905990781Z [2024-02-24T02:25:09.905+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:25:09.954311857Z [2024-02-24T02:25:09.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T02:20:00+00:00 exited with status queued for try_number 1 2024-02-24T02:25:09.954631571Z [2024-02-24T02:25:09.954+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T02:20:00+00:00 exited with status success for try_number 1 2024-02-24T02:25:09.961898833Z [2024-02-24T02:25:09.961+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d93786a-b421-48c0-855b-e156f373a542 2024-02-24T02:25:09.962602740Z [2024-02-24T02:25:09.962+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T02:20:00+00:00, map_index=0, run_start_date=2024-02-24 02:25:09.091204+00:00, run_end_date=2024-02-24 02:25:09.478328+00:00, run_duration=0.387124, state=success, executor_state=success, try_number=1, max_tries=1, job_id=768, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:25:07.484574+00:00, queued_by_job_id=2, pid=11216 2024-02-24T02:25:12.274111520Z [2024-02-24T02:25:12.273+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:25:12.274838888Z [2024-02-24T02:25:12.274+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:20:00+00:00, run_id=scheduled__2024-02-24T02:20:00+00:00, run_start_date=2024-02-24 02:25:00.988714+00:00, run_end_date=2024-02-24 02:25:12.274190+00:00, run_duration=11.285476, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:20:00+00:00, data_interval_end=2024-02-24 02:25:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T02:25:12.287274853Z [2024-02-24T02:25:12.286+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:25:00+00:00, run_after=2024-02-24T02:30:00+00:00 2024-02-24T02:25:12.325375508Z [2024-02-24T02:25:12.324+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T02:20:00+00:00 exited with status success for try_number 1 2024-02-24T02:25:12.332186082Z [2024-02-24T02:25:12.331+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T02:20:00+00:00, map_index=-1, run_start_date=2024-02-24 02:25:11.491492+00:00, run_end_date=2024-02-24 02:25:11.861321+00:00, run_duration=0.369829, state=success, executor_state=success, try_number=1, max_tries=1, job_id=769, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:25:09.903399+00:00, queued_by_job_id=2, pid=11224 2024-02-24T02:26:00.778730299Z [2024-02-24T02:26:00.778+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:26:00.790136782Z [2024-02-24T02:26:00.789+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:26:00.806402297Z [2024-02-24T02:26:00.806+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:26:00+00:00, run_after=2024-02-24T02:27:00+00:00 2024-02-24T02:26:00.821716684Z [2024-02-24T02:26:00.821+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:26:00+00:00, run_after=2024-02-24T02:27:00+00:00 2024-02-24T02:26:00.921421723Z [2024-02-24T02:26:00.921+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T02:26:00.921453460Z 2024-02-24T02:26:00.921483876Z 2024-02-24T02:26:00.921489158Z 2024-02-24T02:26:00.921493992Z 2024-02-24T02:26:00.921980102Z [2024-02-24T02:26:00.921+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T02:26:00.922324002Z [2024-02-24T02:26:00.922+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:26:00.922603383Z [2024-02-24T02:26:00.922+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:26:00.922887208Z [2024-02-24T02:26:00.922+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:26:00.923817591Z [2024-02-24T02:26:00.923+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:26:00.923834016Z 2024-02-24T02:26:00.923839576Z 2024-02-24T02:26:00.923845413Z 2024-02-24T02:26:00.923850288Z 2024-02-24T02:26:00.928737193Z [2024-02-24T02:26:00.928+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:26:00.929049938Z [2024-02-24T02:26:00.928+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T02:26:00.929485256Z [2024-02-24T02:26:00.929+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:26:00.929748774Z [2024-02-24T02:26:00.929+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:26:00.930129006Z [2024-02-24T02:26:00.929+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:26:00.930352564Z [2024-02-24T02:26:00.930+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:26:00.930728237Z [2024-02-24T02:26:00.930+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:26:00.931014611Z [2024-02-24T02:26:00.930+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:26:01.359380951Z [2024-02-24T02:26:01.358+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:24:00+00:00 exited with status queued for try_number 1 2024-02-24T02:26:01.359572463Z [2024-02-24T02:26:01.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:25:00+00:00 exited with status queued for try_number 1 2024-02-24T02:26:01.359722446Z [2024-02-24T02:26:01.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:25:00+00:00 exited with status queued for try_number 1 2024-02-24T02:26:01.359853430Z [2024-02-24T02:26:01.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:25:00+00:00 exited with status queued for try_number 1 2024-02-24T02:26:01.369177954Z [2024-02-24T02:26:01.368+0000] {scheduler_job.py:635} INFO - Setting external_id for to 21cea182-13c3-4ddb-9c8b-1f18126aa20d 2024-02-24T02:26:01.369272824Z [2024-02-24T02:26:01.369+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25eee561-4ac7-40ff-9028-f04bbde7e866 2024-02-24T02:26:01.369462464Z [2024-02-24T02:26:01.369+0000] {scheduler_job.py:635} INFO - Setting external_id for to f91f0508-692d-48ee-8f0c-1dc0b83c3214 2024-02-24T02:26:01.369612856Z [2024-02-24T02:26:01.369+0000] {scheduler_job.py:635} INFO - Setting external_id for to f6329603-6a3e-4cda-be06-d792e11fcc81 2024-02-24T02:26:02.543731228Z [2024-02-24T02:26:02.543+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:26:02.545415395Z [2024-02-24T02:26:02.545+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:25:00+00:00, run_id=scheduled__2024-02-24T02:25:00+00:00, run_start_date=2024-02-24 02:26:00.842184+00:00, run_end_date=2024-02-24 02:26:02.544770+00:00, run_duration=1.702586, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:25:00+00:00, data_interval_end=2024-02-24 02:26:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:26:02.565166287Z [2024-02-24T02:26:02.564+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:26:00+00:00, run_after=2024-02-24T02:27:00+00:00 2024-02-24T02:26:02.649210325Z [2024-02-24T02:26:02.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:24:00+00:00 exited with status success for try_number 1 2024-02-24T02:26:02.649242818Z [2024-02-24T02:26:02.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:25:00+00:00 exited with status success for try_number 1 2024-02-24T02:26:02.676705183Z [2024-02-24T02:26:02.661+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:25:00+00:00, map_index=-1, run_start_date=2024-02-24 02:26:01.875627+00:00, run_end_date=2024-02-24 02:26:02.259716+00:00, run_duration=0.384089, state=success, executor_state=success, try_number=1, max_tries=1, job_id=770, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:26:00.925187+00:00, queued_by_job_id=2, pid=11247 2024-02-24T02:26:02.676762352Z [2024-02-24T02:26:02.667+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T02:24:00+00:00, map_index=-1, run_start_date=2024-02-24 02:26:02.019068+00:00, run_end_date=2024-02-24 02:26:02.429193+00:00, run_duration=0.410125, state=success, executor_state=success, try_number=1, max_tries=1, job_id=771, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:26:00.925187+00:00, queued_by_job_id=2, pid=11248 2024-02-24T02:26:03.575717437Z [2024-02-24T02:26:03.575+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:26:03.575864798Z [2024-02-24T02:26:03.575+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 02:24:00+00:00, run_id=scheduled__2024-02-24T02:24:00+00:00, run_start_date=2024-02-24 02:26:00.840602+00:00, run_end_date=2024-02-24 02:26:03.575647+00:00, run_duration=2.735045, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:24:00+00:00, data_interval_end=2024-02-24 02:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T02:26:03.582760067Z [2024-02-24T02:26:03.582+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T02:26:00+00:00, run_after=2024-02-24T02:28:00+00:00 2024-02-24T02:26:04.717913964Z [2024-02-24T02:26:04.715+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:26:04.718384803Z [2024-02-24T02:26:04.717+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:25:00+00:00, run_id=scheduled__2024-02-24T02:25:00+00:00, run_start_date=2024-02-24 02:26:00.843484+00:00, run_end_date=2024-02-24 02:26:04.717652+00:00, run_duration=3.874168, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:25:00+00:00, data_interval_end=2024-02-24 02:26:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:26:04.731836015Z [2024-02-24T02:26:04.731+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:26:00+00:00, run_after=2024-02-24T02:27:00+00:00 2024-02-24T02:26:04.775508287Z [2024-02-24T02:26:04.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:25:00+00:00 exited with status success for try_number 1 2024-02-24T02:26:04.783127803Z [2024-02-24T02:26:04.781+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:25:00+00:00, map_index=-1, run_start_date=2024-02-24 02:26:03.320459+00:00, run_end_date=2024-02-24 02:26:04.546192+00:00, run_duration=1.225733, state=success, executor_state=success, try_number=1, max_tries=1, job_id=773, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:26:00.925187+00:00, queued_by_job_id=2, pid=11272 2024-02-24T02:26:05.835865309Z [2024-02-24T02:26:05.835+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:26:05.836225601Z [2024-02-24T02:26:05.835+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:25:00+00:00, run_id=scheduled__2024-02-24T02:25:00+00:00, run_start_date=2024-02-24 02:26:00.844690+00:00, run_end_date=2024-02-24 02:26:05.835731+00:00, run_duration=4.991041, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:25:00+00:00, data_interval_end=2024-02-24 02:26:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:26:05.847664225Z [2024-02-24T02:26:05.847+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:26:00+00:00, run_after=2024-02-24T02:27:00+00:00 2024-02-24T02:26:05.902010331Z [2024-02-24T02:26:05.901+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:25:00+00:00 exited with status success for try_number 1 2024-02-24T02:26:05.910405780Z [2024-02-24T02:26:05.909+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:25:00+00:00, map_index=-1, run_start_date=2024-02-24 02:26:03.207823+00:00, run_end_date=2024-02-24 02:26:05.020690+00:00, run_duration=1.812867, state=success, executor_state=success, try_number=1, max_tries=1, job_id=772, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:26:00.925187+00:00, queued_by_job_id=2, pid=11271 2024-02-24T02:27:00.386378622Z [2024-02-24T02:27:00.385+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:27:00.402686836Z [2024-02-24T02:27:00.402+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:27:00+00:00, run_after=2024-02-24T02:28:00+00:00 2024-02-24T02:27:00.417537329Z [2024-02-24T02:27:00.417+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:27:00+00:00, run_after=2024-02-24T02:28:00+00:00 2024-02-24T02:27:00.518270737Z [2024-02-24T02:27:00.517+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T02:27:00.518349250Z 2024-02-24T02:27:00.518357228Z 2024-02-24T02:27:00.518383969Z 2024-02-24T02:27:00.518389510Z [2024-02-24T02:27:00.518+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:27:00.518406400Z [2024-02-24T02:27:00.518+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:27:00.518473976Z [2024-02-24T02:27:00.518+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:27:00.519113727Z [2024-02-24T02:27:00.518+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:27:00.519127559Z 2024-02-24T02:27:00.519133141Z 2024-02-24T02:27:00.519138470Z 2024-02-24T02:27:00.522753547Z [2024-02-24T02:27:00.522+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:27:00.522936926Z [2024-02-24T02:27:00.522+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:27:00.523215863Z [2024-02-24T02:27:00.523+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:27:00.523391196Z [2024-02-24T02:27:00.523+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:27:00.523643125Z [2024-02-24T02:27:00.523+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:27:00.523719487Z [2024-02-24T02:27:00.523+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:27:00.843142682Z [2024-02-24T02:27:00.842+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:26:00+00:00 exited with status queued for try_number 1 2024-02-24T02:27:00.846023553Z [2024-02-24T02:27:00.843+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:26:00+00:00 exited with status queued for try_number 1 2024-02-24T02:27:00.846244735Z [2024-02-24T02:27:00.845+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:26:00+00:00 exited with status queued for try_number 1 2024-02-24T02:27:00.853614748Z [2024-02-24T02:27:00.853+0000] {scheduler_job.py:635} INFO - Setting external_id for to 09b16109-e6ca-4988-9c51-efe09a7ab98f 2024-02-24T02:27:00.853712791Z [2024-02-24T02:27:00.853+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0ca63227-c22a-4f06-9411-d82033992b02 2024-02-24T02:27:00.853952693Z [2024-02-24T02:27:00.853+0000] {scheduler_job.py:635} INFO - Setting external_id for to ffbde701-2fd7-4293-943b-2d5fa007bbf9 2024-02-24T02:27:02.254545998Z [2024-02-24T02:27:02.254+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:27:02.254918536Z [2024-02-24T02:27:02.254+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:26:00+00:00, run_id=scheduled__2024-02-24T02:26:00+00:00, run_start_date=2024-02-24 02:27:00.433472+00:00, run_end_date=2024-02-24 02:27:02.254432+00:00, run_duration=1.82096, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:26:00+00:00, data_interval_end=2024-02-24 02:27:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:27:02.265819822Z [2024-02-24T02:27:02.265+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:27:00+00:00, run_after=2024-02-24T02:28:00+00:00 2024-02-24T02:27:02.328166589Z [2024-02-24T02:27:02.327+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:26:00+00:00 exited with status success for try_number 1 2024-02-24T02:27:02.335116222Z [2024-02-24T02:27:02.334+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:26:00+00:00, map_index=-1, run_start_date=2024-02-24 02:27:01.585028+00:00, run_end_date=2024-02-24 02:27:02.078842+00:00, run_duration=0.493814, state=success, executor_state=success, try_number=1, max_tries=1, job_id=774, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:27:00.519792+00:00, queued_by_job_id=2, pid=11304 2024-02-24T02:27:04.119132601Z [2024-02-24T02:27:04.118+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:27:04.119588471Z [2024-02-24T02:27:04.119+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:26:00+00:00, run_id=scheduled__2024-02-24T02:26:00+00:00, run_start_date=2024-02-24 02:27:00.434777+00:00, run_end_date=2024-02-24 02:27:04.119246+00:00, run_duration=3.684469, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:26:00+00:00, data_interval_end=2024-02-24 02:27:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:27:04.128799512Z [2024-02-24T02:27:04.128+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:27:00+00:00, run_after=2024-02-24T02:28:00+00:00 2024-02-24T02:27:04.185343929Z [2024-02-24T02:27:04.184+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T02:27:05.241050301Z [2024-02-24T02:27:05.240+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:27:05.241572727Z [2024-02-24T02:27:05.241+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:26:00+00:00, run_id=scheduled__2024-02-24T02:26:00+00:00, run_start_date=2024-02-24 02:27:00.435843+00:00, run_end_date=2024-02-24 02:27:05.240765+00:00, run_duration=4.804922, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:26:00+00:00, data_interval_end=2024-02-24 02:27:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:27:05.256619455Z [2024-02-24T02:27:05.256+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:27:00+00:00, run_after=2024-02-24T02:28:00+00:00 2024-02-24T02:27:05.301632077Z [2024-02-24T02:27:05.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:26:00+00:00 exited with status success for try_number 1 2024-02-24T02:27:05.301898764Z [2024-02-24T02:27:05.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:26:00+00:00 exited with status success for try_number 1 2024-02-24T02:27:05.318387314Z [2024-02-24T02:27:05.317+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:26:00+00:00, map_index=-1, run_start_date=2024-02-24 02:27:02.534280+00:00, run_end_date=2024-02-24 02:27:04.277326+00:00, run_duration=1.743046, state=success, executor_state=success, try_number=1, max_tries=1, job_id=775, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:27:00.519792+00:00, queued_by_job_id=2, pid=11322 2024-02-24T02:27:05.318716076Z [2024-02-24T02:27:05.318+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:26:00+00:00, map_index=-1, run_start_date=2024-02-24 02:27:02.684808+00:00, run_end_date=2024-02-24 02:27:04.079472+00:00, run_duration=1.394664, state=success, executor_state=success, try_number=1, max_tries=1, job_id=776, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:27:00.519792+00:00, queued_by_job_id=2, pid=11323 2024-02-24T02:28:00.355673051Z [2024-02-24T02:28:00.355+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:28:00+00:00, run_after=2024-02-24T02:29:00+00:00 2024-02-24T02:28:00.373494232Z [2024-02-24T02:28:00.373+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:28:00+00:00, run_after=2024-02-24T02:29:00+00:00 2024-02-24T02:28:00.382803797Z [2024-02-24T02:28:00.382+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:28:00.390875919Z [2024-02-24T02:28:00.390+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:28:00.512382942Z [2024-02-24T02:28:00.511+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T02:28:00.512412624Z 2024-02-24T02:28:00.512418659Z 2024-02-24T02:28:00.512423661Z 2024-02-24T02:28:00.512428431Z 2024-02-24T02:28:00.512782465Z [2024-02-24T02:28:00.512+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T02:28:00.513155172Z [2024-02-24T02:28:00.512+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:28:00.513501018Z [2024-02-24T02:28:00.513+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:28:00.513902785Z [2024-02-24T02:28:00.513+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:28:00.514975973Z [2024-02-24T02:28:00.514+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:28:00.514989548Z 2024-02-24T02:28:00.514995406Z 2024-02-24T02:28:00.514999852Z 2024-02-24T02:28:00.515024011Z 2024-02-24T02:28:00.523329396Z [2024-02-24T02:28:00.522+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:28:00.523790618Z [2024-02-24T02:28:00.523+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T02:28:00.525146017Z [2024-02-24T02:28:00.524+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:28:00.525427889Z [2024-02-24T02:28:00.525+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:28:00.526357536Z [2024-02-24T02:28:00.525+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:28:00.526615416Z [2024-02-24T02:28:00.526+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:28:00.527021942Z [2024-02-24T02:28:00.526+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:28:00.527306268Z [2024-02-24T02:28:00.526+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:28:00.862266763Z [2024-02-24T02:28:00.861+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:26:00+00:00 exited with status queued for try_number 1 2024-02-24T02:28:00.862489428Z [2024-02-24T02:28:00.862+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:27:00+00:00 exited with status queued for try_number 1 2024-02-24T02:28:00.862833555Z [2024-02-24T02:28:00.862+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:27:00+00:00 exited with status queued for try_number 1 2024-02-24T02:28:00.863143564Z [2024-02-24T02:28:00.862+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:27:00+00:00 exited with status queued for try_number 1 2024-02-24T02:28:00.876608195Z [2024-02-24T02:28:00.876+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0530a856-2e4e-4ec3-9e31-c0870b53ec30 2024-02-24T02:28:00.876844279Z [2024-02-24T02:28:00.876+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9aa6912a-cf7b-4bec-a577-a854986358b8 2024-02-24T02:28:00.877091312Z [2024-02-24T02:28:00.876+0000] {scheduler_job.py:635} INFO - Setting external_id for to 673eb173-3703-405a-9531-9bc5b5204180 2024-02-24T02:28:00.877247494Z [2024-02-24T02:28:00.877+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b1a289e-887b-4610-88df-ce4bb929faa5 2024-02-24T02:28:02.233628000Z [2024-02-24T02:28:02.233+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:28:02.233872614Z [2024-02-24T02:28:02.233+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 02:26:00+00:00, run_id=scheduled__2024-02-24T02:26:00+00:00, run_start_date=2024-02-24 02:28:00.405068+00:00, run_end_date=2024-02-24 02:28:02.233536+00:00, run_duration=1.828468, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:26:00+00:00, data_interval_end=2024-02-24 02:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T02:28:02.242297724Z [2024-02-24T02:28:02.241+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T02:28:00+00:00, run_after=2024-02-24T02:30:00+00:00 2024-02-24T02:28:02.253470262Z [2024-02-24T02:28:02.253+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:28:02.253603405Z [2024-02-24T02:28:02.253+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:27:00+00:00, run_id=scheduled__2024-02-24T02:27:00+00:00, run_start_date=2024-02-24 02:28:00.406645+00:00, run_end_date=2024-02-24 02:28:02.253381+00:00, run_duration=1.846736, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:27:00+00:00, data_interval_end=2024-02-24 02:28:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:28:02.265535686Z [2024-02-24T02:28:02.265+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:28:00+00:00, run_after=2024-02-24T02:29:00+00:00 2024-02-24T02:28:02.338641083Z [2024-02-24T02:28:02.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:26:00+00:00 exited with status success for try_number 1 2024-02-24T02:28:02.338797303Z [2024-02-24T02:28:02.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:27:00+00:00 exited with status success for try_number 1 2024-02-24T02:28:02.348519250Z [2024-02-24T02:28:02.348+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:27:00+00:00, map_index=-1, run_start_date=2024-02-24 02:28:01.722542+00:00, run_end_date=2024-02-24 02:28:02.075774+00:00, run_duration=0.353232, state=success, executor_state=success, try_number=1, max_tries=1, job_id=778, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:28:00.517479+00:00, queued_by_job_id=2, pid=11363 2024-02-24T02:28:02.348660517Z [2024-02-24T02:28:02.348+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T02:26:00+00:00, map_index=-1, run_start_date=2024-02-24 02:28:01.311901+00:00, run_end_date=2024-02-24 02:28:01.602124+00:00, run_duration=0.290223, state=success, executor_state=success, try_number=1, max_tries=1, job_id=777, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:28:00.517479+00:00, queued_by_job_id=2, pid=11351 2024-02-24T02:28:04.398510940Z [2024-02-24T02:28:04.397+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:28:04.398937775Z [2024-02-24T02:28:04.398+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:27:00+00:00, run_id=scheduled__2024-02-24T02:27:00+00:00, run_start_date=2024-02-24 02:28:00.407897+00:00, run_end_date=2024-02-24 02:28:04.398409+00:00, run_duration=3.990512, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:27:00+00:00, data_interval_end=2024-02-24 02:28:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:28:04.411781762Z [2024-02-24T02:28:04.411+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:28:00+00:00, run_after=2024-02-24T02:29:00+00:00 2024-02-24T02:28:04.422151518Z [2024-02-24T02:28:04.421+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:28:04.422498532Z [2024-02-24T02:28:04.422+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:27:00+00:00, run_id=scheduled__2024-02-24T02:27:00+00:00, run_start_date=2024-02-24 02:28:00.409153+00:00, run_end_date=2024-02-24 02:28:04.421974+00:00, run_duration=4.012821, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:27:00+00:00, data_interval_end=2024-02-24 02:28:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:28:04.435964654Z [2024-02-24T02:28:04.435+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:28:00+00:00, run_after=2024-02-24T02:29:00+00:00 2024-02-24T02:28:04.484184661Z [2024-02-24T02:28:04.483+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:27:00+00:00 exited with status success for try_number 1 2024-02-24T02:28:04.484398408Z [2024-02-24T02:28:04.484+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:27:00+00:00 exited with status success for try_number 1 2024-02-24T02:28:04.490987121Z [2024-02-24T02:28:04.490+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:27:00+00:00, map_index=-1, run_start_date=2024-02-24 02:28:02.808003+00:00, run_end_date=2024-02-24 02:28:04.154804+00:00, run_duration=1.346801, state=success, executor_state=success, try_number=1, max_tries=1, job_id=780, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:28:00.517479+00:00, queued_by_job_id=2, pid=11381 2024-02-24T02:28:04.491310921Z [2024-02-24T02:28:04.491+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:27:00+00:00, map_index=-1, run_start_date=2024-02-24 02:28:02.555791+00:00, run_end_date=2024-02-24 02:28:04.211074+00:00, run_duration=1.655283, state=success, executor_state=success, try_number=1, max_tries=1, job_id=779, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:28:00.517479+00:00, queued_by_job_id=2, pid=11378 2024-02-24T02:29:00.257968022Z [2024-02-24T02:29:00.257+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:29:00+00:00, run_after=2024-02-24T02:30:00+00:00 2024-02-24T02:29:00.273949193Z [2024-02-24T02:29:00.273+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:29:00+00:00, run_after=2024-02-24T02:30:00+00:00 2024-02-24T02:29:00.281683423Z [2024-02-24T02:29:00.281+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:29:00.381061782Z [2024-02-24T02:29:00.380+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T02:29:00.381086130Z 2024-02-24T02:29:00.381089891Z 2024-02-24T02:29:00.381093139Z 2024-02-24T02:29:00.381289846Z [2024-02-24T02:29:00.381+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:29:00.381482996Z [2024-02-24T02:29:00.381+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:29:00.381671440Z [2024-02-24T02:29:00.381+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:29:00.382420171Z [2024-02-24T02:29:00.382+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:29:00.382425914Z 2024-02-24T02:29:00.382429133Z 2024-02-24T02:29:00.382432505Z 2024-02-24T02:29:00.385817012Z [2024-02-24T02:29:00.385+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:29:00.386052602Z [2024-02-24T02:29:00.385+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:29:00.386327587Z [2024-02-24T02:29:00.386+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:29:00.386485445Z [2024-02-24T02:29:00.386+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:29:00.386781417Z [2024-02-24T02:29:00.386+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:29:00.386983197Z [2024-02-24T02:29:00.386+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:29:00.595877504Z [2024-02-24T02:29:00.593+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:28:00+00:00 exited with status queued for try_number 1 2024-02-24T02:29:00.596039088Z [2024-02-24T02:29:00.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:28:00+00:00 exited with status queued for try_number 1 2024-02-24T02:29:00.596108866Z [2024-02-24T02:29:00.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:28:00+00:00 exited with status queued for try_number 1 2024-02-24T02:29:00.605895611Z [2024-02-24T02:29:00.605+0000] {scheduler_job.py:635} INFO - Setting external_id for to ecb14f4a-a736-4b7b-b2f4-da075df0b95d 2024-02-24T02:29:00.606341705Z [2024-02-24T02:29:00.606+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6a79c520-f0f1-4a9d-a756-5c46ec260b92 2024-02-24T02:29:00.606703755Z [2024-02-24T02:29:00.606+0000] {scheduler_job.py:635} INFO - Setting external_id for to fd13702d-5ab9-44bf-bd1c-69ffce7cdc01 2024-02-24T02:29:01.778122787Z [2024-02-24T02:29:01.777+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:29:01.778559486Z [2024-02-24T02:29:01.778+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:28:00+00:00, run_id=scheduled__2024-02-24T02:28:00+00:00, run_start_date=2024-02-24 02:29:00.294439+00:00, run_end_date=2024-02-24 02:29:01.778063+00:00, run_duration=1.483624, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:28:00+00:00, data_interval_end=2024-02-24 02:29:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:29:01.790934339Z [2024-02-24T02:29:01.790+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:29:00+00:00, run_after=2024-02-24T02:30:00+00:00 2024-02-24T02:29:01.866880685Z [2024-02-24T02:29:01.866+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:28:00+00:00 exited with status success for try_number 1 2024-02-24T02:29:01.873238767Z [2024-02-24T02:29:01.872+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:28:00+00:00, map_index=-1, run_start_date=2024-02-24 02:29:01.186782+00:00, run_end_date=2024-02-24 02:29:01.594212+00:00, run_duration=0.40743, state=success, executor_state=success, try_number=1, max_tries=1, job_id=781, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:29:00.383344+00:00, queued_by_job_id=2, pid=11413 2024-02-24T02:29:04.863692293Z [2024-02-24T02:29:04.863+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:29:04.864346887Z [2024-02-24T02:29:04.863+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:28:00+00:00, run_id=scheduled__2024-02-24T02:28:00+00:00, run_start_date=2024-02-24 02:29:00.295708+00:00, run_end_date=2024-02-24 02:29:04.863790+00:00, run_duration=4.568082, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:28:00+00:00, data_interval_end=2024-02-24 02:29:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:29:04.879270137Z [2024-02-24T02:29:04.878+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:29:00+00:00, run_after=2024-02-24T02:30:00+00:00 2024-02-24T02:29:04.887108931Z [2024-02-24T02:29:04.886+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:29:04.887728767Z [2024-02-24T02:29:04.887+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:28:00+00:00, run_id=scheduled__2024-02-24T02:28:00+00:00, run_start_date=2024-02-24 02:29:00.296923+00:00, run_end_date=2024-02-24 02:29:04.887216+00:00, run_duration=4.590293, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:28:00+00:00, data_interval_end=2024-02-24 02:29:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:29:04.897493111Z [2024-02-24T02:29:04.897+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:29:00+00:00, run_after=2024-02-24T02:30:00+00:00 2024-02-24T02:29:04.937996450Z [2024-02-24T02:29:04.937+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:28:00+00:00 exited with status success for try_number 1 2024-02-24T02:29:04.938130065Z [2024-02-24T02:29:04.937+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:28:00+00:00 exited with status success for try_number 1 2024-02-24T02:29:04.946026785Z [2024-02-24T02:29:04.945+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:28:00+00:00, map_index=-1, run_start_date=2024-02-24 02:29:02.257500+00:00, run_end_date=2024-02-24 02:29:04.317505+00:00, run_duration=2.060005, state=success, executor_state=success, try_number=1, max_tries=1, job_id=783, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:29:00.383344+00:00, queued_by_job_id=2, pid=11432 2024-02-24T02:29:04.946323050Z [2024-02-24T02:29:04.946+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:28:00+00:00, map_index=-1, run_start_date=2024-02-24 02:29:02.167106+00:00, run_end_date=2024-02-24 02:29:04.744637+00:00, run_duration=2.577531, state=success, executor_state=success, try_number=1, max_tries=1, job_id=782, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:29:00.383344+00:00, queued_by_job_id=2, pid=11431 2024-02-24T02:30:00.198819334Z [2024-02-24T02:30:00.198+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:30:00+00:00, run_after=2024-02-24T02:35:00+00:00 2024-02-24T02:30:00.226849744Z [2024-02-24T02:30:00.226+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:30:00+00:00, run_after=2024-02-24T02:31:00+00:00 2024-02-24T02:30:00.239709592Z [2024-02-24T02:30:00.239+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:30:00+00:00, run_after=2024-02-24T02:31:00+00:00 2024-02-24T02:30:00.248025740Z [2024-02-24T02:30:00.247+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:30:00.262466768Z [2024-02-24T02:30:00.261+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:30:00.388467346Z [2024-02-24T02:30:00.387+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-02-24T02:30:00.388498810Z 2024-02-24T02:30:00.388504910Z 2024-02-24T02:30:00.388510814Z 2024-02-24T02:30:00.388516035Z 2024-02-24T02:30:00.388521255Z 2024-02-24T02:30:00.388671238Z [2024-02-24T02:30:00.388+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:30:00.389067626Z [2024-02-24T02:30:00.388+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T02:30:00.389408509Z [2024-02-24T02:30:00.389+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:30:00.389739738Z [2024-02-24T02:30:00.389+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:30:00.390282926Z [2024-02-24T02:30:00.389+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:30:00.391613552Z [2024-02-24T02:30:00.391+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:30:00.391626244Z 2024-02-24T02:30:00.391632052Z 2024-02-24T02:30:00.391637534Z 2024-02-24T02:30:00.391661228Z 2024-02-24T02:30:00.391666864Z 2024-02-24T02:30:00.399150500Z [2024-02-24T02:30:00.398+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T02:30:00.399410037Z [2024-02-24T02:30:00.399+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:30:00.399778844Z [2024-02-24T02:30:00.399+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:30:00.399995034Z [2024-02-24T02:30:00.399+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T02:30:00.400327852Z [2024-02-24T02:30:00.400+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:30:00.400558497Z [2024-02-24T02:30:00.400+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:30:00.400951593Z [2024-02-24T02:30:00.400+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:30:00.401160697Z [2024-02-24T02:30:00.400+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:30:00.401496621Z [2024-02-24T02:30:00.401+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:30:00.401715931Z [2024-02-24T02:30:00.401+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:30:00.903768053Z [2024-02-24T02:30:00.903+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T02:25:00+00:00 exited with status queued for try_number 1 2024-02-24T02:30:00.905953152Z [2024-02-24T02:30:00.903+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:28:00+00:00 exited with status queued for try_number 1 2024-02-24T02:30:00.906219019Z [2024-02-24T02:30:00.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:29:00+00:00 exited with status queued for try_number 1 2024-02-24T02:30:00.906374445Z [2024-02-24T02:30:00.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:29:00+00:00 exited with status queued for try_number 1 2024-02-24T02:30:00.906511996Z [2024-02-24T02:30:00.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:29:00+00:00 exited with status queued for try_number 1 2024-02-24T02:30:00.924917176Z [2024-02-24T02:30:00.924+0000] {scheduler_job.py:635} INFO - Setting external_id for to 83e47c1d-aeb0-4ab1-a061-415d23fee9af 2024-02-24T02:30:00.925136392Z [2024-02-24T02:30:00.924+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5a6ef23-6af3-460c-8c06-0d9451a166be 2024-02-24T02:30:00.925353039Z [2024-02-24T02:30:00.925+0000] {scheduler_job.py:635} INFO - Setting external_id for to 595101f8-d13d-4127-835b-26a9785dd643 2024-02-24T02:30:00.925524690Z [2024-02-24T02:30:00.925+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37c14c7f-6e84-4747-a863-1f3ce4481458 2024-02-24T02:30:00.925708432Z [2024-02-24T02:30:00.925+0000] {scheduler_job.py:635} INFO - Setting external_id for to e1325659-7339-4017-bb4e-9ef7abc384f8 2024-02-24T02:30:02.197406331Z [2024-02-24T02:30:02.197+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:30:02.197790500Z [2024-02-24T02:30:02.197+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 02:28:00+00:00, run_id=scheduled__2024-02-24T02:28:00+00:00, run_start_date=2024-02-24 02:30:00.281498+00:00, run_end_date=2024-02-24 02:30:02.197424+00:00, run_duration=1.915926, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:28:00+00:00, data_interval_end=2024-02-24 02:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T02:30:02.207856722Z [2024-02-24T02:30:02.207+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T02:30:00+00:00, run_after=2024-02-24T02:32:00+00:00 2024-02-24T02:30:02.313987006Z [2024-02-24T02:30:02.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:28:00+00:00 exited with status success for try_number 1 2024-02-24T02:30:02.322429057Z [2024-02-24T02:30:02.322+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T02:28:00+00:00, map_index=-1, run_start_date=2024-02-24 02:30:01.209921+00:00, run_end_date=2024-02-24 02:30:01.703002+00:00, run_duration=0.493081, state=success, executor_state=success, try_number=1, max_tries=1, job_id=784, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:30:00.394504+00:00, queued_by_job_id=2, pid=11461 2024-02-24T02:30:03.402278207Z [2024-02-24T02:30:03.401+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:30:03.402696123Z [2024-02-24T02:30:03.402+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:29:00+00:00, run_id=scheduled__2024-02-24T02:29:00+00:00, run_start_date=2024-02-24 02:30:00.283072+00:00, run_end_date=2024-02-24 02:30:03.402276+00:00, run_duration=3.119204, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:29:00+00:00, data_interval_end=2024-02-24 02:30:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:30:03.419504840Z [2024-02-24T02:30:03.419+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:30:00+00:00, run_after=2024-02-24T02:31:00+00:00 2024-02-24T02:30:03.459760389Z [2024-02-24T02:30:03.459+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:30:03.459799154Z 2024-02-24T02:30:03.459950121Z [2024-02-24T02:30:03.459+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:30:03.460643434Z [2024-02-24T02:30:03.460+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:30:03.460661484Z 2024-02-24T02:30:03.463546062Z [2024-02-24T02:30:03.463+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T02:30:03.463719164Z [2024-02-24T02:30:03.463+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:30:03.514344931Z [2024-02-24T02:30:03.513+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T02:25:00+00:00 exited with status queued for try_number 1 2024-02-24T02:30:03.514587049Z [2024-02-24T02:30:03.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T02:25:00+00:00 exited with status success for try_number 1 2024-02-24T02:30:03.514766606Z [2024-02-24T02:30:03.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:29:00+00:00 exited with status success for try_number 1 2024-02-24T02:30:03.523410959Z [2024-02-24T02:30:03.523+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T02:25:00+00:00, map_index=-1, run_start_date=2024-02-24 02:30:02.839663+00:00, run_end_date=2024-02-24 02:30:03.267637+00:00, run_duration=0.427974, state=success, executor_state=success, try_number=1, max_tries=1, job_id=787, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:30:00.394504+00:00, queued_by_job_id=2, pid=11497 2024-02-24T02:30:03.523982533Z [2024-02-24T02:30:03.523+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:29:00+00:00, map_index=-1, run_start_date=2024-02-24 02:30:01.818700+00:00, run_end_date=2024-02-24 02:30:02.251214+00:00, run_duration=0.432514, state=success, executor_state=success, try_number=1, max_tries=1, job_id=785, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:30:00.394504+00:00, queued_by_job_id=2, pid=11473 2024-02-24T02:30:03.524364143Z [2024-02-24T02:30:03.524+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd457c46-aff1-43f1-be03-7820ccd36a05 2024-02-24T02:30:04.878079330Z [2024-02-24T02:30:04.877+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:30:04.879142415Z [2024-02-24T02:30:04.877+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:29:00+00:00, run_id=scheduled__2024-02-24T02:29:00+00:00, run_start_date=2024-02-24 02:30:00.284668+00:00, run_end_date=2024-02-24 02:30:04.877865+00:00, run_duration=4.593197, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:29:00+00:00, data_interval_end=2024-02-24 02:30:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:30:04.889088945Z [2024-02-24T02:30:04.888+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:30:00+00:00, run_after=2024-02-24T02:31:00+00:00 2024-02-24T02:30:04.966193673Z [2024-02-24T02:30:04.965+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:29:00+00:00 exited with status success for try_number 1 2024-02-24T02:30:04.974000934Z [2024-02-24T02:30:04.973+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:29:00+00:00, map_index=-1, run_start_date=2024-02-24 02:30:02.820615+00:00, run_end_date=2024-02-24 02:30:04.159201+00:00, run_duration=1.338586, state=success, executor_state=success, try_number=1, max_tries=1, job_id=786, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:30:00.394504+00:00, queued_by_job_id=2, pid=11496 2024-02-24T02:30:05.369720355Z [2024-02-24T02:30:05.368+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:30:05.370559667Z [2024-02-24T02:30:05.369+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:29:00+00:00, run_id=scheduled__2024-02-24T02:29:00+00:00, run_start_date=2024-02-24 02:30:00.286212+00:00, run_end_date=2024-02-24 02:30:05.369491+00:00, run_duration=5.083279, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:29:00+00:00, data_interval_end=2024-02-24 02:30:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:30:05.381510202Z [2024-02-24T02:30:05.381+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:30:00+00:00, run_after=2024-02-24T02:31:00+00:00 2024-02-24T02:30:05.456020875Z [2024-02-24T02:30:05.455+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:29:00+00:00 exited with status success for try_number 1 2024-02-24T02:30:05.464460666Z [2024-02-24T02:30:05.463+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:29:00+00:00, map_index=-1, run_start_date=2024-02-24 02:30:03.059141+00:00, run_end_date=2024-02-24 02:30:04.728886+00:00, run_duration=1.669745, state=success, executor_state=success, try_number=1, max_tries=1, job_id=788, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:30:00.394504+00:00, queued_by_job_id=2, pid=11498 2024-02-24T02:30:06.040717340Z [2024-02-24T02:30:06.040+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:30:06.040750643Z 2024-02-24T02:30:06.041315747Z [2024-02-24T02:30:06.040+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:30:06.042920944Z [2024-02-24T02:30:06.042+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:30:06.042928388Z 2024-02-24T02:30:06.048643952Z [2024-02-24T02:30:06.048+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T02:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T02:30:06.049064867Z [2024-02-24T02:30:06.048+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T02:30:06.114835088Z [2024-02-24T02:30:06.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T02:25:00+00:00 exited with status queued for try_number 1 2024-02-24T02:30:06.115119739Z [2024-02-24T02:30:06.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T02:25:00+00:00 exited with status success for try_number 1 2024-02-24T02:30:06.122591186Z [2024-02-24T02:30:06.122+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64fec015-9273-433e-9b16-611b31f56360 2024-02-24T02:30:06.123016027Z [2024-02-24T02:30:06.122+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T02:25:00+00:00, map_index=-1, run_start_date=2024-02-24 02:30:05.189581+00:00, run_end_date=2024-02-24 02:30:05.584982+00:00, run_duration=0.395401, state=success, executor_state=success, try_number=1, max_tries=1, job_id=789, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:30:03.461125+00:00, queued_by_job_id=2, pid=11521 2024-02-24T02:30:08.370866798Z [2024-02-24T02:30:08.370+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:30:08.370903379Z 2024-02-24T02:30:08.371297010Z [2024-02-24T02:30:08.370+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:30:08.372303789Z [2024-02-24T02:30:08.372+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:30:08.372327228Z 2024-02-24T02:30:08.376576131Z [2024-02-24T02:30:08.375+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:30:08.376982356Z [2024-02-24T02:30:08.376+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:30:08.438132743Z [2024-02-24T02:30:08.437+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T02:25:00+00:00 exited with status queued for try_number 1 2024-02-24T02:30:08.438206864Z [2024-02-24T02:30:08.438+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T02:25:00+00:00 exited with status success for try_number 1 2024-02-24T02:30:08.447177714Z [2024-02-24T02:30:08.446+0000] {scheduler_job.py:635} INFO - Setting external_id for to e23023b3-4fd0-4d81-9df3-76463f4b25ee 2024-02-24T02:30:08.447423299Z [2024-02-24T02:30:08.447+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T02:25:00+00:00, map_index=0, run_start_date=2024-02-24 02:30:07.698423+00:00, run_end_date=2024-02-24 02:30:08.043204+00:00, run_duration=0.344781, state=success, executor_state=success, try_number=1, max_tries=1, job_id=790, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:30:06.043953+00:00, queued_by_job_id=2, pid=11529 2024-02-24T02:30:11.182366009Z [2024-02-24T02:30:11.181+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:30:11.184723403Z [2024-02-24T02:30:11.182+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:25:00+00:00, run_id=scheduled__2024-02-24T02:25:00+00:00, run_start_date=2024-02-24 02:30:00.279800+00:00, run_end_date=2024-02-24 02:30:11.182324+00:00, run_duration=10.902524, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:25:00+00:00, data_interval_end=2024-02-24 02:30:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T02:30:11.196058309Z [2024-02-24T02:30:11.195+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:30:00+00:00, run_after=2024-02-24T02:35:00+00:00 2024-02-24T02:30:11.231369102Z [2024-02-24T02:30:11.231+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T02:25:00+00:00 exited with status success for try_number 1 2024-02-24T02:30:11.236238474Z [2024-02-24T02:30:11.235+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T02:25:00+00:00, map_index=-1, run_start_date=2024-02-24 02:30:10.094746+00:00, run_end_date=2024-02-24 02:30:10.436171+00:00, run_duration=0.341425, state=success, executor_state=success, try_number=1, max_tries=1, job_id=791, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:30:08.373035+00:00, queued_by_job_id=2, pid=11537 2024-02-24T02:31:01.054714340Z [2024-02-24T02:31:01.054+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:31:01.068974361Z [2024-02-24T02:31:01.068+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:31:00+00:00, run_after=2024-02-24T02:32:00+00:00 2024-02-24T02:31:01.081140517Z [2024-02-24T02:31:01.080+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:31:00+00:00, run_after=2024-02-24T02:32:00+00:00 2024-02-24T02:31:01.152360788Z [2024-02-24T02:31:01.151+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T02:31:01.152411532Z 2024-02-24T02:31:01.152420525Z 2024-02-24T02:31:01.152427782Z 2024-02-24T02:31:01.152600687Z [2024-02-24T02:31:01.152+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:31:01.152693115Z [2024-02-24T02:31:01.152+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:31:01.152931157Z [2024-02-24T02:31:01.152+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:31:01.153695433Z [2024-02-24T02:31:01.153+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:31:01.153716752Z 2024-02-24T02:31:01.153889361Z 2024-02-24T02:31:01.153900342Z 2024-02-24T02:31:01.157172016Z [2024-02-24T02:31:01.156+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:31:01.157428741Z [2024-02-24T02:31:01.157+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:31:01.157906474Z [2024-02-24T02:31:01.157+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:31:01.157986378Z [2024-02-24T02:31:01.157+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:31:01.158329342Z [2024-02-24T02:31:01.158+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:31:01.158355211Z [2024-02-24T02:31:01.158+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:31:01.515175762Z [2024-02-24T02:31:01.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:30:00+00:00 exited with status queued for try_number 1 2024-02-24T02:31:01.518077710Z [2024-02-24T02:31:01.515+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:30:00+00:00 exited with status queued for try_number 1 2024-02-24T02:31:01.518392954Z [2024-02-24T02:31:01.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:30:00+00:00 exited with status queued for try_number 1 2024-02-24T02:31:01.532191666Z [2024-02-24T02:31:01.531+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0dade461-f621-49e1-987b-56036b652902 2024-02-24T02:31:01.534523551Z [2024-02-24T02:31:01.532+0000] {scheduler_job.py:635} INFO - Setting external_id for to 72312885-b8d8-496d-9724-d4a0dc99c3ac 2024-02-24T02:31:01.534844849Z [2024-02-24T02:31:01.534+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d69eb96-6e11-4013-85a8-6001c03876a5 2024-02-24T02:31:03.070378973Z [2024-02-24T02:31:03.069+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:31:03.070861581Z [2024-02-24T02:31:03.070+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:30:00+00:00, run_id=scheduled__2024-02-24T02:30:00+00:00, run_start_date=2024-02-24 02:31:01.091896+00:00, run_end_date=2024-02-24 02:31:03.070407+00:00, run_duration=1.978511, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:30:00+00:00, data_interval_end=2024-02-24 02:31:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:31:03.087055320Z [2024-02-24T02:31:03.086+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:31:00+00:00, run_after=2024-02-24T02:32:00+00:00 2024-02-24T02:31:03.161881744Z [2024-02-24T02:31:03.161+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:30:00+00:00 exited with status success for try_number 1 2024-02-24T02:31:03.168007368Z [2024-02-24T02:31:03.167+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:30:00+00:00, map_index=-1, run_start_date=2024-02-24 02:31:01.974793+00:00, run_end_date=2024-02-24 02:31:02.388053+00:00, run_duration=0.41326, state=success, executor_state=success, try_number=1, max_tries=1, job_id=792, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:31:01.154514+00:00, queued_by_job_id=2, pid=11559 2024-02-24T02:31:05.287937881Z [2024-02-24T02:31:05.287+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:31:05.288384869Z [2024-02-24T02:31:05.288+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:30:00+00:00, run_id=scheduled__2024-02-24T02:30:00+00:00, run_start_date=2024-02-24 02:31:01.094622+00:00, run_end_date=2024-02-24 02:31:05.287812+00:00, run_duration=4.19319, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:30:00+00:00, data_interval_end=2024-02-24 02:31:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:31:05.302338712Z [2024-02-24T02:31:05.301+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:31:00+00:00, run_after=2024-02-24T02:32:00+00:00 2024-02-24T02:31:05.311437646Z [2024-02-24T02:31:05.310+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:31:05.311776107Z [2024-02-24T02:31:05.311+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:30:00+00:00, run_id=scheduled__2024-02-24T02:30:00+00:00, run_start_date=2024-02-24 02:31:01.095741+00:00, run_end_date=2024-02-24 02:31:05.311320+00:00, run_duration=4.215579, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:30:00+00:00, data_interval_end=2024-02-24 02:31:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:31:05.322321230Z [2024-02-24T02:31:05.321+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:31:00+00:00, run_after=2024-02-24T02:32:00+00:00 2024-02-24T02:31:05.356163085Z [2024-02-24T02:31:05.355+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:30:00+00:00 exited with status success for try_number 1 2024-02-24T02:31:05.356426911Z [2024-02-24T02:31:05.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:30:00+00:00 exited with status success for try_number 1 2024-02-24T02:31:05.362629643Z [2024-02-24T02:31:05.362+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:30:00+00:00, map_index=-1, run_start_date=2024-02-24 02:31:03.145154+00:00, run_end_date=2024-02-24 02:31:04.489486+00:00, run_duration=1.344332, state=success, executor_state=success, try_number=1, max_tries=1, job_id=793, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:31:01.154514+00:00, queued_by_job_id=2, pid=11577 2024-02-24T02:31:05.362872493Z [2024-02-24T02:31:05.362+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:30:00+00:00, map_index=-1, run_start_date=2024-02-24 02:31:03.330114+00:00, run_end_date=2024-02-24 02:31:05.129608+00:00, run_duration=1.799494, state=success, executor_state=success, try_number=1, max_tries=1, job_id=794, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:31:01.154514+00:00, queued_by_job_id=2, pid=11578 2024-02-24T02:32:00.896244284Z [2024-02-24T02:32:00.894+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:32:00+00:00, run_after=2024-02-24T02:33:00+00:00 2024-02-24T02:32:00.904573636Z [2024-02-24T02:32:00.904+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:32:00.910804913Z [2024-02-24T02:32:00.910+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:32:00.921887633Z [2024-02-24T02:32:00.921+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:32:00+00:00, run_after=2024-02-24T02:33:00+00:00 2024-02-24T02:32:00.999433435Z [2024-02-24T02:32:00.999+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T02:32:00.999477499Z 2024-02-24T02:32:00.999481504Z 2024-02-24T02:32:00.999484821Z 2024-02-24T02:32:00.999488607Z 2024-02-24T02:32:00.999585577Z [2024-02-24T02:32:00.999+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T02:32:00.999766014Z [2024-02-24T02:32:00.999+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:32:00.999926300Z [2024-02-24T02:32:00.999+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:32:01.000094132Z [2024-02-24T02:32:00.999+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:32:01.000863306Z [2024-02-24T02:32:01.000+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:32:01.000878729Z 2024-02-24T02:32:01.000931618Z 2024-02-24T02:32:01.000937226Z 2024-02-24T02:32:01.000941694Z 2024-02-24T02:32:01.005163455Z [2024-02-24T02:32:01.004+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:32:01.005307221Z [2024-02-24T02:32:01.005+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T02:32:01.005547642Z [2024-02-24T02:32:01.005+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:32:01.005734240Z [2024-02-24T02:32:01.005+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:32:01.005921916Z [2024-02-24T02:32:01.005+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:32:01.006072319Z [2024-02-24T02:32:01.005+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:32:01.006284648Z [2024-02-24T02:32:01.006+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:32:01.006403729Z [2024-02-24T02:32:01.006+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:32:01.563082690Z [2024-02-24T02:32:01.562+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:30:00+00:00 exited with status queued for try_number 1 2024-02-24T02:32:01.563179879Z [2024-02-24T02:32:01.562+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:31:00+00:00 exited with status queued for try_number 1 2024-02-24T02:32:01.563309210Z [2024-02-24T02:32:01.563+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:31:00+00:00 exited with status queued for try_number 1 2024-02-24T02:32:01.563419906Z [2024-02-24T02:32:01.563+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:31:00+00:00 exited with status queued for try_number 1 2024-02-24T02:32:01.579537920Z [2024-02-24T02:32:01.579+0000] {scheduler_job.py:635} INFO - Setting external_id for to 258492e4-b775-4643-9876-955ae1eedd94 2024-02-24T02:32:01.579842230Z [2024-02-24T02:32:01.579+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5363a8f2-f590-4d56-83d3-c1686d98451b 2024-02-24T02:32:01.580079413Z [2024-02-24T02:32:01.579+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23d43fa6-d89e-428e-87ee-aee7fa1375ad 2024-02-24T02:32:01.580315585Z [2024-02-24T02:32:01.580+0000] {scheduler_job.py:635} INFO - Setting external_id for to 078a610a-7c05-42fb-aa5b-0cc44b5a107a 2024-02-24T02:32:02.833237504Z [2024-02-24T02:32:02.832+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:32:02.833542256Z [2024-02-24T02:32:02.833+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 02:30:00+00:00, run_id=scheduled__2024-02-24T02:30:00+00:00, run_start_date=2024-02-24 02:32:00.931762+00:00, run_end_date=2024-02-24 02:32:02.833209+00:00, run_duration=1.901447, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:30:00+00:00, data_interval_end=2024-02-24 02:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T02:32:02.841270672Z [2024-02-24T02:32:02.840+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T02:32:00+00:00, run_after=2024-02-24T02:34:00+00:00 2024-02-24T02:32:02.848022885Z [2024-02-24T02:32:02.847+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:32:02.848245200Z [2024-02-24T02:32:02.848+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:31:00+00:00, run_id=scheduled__2024-02-24T02:31:00+00:00, run_start_date=2024-02-24 02:32:00.932887+00:00, run_end_date=2024-02-24 02:32:02.847981+00:00, run_duration=1.915094, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:31:00+00:00, data_interval_end=2024-02-24 02:32:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:32:02.858058431Z [2024-02-24T02:32:02.857+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:32:00+00:00, run_after=2024-02-24T02:33:00+00:00 2024-02-24T02:32:02.906568461Z [2024-02-24T02:32:02.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:30:00+00:00 exited with status success for try_number 1 2024-02-24T02:32:02.906997736Z [2024-02-24T02:32:02.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:31:00+00:00 exited with status success for try_number 1 2024-02-24T02:32:02.915276241Z [2024-02-24T02:32:02.914+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T02:30:00+00:00, map_index=-1, run_start_date=2024-02-24 02:32:01.957676+00:00, run_end_date=2024-02-24 02:32:02.374459+00:00, run_duration=0.416783, state=success, executor_state=success, try_number=1, max_tries=1, job_id=796, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:32:01.001931+00:00, queued_by_job_id=2, pid=11612 2024-02-24T02:32:02.915411507Z [2024-02-24T02:32:02.915+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:31:00+00:00, map_index=-1, run_start_date=2024-02-24 02:32:01.879995+00:00, run_end_date=2024-02-24 02:32:02.246762+00:00, run_duration=0.366767, state=success, executor_state=success, try_number=1, max_tries=1, job_id=795, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:32:01.001931+00:00, queued_by_job_id=2, pid=11611 2024-02-24T02:32:04.308056162Z [2024-02-24T02:32:04.307+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T02:32:05.362972942Z [2024-02-24T02:32:05.362+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:32:05.363235503Z [2024-02-24T02:32:05.362+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:31:00+00:00, run_id=scheduled__2024-02-24T02:31:00+00:00, run_start_date=2024-02-24 02:32:00.933911+00:00, run_end_date=2024-02-24 02:32:05.362812+00:00, run_duration=4.428901, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:31:00+00:00, data_interval_end=2024-02-24 02:32:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:32:05.377390741Z [2024-02-24T02:32:05.376+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:32:00+00:00, run_after=2024-02-24T02:33:00+00:00 2024-02-24T02:32:05.422045247Z [2024-02-24T02:32:05.421+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:31:00+00:00 exited with status success for try_number 1 2024-02-24T02:32:05.427688776Z [2024-02-24T02:32:05.427+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:31:00+00:00, map_index=-1, run_start_date=2024-02-24 02:32:03.405963+00:00, run_end_date=2024-02-24 02:32:04.840462+00:00, run_duration=1.434499, state=success, executor_state=success, try_number=1, max_tries=1, job_id=798, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:32:01.001931+00:00, queued_by_job_id=2, pid=11636 2024-02-24T02:32:06.227605107Z [2024-02-24T02:32:06.227+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:32:06.227969493Z [2024-02-24T02:32:06.227+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:31:00+00:00, run_id=scheduled__2024-02-24T02:31:00+00:00, run_start_date=2024-02-24 02:32:00.934904+00:00, run_end_date=2024-02-24 02:32:06.227514+00:00, run_duration=5.29261, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:31:00+00:00, data_interval_end=2024-02-24 02:32:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:32:06.236799637Z [2024-02-24T02:32:06.236+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:32:00+00:00, run_after=2024-02-24T02:33:00+00:00 2024-02-24T02:32:06.267470339Z [2024-02-24T02:32:06.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:31:00+00:00 exited with status success for try_number 1 2024-02-24T02:32:06.272342278Z [2024-02-24T02:32:06.271+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:31:00+00:00, map_index=-1, run_start_date=2024-02-24 02:32:03.150633+00:00, run_end_date=2024-02-24 02:32:05.564240+00:00, run_duration=2.413607, state=success, executor_state=success, try_number=1, max_tries=1, job_id=797, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:32:01.001931+00:00, queued_by_job_id=2, pid=11635 2024-02-24T02:33:00.827662305Z [2024-02-24T02:33:00.827+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:33:00+00:00, run_after=2024-02-24T02:34:00+00:00 2024-02-24T02:33:00.840821906Z [2024-02-24T02:33:00.840+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:33:00.870317984Z [2024-02-24T02:33:00.869+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:33:00+00:00, run_after=2024-02-24T02:34:00+00:00 2024-02-24T02:33:00.968145996Z [2024-02-24T02:33:00.967+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T02:33:00.968203974Z 2024-02-24T02:33:00.968211325Z 2024-02-24T02:33:00.968216920Z 2024-02-24T02:33:00.968221911Z [2024-02-24T02:33:00.967+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:33:00.968253869Z [2024-02-24T02:33:00.968+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:33:00.968258755Z [2024-02-24T02:33:00.968+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:33:00.969093985Z [2024-02-24T02:33:00.968+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:33:00.969156250Z 2024-02-24T02:33:00.969166622Z 2024-02-24T02:33:00.969175630Z 2024-02-24T02:33:00.972936520Z [2024-02-24T02:33:00.972+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:33:00.973111887Z [2024-02-24T02:33:00.972+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:33:00.973414781Z [2024-02-24T02:33:00.973+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:33:00.973582265Z [2024-02-24T02:33:00.973+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:33:00.973905991Z [2024-02-24T02:33:00.973+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:33:00.974144367Z [2024-02-24T02:33:00.973+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:33:01.277494925Z [2024-02-24T02:33:01.274+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:32:00+00:00 exited with status queued for try_number 1 2024-02-24T02:33:01.277518365Z [2024-02-24T02:33:01.275+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:32:00+00:00 exited with status queued for try_number 1 2024-02-24T02:33:01.277522027Z [2024-02-24T02:33:01.275+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:32:00+00:00 exited with status queued for try_number 1 2024-02-24T02:33:01.292686606Z [2024-02-24T02:33:01.289+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0cdbb7d9-e21d-4a8b-aaae-04b65ccb4801 2024-02-24T02:33:01.292708604Z [2024-02-24T02:33:01.290+0000] {scheduler_job.py:635} INFO - Setting external_id for to 90a90332-ee8e-49ee-96d1-e9a77dacc382 2024-02-24T02:33:01.292723965Z [2024-02-24T02:33:01.290+0000] {scheduler_job.py:635} INFO - Setting external_id for to 917e5247-81d1-4b0d-971e-2363cad99ab7 2024-02-24T02:33:03.573151212Z [2024-02-24T02:33:03.572+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:33:03.573606401Z [2024-02-24T02:33:03.573+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:32:00+00:00, run_id=scheduled__2024-02-24T02:32:00+00:00, run_start_date=2024-02-24 02:33:00.887863+00:00, run_end_date=2024-02-24 02:33:03.573100+00:00, run_duration=2.685237, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:32:00+00:00, data_interval_end=2024-02-24 02:33:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:33:03.596885932Z [2024-02-24T02:33:03.596+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:33:00+00:00, run_after=2024-02-24T02:34:00+00:00 2024-02-24T02:33:03.676754707Z [2024-02-24T02:33:03.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:32:00+00:00 exited with status success for try_number 1 2024-02-24T02:33:03.686699669Z [2024-02-24T02:33:03.686+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:32:00+00:00, map_index=-1, run_start_date=2024-02-24 02:33:02.014428+00:00, run_end_date=2024-02-24 02:33:02.535739+00:00, run_duration=0.521311, state=success, executor_state=success, try_number=1, max_tries=1, job_id=799, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:33:00.969566+00:00, queued_by_job_id=2, pid=11668 2024-02-24T02:33:04.928318688Z [2024-02-24T02:33:04.927+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:33:04.928648328Z [2024-02-24T02:33:04.928+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:32:00+00:00, run_id=scheduled__2024-02-24T02:32:00+00:00, run_start_date=2024-02-24 02:33:00.889927+00:00, run_end_date=2024-02-24 02:33:04.928112+00:00, run_duration=4.038185, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:32:00+00:00, data_interval_end=2024-02-24 02:33:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:33:04.942148942Z [2024-02-24T02:33:04.941+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:33:00+00:00, run_after=2024-02-24T02:34:00+00:00 2024-02-24T02:33:04.984165560Z [2024-02-24T02:33:04.983+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:32:00+00:00 exited with status success for try_number 1 2024-02-24T02:33:04.989428508Z [2024-02-24T02:33:04.989+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:32:00+00:00, map_index=-1, run_start_date=2024-02-24 02:33:03.073462+00:00, run_end_date=2024-02-24 02:33:04.628907+00:00, run_duration=1.555445, state=success, executor_state=success, try_number=1, max_tries=1, job_id=801, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:33:00.969566+00:00, queued_by_job_id=2, pid=11687 2024-02-24T02:33:06.027240212Z [2024-02-24T02:33:06.026+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:33:06.027683099Z [2024-02-24T02:33:06.027+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:32:00+00:00, run_id=scheduled__2024-02-24T02:32:00+00:00, run_start_date=2024-02-24 02:33:00.891547+00:00, run_end_date=2024-02-24 02:33:06.027143+00:00, run_duration=5.135596, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:32:00+00:00, data_interval_end=2024-02-24 02:33:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:33:06.038795032Z [2024-02-24T02:33:06.038+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:33:00+00:00, run_after=2024-02-24T02:34:00+00:00 2024-02-24T02:33:06.079505929Z [2024-02-24T02:33:06.078+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:32:00+00:00 exited with status success for try_number 1 2024-02-24T02:33:06.087048852Z [2024-02-24T02:33:06.086+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:32:00+00:00, map_index=-1, run_start_date=2024-02-24 02:33:03.051383+00:00, run_end_date=2024-02-24 02:33:04.934454+00:00, run_duration=1.883071, state=success, executor_state=success, try_number=1, max_tries=1, job_id=800, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:33:00.969566+00:00, queued_by_job_id=2, pid=11686 2024-02-24T02:34:00.806695450Z [2024-02-24T02:34:00.805+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:34:00.820139227Z [2024-02-24T02:34:00.819+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:34:00+00:00, run_after=2024-02-24T02:35:00+00:00 2024-02-24T02:34:00.827052637Z [2024-02-24T02:34:00.826+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:34:00.846872100Z [2024-02-24T02:34:00.846+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:34:00+00:00, run_after=2024-02-24T02:35:00+00:00 2024-02-24T02:34:00.939680052Z [2024-02-24T02:34:00.939+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T02:34:00.939705840Z 2024-02-24T02:34:00.939710555Z 2024-02-24T02:34:00.939714039Z 2024-02-24T02:34:00.939733590Z 2024-02-24T02:34:00.939947039Z [2024-02-24T02:34:00.939+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T02:34:00.940100831Z [2024-02-24T02:34:00.939+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:34:00.940321247Z [2024-02-24T02:34:00.940+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:34:00.940514927Z [2024-02-24T02:34:00.940+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:34:00.941256397Z [2024-02-24T02:34:00.941+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:34:00.941267877Z 2024-02-24T02:34:00.941271713Z 2024-02-24T02:34:00.941274979Z 2024-02-24T02:34:00.941278142Z 2024-02-24T02:34:00.946086179Z [2024-02-24T02:34:00.945+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:34:00.946314219Z [2024-02-24T02:34:00.946+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T02:34:00.946644670Z [2024-02-24T02:34:00.946+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:34:00.946751462Z [2024-02-24T02:34:00.946+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:34:00.947049001Z [2024-02-24T02:34:00.946+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:34:00.947203911Z [2024-02-24T02:34:00.947+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:34:00.947454059Z [2024-02-24T02:34:00.947+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:34:00.947599599Z [2024-02-24T02:34:00.947+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:34:01.447486697Z [2024-02-24T02:34:01.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:32:00+00:00 exited with status queued for try_number 1 2024-02-24T02:34:01.447608914Z [2024-02-24T02:34:01.447+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:33:00+00:00 exited with status queued for try_number 1 2024-02-24T02:34:01.447795465Z [2024-02-24T02:34:01.447+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:33:00+00:00 exited with status queued for try_number 1 2024-02-24T02:34:01.447941037Z [2024-02-24T02:34:01.447+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:33:00+00:00 exited with status queued for try_number 1 2024-02-24T02:34:01.463537197Z [2024-02-24T02:34:01.463+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d82e2fa-7545-4557-b47f-8a47a0fec2b3 2024-02-24T02:34:01.463669903Z [2024-02-24T02:34:01.463+0000] {scheduler_job.py:635} INFO - Setting external_id for to 556e6484-fb94-4351-b3b8-603a37ae527e 2024-02-24T02:34:01.463841377Z [2024-02-24T02:34:01.463+0000] {scheduler_job.py:635} INFO - Setting external_id for to 684f71a8-c9ac-43e2-8440-49cf62687499 2024-02-24T02:34:01.463994010Z [2024-02-24T02:34:01.463+0000] {scheduler_job.py:635} INFO - Setting external_id for to faa13534-21c7-4ade-a4c4-cb0d1ac22eb5 2024-02-24T02:34:04.193322127Z [2024-02-24T02:34:04.192+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:34:04.195465924Z [2024-02-24T02:34:04.193+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:33:00+00:00, run_id=scheduled__2024-02-24T02:33:00+00:00, run_start_date=2024-02-24 02:34:00.866318+00:00, run_end_date=2024-02-24 02:34:04.193258+00:00, run_duration=3.32694, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:33:00+00:00, data_interval_end=2024-02-24 02:34:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:34:04.205555942Z [2024-02-24T02:34:04.205+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:34:00+00:00, run_after=2024-02-24T02:35:00+00:00 2024-02-24T02:34:04.213275213Z [2024-02-24T02:34:04.212+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:34:04.213412627Z [2024-02-24T02:34:04.213+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 02:32:00+00:00, run_id=scheduled__2024-02-24T02:32:00+00:00, run_start_date=2024-02-24 02:34:00.864757+00:00, run_end_date=2024-02-24 02:34:04.213186+00:00, run_duration=3.348429, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:32:00+00:00, data_interval_end=2024-02-24 02:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T02:34:04.222923861Z [2024-02-24T02:34:04.222+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T02:34:00+00:00, run_after=2024-02-24T02:36:00+00:00 2024-02-24T02:34:04.297657243Z [2024-02-24T02:34:04.297+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:32:00+00:00 exited with status success for try_number 1 2024-02-24T02:34:04.297821425Z [2024-02-24T02:34:04.297+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:33:00+00:00 exited with status success for try_number 1 2024-02-24T02:34:04.305390481Z [2024-02-24T02:34:04.304+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T02:32:00+00:00, map_index=-1, run_start_date=2024-02-24 02:34:02.201438+00:00, run_end_date=2024-02-24 02:34:03.011583+00:00, run_duration=0.810145, state=success, executor_state=success, try_number=1, max_tries=1, job_id=803, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:34:00.942456+00:00, queued_by_job_id=2, pid=11720 2024-02-24T02:34:04.305481116Z [2024-02-24T02:34:04.305+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:33:00+00:00, map_index=-1, run_start_date=2024-02-24 02:34:02.220852+00:00, run_end_date=2024-02-24 02:34:03.087242+00:00, run_duration=0.86639, state=success, executor_state=success, try_number=1, max_tries=1, job_id=802, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:34:00.942456+00:00, queued_by_job_id=2, pid=11721 2024-02-24T02:34:05.935073959Z [2024-02-24T02:34:05.934+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:34:05.935743397Z [2024-02-24T02:34:05.935+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:33:00+00:00, run_id=scheduled__2024-02-24T02:33:00+00:00, run_start_date=2024-02-24 02:34:00.867776+00:00, run_end_date=2024-02-24 02:34:05.934902+00:00, run_duration=5.067126, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:33:00+00:00, data_interval_end=2024-02-24 02:34:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:34:05.954533879Z [2024-02-24T02:34:05.954+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:34:00+00:00, run_after=2024-02-24T02:35:00+00:00 2024-02-24T02:34:06.011128481Z [2024-02-24T02:34:06.010+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:33:00+00:00 exited with status success for try_number 1 2024-02-24T02:34:06.017244278Z [2024-02-24T02:34:06.016+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:33:00+00:00, map_index=-1, run_start_date=2024-02-24 02:34:03.486428+00:00, run_end_date=2024-02-24 02:34:05.442206+00:00, run_duration=1.955778, state=success, executor_state=success, try_number=1, max_tries=1, job_id=804, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:34:00.942456+00:00, queued_by_job_id=2, pid=11739 2024-02-24T02:34:08.166636266Z [2024-02-24T02:34:08.166+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:34:08.166999298Z [2024-02-24T02:34:08.166+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:33:00+00:00, run_id=scheduled__2024-02-24T02:33:00+00:00, run_start_date=2024-02-24 02:34:00.869418+00:00, run_end_date=2024-02-24 02:34:08.166506+00:00, run_duration=7.297088, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:33:00+00:00, data_interval_end=2024-02-24 02:34:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:34:08.174665245Z [2024-02-24T02:34:08.174+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:34:00+00:00, run_after=2024-02-24T02:35:00+00:00 2024-02-24T02:34:09.289068316Z [2024-02-24T02:34:09.288+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:33:00+00:00 exited with status success for try_number 1 2024-02-24T02:34:09.294199784Z [2024-02-24T02:34:09.293+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:33:00+00:00, map_index=-1, run_start_date=2024-02-24 02:34:04.343292+00:00, run_end_date=2024-02-24 02:34:08.120048+00:00, run_duration=3.776756, state=success, executor_state=success, try_number=1, max_tries=1, job_id=805, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:34:00.942456+00:00, queued_by_job_id=2, pid=11750 2024-02-24T02:35:00.660307049Z [2024-02-24T02:35:00.659+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:35:00+00:00, run_after=2024-02-24T02:36:00+00:00 2024-02-24T02:35:00.669703760Z [2024-02-24T02:35:00.669+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:35:00.681852263Z [2024-02-24T02:35:00.681+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:35:00+00:00, run_after=2024-02-24T02:40:00+00:00 2024-02-24T02:35:00.704432358Z [2024-02-24T02:35:00.703+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:35:00+00:00, run_after=2024-02-24T02:36:00+00:00 2024-02-24T02:35:00.797805309Z [2024-02-24T02:35:00.797+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T02:35:00.797855194Z 2024-02-24T02:35:00.797868583Z 2024-02-24T02:35:00.797903485Z 2024-02-24T02:35:00.797909333Z 2024-02-24T02:35:00.798018384Z [2024-02-24T02:35:00.797+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:35:00.798026781Z [2024-02-24T02:35:00.797+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:35:00.798111762Z [2024-02-24T02:35:00.797+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:35:00.798178660Z [2024-02-24T02:35:00.798+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:35:00.799304849Z [2024-02-24T02:35:00.798+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:35:00.799340754Z 2024-02-24T02:35:00.799369087Z 2024-02-24T02:35:00.799374519Z 2024-02-24T02:35:00.799379296Z 2024-02-24T02:35:00.806702431Z [2024-02-24T02:35:00.806+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T02:35:00.806760991Z [2024-02-24T02:35:00.806+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:35:00.806979096Z [2024-02-24T02:35:00.806+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:35:00.806998096Z [2024-02-24T02:35:00.806+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:35:00.807200186Z [2024-02-24T02:35:00.807+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:35:00.807293455Z [2024-02-24T02:35:00.807+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:35:00.807444042Z [2024-02-24T02:35:00.807+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:35:00.807509275Z [2024-02-24T02:35:00.807+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:35:01.253890394Z [2024-02-24T02:35:01.249+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T02:30:00+00:00 exited with status queued for try_number 1 2024-02-24T02:35:01.253930548Z [2024-02-24T02:35:01.249+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:34:00+00:00 exited with status queued for try_number 1 2024-02-24T02:35:01.253934477Z [2024-02-24T02:35:01.249+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:34:00+00:00 exited with status queued for try_number 1 2024-02-24T02:35:01.253937944Z [2024-02-24T02:35:01.249+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:34:00+00:00 exited with status queued for try_number 1 2024-02-24T02:35:01.287759153Z [2024-02-24T02:35:01.287+0000] {scheduler_job.py:635} INFO - Setting external_id for to bde1f27a-6fef-4de5-bee4-3217e8f91237 2024-02-24T02:35:01.287886696Z [2024-02-24T02:35:01.287+0000] {scheduler_job.py:635} INFO - Setting external_id for to d65f8d21-1bf9-462c-9d8f-6c4948d546d1 2024-02-24T02:35:01.290020933Z [2024-02-24T02:35:01.287+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6f9b8d3-46e7-40ea-80bd-8c30232f303c 2024-02-24T02:35:01.290043201Z [2024-02-24T02:35:01.288+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d268d2b-1d1a-44fc-be0c-fad589814c23 2024-02-24T02:35:02.568385791Z [2024-02-24T02:35:02.567+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:35:02.568833213Z [2024-02-24T02:35:02.568+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:34:00+00:00, run_id=scheduled__2024-02-24T02:34:00+00:00, run_start_date=2024-02-24 02:35:00.720240+00:00, run_end_date=2024-02-24 02:35:02.568285+00:00, run_duration=1.848045, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:34:00+00:00, data_interval_end=2024-02-24 02:35:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:35:02.581034437Z [2024-02-24T02:35:02.580+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:35:00+00:00, run_after=2024-02-24T02:36:00+00:00 2024-02-24T02:35:02.646044588Z [2024-02-24T02:35:02.642+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:34:00+00:00 exited with status success for try_number 1 2024-02-24T02:35:02.652837116Z [2024-02-24T02:35:02.652+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:34:00+00:00, map_index=-1, run_start_date=2024-02-24 02:35:01.760369+00:00, run_end_date=2024-02-24 02:35:02.245722+00:00, run_duration=0.485353, state=success, executor_state=success, try_number=1, max_tries=1, job_id=806, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:35:00.801235+00:00, queued_by_job_id=2, pid=11778 2024-02-24T02:35:04.968301200Z [2024-02-24T02:35:04.965+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:35:04.968340780Z [2024-02-24T02:35:04.966+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:34:00+00:00, run_id=scheduled__2024-02-24T02:34:00+00:00, run_start_date=2024-02-24 02:35:00.721451+00:00, run_end_date=2024-02-24 02:35:04.966174+00:00, run_duration=4.244723, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:34:00+00:00, data_interval_end=2024-02-24 02:35:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:35:04.975607513Z [2024-02-24T02:35:04.975+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:35:00+00:00, run_after=2024-02-24T02:36:00+00:00 2024-02-24T02:35:05.001229431Z [2024-02-24T02:35:05.000+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:35:05.001265057Z 2024-02-24T02:35:05.001279451Z [2024-02-24T02:35:05.001+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:35:05.001851678Z [2024-02-24T02:35:05.001+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:35:05.001864323Z 2024-02-24T02:35:05.012789591Z [2024-02-24T02:35:05.012+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T02:35:05.012830335Z [2024-02-24T02:35:05.012+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:35:05.078507453Z [2024-02-24T02:35:05.078+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T02:30:00+00:00 exited with status queued for try_number 1 2024-02-24T02:35:05.078651269Z [2024-02-24T02:35:05.078+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T02:30:00+00:00 exited with status success for try_number 1 2024-02-24T02:35:05.078817523Z [2024-02-24T02:35:05.078+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:34:00+00:00 exited with status success for try_number 1 2024-02-24T02:35:05.087074277Z [2024-02-24T02:35:05.086+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T02:30:00+00:00, map_index=-1, run_start_date=2024-02-24 02:35:03.396169+00:00, run_end_date=2024-02-24 02:35:03.908316+00:00, run_duration=0.512147, state=success, executor_state=success, try_number=1, max_tries=1, job_id=809, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:35:00.801235+00:00, queued_by_job_id=2, pid=11804 2024-02-24T02:35:05.087345367Z [2024-02-24T02:35:05.087+0000] {scheduler_job.py:635} INFO - Setting external_id for to 697bb3e0-5c0a-46f8-bb39-8d19755235cc 2024-02-24T02:35:05.087575959Z [2024-02-24T02:35:05.087+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:34:00+00:00, map_index=-1, run_start_date=2024-02-24 02:35:03.201284+00:00, run_end_date=2024-02-24 02:35:04.783506+00:00, run_duration=1.582222, state=success, executor_state=success, try_number=1, max_tries=1, job_id=807, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:35:00.801235+00:00, queued_by_job_id=2, pid=11802 2024-02-24T02:35:06.246622762Z [2024-02-24T02:35:06.246+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:35:06.246920094Z [2024-02-24T02:35:06.246+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:34:00+00:00, run_id=scheduled__2024-02-24T02:34:00+00:00, run_start_date=2024-02-24 02:35:00.722539+00:00, run_end_date=2024-02-24 02:35:06.246592+00:00, run_duration=5.524053, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:34:00+00:00, data_interval_end=2024-02-24 02:35:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:35:06.257222612Z [2024-02-24T02:35:06.256+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:35:00+00:00, run_after=2024-02-24T02:36:00+00:00 2024-02-24T02:35:06.306490708Z [2024-02-24T02:35:06.305+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:34:00+00:00 exited with status success for try_number 1 2024-02-24T02:35:06.315369730Z [2024-02-24T02:35:06.314+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:34:00+00:00, map_index=-1, run_start_date=2024-02-24 02:35:03.358390+00:00, run_end_date=2024-02-24 02:35:05.701165+00:00, run_duration=2.342775, state=success, executor_state=success, try_number=1, max_tries=1, job_id=808, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:35:00.801235+00:00, queued_by_job_id=2, pid=11803 2024-02-24T02:35:07.557840156Z [2024-02-24T02:35:07.557+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:35:07.557885296Z 2024-02-24T02:35:07.558151812Z [2024-02-24T02:35:07.557+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:35:07.558927415Z [2024-02-24T02:35:07.558+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:35:07.558947894Z 2024-02-24T02:35:07.561692501Z [2024-02-24T02:35:07.561+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T02:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T02:35:07.561982094Z [2024-02-24T02:35:07.561+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T02:35:07.604800928Z [2024-02-24T02:35:07.604+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T02:30:00+00:00 exited with status queued for try_number 1 2024-02-24T02:35:07.604887720Z [2024-02-24T02:35:07.604+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T02:30:00+00:00 exited with status success for try_number 1 2024-02-24T02:35:07.611908607Z [2024-02-24T02:35:07.611+0000] {scheduler_job.py:635} INFO - Setting external_id for to b8158340-b03f-4fb5-a3f3-5c494142a683 2024-02-24T02:35:07.612290482Z [2024-02-24T02:35:07.611+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T02:30:00+00:00, map_index=-1, run_start_date=2024-02-24 02:35:06.758903+00:00, run_end_date=2024-02-24 02:35:07.065965+00:00, run_duration=0.307062, state=success, executor_state=success, try_number=1, max_tries=1, job_id=810, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:35:05.002178+00:00, queued_by_job_id=2, pid=11827 2024-02-24T02:35:09.891906892Z [2024-02-24T02:35:09.891+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:35:09.891941287Z 2024-02-24T02:35:09.892145901Z [2024-02-24T02:35:09.891+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:35:09.893609757Z [2024-02-24T02:35:09.893+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:35:09.893623954Z 2024-02-24T02:35:09.896077661Z [2024-02-24T02:35:09.895+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:35:09.896317235Z [2024-02-24T02:35:09.896+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:35:09.935546131Z [2024-02-24T02:35:09.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T02:30:00+00:00 exited with status queued for try_number 1 2024-02-24T02:35:09.936120243Z [2024-02-24T02:35:09.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T02:30:00+00:00 exited with status success for try_number 1 2024-02-24T02:35:09.947132352Z [2024-02-24T02:35:09.946+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3556eed4-1b08-4c7f-a701-22fbba2f9e0d 2024-02-24T02:35:09.947579649Z [2024-02-24T02:35:09.947+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T02:30:00+00:00, map_index=0, run_start_date=2024-02-24 02:35:09.085865+00:00, run_end_date=2024-02-24 02:35:09.422711+00:00, run_duration=0.336846, state=success, executor_state=success, try_number=1, max_tries=1, job_id=811, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:35:07.559334+00:00, queued_by_job_id=2, pid=11835 2024-02-24T02:35:12.646270719Z [2024-02-24T02:35:12.645+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:35:12.646297807Z [2024-02-24T02:35:12.645+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:30:00+00:00, run_id=scheduled__2024-02-24T02:30:00+00:00, run_start_date=2024-02-24 02:35:00.718847+00:00, run_end_date=2024-02-24 02:35:12.645363+00:00, run_duration=11.926516, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:30:00+00:00, data_interval_end=2024-02-24 02:35:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T02:35:12.652448710Z [2024-02-24T02:35:12.651+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:35:00+00:00, run_after=2024-02-24T02:40:00+00:00 2024-02-24T02:35:12.698110412Z [2024-02-24T02:35:12.697+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T02:30:00+00:00 exited with status success for try_number 1 2024-02-24T02:35:12.704974222Z [2024-02-24T02:35:12.704+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T02:30:00+00:00, map_index=-1, run_start_date=2024-02-24 02:35:11.460227+00:00, run_end_date=2024-02-24 02:35:11.824116+00:00, run_duration=0.363889, state=success, executor_state=success, try_number=1, max_tries=1, job_id=812, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:35:09.894147+00:00, queued_by_job_id=2, pid=11843 2024-02-24T02:36:00.122817999Z [2024-02-24T02:36:00.122+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:36:00.137317525Z [2024-02-24T02:36:00.136+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:36:00.152903555Z [2024-02-24T02:36:00.152+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:36:00+00:00, run_after=2024-02-24T02:37:00+00:00 2024-02-24T02:36:00.166412344Z [2024-02-24T02:36:00.166+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:36:00+00:00, run_after=2024-02-24T02:37:00+00:00 2024-02-24T02:36:00.288360136Z [2024-02-24T02:36:00.287+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T02:36:00.288394973Z 2024-02-24T02:36:00.288402808Z 2024-02-24T02:36:00.288409772Z 2024-02-24T02:36:00.288415970Z 2024-02-24T02:36:00.288434563Z [2024-02-24T02:36:00.288+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T02:36:00.288668338Z [2024-02-24T02:36:00.288+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:36:00.288880861Z [2024-02-24T02:36:00.288+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:36:00.289005760Z [2024-02-24T02:36:00.288+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:36:00.289910347Z [2024-02-24T02:36:00.289+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:36:00.289933694Z 2024-02-24T02:36:00.289940795Z 2024-02-24T02:36:00.289946913Z 2024-02-24T02:36:00.289953148Z 2024-02-24T02:36:00.294941917Z [2024-02-24T02:36:00.294+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:36:00.294969407Z [2024-02-24T02:36:00.294+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T02:36:00.295119269Z [2024-02-24T02:36:00.294+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:36:00.295155278Z [2024-02-24T02:36:00.295+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:36:00.295322978Z [2024-02-24T02:36:00.295+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:36:00.295464533Z [2024-02-24T02:36:00.295+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:36:00.295827829Z [2024-02-24T02:36:00.295+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:36:00.295951747Z [2024-02-24T02:36:00.295+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:36:00.692292476Z [2024-02-24T02:36:00.691+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:34:00+00:00 exited with status queued for try_number 1 2024-02-24T02:36:00.692458001Z [2024-02-24T02:36:00.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:35:00+00:00 exited with status queued for try_number 1 2024-02-24T02:36:00.692627404Z [2024-02-24T02:36:00.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:35:00+00:00 exited with status queued for try_number 1 2024-02-24T02:36:00.692912015Z [2024-02-24T02:36:00.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:35:00+00:00 exited with status queued for try_number 1 2024-02-24T02:36:00.711737485Z [2024-02-24T02:36:00.711+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a4e2400-2292-4c55-97d9-e9debcf066ea 2024-02-24T02:36:00.711916354Z [2024-02-24T02:36:00.711+0000] {scheduler_job.py:635} INFO - Setting external_id for to f75a41f2-18bb-4935-a517-12bb0c33a9ed 2024-02-24T02:36:00.712103286Z [2024-02-24T02:36:00.711+0000] {scheduler_job.py:635} INFO - Setting external_id for to 91a75182-884b-41d3-80c1-56d8120e6df5 2024-02-24T02:36:00.712275444Z [2024-02-24T02:36:00.712+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a0b1be1-cb23-460c-b93c-ece2c8edc603 2024-02-24T02:36:02.354556523Z [2024-02-24T02:36:02.354+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:36:02.354903098Z [2024-02-24T02:36:02.354+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 02:34:00+00:00, run_id=scheduled__2024-02-24T02:34:00+00:00, run_start_date=2024-02-24 02:36:00.186268+00:00, run_end_date=2024-02-24 02:36:02.354475+00:00, run_duration=2.168207, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:34:00+00:00, data_interval_end=2024-02-24 02:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T02:36:02.367249726Z [2024-02-24T02:36:02.366+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T02:36:00+00:00, run_after=2024-02-24T02:38:00+00:00 2024-02-24T02:36:02.381944285Z [2024-02-24T02:36:02.379+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:36:02.381968944Z [2024-02-24T02:36:02.379+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:35:00+00:00, run_id=scheduled__2024-02-24T02:35:00+00:00, run_start_date=2024-02-24 02:36:00.188865+00:00, run_end_date=2024-02-24 02:36:02.379861+00:00, run_duration=2.190996, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:35:00+00:00, data_interval_end=2024-02-24 02:36:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:36:02.393924210Z [2024-02-24T02:36:02.390+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:36:00+00:00, run_after=2024-02-24T02:37:00+00:00 2024-02-24T02:36:02.494116896Z [2024-02-24T02:36:02.493+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:34:00+00:00 exited with status success for try_number 1 2024-02-24T02:36:02.494224322Z [2024-02-24T02:36:02.494+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:35:00+00:00 exited with status success for try_number 1 2024-02-24T02:36:02.505597400Z [2024-02-24T02:36:02.505+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T02:34:00+00:00, map_index=-1, run_start_date=2024-02-24 02:36:01.224976+00:00, run_end_date=2024-02-24 02:36:01.909561+00:00, run_duration=0.684585, state=success, executor_state=success, try_number=1, max_tries=1, job_id=813, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:36:00.291291+00:00, queued_by_job_id=2, pid=11866 2024-02-24T02:36:02.505681641Z [2024-02-24T02:36:02.505+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:35:00+00:00, map_index=-1, run_start_date=2024-02-24 02:36:01.601219+00:00, run_end_date=2024-02-24 02:36:02.115244+00:00, run_duration=0.514025, state=success, executor_state=success, try_number=1, max_tries=1, job_id=814, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:36:00.291291+00:00, queued_by_job_id=2, pid=11867 2024-02-24T02:36:04.702488144Z [2024-02-24T02:36:04.701+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:36:04.702806528Z [2024-02-24T02:36:04.702+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:35:00+00:00, run_id=scheduled__2024-02-24T02:35:00+00:00, run_start_date=2024-02-24 02:36:00.193233+00:00, run_end_date=2024-02-24 02:36:04.702366+00:00, run_duration=4.509133, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:35:00+00:00, data_interval_end=2024-02-24 02:36:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:36:04.716339551Z [2024-02-24T02:36:04.715+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:36:00+00:00, run_after=2024-02-24T02:37:00+00:00 2024-02-24T02:36:04.728000584Z [2024-02-24T02:36:04.727+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:36:04.728043473Z [2024-02-24T02:36:04.727+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:35:00+00:00, run_id=scheduled__2024-02-24T02:35:00+00:00, run_start_date=2024-02-24 02:36:00.195393+00:00, run_end_date=2024-02-24 02:36:04.727680+00:00, run_duration=4.532287, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:35:00+00:00, data_interval_end=2024-02-24 02:36:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:36:04.738200914Z [2024-02-24T02:36:04.737+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:36:00+00:00, run_after=2024-02-24T02:37:00+00:00 2024-02-24T02:36:04.783890401Z [2024-02-24T02:36:04.783+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:35:00+00:00 exited with status success for try_number 1 2024-02-24T02:36:04.783946543Z [2024-02-24T02:36:04.783+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:35:00+00:00 exited with status success for try_number 1 2024-02-24T02:36:04.795471482Z [2024-02-24T02:36:04.794+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:35:00+00:00, map_index=-1, run_start_date=2024-02-24 02:36:02.695543+00:00, run_end_date=2024-02-24 02:36:04.502757+00:00, run_duration=1.807214, state=success, executor_state=success, try_number=1, max_tries=1, job_id=815, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:36:00.291291+00:00, queued_by_job_id=2, pid=11890 2024-02-24T02:36:04.795682075Z [2024-02-24T02:36:04.795+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:35:00+00:00, map_index=-1, run_start_date=2024-02-24 02:36:02.818609+00:00, run_end_date=2024-02-24 02:36:04.043745+00:00, run_duration=1.225136, state=success, executor_state=success, try_number=1, max_tries=1, job_id=816, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:36:00.291291+00:00, queued_by_job_id=2, pid=11891 2024-02-24T02:37:00.513264280Z [2024-02-24T02:37:00.512+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:37:00.534473253Z [2024-02-24T02:37:00.534+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:37:00+00:00, run_after=2024-02-24T02:38:00+00:00 2024-02-24T02:37:00.563129635Z [2024-02-24T02:37:00.562+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:37:00+00:00, run_after=2024-02-24T02:38:00+00:00 2024-02-24T02:37:00.654703422Z [2024-02-24T02:37:00.654+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T02:37:00.654736790Z 2024-02-24T02:37:00.654748375Z 2024-02-24T02:37:00.654753480Z 2024-02-24T02:37:00.655031974Z [2024-02-24T02:37:00.654+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:37:00.655317241Z [2024-02-24T02:37:00.655+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:37:00.655572177Z [2024-02-24T02:37:00.655+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:37:00.656508496Z [2024-02-24T02:37:00.656+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:37:00.656522423Z 2024-02-24T02:37:00.656527278Z 2024-02-24T02:37:00.656532163Z 2024-02-24T02:37:00.661291650Z [2024-02-24T02:37:00.660+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:37:00.661576471Z [2024-02-24T02:37:00.661+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:37:00.662100632Z [2024-02-24T02:37:00.661+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:37:00.662234138Z [2024-02-24T02:37:00.661+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:37:00.662550370Z [2024-02-24T02:37:00.662+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:37:00.662785378Z [2024-02-24T02:37:00.662+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:37:00.888944314Z [2024-02-24T02:37:00.888+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:36:00+00:00 exited with status queued for try_number 1 2024-02-24T02:37:00.889474703Z [2024-02-24T02:37:00.889+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:36:00+00:00 exited with status queued for try_number 1 2024-02-24T02:37:00.889809490Z [2024-02-24T02:37:00.889+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:36:00+00:00 exited with status queued for try_number 1 2024-02-24T02:37:00.903981973Z [2024-02-24T02:37:00.903+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e4d8f35-5c03-48ba-a273-3de0501dbcc8 2024-02-24T02:37:00.904383437Z [2024-02-24T02:37:00.904+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ae9ac12-cb8b-42f1-bef0-38a952abf68a 2024-02-24T02:37:00.904747818Z [2024-02-24T02:37:00.904+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5605be0c-e096-4196-b3a5-bcfd4b381e76 2024-02-24T02:37:02.163568413Z [2024-02-24T02:37:02.162+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:37:02.164904625Z [2024-02-24T02:37:02.164+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:36:00+00:00, run_id=scheduled__2024-02-24T02:36:00+00:00, run_start_date=2024-02-24 02:37:00.579938+00:00, run_end_date=2024-02-24 02:37:02.163447+00:00, run_duration=1.583509, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:36:00+00:00, data_interval_end=2024-02-24 02:37:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:37:02.185348707Z [2024-02-24T02:37:02.184+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:37:00+00:00, run_after=2024-02-24T02:38:00+00:00 2024-02-24T02:37:02.272834747Z [2024-02-24T02:37:02.272+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:36:00+00:00 exited with status success for try_number 1 2024-02-24T02:37:02.282498735Z [2024-02-24T02:37:02.281+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:36:00+00:00, map_index=-1, run_start_date=2024-02-24 02:37:01.461949+00:00, run_end_date=2024-02-24 02:37:01.900900+00:00, run_duration=0.438951, state=success, executor_state=success, try_number=1, max_tries=1, job_id=817, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:37:00.657620+00:00, queued_by_job_id=2, pid=11923 2024-02-24T02:37:04.431177996Z [2024-02-24T02:37:04.430+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T02:37:05.488579517Z [2024-02-24T02:37:05.488+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:37:05.488957152Z [2024-02-24T02:37:05.488+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:36:00+00:00, run_id=scheduled__2024-02-24T02:36:00+00:00, run_start_date=2024-02-24 02:37:00.581836+00:00, run_end_date=2024-02-24 02:37:05.488468+00:00, run_duration=4.906632, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:36:00+00:00, data_interval_end=2024-02-24 02:37:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:37:05.498717624Z [2024-02-24T02:37:05.498+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:37:00+00:00, run_after=2024-02-24T02:38:00+00:00 2024-02-24T02:37:05.506847032Z [2024-02-24T02:37:05.506+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:37:05.507210528Z [2024-02-24T02:37:05.506+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:36:00+00:00, run_id=scheduled__2024-02-24T02:36:00+00:00, run_start_date=2024-02-24 02:37:00.583616+00:00, run_end_date=2024-02-24 02:37:05.506756+00:00, run_duration=4.92314, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:36:00+00:00, data_interval_end=2024-02-24 02:37:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:37:05.516408812Z [2024-02-24T02:37:05.516+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:37:00+00:00, run_after=2024-02-24T02:38:00+00:00 2024-02-24T02:37:05.549149565Z [2024-02-24T02:37:05.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:36:00+00:00 exited with status success for try_number 1 2024-02-24T02:37:05.549371010Z [2024-02-24T02:37:05.549+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:36:00+00:00 exited with status success for try_number 1 2024-02-24T02:37:05.556924569Z [2024-02-24T02:37:05.556+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:36:00+00:00, map_index=-1, run_start_date=2024-02-24 02:37:02.524540+00:00, run_end_date=2024-02-24 02:37:04.508134+00:00, run_duration=1.983594, state=success, executor_state=success, try_number=1, max_tries=1, job_id=818, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:37:00.657620+00:00, queued_by_job_id=2, pid=11941 2024-02-24T02:37:05.557022663Z [2024-02-24T02:37:05.556+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:36:00+00:00, map_index=-1, run_start_date=2024-02-24 02:37:02.588095+00:00, run_end_date=2024-02-24 02:37:04.360509+00:00, run_duration=1.772414, state=success, executor_state=success, try_number=1, max_tries=1, job_id=819, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:37:00.657620+00:00, queued_by_job_id=2, pid=11942 2024-02-24T02:37:38.247245098Z [2024-02-24T02:37:38.246+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:37:38.247314008Z 2024-02-24T02:37:38.247344806Z [2024-02-24T02:37:38.247+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-02-24T02:37:38.248411099Z [2024-02-24T02:37:38.248+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:37:38.248433756Z 2024-02-24T02:37:38.251888648Z [2024-02-24T02:37:38.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240224023737_681209', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:37:38.252049627Z [2024-02-24T02:37:38.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240224023737_681209', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-02-24T02:37:38.307050009Z [2024-02-24T02:37:38.306+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240224023737_681209 exited with status queued for try_number 1 2024-02-24T02:37:38.316904530Z [2024-02-24T02:37:38.316+0000] {scheduler_job.py:635} INFO - Setting external_id for to d850f193-cfb9-4f3a-9d29-e1f710df912c 2024-02-24T02:37:40.148934854Z [2024-02-24T02:37:40.148+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:37:40.149071297Z [2024-02-24T02:37:40.148+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-02-24 02:37:38.007053+00:00, run_id=vdu_down_20240224023737_681209, run_start_date=2024-02-24 02:37:38.200236+00:00, run_end_date=2024-02-24 02:37:40.148848+00:00, run_duration=1.948612, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-02-24 02:37:38.007053+00:00, data_interval_end=2024-02-24 02:37:38.007053+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-02-24T02:37:40.151609337Z [2024-02-24T02:37:40.151+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-02-24T02:37:40.183108114Z [2024-02-24T02:37:40.182+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240224023737_681209 exited with status success for try_number 1 2024-02-24T02:37:40.192802707Z [2024-02-24T02:37:40.192+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240224023737_681209, map_index=-1, run_start_date=2024-02-24 02:37:38.866294+00:00, run_end_date=2024-02-24 02:37:39.233233+00:00, run_duration=0.366939, state=success, executor_state=success, try_number=1, max_tries=1, job_id=820, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:37:38.248995+00:00, queued_by_job_id=2, pid=11954 2024-02-24T02:38:00.471592201Z [2024-02-24T02:38:00.471+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:38:00+00:00, run_after=2024-02-24T02:39:00+00:00 2024-02-24T02:38:00.479189378Z [2024-02-24T02:38:00.478+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:38:00.492155022Z [2024-02-24T02:38:00.491+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:38:00+00:00, run_after=2024-02-24T02:39:00+00:00 2024-02-24T02:38:00.503045044Z [2024-02-24T02:38:00.502+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:38:00.617472961Z [2024-02-24T02:38:00.616+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T02:38:00.617541996Z 2024-02-24T02:38:00.617553006Z 2024-02-24T02:38:00.617561619Z 2024-02-24T02:38:00.617570968Z 2024-02-24T02:38:00.618274940Z [2024-02-24T02:38:00.617+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T02:38:00.618861761Z [2024-02-24T02:38:00.618+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:38:00.619375335Z [2024-02-24T02:38:00.619+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:38:00.619986970Z [2024-02-24T02:38:00.619+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:38:00.621471051Z [2024-02-24T02:38:00.621+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:38:00.621496980Z 2024-02-24T02:38:00.621507062Z 2024-02-24T02:38:00.621515820Z 2024-02-24T02:38:00.621524795Z 2024-02-24T02:38:00.630406121Z [2024-02-24T02:38:00.629+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:38:00.630767226Z [2024-02-24T02:38:00.630+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T02:38:00.631512506Z [2024-02-24T02:38:00.631+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:38:00.632012271Z [2024-02-24T02:38:00.631+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:38:00.632705060Z [2024-02-24T02:38:00.632+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:38:00.633323764Z [2024-02-24T02:38:00.633+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:38:00.634002589Z [2024-02-24T02:38:00.633+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:38:00.634302972Z [2024-02-24T02:38:00.634+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:38:00.900781837Z [2024-02-24T02:38:00.900+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:36:00+00:00 exited with status queued for try_number 1 2024-02-24T02:38:00.900898653Z [2024-02-24T02:38:00.900+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:37:00+00:00 exited with status queued for try_number 1 2024-02-24T02:38:00.900999481Z [2024-02-24T02:38:00.900+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:37:00+00:00 exited with status queued for try_number 1 2024-02-24T02:38:00.901090741Z [2024-02-24T02:38:00.900+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:37:00+00:00 exited with status queued for try_number 1 2024-02-24T02:38:00.913264500Z [2024-02-24T02:38:00.912+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e739a78-7cca-4bc8-91fa-df13879e6ade 2024-02-24T02:38:00.913421004Z [2024-02-24T02:38:00.913+0000] {scheduler_job.py:635} INFO - Setting external_id for to f3e1d23d-0a09-418d-bc4f-511ed33d68d6 2024-02-24T02:38:00.913719025Z [2024-02-24T02:38:00.913+0000] {scheduler_job.py:635} INFO - Setting external_id for to 53f21bb7-e5ab-4167-afc9-827f6b20782e 2024-02-24T02:38:00.913927066Z [2024-02-24T02:38:00.913+0000] {scheduler_job.py:635} INFO - Setting external_id for to e07ee277-16ed-4518-8687-e0ec900c7827 2024-02-24T02:38:02.060242407Z [2024-02-24T02:38:02.059+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:38:02.060800403Z [2024-02-24T02:38:02.060+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 02:36:00+00:00, run_id=scheduled__2024-02-24T02:36:00+00:00, run_start_date=2024-02-24 02:38:00.520167+00:00, run_end_date=2024-02-24 02:38:02.060121+00:00, run_duration=1.539954, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:36:00+00:00, data_interval_end=2024-02-24 02:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T02:38:02.068488606Z [2024-02-24T02:38:02.068+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T02:38:00+00:00, run_after=2024-02-24T02:40:00+00:00 2024-02-24T02:38:02.123970391Z [2024-02-24T02:38:02.123+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:36:00+00:00 exited with status success for try_number 1 2024-02-24T02:38:02.124505686Z [2024-02-24T02:38:02.123+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:37:00+00:00 exited with status success for try_number 1 2024-02-24T02:38:02.136391648Z [2024-02-24T02:38:02.135+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T02:36:00+00:00, map_index=-1, run_start_date=2024-02-24 02:38:01.475915+00:00, run_end_date=2024-02-24 02:38:01.858580+00:00, run_duration=0.382665, state=success, executor_state=success, try_number=1, max_tries=1, job_id=821, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:38:00.624397+00:00, queued_by_job_id=2, pid=11983 2024-02-24T02:38:02.137013812Z [2024-02-24T02:38:02.136+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:37:00+00:00, map_index=-1, run_start_date=2024-02-24 02:38:01.615206+00:00, run_end_date=2024-02-24 02:38:02.000415+00:00, run_duration=0.385209, state=success, executor_state=success, try_number=1, max_tries=1, job_id=822, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:38:00.624397+00:00, queued_by_job_id=2, pid=11984 2024-02-24T02:38:03.188007969Z [2024-02-24T02:38:03.187+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:38:03.188564593Z [2024-02-24T02:38:03.188+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:37:00+00:00, run_id=scheduled__2024-02-24T02:37:00+00:00, run_start_date=2024-02-24 02:38:00.522105+00:00, run_end_date=2024-02-24 02:38:03.187920+00:00, run_duration=2.665815, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:37:00+00:00, data_interval_end=2024-02-24 02:38:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:38:03.203624162Z [2024-02-24T02:38:03.203+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:38:00+00:00, run_after=2024-02-24T02:39:00+00:00 2024-02-24T02:38:06.719519459Z [2024-02-24T02:38:06.718+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:38:06.719590728Z [2024-02-24T02:38:06.719+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:37:00+00:00, run_id=scheduled__2024-02-24T02:37:00+00:00, run_start_date=2024-02-24 02:38:00.523854+00:00, run_end_date=2024-02-24 02:38:06.719219+00:00, run_duration=6.195365, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:37:00+00:00, data_interval_end=2024-02-24 02:38:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:38:06.733747879Z [2024-02-24T02:38:06.732+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:38:00+00:00, run_after=2024-02-24T02:39:00+00:00 2024-02-24T02:38:06.741670486Z [2024-02-24T02:38:06.741+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:38:06.741788873Z [2024-02-24T02:38:06.741+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:37:00+00:00, run_id=scheduled__2024-02-24T02:37:00+00:00, run_start_date=2024-02-24 02:38:00.525487+00:00, run_end_date=2024-02-24 02:38:06.741431+00:00, run_duration=6.215944, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:37:00+00:00, data_interval_end=2024-02-24 02:38:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:38:06.754079949Z [2024-02-24T02:38:06.753+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:38:00+00:00, run_after=2024-02-24T02:39:00+00:00 2024-02-24T02:38:06.793190165Z [2024-02-24T02:38:06.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:37:00+00:00 exited with status success for try_number 1 2024-02-24T02:38:06.793221636Z [2024-02-24T02:38:06.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:37:00+00:00 exited with status success for try_number 1 2024-02-24T02:38:06.800327070Z [2024-02-24T02:38:06.799+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:37:00+00:00, map_index=-1, run_start_date=2024-02-24 02:38:02.939333+00:00, run_end_date=2024-02-24 02:38:05.616447+00:00, run_duration=2.677114, state=success, executor_state=success, try_number=1, max_tries=1, job_id=823, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:38:00.624397+00:00, queued_by_job_id=2, pid=12008 2024-02-24T02:38:06.800613225Z [2024-02-24T02:38:06.800+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:37:00+00:00, map_index=-1, run_start_date=2024-02-24 02:38:02.925516+00:00, run_end_date=2024-02-24 02:38:05.842655+00:00, run_duration=2.917139, state=success, executor_state=success, try_number=1, max_tries=1, job_id=824, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:38:00.624397+00:00, queued_by_job_id=2, pid=12007 2024-02-24T02:39:00.387966716Z [2024-02-24T02:39:00.387+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:39:00.417668616Z [2024-02-24T02:39:00.417+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:39:00+00:00, run_after=2024-02-24T02:40:00+00:00 2024-02-24T02:39:00.434084253Z [2024-02-24T02:39:00.433+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:39:00+00:00, run_after=2024-02-24T02:40:00+00:00 2024-02-24T02:39:00.499999960Z [2024-02-24T02:39:00.499+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T02:39:00.500297087Z 2024-02-24T02:39:00.500311078Z 2024-02-24T02:39:00.500320763Z 2024-02-24T02:39:00.500376475Z [2024-02-24T02:39:00.499+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:39:00.500386619Z [2024-02-24T02:39:00.499+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:39:00.500439131Z [2024-02-24T02:39:00.500+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:39:00.501050245Z [2024-02-24T02:39:00.500+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:39:00.501071090Z 2024-02-24T02:39:00.501080806Z 2024-02-24T02:39:00.501089825Z 2024-02-24T02:39:00.505474084Z [2024-02-24T02:39:00.505+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:39:00.505556507Z [2024-02-24T02:39:00.505+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:39:00.505806770Z [2024-02-24T02:39:00.505+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:39:00.505970312Z [2024-02-24T02:39:00.505+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:39:00.506245058Z [2024-02-24T02:39:00.506+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:39:00.506393856Z [2024-02-24T02:39:00.506+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:39:00.776832539Z [2024-02-24T02:39:00.776+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:38:00+00:00 exited with status queued for try_number 1 2024-02-24T02:39:00.777012178Z [2024-02-24T02:39:00.776+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:38:00+00:00 exited with status queued for try_number 1 2024-02-24T02:39:00.777157599Z [2024-02-24T02:39:00.777+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:38:00+00:00 exited with status queued for try_number 1 2024-02-24T02:39:00.788784500Z [2024-02-24T02:39:00.788+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e5f6362-149d-4060-ade8-d057216dfb8a 2024-02-24T02:39:00.789081641Z [2024-02-24T02:39:00.788+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc842f39-3441-47f6-8f3b-891239e7ecae 2024-02-24T02:39:00.789322334Z [2024-02-24T02:39:00.789+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b3e6405-5203-4867-b5d6-51c1fbcc63a7 2024-02-24T02:39:01.963020053Z [2024-02-24T02:39:01.962+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:39:01.963375303Z [2024-02-24T02:39:01.963+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:38:00+00:00, run_id=scheduled__2024-02-24T02:38:00+00:00, run_start_date=2024-02-24 02:39:00.445556+00:00, run_end_date=2024-02-24 02:39:01.962917+00:00, run_duration=1.517361, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:38:00+00:00, data_interval_end=2024-02-24 02:39:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:39:01.973079625Z [2024-02-24T02:39:01.972+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:39:00+00:00, run_after=2024-02-24T02:40:00+00:00 2024-02-24T02:39:02.024232108Z [2024-02-24T02:39:02.022+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:38:00+00:00 exited with status success for try_number 1 2024-02-24T02:39:02.029200015Z [2024-02-24T02:39:02.028+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:38:00+00:00, map_index=-1, run_start_date=2024-02-24 02:39:01.351112+00:00, run_end_date=2024-02-24 02:39:01.741046+00:00, run_duration=0.389934, state=success, executor_state=success, try_number=1, max_tries=1, job_id=825, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:39:00.502358+00:00, queued_by_job_id=2, pid=12039 2024-02-24T02:39:05.318117735Z [2024-02-24T02:39:05.317+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:39:05.318622702Z [2024-02-24T02:39:05.318+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:38:00+00:00, run_id=scheduled__2024-02-24T02:38:00+00:00, run_start_date=2024-02-24 02:39:00.448153+00:00, run_end_date=2024-02-24 02:39:05.318016+00:00, run_duration=4.869863, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:38:00+00:00, data_interval_end=2024-02-24 02:39:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:39:05.330850155Z [2024-02-24T02:39:05.330+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:39:00+00:00, run_after=2024-02-24T02:40:00+00:00 2024-02-24T02:39:05.391362504Z [2024-02-24T02:39:05.390+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:38:00+00:00 exited with status success for try_number 1 2024-02-24T02:39:05.396666695Z [2024-02-24T02:39:05.396+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:38:00+00:00, map_index=-1, run_start_date=2024-02-24 02:39:02.413043+00:00, run_end_date=2024-02-24 02:39:04.866355+00:00, run_duration=2.453312, state=success, executor_state=success, try_number=1, max_tries=1, job_id=826, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:39:00.502358+00:00, queued_by_job_id=2, pid=12057 2024-02-24T02:39:06.953945933Z [2024-02-24T02:39:06.953+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:39:06.955531698Z [2024-02-24T02:39:06.955+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:38:00+00:00, run_id=scheduled__2024-02-24T02:38:00+00:00, run_start_date=2024-02-24 02:39:00.447098+00:00, run_end_date=2024-02-24 02:39:06.953912+00:00, run_duration=6.506814, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:38:00+00:00, data_interval_end=2024-02-24 02:39:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:39:06.964617421Z [2024-02-24T02:39:06.964+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:39:00+00:00, run_after=2024-02-24T02:40:00+00:00 2024-02-24T02:39:07.002634541Z [2024-02-24T02:39:07.002+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:38:00+00:00 exited with status success for try_number 1 2024-02-24T02:39:07.012634423Z [2024-02-24T02:39:07.012+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:38:00+00:00, map_index=-1, run_start_date=2024-02-24 02:39:02.607319+00:00, run_end_date=2024-02-24 02:39:05.863981+00:00, run_duration=3.256662, state=success, executor_state=success, try_number=1, max_tries=1, job_id=827, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:39:00.502358+00:00, queued_by_job_id=2, pid=12058 2024-02-24T02:39:13.537453991Z [2024-02-24T02:39:13.536+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d to 2024-02-24T02:35:00+00:00, run_after=2024-02-24T02:40:00+00:00 2024-02-24T02:39:13.612895882Z [2024-02-24T02:39:13.612+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:39:13.612940642Z 2024-02-24T02:39:13.612979296Z [2024-02-24T02:39:13.612+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d has 0/16 running and queued tasks 2024-02-24T02:39:13.613655432Z [2024-02-24T02:39:13.613+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:39:13.613700318Z 2024-02-24T02:39:13.616517263Z [2024-02-24T02:39:13.616+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T02:39:13.616736454Z [2024-02-24T02:39:13.616+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:39:13.694840239Z [2024-02-24T02:39:13.694+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T02:30:00+00:00 exited with status queued for try_number 1 2024-02-24T02:39:13.702803756Z [2024-02-24T02:39:13.702+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a84770a-e2ce-45cd-8438-c4a71cb9cb9d 2024-02-24T02:39:15.977613927Z [2024-02-24T02:39:15.976+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:39:15.977671937Z 2024-02-24T02:39:15.977690575Z [2024-02-24T02:39:15.977+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d has 0/16 running and queued tasks 2024-02-24T02:39:15.978718866Z [2024-02-24T02:39:15.978+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:39:15.978784071Z 2024-02-24T02:39:15.982531949Z [2024-02-24T02:39:15.982+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d', task_id='split_metrics', run_id='scheduled__2024-02-24T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T02:39:15.982680466Z [2024-02-24T02:39:15.982+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d', 'split_metrics', 'scheduled__2024-02-24T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:39:16.043588705Z [2024-02-24T02:39:16.043+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d.split_metrics run_id=scheduled__2024-02-24T02:30:00+00:00 exited with status queued for try_number 1 2024-02-24T02:39:16.043888283Z [2024-02-24T02:39:16.043+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T02:30:00+00:00 exited with status success for try_number 1 2024-02-24T02:39:16.050913027Z [2024-02-24T02:39:16.050+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39a8b7af-23e8-48ae-adca-ea9be545c986 2024-02-24T02:39:16.051457844Z [2024-02-24T02:39:16.051+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T02:30:00+00:00, map_index=-1, run_start_date=2024-02-24 02:39:15.079446+00:00, run_end_date=2024-02-24 02:39:15.426661+00:00, run_duration=0.347215, state=success, executor_state=success, try_number=1, max_tries=1, job_id=828, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:39:13.614012+00:00, queued_by_job_id=2, pid=12076 2024-02-24T02:39:18.924849306Z [2024-02-24T02:39:18.924+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_e3d0a28a-b3ee-4530-a90a-efa92840586d to 2024-02-24T02:39:00+00:00, run_after=2024-02-24T02:40:00+00:00 2024-02-24T02:39:19.001933019Z [2024-02-24T02:39:19.001+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-02-24T02:39:19.001987800Z 2024-02-24T02:39:19.001996919Z 2024-02-24T02:39:19.002512453Z [2024-02-24T02:39:19.001+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d has 0/16 running and queued tasks 2024-02-24T02:39:19.003004463Z [2024-02-24T02:39:19.002+0000] {scheduler_job.py:425} INFO - DAG vim_status_e3d0a28a-b3ee-4530-a90a-efa92840586d has 0/16 running and queued tasks 2024-02-24T02:39:19.004870058Z [2024-02-24T02:39:19.004+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:39:19.004924393Z 2024-02-24T02:39:19.004934187Z 2024-02-24T02:39:19.009754416Z [2024-02-24T02:39:19.009+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d', task_id='collect_metrics', run_id='scheduled__2024-02-24T02:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T02:39:19.010186570Z [2024-02-24T02:39:19.009+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d', 'collect_metrics', 'scheduled__2024-02-24T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T02:39:19.010696451Z [2024-02-24T02:39:19.010+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_e3d0a28a-b3ee-4530-a90a-efa92840586d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:39:19.010959961Z [2024-02-24T02:39:19.010+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_e3d0a28a-b3ee-4530-a90a-efa92840586d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:39:19.185255519Z [2024-02-24T02:39:19.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d.collect_metrics run_id=scheduled__2024-02-24T02:30:00+00:00 exited with status queued for try_number 1 2024-02-24T02:39:19.185301726Z [2024-02-24T02:39:19.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e3d0a28a-b3ee-4530-a90a-efa92840586d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:38:00+00:00 exited with status queued for try_number 1 2024-02-24T02:39:19.185363939Z [2024-02-24T02:39:19.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d.split_metrics run_id=scheduled__2024-02-24T02:30:00+00:00 exited with status success for try_number 1 2024-02-24T02:39:19.192885085Z [2024-02-24T02:39:19.192+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d, task_id=split_metrics, run_id=scheduled__2024-02-24T02:30:00+00:00, map_index=-1, run_start_date=2024-02-24 02:39:17.511323+00:00, run_end_date=2024-02-24 02:39:17.847355+00:00, run_duration=0.336032, state=success, executor_state=success, try_number=1, max_tries=1, job_id=829, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:39:15.979083+00:00, queued_by_job_id=2, pid=12089 2024-02-24T02:39:19.193016137Z [2024-02-24T02:39:19.192+0000] {scheduler_job.py:635} INFO - Setting external_id for to 21323f6e-543f-4faa-93e1-d06b63e568ff 2024-02-24T02:39:19.193113779Z [2024-02-24T02:39:19.193+0000] {scheduler_job.py:635} INFO - Setting external_id for to 98cd126e-02b3-4057-ad1f-64fa0135a1b9 2024-02-24T02:39:20.549139895Z [2024-02-24T02:39:20.548+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:39:20.627729140Z [2024-02-24T02:39:20.627+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:39:20.627753569Z 2024-02-24T02:39:20.629273623Z [2024-02-24T02:39:20.628+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d has 0/16 running and queued tasks 2024-02-24T02:39:20.629966187Z [2024-02-24T02:39:20.629+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:39:20.629979429Z 2024-02-24T02:39:20.635055300Z [2024-02-24T02:39:20.633+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:39:20.635371574Z [2024-02-24T02:39:20.634+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:39:20.721764680Z [2024-02-24T02:39:20.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:38:00+00:00 exited with status queued for try_number 1 2024-02-24T02:39:20.731106439Z [2024-02-24T02:39:20.730+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c562003-8715-44ad-93ee-186215f83cdf 2024-02-24T02:39:21.165653288Z [2024-02-24T02:39:21.165+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:39:21.165675542Z 2024-02-24T02:39:21.165959776Z [2024-02-24T02:39:21.165+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d has 0/16 running and queued tasks 2024-02-24T02:39:21.166710490Z [2024-02-24T02:39:21.166+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:39:21.166722614Z 2024-02-24T02:39:21.171125165Z [2024-02-24T02:39:21.170+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d', task_id='send_prometheus', run_id='scheduled__2024-02-24T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:39:21.171368136Z [2024-02-24T02:39:21.171+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d', 'send_prometheus', 'scheduled__2024-02-24T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:39:21.308561942Z [2024-02-24T02:39:21.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d.send_prometheus run_id=scheduled__2024-02-24T02:30:00+00:00 exited with status queued for try_number 1 2024-02-24T02:39:21.309498756Z [2024-02-24T02:39:21.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d.collect_metrics run_id=scheduled__2024-02-24T02:30:00+00:00 exited with status success for try_number 1 2024-02-24T02:39:21.317700859Z [2024-02-24T02:39:21.317+0000] {scheduler_job.py:635} INFO - Setting external_id for to 03d2abc2-8743-48eb-96a1-a19b2062b41b 2024-02-24T02:39:21.318006513Z [2024-02-24T02:39:21.317+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d, task_id=collect_metrics, run_id=scheduled__2024-02-24T02:30:00+00:00, map_index=0, run_start_date=2024-02-24 02:39:20.707374+00:00, run_end_date=2024-02-24 02:39:21.070886+00:00, run_duration=0.363512, state=success, executor_state=success, try_number=1, max_tries=1, job_id=830, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:39:19.006304+00:00, queued_by_job_id=2, pid=12106 2024-02-24T02:39:22.467102776Z [2024-02-24T02:39:22.466+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:39:22.467479039Z [2024-02-24T02:39:22.467+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_e3d0a28a-b3ee-4530-a90a-efa92840586d, execution_date=2024-02-24 02:38:00+00:00, run_id=scheduled__2024-02-24T02:38:00+00:00, run_start_date=2024-02-24 02:39:18.938611+00:00, run_end_date=2024-02-24 02:39:22.466923+00:00, run_duration=3.528312, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:38:00+00:00, data_interval_end=2024-02-24 02:39:00+00:00, dag_hash=4b1dd38fcad4575292f1bff546da90f2 2024-02-24T02:39:22.480581661Z [2024-02-24T02:39:22.480+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_e3d0a28a-b3ee-4530-a90a-efa92840586d to 2024-02-24T02:39:00+00:00, run_after=2024-02-24T02:40:00+00:00 2024-02-24T02:39:22.542052894Z [2024-02-24T02:39:22.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e3d0a28a-b3ee-4530-a90a-efa92840586d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:38:00+00:00 exited with status success for try_number 1 2024-02-24T02:39:22.555422864Z [2024-02-24T02:39:22.555+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_e3d0a28a-b3ee-4530-a90a-efa92840586d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:38:00+00:00, map_index=-1, run_start_date=2024-02-24 02:39:20.705041+00:00, run_end_date=2024-02-24 02:39:22.101221+00:00, run_duration=1.39618, state=success, executor_state=success, try_number=1, max_tries=1, job_id=831, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:39:19.006304+00:00, queued_by_job_id=2, pid=12105 2024-02-24T02:39:23.602740003Z [2024-02-24T02:39:23.602+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:39:23.603020701Z [2024-02-24T02:39:23.602+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d, execution_date=2024-02-24 02:30:00+00:00, run_id=scheduled__2024-02-24T02:30:00+00:00, run_start_date=2024-02-24 02:39:13.553512+00:00, run_end_date=2024-02-24 02:39:23.602635+00:00, run_duration=10.049123, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:30:00+00:00, data_interval_end=2024-02-24 02:35:00+00:00, dag_hash=a27cffdf4a174dcb727d21409f26deed 2024-02-24T02:39:23.609398039Z [2024-02-24T02:39:23.609+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d to 2024-02-24T02:35:00+00:00, run_after=2024-02-24T02:40:00+00:00 2024-02-24T02:39:23.660451840Z [2024-02-24T02:39:23.660+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d.send_prometheus run_id=scheduled__2024-02-24T02:30:00+00:00 exited with status success for try_number 1 2024-02-24T02:39:23.666537075Z [2024-02-24T02:39:23.666+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d, task_id=send_prometheus, run_id=scheduled__2024-02-24T02:30:00+00:00, map_index=-1, run_start_date=2024-02-24 02:39:22.948290+00:00, run_end_date=2024-02-24 02:39:23.248246+00:00, run_duration=0.299956, state=success, executor_state=success, try_number=1, max_tries=1, job_id=833, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:39:21.168876+00:00, queued_by_job_id=2, pid=12131 2024-02-24T02:39:24.719888179Z [2024-02-24T02:39:24.719+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:39:24.720494383Z [2024-02-24T02:39:24.720+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d, execution_date=2024-02-24 02:38:00+00:00, run_id=scheduled__2024-02-24T02:38:00+00:00, run_start_date=2024-02-24 02:39:20.559452+00:00, run_end_date=2024-02-24 02:39:24.719718+00:00, run_duration=4.160266, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:38:00+00:00, data_interval_end=2024-02-24 02:39:00+00:00, dag_hash=f111a351244f4610ef21921fdfec93a1 2024-02-24T02:39:24.735264072Z [2024-02-24T02:39:24.734+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d to 2024-02-24T02:39:00+00:00, run_after=2024-02-24T02:40:00+00:00 2024-02-24T02:39:24.781188161Z [2024-02-24T02:39:24.780+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:38:00+00:00 exited with status success for try_number 1 2024-02-24T02:39:24.787136911Z [2024-02-24T02:39:24.786+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:38:00+00:00, map_index=-1, run_start_date=2024-02-24 02:39:22.422604+00:00, run_end_date=2024-02-24 02:39:24.348861+00:00, run_duration=1.926257, state=success, executor_state=success, try_number=1, max_tries=1, job_id=832, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:39:20.630638+00:00, queued_by_job_id=2, pid=12120 2024-02-24T02:39:38.701677490Z [2024-02-24T02:39:38.701+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:39:38.701705537Z 2024-02-24T02:39:38.701992953Z [2024-02-24T02:39:38.701+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-02-24T02:39:38.702593697Z [2024-02-24T02:39:38.702+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:39:38.702600115Z 2024-02-24T02:39:38.708618366Z [2024-02-24T02:39:38.706+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240224023937_351244', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:39:38.708651061Z [2024-02-24T02:39:38.706+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240224023937_351244', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-02-24T02:39:38.767517999Z [2024-02-24T02:39:38.767+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240224023937_351244 exited with status queued for try_number 1 2024-02-24T02:39:38.773348719Z [2024-02-24T02:39:38.773+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e7c8d92-5711-448b-abc5-ef8043921c32 2024-02-24T02:39:40.735860635Z [2024-02-24T02:39:40.735+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:39:40.740578140Z [2024-02-24T02:39:40.740+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-02-24 02:39:37.961346+00:00, run_id=vdu_down_20240224023937_351244, run_start_date=2024-02-24 02:39:38.664815+00:00, run_end_date=2024-02-24 02:39:40.740173+00:00, run_duration=2.075358, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-02-24 02:39:37.961346+00:00, data_interval_end=2024-02-24 02:39:37.961346+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-02-24T02:39:40.745556794Z [2024-02-24T02:39:40.745+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-02-24T02:39:40.778166884Z [2024-02-24T02:39:40.777+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240224023937_351244 exited with status success for try_number 1 2024-02-24T02:39:40.784722886Z [2024-02-24T02:39:40.784+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240224023937_351244, map_index=-1, run_start_date=2024-02-24 02:39:39.405612+00:00, run_end_date=2024-02-24 02:39:39.770412+00:00, run_duration=0.3648, state=success, executor_state=success, try_number=1, max_tries=1, job_id=834, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:39:38.702932+00:00, queued_by_job_id=2, pid=12133 2024-02-24T02:40:00.912495361Z [2024-02-24T02:40:00.911+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:40:00+00:00, run_after=2024-02-24T02:41:00+00:00 2024-02-24T02:40:00.934278610Z [2024-02-24T02:40:00.933+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:40:00+00:00, run_after=2024-02-24T02:41:00+00:00 2024-02-24T02:40:00.952029015Z [2024-02-24T02:40:00.951+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d to 2024-02-24T02:40:00+00:00, run_after=2024-02-24T02:45:00+00:00 2024-02-24T02:40:00.968284983Z [2024-02-24T02:40:00.967+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:40:00+00:00, run_after=2024-02-24T02:45:00+00:00 2024-02-24T02:40:00.978269724Z [2024-02-24T02:40:00.977+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:40:00.988773507Z [2024-02-24T02:40:00.988+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:40:01.015860906Z [2024-02-24T02:40:01.015+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_e3d0a28a-b3ee-4530-a90a-efa92840586d to 2024-02-24T02:40:00+00:00, run_after=2024-02-24T02:41:00+00:00 2024-02-24T02:40:01.027498979Z [2024-02-24T02:40:01.027+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:40:01.217927108Z [2024-02-24T02:40:01.216+0000] {scheduler_job.py:360} INFO - 8 tasks up for execution: 2024-02-24T02:40:01.217952069Z 2024-02-24T02:40:01.217955663Z 2024-02-24T02:40:01.217969581Z 2024-02-24T02:40:01.217973316Z 2024-02-24T02:40:01.217976875Z 2024-02-24T02:40:01.217979849Z 2024-02-24T02:40:01.217983080Z 2024-02-24T02:40:01.218001613Z 2024-02-24T02:40:01.218004908Z [2024-02-24T02:40:01.217+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d has 0/16 running and queued tasks 2024-02-24T02:40:01.218007899Z [2024-02-24T02:40:01.217+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:40:01.218011348Z [2024-02-24T02:40:01.217+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T02:40:01.218014354Z [2024-02-24T02:40:01.217+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:40:01.219763078Z [2024-02-24T02:40:01.217+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d has 0/16 running and queued tasks 2024-02-24T02:40:01.219783252Z [2024-02-24T02:40:01.218+0000] {scheduler_job.py:425} INFO - DAG vim_status_e3d0a28a-b3ee-4530-a90a-efa92840586d has 0/16 running and queued tasks 2024-02-24T02:40:01.219787677Z [2024-02-24T02:40:01.218+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:40:01.219791688Z [2024-02-24T02:40:01.218+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:40:01.219799036Z [2024-02-24T02:40:01.219+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:40:01.219803050Z 2024-02-24T02:40:01.219806453Z 2024-02-24T02:40:01.219810662Z 2024-02-24T02:40:01.219814081Z 2024-02-24T02:40:01.219820407Z 2024-02-24T02:40:01.219824373Z 2024-02-24T02:40:01.219827725Z 2024-02-24T02:40:01.219831185Z 2024-02-24T02:40:01.234073704Z [2024-02-24T02:40:01.229+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T02:40:01.234092770Z [2024-02-24T02:40:01.229+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:40:01.234100843Z [2024-02-24T02:40:01.230+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T02:40:01.234104519Z [2024-02-24T02:40:01.230+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:40:01.234108665Z [2024-02-24T02:40:01.230+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:40:01.234112338Z [2024-02-24T02:40:01.230+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T02:40:01.234115511Z [2024-02-24T02:40:01.231+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:40:01.234118609Z [2024-02-24T02:40:01.231+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:40:01.234121779Z [2024-02-24T02:40:01.231+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:40:01.234124811Z [2024-02-24T02:40:01.231+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:40:01.234128045Z [2024-02-24T02:40:01.232+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_e3d0a28a-b3ee-4530-a90a-efa92840586d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:40:01.234131317Z [2024-02-24T02:40:01.232+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_e3d0a28a-b3ee-4530-a90a-efa92840586d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:40:01.234163949Z [2024-02-24T02:40:01.232+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:40:01.234187447Z [2024-02-24T02:40:01.233+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:40:01.234202320Z [2024-02-24T02:40:01.233+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:40:01.234205845Z [2024-02-24T02:40:01.233+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:40:02.259891283Z [2024-02-24T02:40:02.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T02:35:00+00:00 exited with status queued for try_number 1 2024-02-24T02:40:02.260100438Z [2024-02-24T02:40:02.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T02:35:00+00:00 exited with status queued for try_number 1 2024-02-24T02:40:02.260235189Z [2024-02-24T02:40:02.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:38:00+00:00 exited with status queued for try_number 1 2024-02-24T02:40:02.260361760Z [2024-02-24T02:40:02.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:39:00+00:00 exited with status queued for try_number 1 2024-02-24T02:40:02.260483209Z [2024-02-24T02:40:02.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:39:00+00:00 exited with status queued for try_number 1 2024-02-24T02:40:02.260602750Z [2024-02-24T02:40:02.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e3d0a28a-b3ee-4530-a90a-efa92840586d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:39:00+00:00 exited with status queued for try_number 1 2024-02-24T02:40:02.260762197Z [2024-02-24T02:40:02.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:39:00+00:00 exited with status queued for try_number 1 2024-02-24T02:40:02.260882819Z [2024-02-24T02:40:02.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:39:00+00:00 exited with status queued for try_number 1 2024-02-24T02:40:02.283429051Z [2024-02-24T02:40:02.282+0000] {scheduler_job.py:635} INFO - Setting external_id for to cad89f49-52f9-4d12-9c0b-d14af2037ae8 2024-02-24T02:40:02.286713418Z [2024-02-24T02:40:02.286+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71cdf606-782b-498c-9bcc-5c5f2f261a17 2024-02-24T02:40:02.287036258Z [2024-02-24T02:40:02.286+0000] {scheduler_job.py:635} INFO - Setting external_id for to bbc6016e-ac7d-4f47-a762-6acfde22379b 2024-02-24T02:40:02.290484508Z [2024-02-24T02:40:02.290+0000] {scheduler_job.py:635} INFO - Setting external_id for to c248d074-df94-4113-b2d7-aabf49fd6c10 2024-02-24T02:40:02.290725226Z [2024-02-24T02:40:02.290+0000] {scheduler_job.py:635} INFO - Setting external_id for to 601dadb5-f292-47d9-9c7c-d580b49da4c8 2024-02-24T02:40:02.291354288Z [2024-02-24T02:40:02.291+0000] {scheduler_job.py:635} INFO - Setting external_id for to b4d45f65-f42a-4093-8e26-8cd1589bb171 2024-02-24T02:40:02.291585873Z [2024-02-24T02:40:02.291+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6168a6d1-7ddc-444f-8329-e162d1d161a5 2024-02-24T02:40:02.292129249Z [2024-02-24T02:40:02.291+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4ba626a-d750-4e6b-8468-dfe6ab4ac7a5 2024-02-24T02:40:03.876319497Z [2024-02-24T02:40:03.875+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:40:03.877135982Z [2024-02-24T02:40:03.876+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 02:38:00+00:00, run_id=scheduled__2024-02-24T02:38:00+00:00, run_start_date=2024-02-24 02:40:01.055252+00:00, run_end_date=2024-02-24 02:40:03.876400+00:00, run_duration=2.821148, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:38:00+00:00, data_interval_end=2024-02-24 02:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T02:40:03.903581496Z [2024-02-24T02:40:03.901+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T02:40:00+00:00, run_after=2024-02-24T02:42:00+00:00 2024-02-24T02:40:04.074975264Z [2024-02-24T02:40:04.074+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:38:00+00:00 exited with status success for try_number 1 2024-02-24T02:40:04.084153744Z [2024-02-24T02:40:04.083+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T02:38:00+00:00, map_index=-1, run_start_date=2024-02-24 02:40:02.344552+00:00, run_end_date=2024-02-24 02:40:03.181234+00:00, run_duration=0.836682, state=success, executor_state=success, try_number=1, max_tries=1, job_id=835, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:40:01.222445+00:00, queued_by_job_id=2, pid=12160 2024-02-24T02:40:05.144818002Z [2024-02-24T02:40:05.144+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:40:05.145225298Z [2024-02-24T02:40:05.145+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:39:00+00:00, run_id=scheduled__2024-02-24T02:39:00+00:00, run_start_date=2024-02-24 02:40:01.058315+00:00, run_end_date=2024-02-24 02:40:05.144735+00:00, run_duration=4.08642, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:39:00+00:00, data_interval_end=2024-02-24 02:40:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:40:05.161585206Z [2024-02-24T02:40:05.161+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:40:00+00:00, run_after=2024-02-24T02:41:00+00:00 2024-02-24T02:40:05.347089029Z [2024-02-24T02:40:05.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:39:00+00:00 exited with status success for try_number 1 2024-02-24T02:40:05.359426762Z [2024-02-24T02:40:05.358+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:39:00+00:00, map_index=-1, run_start_date=2024-02-24 02:40:03.631968+00:00, run_end_date=2024-02-24 02:40:04.508606+00:00, run_duration=0.876638, state=success, executor_state=success, try_number=1, max_tries=1, job_id=836, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:40:01.222445+00:00, queued_by_job_id=2, pid=12172 2024-02-24T02:40:06.508633052Z [2024-02-24T02:40:06.508+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T02:35:00+00:00 exited with status failed for try_number 1 2024-02-24T02:40:06.508762159Z [2024-02-24T02:40:06.508+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:39:00+00:00 exited with status failed for try_number 1 2024-02-24T02:40:06.508902105Z [2024-02-24T02:40:06.508+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e3d0a28a-b3ee-4530-a90a-efa92840586d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:39:00+00:00 exited with status failed for try_number 1 2024-02-24T02:40:06.518949577Z [2024-02-24T02:40:06.518+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T02:35:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:40:01.222445+00:00, queued_by_job_id=2, pid=None 2024-02-24T02:40:06.519375800Z [2024-02-24T02:40:06.519+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-24T02:40:06.521844556Z [2024-02-24T02:40:06.521+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-24T02:40:06.534423269Z [2024-02-24T02:40:06.534+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d, task_id=extract_metrics_from_vnfrs, execution_date=20240224T023500, start_date=, end_date=20240224T024006 2024-02-24T02:40:06.544570316Z [2024-02-24T02:40:06.544+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_e3d0a28a-b3ee-4530-a90a-efa92840586d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:39:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:40:01.222445+00:00, queued_by_job_id=2, pid=None 2024-02-24T02:40:06.545425110Z [2024-02-24T02:40:06.545+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-24T02:40:06.547850257Z [2024-02-24T02:40:06.547+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-24T02:40:06.568506643Z [2024-02-24T02:40:06.568+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_e3d0a28a-b3ee-4530-a90a-efa92840586d, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240224T023900, start_date=, end_date=20240224T024006 2024-02-24T02:40:06.585933165Z [2024-02-24T02:40:06.585+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:39:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:40:01.222445+00:00, queued_by_job_id=2, pid=None 2024-02-24T02:40:06.586850060Z [2024-02-24T02:40:06.586+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-24T02:40:06.590573287Z [2024-02-24T02:40:06.590+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-24T02:40:06.613100785Z [2024-02-24T02:40:06.612+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240224T023900, start_date=, end_date=20240224T024006 2024-02-24T02:40:07.390117500Z [2024-02-24T02:40:07.389+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:40:07.390779135Z [2024-02-24T02:40:07.390+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:39:00+00:00, run_id=scheduled__2024-02-24T02:39:00+00:00, run_start_date=2024-02-24 02:40:01.057268+00:00, run_end_date=2024-02-24 02:40:07.390098+00:00, run_duration=6.33283, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:39:00+00:00, data_interval_end=2024-02-24 02:40:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:40:07.417709000Z [2024-02-24T02:40:07.417+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:40:00+00:00, run_after=2024-02-24T02:41:00+00:00 2024-02-24T02:40:07.539723352Z [2024-02-24T02:40:07.539+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:40:07.539755143Z 2024-02-24T02:40:07.539903488Z [2024-02-24T02:40:07.539+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:40:07.540741105Z [2024-02-24T02:40:07.540+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:40:07.540753845Z 2024-02-24T02:40:07.544889037Z [2024-02-24T02:40:07.544+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T02:40:07.545317294Z [2024-02-24T02:40:07.545+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:40:07.611183271Z [2024-02-24T02:40:07.610+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T02:35:00+00:00 exited with status queued for try_number 1 2024-02-24T02:40:07.611498166Z [2024-02-24T02:40:07.611+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T02:35:00+00:00 exited with status success for try_number 1 2024-02-24T02:40:07.611723310Z [2024-02-24T02:40:07.611+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:39:00+00:00 exited with status success for try_number 1 2024-02-24T02:40:07.622391049Z [2024-02-24T02:40:07.621+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T02:35:00+00:00, map_index=-1, run_start_date=2024-02-24 02:40:06.024032+00:00, run_end_date=2024-02-24 02:40:06.428426+00:00, run_duration=0.404394, state=success, executor_state=success, try_number=1, max_tries=1, job_id=839, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:40:01.222445+00:00, queued_by_job_id=2, pid=12240 2024-02-24T02:40:07.622773262Z [2024-02-24T02:40:07.622+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f6d1bd4-2b8e-41a8-8e44-a915601d7a10 2024-02-24T02:40:07.623165279Z [2024-02-24T02:40:07.622+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:39:00+00:00, map_index=-1, run_start_date=2024-02-24 02:40:04.903933+00:00, run_end_date=2024-02-24 02:40:06.890369+00:00, run_duration=1.986436, state=success, executor_state=success, try_number=1, max_tries=1, job_id=837, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:40:01.222445+00:00, queued_by_job_id=2, pid=12188 2024-02-24T02:40:07.686697061Z [2024-02-24T02:40:07.686+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:40:07.687154054Z [2024-02-24T02:40:07.686+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:39:00+00:00, run_id=scheduled__2024-02-24T02:39:00+00:00, run_start_date=2024-02-24 02:40:01.059260+00:00, run_end_date=2024-02-24 02:40:07.686576+00:00, run_duration=6.627316, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:39:00+00:00, data_interval_end=2024-02-24 02:40:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:40:07.702158981Z [2024-02-24T02:40:07.701+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:40:00+00:00, run_after=2024-02-24T02:41:00+00:00 2024-02-24T02:40:07.840056481Z [2024-02-24T02:40:07.839+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:39:00+00:00 exited with status success for try_number 1 2024-02-24T02:40:07.849587360Z [2024-02-24T02:40:07.849+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:39:00+00:00, map_index=-1, run_start_date=2024-02-24 02:40:05.483753+00:00, run_end_date=2024-02-24 02:40:07.556352+00:00, run_duration=2.072599, state=success, executor_state=success, try_number=1, max_tries=1, job_id=838, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:40:01.222445+00:00, queued_by_job_id=2, pid=12223 2024-02-24T02:40:09.981729974Z [2024-02-24T02:40:09.981+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:40:09.981826087Z 2024-02-24T02:40:09.981984234Z [2024-02-24T02:40:09.981+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:40:09.984048213Z [2024-02-24T02:40:09.983+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:40:09.984066903Z 2024-02-24T02:40:09.991897757Z [2024-02-24T02:40:09.991+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T02:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T02:40:09.992026366Z [2024-02-24T02:40:09.991+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T02:40:10.070475709Z [2024-02-24T02:40:10.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T02:35:00+00:00 exited with status queued for try_number 1 2024-02-24T02:40:10.070742258Z [2024-02-24T02:40:10.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T02:35:00+00:00 exited with status success for try_number 1 2024-02-24T02:40:10.077503182Z [2024-02-24T02:40:10.077+0000] {scheduler_job.py:635} INFO - Setting external_id for to 060d07e5-323b-4734-b81e-46e013f4a8d8 2024-02-24T02:40:10.077977674Z [2024-02-24T02:40:10.077+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T02:35:00+00:00, map_index=-1, run_start_date=2024-02-24 02:40:09.175523+00:00, run_end_date=2024-02-24 02:40:09.580051+00:00, run_duration=0.404528, state=success, executor_state=success, try_number=1, max_tries=1, job_id=840, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:40:07.541235+00:00, queued_by_job_id=2, pid=12253 2024-02-24T02:40:12.832284869Z [2024-02-24T02:40:12.831+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:40:12.832312813Z 2024-02-24T02:40:12.832639752Z [2024-02-24T02:40:12.832+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:40:12.833425020Z [2024-02-24T02:40:12.833+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:40:12.833432981Z 2024-02-24T02:40:12.836067202Z [2024-02-24T02:40:12.835+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:40:12.836605570Z [2024-02-24T02:40:12.836+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:40:12.930070603Z [2024-02-24T02:40:12.928+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T02:35:00+00:00 exited with status queued for try_number 1 2024-02-24T02:40:12.930359746Z [2024-02-24T02:40:12.930+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T02:35:00+00:00 exited with status success for try_number 1 2024-02-24T02:40:12.935926803Z [2024-02-24T02:40:12.935+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c902e3f-fb36-40fa-88c7-231c3ca5f699 2024-02-24T02:40:12.936162404Z [2024-02-24T02:40:12.935+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T02:35:00+00:00, map_index=0, run_start_date=2024-02-24 02:40:11.662225+00:00, run_end_date=2024-02-24 02:40:12.046170+00:00, run_duration=0.383945, state=success, executor_state=success, try_number=1, max_tries=1, job_id=841, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:40:09.984896+00:00, queued_by_job_id=2, pid=12261 2024-02-24T02:40:15.309865852Z [2024-02-24T02:40:15.309+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:40:15.310503354Z [2024-02-24T02:40:15.310+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:35:00+00:00, run_id=scheduled__2024-02-24T02:35:00+00:00, run_start_date=2024-02-24 02:40:01.052694+00:00, run_end_date=2024-02-24 02:40:15.310144+00:00, run_duration=14.25745, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:35:00+00:00, data_interval_end=2024-02-24 02:40:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T02:40:15.316481799Z [2024-02-24T02:40:15.316+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:40:00+00:00, run_after=2024-02-24T02:45:00+00:00 2024-02-24T02:40:15.383207501Z [2024-02-24T02:40:15.382+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T02:35:00+00:00 exited with status success for try_number 1 2024-02-24T02:40:15.398912540Z [2024-02-24T02:40:15.398+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T02:35:00+00:00, map_index=-1, run_start_date=2024-02-24 02:40:14.414850+00:00, run_end_date=2024-02-24 02:40:14.768329+00:00, run_duration=0.353479, state=success, executor_state=success, try_number=1, max_tries=1, job_id=842, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:40:12.833851+00:00, queued_by_job_id=2, pid=12269 2024-02-24T02:40:16.870934087Z [2024-02-24T02:40:16.870+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T02:40:16.870966709Z 2024-02-24T02:40:16.870972034Z 2024-02-24T02:40:16.870976208Z 2024-02-24T02:40:16.870988196Z [2024-02-24T02:40:16.870+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d has 0/16 running and queued tasks 2024-02-24T02:40:16.871042524Z [2024-02-24T02:40:16.870+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d has 0/16 running and queued tasks 2024-02-24T02:40:16.871164096Z [2024-02-24T02:40:16.871+0000] {scheduler_job.py:425} INFO - DAG vim_status_e3d0a28a-b3ee-4530-a90a-efa92840586d has 0/16 running and queued tasks 2024-02-24T02:40:16.871878848Z [2024-02-24T02:40:16.871+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:40:16.871892754Z 2024-02-24T02:40:16.871914650Z 2024-02-24T02:40:16.871919121Z 2024-02-24T02:40:16.875432938Z [2024-02-24T02:40:16.875+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T02:35:00+00:00', try_number=2, map_index=-1) to executor with priority 4 and queue default 2024-02-24T02:40:16.875529437Z [2024-02-24T02:40:16.875+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:40:16.875766088Z [2024-02-24T02:40:16.875+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:39:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:40:16.875839544Z [2024-02-24T02:40:16.875+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:40:16.876067851Z [2024-02-24T02:40:16.875+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_e3d0a28a-b3ee-4530-a90a-efa92840586d', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:39:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:40:16.876140290Z [2024-02-24T02:40:16.876+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_e3d0a28a-b3ee-4530-a90a-efa92840586d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:40:17.112552394Z [2024-02-24T02:40:17.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T02:35:00+00:00 exited with status queued for try_number 2 2024-02-24T02:40:17.112597683Z [2024-02-24T02:40:17.112+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:39:00+00:00 exited with status queued for try_number 2 2024-02-24T02:40:17.112686517Z [2024-02-24T02:40:17.112+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e3d0a28a-b3ee-4530-a90a-efa92840586d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:39:00+00:00 exited with status queued for try_number 2 2024-02-24T02:40:17.145045577Z [2024-02-24T02:40:17.144+0000] {scheduler_job.py:635} INFO - Setting external_id for to 14f307c6-d319-497b-a628-0bcb9c0b8e19 2024-02-24T02:40:17.145228701Z [2024-02-24T02:40:17.145+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b4dd353-0925-4bfc-8953-4cc47374e310 2024-02-24T02:40:17.145412620Z [2024-02-24T02:40:17.145+0000] {scheduler_job.py:635} INFO - Setting external_id for to 122920b4-e67d-44a2-863a-b212fab17638 2024-02-24T02:40:19.218616338Z [2024-02-24T02:40:19.218+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T02:35:00+00:00 exited with status failed for try_number 2 2024-02-24T02:40:19.218645532Z [2024-02-24T02:40:19.218+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:39:00+00:00 exited with status failed for try_number 2 2024-02-24T02:40:19.218649342Z [2024-02-24T02:40:19.218+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_e3d0a28a-b3ee-4530-a90a-efa92840586d.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:39:00+00:00 exited with status failed for try_number 2 2024-02-24T02:40:19.227423177Z [2024-02-24T02:40:19.227+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T02:35:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-02-24 02:40:06.524611+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:40:16.872688+00:00, queued_by_job_id=2, pid=None 2024-02-24T02:40:19.227733143Z [2024-02-24T02:40:19.227+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-24T02:40:19.229874601Z [2024-02-24T02:40:19.229+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-24T02:40:19.241140715Z [2024-02-24T02:40:19.240+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d, task_id=extract_metrics_from_vnfrs, execution_date=20240224T023500, start_date=, end_date=20240224T024019 2024-02-24T02:40:19.249249153Z [2024-02-24T02:40:19.248+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_e3d0a28a-b3ee-4530-a90a-efa92840586d, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:39:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-02-24 02:40:06.551113+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:40:16.872688+00:00, queued_by_job_id=2, pid=None 2024-02-24T02:40:19.249551184Z [2024-02-24T02:40:19.249+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-24T02:40:19.251440269Z [2024-02-24T02:40:19.251+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-24T02:40:19.262507574Z [2024-02-24T02:40:19.262+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_e3d0a28a-b3ee-4530-a90a-efa92840586d, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240224T023900, start_date=, end_date=20240224T024019 2024-02-24T02:40:19.269306407Z [2024-02-24T02:40:19.269+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:39:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-02-24 02:40:06.595454+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:40:16.872688+00:00, queued_by_job_id=2, pid=None 2024-02-24T02:40:19.269617081Z [2024-02-24T02:40:19.269+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-24T02:40:19.271651372Z [2024-02-24T02:40:19.271+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-02-24T02:40:19.282495586Z [2024-02-24T02:40:19.282+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240224T023900, start_date=, end_date=20240224T024019 2024-02-24T02:40:20.156028666Z [2024-02-24T02:40:20.155+0000] {dagrun.py:586} ERROR - Marking run failed 2024-02-24T02:40:20.156231063Z [2024-02-24T02:40:20.156+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_e3d0a28a-b3ee-4530-a90a-efa92840586d, execution_date=2024-02-24 02:39:00+00:00, run_id=scheduled__2024-02-24T02:39:00+00:00, run_start_date=2024-02-24 02:40:01.056250+00:00, run_end_date=2024-02-24 02:40:20.155887+00:00, run_duration=19.099637, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:39:00+00:00, data_interval_end=2024-02-24 02:40:00+00:00, dag_hash=4b1dd38fcad4575292f1bff546da90f2 2024-02-24T02:40:20.180064198Z [2024-02-24T02:40:20.179+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_e3d0a28a-b3ee-4530-a90a-efa92840586d to 2024-02-24T02:40:00+00:00, run_after=2024-02-24T02:41:00+00:00 2024-02-24T02:40:20.189812196Z [2024-02-24T02:40:20.189+0000] {dagrun.py:586} ERROR - Marking run failed 2024-02-24T02:40:20.190316709Z [2024-02-24T02:40:20.190+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d, execution_date=2024-02-24 02:39:00+00:00, run_id=scheduled__2024-02-24T02:39:00+00:00, run_start_date=2024-02-24 02:40:01.060201+00:00, run_end_date=2024-02-24 02:40:20.189958+00:00, run_duration=19.129757, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:39:00+00:00, data_interval_end=2024-02-24 02:40:00+00:00, dag_hash=f111a351244f4610ef21921fdfec93a1 2024-02-24T02:40:20.202226806Z [2024-02-24T02:40:20.201+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d to 2024-02-24T02:40:00+00:00, run_after=2024-02-24T02:41:00+00:00 2024-02-24T02:40:23.136930723Z [2024-02-24T02:40:23.135+0000] {dagrun.py:586} ERROR - Marking run failed 2024-02-24T02:40:23.137004672Z [2024-02-24T02:40:23.136+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d, execution_date=2024-02-24 02:35:00+00:00, run_id=scheduled__2024-02-24T02:35:00+00:00, run_start_date=2024-02-24 02:40:01.054006+00:00, run_end_date=2024-02-24 02:40:23.136132+00:00, run_duration=22.082126, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:35:00+00:00, data_interval_end=2024-02-24 02:40:00+00:00, dag_hash=a27cffdf4a174dcb727d21409f26deed 2024-02-24T02:40:23.146017288Z [2024-02-24T02:40:23.145+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d to 2024-02-24T02:40:00+00:00, run_after=2024-02-24T02:45:00+00:00 2024-02-24T02:41:00.513669684Z [2024-02-24T02:41:00.513+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:41:00.527666086Z [2024-02-24T02:41:00.527+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:41:00+00:00, run_after=2024-02-24T02:42:00+00:00 2024-02-24T02:41:00.542095895Z [2024-02-24T02:41:00.541+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:41:00+00:00, run_after=2024-02-24T02:42:00+00:00 2024-02-24T02:41:00.640509519Z [2024-02-24T02:41:00.639+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T02:41:00.640534057Z 2024-02-24T02:41:00.640538018Z 2024-02-24T02:41:00.640541164Z 2024-02-24T02:41:00.641115359Z [2024-02-24T02:41:00.640+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:41:00.641605825Z [2024-02-24T02:41:00.641+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:41:00.642125392Z [2024-02-24T02:41:00.641+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:41:00.643621898Z [2024-02-24T02:41:00.643+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:41:00.643643502Z 2024-02-24T02:41:00.643651655Z 2024-02-24T02:41:00.643658882Z 2024-02-24T02:41:00.649037049Z [2024-02-24T02:41:00.648+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:41:00.649449745Z [2024-02-24T02:41:00.649+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:41:00.649996511Z [2024-02-24T02:41:00.649+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:41:00.650291864Z [2024-02-24T02:41:00.650+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:41:00.650739474Z [2024-02-24T02:41:00.650+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:41:00.651081118Z [2024-02-24T02:41:00.650+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:41:00.942980742Z [2024-02-24T02:41:00.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:40:00+00:00 exited with status queued for try_number 1 2024-02-24T02:41:00.943137968Z [2024-02-24T02:41:00.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:40:00+00:00 exited with status queued for try_number 1 2024-02-24T02:41:00.943331052Z [2024-02-24T02:41:00.943+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:40:00+00:00 exited with status queued for try_number 1 2024-02-24T02:41:00.952824823Z [2024-02-24T02:41:00.952+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7775e759-0cb7-454d-82ab-238005b27c4f 2024-02-24T02:41:00.953083850Z [2024-02-24T02:41:00.952+0000] {scheduler_job.py:635} INFO - Setting external_id for to a126e254-6d25-4a8e-86d6-eabfdacb8e74 2024-02-24T02:41:00.953334165Z [2024-02-24T02:41:00.953+0000] {scheduler_job.py:635} INFO - Setting external_id for to cd8b5662-4f8b-41a5-acc8-0b15b268ae32 2024-02-24T02:41:02.125358882Z [2024-02-24T02:41:02.124+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:41:02.125725273Z [2024-02-24T02:41:02.125+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:40:00+00:00, run_id=scheduled__2024-02-24T02:40:00+00:00, run_start_date=2024-02-24 02:41:00.552921+00:00, run_end_date=2024-02-24 02:41:02.125224+00:00, run_duration=1.572303, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:40:00+00:00, data_interval_end=2024-02-24 02:41:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:41:02.144024974Z [2024-02-24T02:41:02.143+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:41:00+00:00, run_after=2024-02-24T02:42:00+00:00 2024-02-24T02:41:03.319609395Z [2024-02-24T02:41:03.319+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:40:00+00:00 exited with status success for try_number 1 2024-02-24T02:41:03.328375974Z [2024-02-24T02:41:03.327+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:40:00+00:00, map_index=-1, run_start_date=2024-02-24 02:41:01.617260+00:00, run_end_date=2024-02-24 02:41:02.096407+00:00, run_duration=0.479147, state=success, executor_state=success, try_number=1, max_tries=1, job_id=843, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:41:00.644898+00:00, queued_by_job_id=2, pid=12327 2024-02-24T02:41:04.958313483Z [2024-02-24T02:41:04.957+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:41:04.958782694Z [2024-02-24T02:41:04.958+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:40:00+00:00, run_id=scheduled__2024-02-24T02:40:00+00:00, run_start_date=2024-02-24 02:41:00.554970+00:00, run_end_date=2024-02-24 02:41:04.958156+00:00, run_duration=4.403186, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:40:00+00:00, data_interval_end=2024-02-24 02:41:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:41:04.980434421Z [2024-02-24T02:41:04.979+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:41:00+00:00, run_after=2024-02-24T02:42:00+00:00 2024-02-24T02:41:05.034088908Z [2024-02-24T02:41:05.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:40:00+00:00 exited with status success for try_number 1 2024-02-24T02:41:05.039339079Z [2024-02-24T02:41:05.038+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:40:00+00:00, map_index=-1, run_start_date=2024-02-24 02:41:02.563728+00:00, run_end_date=2024-02-24 02:41:03.951843+00:00, run_duration=1.388115, state=success, executor_state=success, try_number=1, max_tries=1, job_id=844, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:41:00.644898+00:00, queued_by_job_id=2, pid=12345 2024-02-24T02:41:06.099559007Z [2024-02-24T02:41:06.099+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:41:06.100059231Z [2024-02-24T02:41:06.099+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:40:00+00:00, run_id=scheduled__2024-02-24T02:40:00+00:00, run_start_date=2024-02-24 02:41:00.556060+00:00, run_end_date=2024-02-24 02:41:06.099688+00:00, run_duration=5.543628, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:40:00+00:00, data_interval_end=2024-02-24 02:41:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:41:06.111444324Z [2024-02-24T02:41:06.111+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:41:00+00:00, run_after=2024-02-24T02:42:00+00:00 2024-02-24T02:41:06.161947492Z [2024-02-24T02:41:06.161+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:40:00+00:00 exited with status success for try_number 1 2024-02-24T02:41:06.167983109Z [2024-02-24T02:41:06.167+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:40:00+00:00, map_index=-1, run_start_date=2024-02-24 02:41:02.605740+00:00, run_end_date=2024-02-24 02:41:04.938359+00:00, run_duration=2.332619, state=success, executor_state=success, try_number=1, max_tries=1, job_id=845, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:41:00.644898+00:00, queued_by_job_id=2, pid=12346 2024-02-24T02:42:00.776489560Z [2024-02-24T02:42:00.775+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:42:00+00:00, run_after=2024-02-24T02:43:00+00:00 2024-02-24T02:42:00.789237134Z [2024-02-24T02:42:00.788+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:42:00.804808155Z [2024-02-24T02:42:00.804+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:42:00+00:00, run_after=2024-02-24T02:43:00+00:00 2024-02-24T02:42:00.813680041Z [2024-02-24T02:42:00.813+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:42:00.931602307Z [2024-02-24T02:42:00.931+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T02:42:00.931634339Z 2024-02-24T02:42:00.931641284Z 2024-02-24T02:42:00.931647259Z 2024-02-24T02:42:00.931652714Z 2024-02-24T02:42:00.932079081Z [2024-02-24T02:42:00.931+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T02:42:00.932525348Z [2024-02-24T02:42:00.932+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:42:00.933010861Z [2024-02-24T02:42:00.932+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:42:00.933535661Z [2024-02-24T02:42:00.933+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:42:00.935327682Z [2024-02-24T02:42:00.934+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:42:00.935350712Z 2024-02-24T02:42:00.935356409Z 2024-02-24T02:42:00.935361603Z 2024-02-24T02:42:00.935366647Z 2024-02-24T02:42:00.940544904Z [2024-02-24T02:42:00.940+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:42:00.940890074Z [2024-02-24T02:42:00.940+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T02:42:00.941363458Z [2024-02-24T02:42:00.941+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:42:00.941687767Z [2024-02-24T02:42:00.941+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:42:00.942216864Z [2024-02-24T02:42:00.941+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:42:00.942521977Z [2024-02-24T02:42:00.942+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:42:00.943002171Z [2024-02-24T02:42:00.942+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:42:00.943301219Z [2024-02-24T02:42:00.943+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:42:01.381048493Z [2024-02-24T02:42:01.380+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:40:00+00:00 exited with status queued for try_number 1 2024-02-24T02:42:01.385717647Z [2024-02-24T02:42:01.380+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:41:00+00:00 exited with status queued for try_number 1 2024-02-24T02:42:01.386814854Z [2024-02-24T02:42:01.385+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:41:00+00:00 exited with status queued for try_number 1 2024-02-24T02:42:01.387107285Z [2024-02-24T02:42:01.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:41:00+00:00 exited with status queued for try_number 1 2024-02-24T02:42:01.397537580Z [2024-02-24T02:42:01.397+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0de63f97-5eac-4b95-a65d-2275d4e591d3 2024-02-24T02:42:01.397899132Z [2024-02-24T02:42:01.397+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f5eff25-9b70-459c-bd80-f07f6a4bbe9b 2024-02-24T02:42:01.398211118Z [2024-02-24T02:42:01.398+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e6b55cc-9a50-41b9-9ff5-a230ffc19959 2024-02-24T02:42:01.398470087Z [2024-02-24T02:42:01.398+0000] {scheduler_job.py:635} INFO - Setting external_id for to c832e6cb-111e-49bc-91ed-98623d95cbad 2024-02-24T02:42:02.592903671Z [2024-02-24T02:42:02.592+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:42:02.593444558Z [2024-02-24T02:42:02.593+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 02:40:00+00:00, run_id=scheduled__2024-02-24T02:40:00+00:00, run_start_date=2024-02-24 02:42:00.830532+00:00, run_end_date=2024-02-24 02:42:02.593004+00:00, run_duration=1.762472, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:40:00+00:00, data_interval_end=2024-02-24 02:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T02:42:02.602519593Z [2024-02-24T02:42:02.602+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T02:42:00+00:00, run_after=2024-02-24T02:44:00+00:00 2024-02-24T02:42:02.611199052Z [2024-02-24T02:42:02.610+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:42:02.611465371Z [2024-02-24T02:42:02.611+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:41:00+00:00, run_id=scheduled__2024-02-24T02:41:00+00:00, run_start_date=2024-02-24 02:42:00.832333+00:00, run_end_date=2024-02-24 02:42:02.611051+00:00, run_duration=1.778718, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:41:00+00:00, data_interval_end=2024-02-24 02:42:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:42:02.623871355Z [2024-02-24T02:42:02.623+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:42:00+00:00, run_after=2024-02-24T02:43:00+00:00 2024-02-24T02:42:02.799261921Z [2024-02-24T02:42:02.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:40:00+00:00 exited with status success for try_number 1 2024-02-24T02:42:02.799525230Z [2024-02-24T02:42:02.799+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:41:00+00:00 exited with status success for try_number 1 2024-02-24T02:42:02.814842388Z [2024-02-24T02:42:02.814+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T02:40:00+00:00, map_index=-1, run_start_date=2024-02-24 02:42:01.857512+00:00, run_end_date=2024-02-24 02:42:02.353436+00:00, run_duration=0.495924, state=success, executor_state=success, try_number=1, max_tries=1, job_id=846, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:42:00.936813+00:00, queued_by_job_id=2, pid=12381 2024-02-24T02:42:02.815260916Z [2024-02-24T02:42:02.814+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:41:00+00:00, map_index=-1, run_start_date=2024-02-24 02:42:01.868115+00:00, run_end_date=2024-02-24 02:42:02.371839+00:00, run_duration=0.503724, state=success, executor_state=success, try_number=1, max_tries=1, job_id=847, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:42:00.936813+00:00, queued_by_job_id=2, pid=12380 2024-02-24T02:42:04.538394710Z [2024-02-24T02:42:04.537+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T02:42:05.904752322Z [2024-02-24T02:42:05.904+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:42:05.905340814Z [2024-02-24T02:42:05.904+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:41:00+00:00, run_id=scheduled__2024-02-24T02:41:00+00:00, run_start_date=2024-02-24 02:42:00.833800+00:00, run_end_date=2024-02-24 02:42:05.904521+00:00, run_duration=5.070721, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:41:00+00:00, data_interval_end=2024-02-24 02:42:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:42:05.918310023Z [2024-02-24T02:42:05.917+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:42:00+00:00, run_after=2024-02-24T02:43:00+00:00 2024-02-24T02:42:05.980210689Z [2024-02-24T02:42:05.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:41:00+00:00 exited with status success for try_number 1 2024-02-24T02:42:05.991187526Z [2024-02-24T02:42:05.990+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:41:00+00:00, map_index=-1, run_start_date=2024-02-24 02:42:03.388776+00:00, run_end_date=2024-02-24 02:42:05.511278+00:00, run_duration=2.122502, state=success, executor_state=success, try_number=1, max_tries=1, job_id=849, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:42:00.936813+00:00, queued_by_job_id=2, pid=12405 2024-02-24T02:42:07.048414865Z [2024-02-24T02:42:07.047+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:42:07.048592869Z [2024-02-24T02:42:07.048+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:41:00+00:00, run_id=scheduled__2024-02-24T02:41:00+00:00, run_start_date=2024-02-24 02:42:00.835114+00:00, run_end_date=2024-02-24 02:42:07.048328+00:00, run_duration=6.213214, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:41:00+00:00, data_interval_end=2024-02-24 02:42:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:42:07.057574680Z [2024-02-24T02:42:07.057+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:42:00+00:00, run_after=2024-02-24T02:43:00+00:00 2024-02-24T02:42:07.098112335Z [2024-02-24T02:42:07.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:41:00+00:00 exited with status success for try_number 1 2024-02-24T02:42:07.106542425Z [2024-02-24T02:42:07.106+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:41:00+00:00, map_index=-1, run_start_date=2024-02-24 02:42:03.372421+00:00, run_end_date=2024-02-24 02:42:06.238843+00:00, run_duration=2.866422, state=success, executor_state=success, try_number=1, max_tries=1, job_id=848, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:42:00.936813+00:00, queued_by_job_id=2, pid=12404 2024-02-24T02:43:00.660909949Z [2024-02-24T02:43:00.660+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:43:00+00:00, run_after=2024-02-24T02:44:00+00:00 2024-02-24T02:43:00.669543720Z [2024-02-24T02:43:00.669+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:43:00.682449434Z [2024-02-24T02:43:00.682+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:43:00+00:00, run_after=2024-02-24T02:44:00+00:00 2024-02-24T02:43:00.747032911Z [2024-02-24T02:43:00.746+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T02:43:00.747078092Z 2024-02-24T02:43:00.747082239Z 2024-02-24T02:43:00.747085597Z 2024-02-24T02:43:00.747240893Z [2024-02-24T02:43:00.746+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:43:00.747398263Z [2024-02-24T02:43:00.747+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:43:00.747550747Z [2024-02-24T02:43:00.747+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:43:00.748190099Z [2024-02-24T02:43:00.747+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:43:00.748201990Z 2024-02-24T02:43:00.748205297Z 2024-02-24T02:43:00.748208433Z 2024-02-24T02:43:00.751548298Z [2024-02-24T02:43:00.751+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:43:00.751596322Z [2024-02-24T02:43:00.751+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:43:00.751846539Z [2024-02-24T02:43:00.751+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:43:00.751948053Z [2024-02-24T02:43:00.751+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:43:00.752198035Z [2024-02-24T02:43:00.752+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:43:00.752296903Z [2024-02-24T02:43:00.752+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:43:01.175453385Z [2024-02-24T02:43:01.174+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:42:00+00:00 exited with status queued for try_number 1 2024-02-24T02:43:01.175784152Z [2024-02-24T02:43:01.175+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:42:00+00:00 exited with status queued for try_number 1 2024-02-24T02:43:01.176024823Z [2024-02-24T02:43:01.175+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:42:00+00:00 exited with status queued for try_number 1 2024-02-24T02:43:01.209003567Z [2024-02-24T02:43:01.208+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5f9f93e-2bb5-47c7-8596-8d7f4621a4f9 2024-02-24T02:43:01.216326159Z [2024-02-24T02:43:01.213+0000] {scheduler_job.py:635} INFO - Setting external_id for to bbd7faf4-e4a0-41b4-9e55-3067c88d4fe0 2024-02-24T02:43:01.216351473Z [2024-02-24T02:43:01.214+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b7e8df0-492e-40e2-999c-30e891a15390 2024-02-24T02:43:03.094790559Z [2024-02-24T02:43:03.093+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:43:03.096938659Z [2024-02-24T02:43:03.096+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:42:00+00:00, run_id=scheduled__2024-02-24T02:42:00+00:00, run_start_date=2024-02-24 02:43:00.693362+00:00, run_end_date=2024-02-24 02:43:03.095812+00:00, run_duration=2.40245, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:42:00+00:00, data_interval_end=2024-02-24 02:43:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:43:03.128910867Z [2024-02-24T02:43:03.128+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:43:00+00:00, run_after=2024-02-24T02:44:00+00:00 2024-02-24T02:43:03.210577969Z [2024-02-24T02:43:03.210+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:42:00+00:00 exited with status success for try_number 1 2024-02-24T02:43:03.219213604Z [2024-02-24T02:43:03.218+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:42:00+00:00, map_index=-1, run_start_date=2024-02-24 02:43:02.029554+00:00, run_end_date=2024-02-24 02:43:02.565621+00:00, run_duration=0.536067, state=success, executor_state=success, try_number=1, max_tries=1, job_id=850, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:43:00.748915+00:00, queued_by_job_id=2, pid=12436 2024-02-24T02:43:06.487198960Z [2024-02-24T02:43:06.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:42:00+00:00 exited with status success for try_number 1 2024-02-24T02:43:06.493234120Z [2024-02-24T02:43:06.492+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:42:00+00:00, map_index=-1, run_start_date=2024-02-24 02:43:03.136191+00:00, run_end_date=2024-02-24 02:43:06.326083+00:00, run_duration=3.189892, state=success, executor_state=success, try_number=1, max_tries=1, job_id=851, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:43:00.748915+00:00, queued_by_job_id=2, pid=12454 2024-02-24T02:43:07.562010433Z [2024-02-24T02:43:07.561+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:43:07.562444445Z [2024-02-24T02:43:07.561+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:42:00+00:00, run_id=scheduled__2024-02-24T02:42:00+00:00, run_start_date=2024-02-24 02:43:00.697167+00:00, run_end_date=2024-02-24 02:43:07.561765+00:00, run_duration=6.864598, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:42:00+00:00, data_interval_end=2024-02-24 02:43:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:43:07.575685904Z [2024-02-24T02:43:07.575+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:43:00+00:00, run_after=2024-02-24T02:44:00+00:00 2024-02-24T02:43:07.583287422Z [2024-02-24T02:43:07.582+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:43:07.583656950Z [2024-02-24T02:43:07.583+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:42:00+00:00, run_id=scheduled__2024-02-24T02:42:00+00:00, run_start_date=2024-02-24 02:43:00.694609+00:00, run_end_date=2024-02-24 02:43:07.583255+00:00, run_duration=6.888646, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:42:00+00:00, data_interval_end=2024-02-24 02:43:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:43:07.593199785Z [2024-02-24T02:43:07.592+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:43:00+00:00, run_after=2024-02-24T02:44:00+00:00 2024-02-24T02:43:07.640871671Z [2024-02-24T02:43:07.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:42:00+00:00 exited with status success for try_number 1 2024-02-24T02:43:07.645827622Z [2024-02-24T02:43:07.645+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:42:00+00:00, map_index=-1, run_start_date=2024-02-24 02:43:03.314553+00:00, run_end_date=2024-02-24 02:43:07.213133+00:00, run_duration=3.89858, state=success, executor_state=success, try_number=1, max_tries=1, job_id=852, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:43:00.748915+00:00, queued_by_job_id=2, pid=12455 2024-02-24T02:44:00.932707590Z [2024-02-24T02:44:00.931+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:44:00+00:00, run_after=2024-02-24T02:45:00+00:00 2024-02-24T02:44:00.942132579Z [2024-02-24T02:44:00.941+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:44:00.965431650Z [2024-02-24T02:44:00.964+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:44:00+00:00, run_after=2024-02-24T02:45:00+00:00 2024-02-24T02:44:00.978340638Z [2024-02-24T02:44:00.977+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:44:01.078664073Z [2024-02-24T02:44:01.078+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T02:44:01.078769470Z 2024-02-24T02:44:01.078782738Z 2024-02-24T02:44:01.078822251Z 2024-02-24T02:44:01.078831110Z 2024-02-24T02:44:01.078840408Z [2024-02-24T02:44:01.078+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T02:44:01.078849033Z [2024-02-24T02:44:01.078+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:44:01.078898924Z [2024-02-24T02:44:01.078+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:44:01.079331178Z [2024-02-24T02:44:01.078+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:44:01.080247454Z [2024-02-24T02:44:01.079+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:44:01.080261688Z 2024-02-24T02:44:01.080269039Z 2024-02-24T02:44:01.080273011Z 2024-02-24T02:44:01.080277330Z 2024-02-24T02:44:01.084212359Z [2024-02-24T02:44:01.083+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:44:01.084228124Z [2024-02-24T02:44:01.084+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T02:44:01.084618152Z [2024-02-24T02:44:01.084+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:44:01.084867715Z [2024-02-24T02:44:01.084+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:44:01.085149609Z [2024-02-24T02:44:01.084+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:44:01.085298283Z [2024-02-24T02:44:01.085+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:44:01.085561945Z [2024-02-24T02:44:01.085+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:44:01.085732317Z [2024-02-24T02:44:01.085+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:44:01.632910213Z [2024-02-24T02:44:01.632+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:42:00+00:00 exited with status queued for try_number 1 2024-02-24T02:44:01.633182610Z [2024-02-24T02:44:01.632+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:43:00+00:00 exited with status queued for try_number 1 2024-02-24T02:44:01.633380103Z [2024-02-24T02:44:01.633+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:43:00+00:00 exited with status queued for try_number 1 2024-02-24T02:44:01.633558769Z [2024-02-24T02:44:01.633+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:43:00+00:00 exited with status queued for try_number 1 2024-02-24T02:44:01.659746446Z [2024-02-24T02:44:01.659+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7a3b06a0-ba6a-4054-a359-451631c9d7bf 2024-02-24T02:44:01.660058327Z [2024-02-24T02:44:01.659+0000] {scheduler_job.py:635} INFO - Setting external_id for to 293b758b-19e8-4cc7-aed5-9378ec248b48 2024-02-24T02:44:01.660295619Z [2024-02-24T02:44:01.660+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b40a1f5-7c7f-4bc8-86b1-453062917efe 2024-02-24T02:44:01.660521060Z [2024-02-24T02:44:01.660+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4635f260-26c5-4097-96c8-8224850181da 2024-02-24T02:44:02.376812833Z [2024-02-24T02:44:02.376+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:44:02.377909608Z [2024-02-24T02:44:02.377+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 02:42:00+00:00, run_id=scheduled__2024-02-24T02:42:00+00:00, run_start_date=2024-02-24 02:44:00.993933+00:00, run_end_date=2024-02-24 02:44:02.376730+00:00, run_duration=1.382797, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:42:00+00:00, data_interval_end=2024-02-24 02:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T02:44:02.394857394Z [2024-02-24T02:44:02.394+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T02:44:00+00:00, run_after=2024-02-24T02:46:00+00:00 2024-02-24T02:44:02.524165926Z [2024-02-24T02:44:02.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:42:00+00:00 exited with status success for try_number 1 2024-02-24T02:44:02.536956673Z [2024-02-24T02:44:02.536+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T02:42:00+00:00, map_index=-1, run_start_date=2024-02-24 02:44:01.887482+00:00, run_end_date=2024-02-24 02:44:02.335895+00:00, run_duration=0.448413, state=success, executor_state=success, try_number=1, max_tries=1, job_id=853, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:44:01.081250+00:00, queued_by_job_id=2, pid=12488 2024-02-24T02:44:03.615576967Z [2024-02-24T02:44:03.615+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:44:03.616281953Z [2024-02-24T02:44:03.616+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:43:00+00:00, run_id=scheduled__2024-02-24T02:43:00+00:00, run_start_date=2024-02-24 02:44:00.995407+00:00, run_end_date=2024-02-24 02:44:03.615488+00:00, run_duration=2.620081, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:43:00+00:00, data_interval_end=2024-02-24 02:44:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:44:03.627008559Z [2024-02-24T02:44:03.626+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:44:00+00:00, run_after=2024-02-24T02:45:00+00:00 2024-02-24T02:44:03.685061811Z [2024-02-24T02:44:03.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:43:00+00:00 exited with status success for try_number 1 2024-02-24T02:44:03.690924642Z [2024-02-24T02:44:03.690+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:43:00+00:00, map_index=-1, run_start_date=2024-02-24 02:44:02.012877+00:00, run_end_date=2024-02-24 02:44:02.520245+00:00, run_duration=0.507368, state=success, executor_state=success, try_number=1, max_tries=1, job_id=854, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:44:01.081250+00:00, queued_by_job_id=2, pid=12489 2024-02-24T02:44:05.853333783Z [2024-02-24T02:44:05.852+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:44:05.853677720Z [2024-02-24T02:44:05.853+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:43:00+00:00, run_id=scheduled__2024-02-24T02:43:00+00:00, run_start_date=2024-02-24 02:44:00.996852+00:00, run_end_date=2024-02-24 02:44:05.853385+00:00, run_duration=4.856533, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:43:00+00:00, data_interval_end=2024-02-24 02:44:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:44:05.865143988Z [2024-02-24T02:44:05.864+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:44:00+00:00, run_after=2024-02-24T02:45:00+00:00 2024-02-24T02:44:05.875761187Z [2024-02-24T02:44:05.875+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:44:05.876258245Z [2024-02-24T02:44:05.876+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:43:00+00:00, run_id=scheduled__2024-02-24T02:43:00+00:00, run_start_date=2024-02-24 02:44:00.998189+00:00, run_end_date=2024-02-24 02:44:05.875666+00:00, run_duration=4.877477, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:43:00+00:00, data_interval_end=2024-02-24 02:44:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:44:05.886107728Z [2024-02-24T02:44:05.885+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:44:00+00:00, run_after=2024-02-24T02:45:00+00:00 2024-02-24T02:44:05.931730246Z [2024-02-24T02:44:05.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:43:00+00:00 exited with status success for try_number 1 2024-02-24T02:44:05.932701712Z [2024-02-24T02:44:05.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:43:00+00:00 exited with status success for try_number 1 2024-02-24T02:44:05.943156295Z [2024-02-24T02:44:05.942+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:43:00+00:00, map_index=-1, run_start_date=2024-02-24 02:44:03.227235+00:00, run_end_date=2024-02-24 02:44:05.095519+00:00, run_duration=1.868284, state=success, executor_state=success, try_number=1, max_tries=1, job_id=855, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:44:01.081250+00:00, queued_by_job_id=2, pid=12512 2024-02-24T02:44:05.943587036Z [2024-02-24T02:44:05.943+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:43:00+00:00, map_index=-1, run_start_date=2024-02-24 02:44:03.314880+00:00, run_end_date=2024-02-24 02:44:05.372784+00:00, run_duration=2.057904, state=success, executor_state=success, try_number=1, max_tries=1, job_id=856, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:44:01.081250+00:00, queued_by_job_id=2, pid=12513 2024-02-24T02:45:00.149218343Z [2024-02-24T02:45:00.148+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:45:00+00:00, run_after=2024-02-24T02:50:00+00:00 2024-02-24T02:45:00.175824849Z [2024-02-24T02:45:00.175+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:45:00+00:00, run_after=2024-02-24T02:46:00+00:00 2024-02-24T02:45:00.185371103Z [2024-02-24T02:45:00.184+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:45:00.196748562Z [2024-02-24T02:45:00.196+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:45:00+00:00, run_after=2024-02-24T02:46:00+00:00 2024-02-24T02:45:00.307423287Z [2024-02-24T02:45:00.306+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T02:45:00.307467498Z 2024-02-24T02:45:00.307503157Z 2024-02-24T02:45:00.307509513Z 2024-02-24T02:45:00.307514815Z 2024-02-24T02:45:00.307943579Z [2024-02-24T02:45:00.307+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:45:00.308337911Z [2024-02-24T02:45:00.308+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:45:00.308630249Z [2024-02-24T02:45:00.308+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:45:00.308992399Z [2024-02-24T02:45:00.308+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:45:00.310426131Z [2024-02-24T02:45:00.310+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:45:00.310439092Z 2024-02-24T02:45:00.310442911Z 2024-02-24T02:45:00.310446265Z 2024-02-24T02:45:00.310449549Z 2024-02-24T02:45:00.316047502Z [2024-02-24T02:45:00.315+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T02:45:00.316293628Z [2024-02-24T02:45:00.316+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:45:00.316720131Z [2024-02-24T02:45:00.316+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:45:00.316961771Z [2024-02-24T02:45:00.316+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:45:00.317329701Z [2024-02-24T02:45:00.317+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:45:00.317592343Z [2024-02-24T02:45:00.317+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:45:00.318048485Z [2024-02-24T02:45:00.317+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:45:00.318336157Z [2024-02-24T02:45:00.318+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:45:00.804348005Z [2024-02-24T02:45:00.803+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T02:40:00+00:00 exited with status queued for try_number 1 2024-02-24T02:45:00.810167309Z [2024-02-24T02:45:00.804+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:44:00+00:00 exited with status queued for try_number 1 2024-02-24T02:45:00.810201283Z [2024-02-24T02:45:00.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:44:00+00:00 exited with status queued for try_number 1 2024-02-24T02:45:00.810268400Z [2024-02-24T02:45:00.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:44:00+00:00 exited with status queued for try_number 1 2024-02-24T02:45:00.831523325Z [2024-02-24T02:45:00.830+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f8afe82-b0f1-4f1f-9088-85c4a8cdfb84 2024-02-24T02:45:00.831634308Z [2024-02-24T02:45:00.831+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5458e32-3ae1-4c21-810c-b63ceb4c90be 2024-02-24T02:45:00.831754123Z [2024-02-24T02:45:00.831+0000] {scheduler_job.py:635} INFO - Setting external_id for to d1b24052-81e5-42a3-8826-be8581bc06a4 2024-02-24T02:45:00.831870852Z [2024-02-24T02:45:00.831+0000] {scheduler_job.py:635} INFO - Setting external_id for to 65a37b2e-12ab-44ca-9683-445ae9bc4bad 2024-02-24T02:45:02.123354346Z [2024-02-24T02:45:02.122+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:45:02.123832356Z [2024-02-24T02:45:02.123+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:44:00+00:00, run_id=scheduled__2024-02-24T02:44:00+00:00, run_start_date=2024-02-24 02:45:00.215062+00:00, run_end_date=2024-02-24 02:45:02.123426+00:00, run_duration=1.908364, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:44:00+00:00, data_interval_end=2024-02-24 02:45:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:45:02.138981359Z [2024-02-24T02:45:02.138+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:45:00+00:00, run_after=2024-02-24T02:46:00+00:00 2024-02-24T02:45:02.189903959Z [2024-02-24T02:45:02.186+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:44:00+00:00 exited with status success for try_number 1 2024-02-24T02:45:02.195171086Z [2024-02-24T02:45:02.194+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:44:00+00:00, map_index=-1, run_start_date=2024-02-24 02:45:01.452948+00:00, run_end_date=2024-02-24 02:45:01.969532+00:00, run_duration=0.516584, state=success, executor_state=success, try_number=1, max_tries=1, job_id=857, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:45:00.311733+00:00, queued_by_job_id=2, pid=12545 2024-02-24T02:45:03.132562518Z [2024-02-24T02:45:03.132+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:45:03.132595906Z 2024-02-24T02:45:03.132813251Z [2024-02-24T02:45:03.132+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:45:03.133648245Z [2024-02-24T02:45:03.133+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:45:03.133661735Z 2024-02-24T02:45:03.138207963Z [2024-02-24T02:45:03.137+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T02:45:03.138552203Z [2024-02-24T02:45:03.138+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:45:03.196859830Z [2024-02-24T02:45:03.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T02:40:00+00:00 exited with status queued for try_number 1 2024-02-24T02:45:03.203332060Z [2024-02-24T02:45:03.202+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99a494ef-82a1-4563-ab7e-4e10b1550b85 2024-02-24T02:45:03.308030800Z [2024-02-24T02:45:03.307+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T02:40:00+00:00 exited with status success for try_number 1 2024-02-24T02:45:03.313284059Z [2024-02-24T02:45:03.312+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T02:40:00+00:00, map_index=-1, run_start_date=2024-02-24 02:45:02.554246+00:00, run_end_date=2024-02-24 02:45:03.002843+00:00, run_duration=0.448597, state=success, executor_state=success, try_number=1, max_tries=1, job_id=858, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:45:00.311733+00:00, queued_by_job_id=2, pid=12564 2024-02-24T02:45:04.370527344Z [2024-02-24T02:45:04.368+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:45:04.370566773Z [2024-02-24T02:45:04.369+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:44:00+00:00, run_id=scheduled__2024-02-24T02:44:00+00:00, run_start_date=2024-02-24 02:45:00.217685+00:00, run_end_date=2024-02-24 02:45:04.369056+00:00, run_duration=4.151371, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:44:00+00:00, data_interval_end=2024-02-24 02:45:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:45:04.387685285Z [2024-02-24T02:45:04.387+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:45:00+00:00, run_after=2024-02-24T02:46:00+00:00 2024-02-24T02:45:04.451405302Z [2024-02-24T02:45:04.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:44:00+00:00 exited with status success for try_number 1 2024-02-24T02:45:04.460173574Z [2024-02-24T02:45:04.459+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:44:00+00:00, map_index=-1, run_start_date=2024-02-24 02:45:02.840703+00:00, run_end_date=2024-02-24 02:45:04.194081+00:00, run_duration=1.353378, state=success, executor_state=success, try_number=1, max_tries=1, job_id=860, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:45:00.311733+00:00, queued_by_job_id=2, pid=12571 2024-02-24T02:45:05.501414244Z [2024-02-24T02:45:05.500+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:45:05.501870214Z [2024-02-24T02:45:05.501+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:44:00+00:00, run_id=scheduled__2024-02-24T02:44:00+00:00, run_start_date=2024-02-24 02:45:00.221941+00:00, run_end_date=2024-02-24 02:45:05.501470+00:00, run_duration=5.279529, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:44:00+00:00, data_interval_end=2024-02-24 02:45:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:45:05.511481500Z [2024-02-24T02:45:05.511+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:45:00+00:00, run_after=2024-02-24T02:46:00+00:00 2024-02-24T02:45:05.545908433Z [2024-02-24T02:45:05.545+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:45:05.545938198Z 2024-02-24T02:45:05.546374886Z [2024-02-24T02:45:05.545+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:45:05.547569230Z [2024-02-24T02:45:05.547+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:45:05.547620916Z 2024-02-24T02:45:05.551797056Z [2024-02-24T02:45:05.551+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T02:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T02:45:05.551899932Z [2024-02-24T02:45:05.551+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T02:45:05.612732559Z [2024-02-24T02:45:05.612+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T02:40:00+00:00 exited with status queued for try_number 1 2024-02-24T02:45:05.612773261Z [2024-02-24T02:45:05.612+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:44:00+00:00 exited with status success for try_number 1 2024-02-24T02:45:05.613035303Z [2024-02-24T02:45:05.612+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T02:40:00+00:00 exited with status success for try_number 1 2024-02-24T02:45:05.619938229Z [2024-02-24T02:45:05.619+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:44:00+00:00, map_index=-1, run_start_date=2024-02-24 02:45:02.661352+00:00, run_end_date=2024-02-24 02:45:04.361631+00:00, run_duration=1.700279, state=success, executor_state=success, try_number=1, max_tries=1, job_id=859, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:45:00.311733+00:00, queued_by_job_id=2, pid=12570 2024-02-24T02:45:05.620254895Z [2024-02-24T02:45:05.620+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71b98462-ebcf-4eaa-a97e-86174f8b74db 2024-02-24T02:45:05.620526802Z [2024-02-24T02:45:05.620+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T02:40:00+00:00, map_index=-1, run_start_date=2024-02-24 02:45:04.889968+00:00, run_end_date=2024-02-24 02:45:05.258796+00:00, run_duration=0.368828, state=success, executor_state=success, try_number=1, max_tries=1, job_id=861, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:45:03.134373+00:00, queued_by_job_id=2, pid=12594 2024-02-24T02:45:07.845928689Z [2024-02-24T02:45:07.845+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:45:07.845966056Z 2024-02-24T02:45:07.845972302Z [2024-02-24T02:45:07.845+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:45:07.846416277Z [2024-02-24T02:45:07.846+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:45:07.846449659Z 2024-02-24T02:45:07.848800992Z [2024-02-24T02:45:07.848+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:45:07.848865640Z [2024-02-24T02:45:07.848+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:45:07.891893765Z [2024-02-24T02:45:07.891+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T02:40:00+00:00 exited with status queued for try_number 1 2024-02-24T02:45:07.892161127Z [2024-02-24T02:45:07.891+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T02:40:00+00:00 exited with status success for try_number 1 2024-02-24T02:45:07.900734312Z [2024-02-24T02:45:07.900+0000] {scheduler_job.py:635} INFO - Setting external_id for to d7532261-b377-4614-b2e0-61ba44958fb1 2024-02-24T02:45:07.901194482Z [2024-02-24T02:45:07.900+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T02:40:00+00:00, map_index=0, run_start_date=2024-02-24 02:45:07.282213+00:00, run_end_date=2024-02-24 02:45:07.600919+00:00, run_duration=0.318706, state=success, executor_state=success, try_number=1, max_tries=1, job_id=862, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:45:05.548221+00:00, queued_by_job_id=2, pid=12602 2024-02-24T02:45:10.504719002Z [2024-02-24T02:45:10.504+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:45:10.505151371Z [2024-02-24T02:45:10.504+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:40:00+00:00, run_id=scheduled__2024-02-24T02:40:00+00:00, run_start_date=2024-02-24 02:45:00.211320+00:00, run_end_date=2024-02-24 02:45:10.504593+00:00, run_duration=10.293273, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:40:00+00:00, data_interval_end=2024-02-24 02:45:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T02:45:10.512355260Z [2024-02-24T02:45:10.511+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:45:00+00:00, run_after=2024-02-24T02:50:00+00:00 2024-02-24T02:45:10.544127223Z [2024-02-24T02:45:10.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T02:40:00+00:00 exited with status success for try_number 1 2024-02-24T02:45:10.549657325Z [2024-02-24T02:45:10.549+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T02:40:00+00:00, map_index=-1, run_start_date=2024-02-24 02:45:09.509411+00:00, run_end_date=2024-02-24 02:45:09.839472+00:00, run_duration=0.330061, state=success, executor_state=success, try_number=1, max_tries=1, job_id=863, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:45:07.846707+00:00, queued_by_job_id=2, pid=12610 2024-02-24T02:46:00.051092663Z [2024-02-24T02:46:00.050+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:46:00+00:00, run_after=2024-02-24T02:47:00+00:00 2024-02-24T02:46:00.068443594Z [2024-02-24T02:46:00.068+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:46:00+00:00, run_after=2024-02-24T02:47:00+00:00 2024-02-24T02:46:00.075245212Z [2024-02-24T02:46:00.074+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:46:00.083863293Z [2024-02-24T02:46:00.083+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:46:00.192278558Z [2024-02-24T02:46:00.191+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T02:46:00.192312983Z 2024-02-24T02:46:00.192319799Z 2024-02-24T02:46:00.192326974Z 2024-02-24T02:46:00.192332963Z 2024-02-24T02:46:00.192619879Z [2024-02-24T02:46:00.192+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T02:46:00.192865657Z [2024-02-24T02:46:00.192+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:46:00.193091737Z [2024-02-24T02:46:00.192+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:46:00.193237282Z [2024-02-24T02:46:00.193+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:46:00.194262493Z [2024-02-24T02:46:00.194+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:46:00.194273968Z 2024-02-24T02:46:00.194279373Z 2024-02-24T02:46:00.194283672Z 2024-02-24T02:46:00.194287855Z 2024-02-24T02:46:00.198414058Z [2024-02-24T02:46:00.198+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:46:00.198642407Z [2024-02-24T02:46:00.198+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T02:46:00.198998821Z [2024-02-24T02:46:00.198+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:46:00.199234377Z [2024-02-24T02:46:00.199+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:46:00.199506008Z [2024-02-24T02:46:00.199+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:46:00.199739031Z [2024-02-24T02:46:00.199+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:46:00.200090357Z [2024-02-24T02:46:00.199+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:46:00.200300533Z [2024-02-24T02:46:00.200+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:46:00.694951197Z [2024-02-24T02:46:00.694+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:44:00+00:00 exited with status queued for try_number 1 2024-02-24T02:46:00.695064994Z [2024-02-24T02:46:00.694+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:45:00+00:00 exited with status queued for try_number 1 2024-02-24T02:46:00.695183175Z [2024-02-24T02:46:00.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:45:00+00:00 exited with status queued for try_number 1 2024-02-24T02:46:00.695298397Z [2024-02-24T02:46:00.695+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:45:00+00:00 exited with status queued for try_number 1 2024-02-24T02:46:00.719323373Z [2024-02-24T02:46:00.718+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6cb809cb-b1bf-4618-a090-6d38dcd235ad 2024-02-24T02:46:00.719523062Z [2024-02-24T02:46:00.719+0000] {scheduler_job.py:635} INFO - Setting external_id for to b1db4088-6488-45ad-ab0e-26fe8ff53af4 2024-02-24T02:46:00.719778824Z [2024-02-24T02:46:00.719+0000] {scheduler_job.py:635} INFO - Setting external_id for to 548c9678-5445-4463-aa3c-e93f546014d2 2024-02-24T02:46:00.719943698Z [2024-02-24T02:46:00.719+0000] {scheduler_job.py:635} INFO - Setting external_id for to 505c3700-8497-4b17-a4bc-e4da23a35063 2024-02-24T02:46:02.050616010Z [2024-02-24T02:46:02.050+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:46:02.051868140Z [2024-02-24T02:46:02.051+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 02:44:00+00:00, run_id=scheduled__2024-02-24T02:44:00+00:00, run_start_date=2024-02-24 02:46:00.101196+00:00, run_end_date=2024-02-24 02:46:02.051275+00:00, run_duration=1.950079, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:44:00+00:00, data_interval_end=2024-02-24 02:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T02:46:02.067649892Z [2024-02-24T02:46:02.067+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T02:46:00+00:00, run_after=2024-02-24T02:48:00+00:00 2024-02-24T02:46:02.079502380Z [2024-02-24T02:46:02.079+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:46:02.079907683Z [2024-02-24T02:46:02.079+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:45:00+00:00, run_id=scheduled__2024-02-24T02:45:00+00:00, run_start_date=2024-02-24 02:46:00.103001+00:00, run_end_date=2024-02-24 02:46:02.079469+00:00, run_duration=1.976468, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:45:00+00:00, data_interval_end=2024-02-24 02:46:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:46:02.098065635Z [2024-02-24T02:46:02.097+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:46:00+00:00, run_after=2024-02-24T02:47:00+00:00 2024-02-24T02:46:02.185542934Z [2024-02-24T02:46:02.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:44:00+00:00 exited with status success for try_number 1 2024-02-24T02:46:02.188979608Z [2024-02-24T02:46:02.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:45:00+00:00 exited with status success for try_number 1 2024-02-24T02:46:02.200121090Z [2024-02-24T02:46:02.199+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T02:44:00+00:00, map_index=-1, run_start_date=2024-02-24 02:46:01.099511+00:00, run_end_date=2024-02-24 02:46:01.566535+00:00, run_duration=0.467024, state=success, executor_state=success, try_number=1, max_tries=1, job_id=865, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:46:00.195424+00:00, queued_by_job_id=2, pid=12634 2024-02-24T02:46:02.200584935Z [2024-02-24T02:46:02.200+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:45:00+00:00, map_index=-1, run_start_date=2024-02-24 02:46:01.065682+00:00, run_end_date=2024-02-24 02:46:01.490118+00:00, run_duration=0.424436, state=success, executor_state=success, try_number=1, max_tries=1, job_id=864, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:46:00.195424+00:00, queued_by_job_id=2, pid=12633 2024-02-24T02:46:04.059618061Z [2024-02-24T02:46:04.059+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:46:04.059903732Z [2024-02-24T02:46:04.059+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:45:00+00:00, run_id=scheduled__2024-02-24T02:45:00+00:00, run_start_date=2024-02-24 02:46:00.104593+00:00, run_end_date=2024-02-24 02:46:04.059598+00:00, run_duration=3.955005, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:45:00+00:00, data_interval_end=2024-02-24 02:46:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:46:04.070364008Z [2024-02-24T02:46:04.069+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:46:00+00:00, run_after=2024-02-24T02:47:00+00:00 2024-02-24T02:46:04.115317726Z [2024-02-24T02:46:04.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:45:00+00:00 exited with status success for try_number 1 2024-02-24T02:46:04.133603231Z [2024-02-24T02:46:04.133+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:45:00+00:00, map_index=-1, run_start_date=2024-02-24 02:46:02.407249+00:00, run_end_date=2024-02-24 02:46:03.800418+00:00, run_duration=1.393169, state=success, executor_state=success, try_number=1, max_tries=1, job_id=867, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:46:00.195424+00:00, queued_by_job_id=2, pid=12658 2024-02-24T02:46:05.202905161Z [2024-02-24T02:46:05.202+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:46:05.203258045Z [2024-02-24T02:46:05.202+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:45:00+00:00, run_id=scheduled__2024-02-24T02:45:00+00:00, run_start_date=2024-02-24 02:46:00.106384+00:00, run_end_date=2024-02-24 02:46:05.202747+00:00, run_duration=5.096363, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:45:00+00:00, data_interval_end=2024-02-24 02:46:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:46:05.216322109Z [2024-02-24T02:46:05.215+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:46:00+00:00, run_after=2024-02-24T02:47:00+00:00 2024-02-24T02:46:05.274358772Z [2024-02-24T02:46:05.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:45:00+00:00 exited with status success for try_number 1 2024-02-24T02:46:05.280825738Z [2024-02-24T02:46:05.279+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:45:00+00:00, map_index=-1, run_start_date=2024-02-24 02:46:02.257043+00:00, run_end_date=2024-02-24 02:46:04.157617+00:00, run_duration=1.900574, state=success, executor_state=success, try_number=1, max_tries=1, job_id=866, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:46:00.195424+00:00, queued_by_job_id=2, pid=12657 2024-02-24T02:47:00.957337456Z [2024-02-24T02:47:00.956+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:47:00+00:00, run_after=2024-02-24T02:48:00+00:00 2024-02-24T02:47:00.979778055Z [2024-02-24T02:47:00.979+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:47:00+00:00, run_after=2024-02-24T02:48:00+00:00 2024-02-24T02:47:00.993534379Z [2024-02-24T02:47:00.993+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:47:01.092681472Z [2024-02-24T02:47:01.092+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T02:47:01.092745978Z 2024-02-24T02:47:01.092752787Z 2024-02-24T02:47:01.092758254Z 2024-02-24T02:47:01.092772047Z [2024-02-24T02:47:01.092+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:47:01.092829662Z [2024-02-24T02:47:01.092+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:47:01.092900527Z [2024-02-24T02:47:01.092+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:47:01.093631413Z [2024-02-24T02:47:01.093+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:47:01.093645654Z 2024-02-24T02:47:01.093650909Z 2024-02-24T02:47:01.093655765Z 2024-02-24T02:47:01.098555320Z [2024-02-24T02:47:01.098+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:47:01.098613623Z [2024-02-24T02:47:01.098+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:47:01.098820084Z [2024-02-24T02:47:01.098+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:47:01.098886356Z [2024-02-24T02:47:01.098+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:47:01.099080399Z [2024-02-24T02:47:01.098+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:47:01.099144744Z [2024-02-24T02:47:01.099+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:47:01.461292103Z [2024-02-24T02:47:01.460+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:46:00+00:00 exited with status queued for try_number 1 2024-02-24T02:47:01.461608452Z [2024-02-24T02:47:01.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:46:00+00:00 exited with status queued for try_number 1 2024-02-24T02:47:01.461892920Z [2024-02-24T02:47:01.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:46:00+00:00 exited with status queued for try_number 1 2024-02-24T02:47:01.471596906Z [2024-02-24T02:47:01.471+0000] {scheduler_job.py:635} INFO - Setting external_id for to 78b7e690-4864-4245-baec-a9b79b6befbc 2024-02-24T02:47:01.472137556Z [2024-02-24T02:47:01.471+0000] {scheduler_job.py:635} INFO - Setting external_id for to cfc3ee17-17aa-4f9e-8e9e-ac5305dd2812 2024-02-24T02:47:01.472438592Z [2024-02-24T02:47:01.472+0000] {scheduler_job.py:635} INFO - Setting external_id for to de57139f-256f-4fb1-8256-78e614d3a26c 2024-02-24T02:47:04.015584834Z [2024-02-24T02:47:04.014+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:47:04.015702300Z [2024-02-24T02:47:04.015+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:46:00+00:00, run_id=scheduled__2024-02-24T02:46:00+00:00, run_start_date=2024-02-24 02:47:01.008462+00:00, run_end_date=2024-02-24 02:47:04.015374+00:00, run_duration=3.006912, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:46:00+00:00, data_interval_end=2024-02-24 02:47:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:47:04.042714864Z [2024-02-24T02:47:04.042+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:47:00+00:00, run_after=2024-02-24T02:48:00+00:00 2024-02-24T02:47:04.143015679Z [2024-02-24T02:47:04.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:46:00+00:00 exited with status success for try_number 1 2024-02-24T02:47:04.164320922Z [2024-02-24T02:47:04.163+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:46:00+00:00, map_index=-1, run_start_date=2024-02-24 02:47:02.256421+00:00, run_end_date=2024-02-24 02:47:03.059463+00:00, run_duration=0.803042, state=success, executor_state=success, try_number=1, max_tries=1, job_id=868, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:47:01.094572+00:00, queued_by_job_id=2, pid=12690 2024-02-24T02:47:04.707732832Z [2024-02-24T02:47:04.707+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T02:47:07.310099018Z [2024-02-24T02:47:07.309+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:47:07.310247003Z [2024-02-24T02:47:07.310+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:46:00+00:00, run_id=scheduled__2024-02-24T02:46:00+00:00, run_start_date=2024-02-24 02:47:01.010301+00:00, run_end_date=2024-02-24 02:47:07.310007+00:00, run_duration=6.299706, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:46:00+00:00, data_interval_end=2024-02-24 02:47:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:47:07.320623203Z [2024-02-24T02:47:07.319+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:47:00+00:00, run_after=2024-02-24T02:48:00+00:00 2024-02-24T02:47:07.338990414Z [2024-02-24T02:47:07.337+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:47:07.339432259Z [2024-02-24T02:47:07.339+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:46:00+00:00, run_id=scheduled__2024-02-24T02:46:00+00:00, run_start_date=2024-02-24 02:47:01.011778+00:00, run_end_date=2024-02-24 02:47:07.339105+00:00, run_duration=6.327327, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:46:00+00:00, data_interval_end=2024-02-24 02:47:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:47:07.356525596Z [2024-02-24T02:47:07.356+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:47:00+00:00, run_after=2024-02-24T02:48:00+00:00 2024-02-24T02:47:07.401211851Z [2024-02-24T02:47:07.400+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:46:00+00:00 exited with status success for try_number 1 2024-02-24T02:47:07.401338689Z [2024-02-24T02:47:07.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:46:00+00:00 exited with status success for try_number 1 2024-02-24T02:47:07.407581143Z [2024-02-24T02:47:07.407+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:46:00+00:00, map_index=-1, run_start_date=2024-02-24 02:47:04.323960+00:00, run_end_date=2024-02-24 02:47:06.329184+00:00, run_duration=2.005224, state=success, executor_state=success, try_number=1, max_tries=1, job_id=869, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:47:01.094572+00:00, queued_by_job_id=2, pid=12703 2024-02-24T02:47:07.407968392Z [2024-02-24T02:47:07.407+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:46:00+00:00, map_index=-1, run_start_date=2024-02-24 02:47:04.878526+00:00, run_end_date=2024-02-24 02:47:07.071010+00:00, run_duration=2.192484, state=success, executor_state=success, try_number=1, max_tries=1, job_id=870, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:47:01.094572+00:00, queued_by_job_id=2, pid=12714 2024-02-24T02:48:00.826262755Z [2024-02-24T02:48:00.825+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:48:00.841878217Z [2024-02-24T02:48:00.841+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:48:00.858481702Z [2024-02-24T02:48:00.858+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:48:00+00:00, run_after=2024-02-24T02:49:00+00:00 2024-02-24T02:48:00.871132945Z [2024-02-24T02:48:00.870+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:48:00+00:00, run_after=2024-02-24T02:49:00+00:00 2024-02-24T02:48:00.957882161Z [2024-02-24T02:48:00.957+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T02:48:00.957915031Z 2024-02-24T02:48:00.957922261Z 2024-02-24T02:48:00.957927531Z 2024-02-24T02:48:00.957932883Z 2024-02-24T02:48:00.957988133Z [2024-02-24T02:48:00.957+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T02:48:00.958316018Z [2024-02-24T02:48:00.958+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:48:00.958588598Z [2024-02-24T02:48:00.958+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:48:00.958943477Z [2024-02-24T02:48:00.958+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:48:00.959672812Z [2024-02-24T02:48:00.959+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:48:00.959681037Z 2024-02-24T02:48:00.959685982Z 2024-02-24T02:48:00.959690466Z 2024-02-24T02:48:00.959711062Z 2024-02-24T02:48:00.965004562Z [2024-02-24T02:48:00.964+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:48:00.965247208Z [2024-02-24T02:48:00.964+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T02:48:00.965573264Z [2024-02-24T02:48:00.965+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:48:00.965732848Z [2024-02-24T02:48:00.965+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:48:00.966258647Z [2024-02-24T02:48:00.966+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:48:00.966471284Z [2024-02-24T02:48:00.966+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:48:00.966887897Z [2024-02-24T02:48:00.966+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:48:00.967349872Z [2024-02-24T02:48:00.966+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:48:01.468803379Z [2024-02-24T02:48:01.466+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:46:00+00:00 exited with status queued for try_number 1 2024-02-24T02:48:01.469859813Z [2024-02-24T02:48:01.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:47:00+00:00 exited with status queued for try_number 1 2024-02-24T02:48:01.470102436Z [2024-02-24T02:48:01.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:47:00+00:00 exited with status queued for try_number 1 2024-02-24T02:48:01.470276436Z [2024-02-24T02:48:01.470+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:47:00+00:00 exited with status queued for try_number 1 2024-02-24T02:48:01.488454983Z [2024-02-24T02:48:01.488+0000] {scheduler_job.py:635} INFO - Setting external_id for to 155eb3b0-4f08-4f7c-80d5-7a002067785c 2024-02-24T02:48:01.489098229Z [2024-02-24T02:48:01.488+0000] {scheduler_job.py:635} INFO - Setting external_id for to e55b1d72-d7f0-4249-9002-14f27d225d02 2024-02-24T02:48:01.489343648Z [2024-02-24T02:48:01.489+0000] {scheduler_job.py:635} INFO - Setting external_id for to 891330b0-869d-4c9b-8386-62049d6cedae 2024-02-24T02:48:01.489818093Z [2024-02-24T02:48:01.489+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6717785-cda9-4a1a-8c1b-b20fcec144c5 2024-02-24T02:48:02.788386878Z [2024-02-24T02:48:02.787+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:48:02.789854452Z [2024-02-24T02:48:02.789+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 02:46:00+00:00, run_id=scheduled__2024-02-24T02:46:00+00:00, run_start_date=2024-02-24 02:48:00.882424+00:00, run_end_date=2024-02-24 02:48:02.788302+00:00, run_duration=1.905878, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:46:00+00:00, data_interval_end=2024-02-24 02:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T02:48:02.800295996Z [2024-02-24T02:48:02.799+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T02:48:00+00:00, run_after=2024-02-24T02:50:00+00:00 2024-02-24T02:48:02.814703821Z [2024-02-24T02:48:02.813+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:48:02.815361278Z [2024-02-24T02:48:02.815+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:47:00+00:00, run_id=scheduled__2024-02-24T02:47:00+00:00, run_start_date=2024-02-24 02:48:00.883695+00:00, run_end_date=2024-02-24 02:48:02.814800+00:00, run_duration=1.931105, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:47:00+00:00, data_interval_end=2024-02-24 02:48:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:48:02.829799438Z [2024-02-24T02:48:02.829+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:48:00+00:00, run_after=2024-02-24T02:49:00+00:00 2024-02-24T02:48:02.918050347Z [2024-02-24T02:48:02.917+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:46:00+00:00 exited with status success for try_number 1 2024-02-24T02:48:02.930463796Z [2024-02-24T02:48:02.930+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T02:46:00+00:00, map_index=-1, run_start_date=2024-02-24 02:48:01.789956+00:00, run_end_date=2024-02-24 02:48:02.196319+00:00, run_duration=0.406363, state=success, executor_state=success, try_number=1, max_tries=1, job_id=871, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:48:00.960941+00:00, queued_by_job_id=2, pid=12737 2024-02-24T02:48:04.059630613Z [2024-02-24T02:48:04.059+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:47:00+00:00 exited with status success for try_number 1 2024-02-24T02:48:04.067868044Z [2024-02-24T02:48:04.067+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:47:00+00:00, map_index=-1, run_start_date=2024-02-24 02:48:02.292777+00:00, run_end_date=2024-02-24 02:48:02.732910+00:00, run_duration=0.440133, state=success, executor_state=success, try_number=1, max_tries=1, job_id=872, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:48:00.960941+00:00, queued_by_job_id=2, pid=12750 2024-02-24T02:48:05.636751265Z [2024-02-24T02:48:05.636+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:48:05.637428353Z [2024-02-24T02:48:05.636+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:47:00+00:00, run_id=scheduled__2024-02-24T02:47:00+00:00, run_start_date=2024-02-24 02:48:00.884782+00:00, run_end_date=2024-02-24 02:48:05.636803+00:00, run_duration=4.752021, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:47:00+00:00, data_interval_end=2024-02-24 02:48:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:48:05.663444748Z [2024-02-24T02:48:05.663+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:48:00+00:00, run_after=2024-02-24T02:49:00+00:00 2024-02-24T02:48:05.672098059Z [2024-02-24T02:48:05.671+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:48:05.672349486Z [2024-02-24T02:48:05.672+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:47:00+00:00, run_id=scheduled__2024-02-24T02:47:00+00:00, run_start_date=2024-02-24 02:48:00.885853+00:00, run_end_date=2024-02-24 02:48:05.672054+00:00, run_duration=4.786201, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:47:00+00:00, data_interval_end=2024-02-24 02:48:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:48:05.683536224Z [2024-02-24T02:48:05.683+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:48:00+00:00, run_after=2024-02-24T02:49:00+00:00 2024-02-24T02:48:05.725281120Z [2024-02-24T02:48:05.724+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:47:00+00:00 exited with status success for try_number 1 2024-02-24T02:48:05.725564511Z [2024-02-24T02:48:05.725+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:47:00+00:00 exited with status success for try_number 1 2024-02-24T02:48:05.734487627Z [2024-02-24T02:48:05.734+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:47:00+00:00, map_index=-1, run_start_date=2024-02-24 02:48:03.213258+00:00, run_end_date=2024-02-24 02:48:05.023140+00:00, run_duration=1.809882, state=success, executor_state=success, try_number=1, max_tries=1, job_id=874, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:48:00.960941+00:00, queued_by_job_id=2, pid=12767 2024-02-24T02:48:05.734897436Z [2024-02-24T02:48:05.734+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:47:00+00:00, map_index=-1, run_start_date=2024-02-24 02:48:03.004816+00:00, run_end_date=2024-02-24 02:48:05.163519+00:00, run_duration=2.158703, state=success, executor_state=success, try_number=1, max_tries=1, job_id=873, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:48:00.960941+00:00, queued_by_job_id=2, pid=12766 2024-02-24T02:49:00.039320357Z [2024-02-24T02:49:00.038+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:49:00+00:00, run_after=2024-02-24T02:50:00+00:00 2024-02-24T02:49:00.050908043Z [2024-02-24T02:49:00.050+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:49:00+00:00, run_after=2024-02-24T02:50:00+00:00 2024-02-24T02:49:00.058256762Z [2024-02-24T02:49:00.057+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:49:00.144874164Z [2024-02-24T02:49:00.144+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T02:49:00.144907161Z 2024-02-24T02:49:00.144915671Z 2024-02-24T02:49:00.144923566Z 2024-02-24T02:49:00.145055375Z [2024-02-24T02:49:00.144+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:49:00.145083847Z [2024-02-24T02:49:00.144+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:49:00.145272955Z [2024-02-24T02:49:00.145+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:49:00.146759022Z [2024-02-24T02:49:00.146+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:49:00.146781617Z 2024-02-24T02:49:00.146789700Z 2024-02-24T02:49:00.146835169Z 2024-02-24T02:49:00.152852599Z [2024-02-24T02:49:00.152+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:49:00.153075500Z [2024-02-24T02:49:00.152+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:49:00.153573487Z [2024-02-24T02:49:00.153+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:49:00.153991406Z [2024-02-24T02:49:00.153+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:49:00.154474902Z [2024-02-24T02:49:00.154+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:49:00.154502639Z [2024-02-24T02:49:00.154+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:49:00.457585239Z [2024-02-24T02:49:00.456+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:48:00+00:00 exited with status queued for try_number 1 2024-02-24T02:49:00.457696700Z [2024-02-24T02:49:00.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:48:00+00:00 exited with status queued for try_number 1 2024-02-24T02:49:00.457812164Z [2024-02-24T02:49:00.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:48:00+00:00 exited with status queued for try_number 1 2024-02-24T02:49:00.470255217Z [2024-02-24T02:49:00.469+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5b5fe74-9530-4eae-aedb-c45cc0c8a889 2024-02-24T02:49:00.470284929Z [2024-02-24T02:49:00.470+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1622ffec-eaed-432b-910e-26e857e118f9 2024-02-24T02:49:00.470337780Z [2024-02-24T02:49:00.470+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62283e4e-ad20-481a-ba76-45afac346c72 2024-02-24T02:49:01.610844076Z [2024-02-24T02:49:01.610+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:49:01.611233370Z [2024-02-24T02:49:01.610+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:48:00+00:00, run_id=scheduled__2024-02-24T02:48:00+00:00, run_start_date=2024-02-24 02:49:00.066547+00:00, run_end_date=2024-02-24 02:49:01.610720+00:00, run_duration=1.544173, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:48:00+00:00, data_interval_end=2024-02-24 02:49:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:49:01.620995055Z [2024-02-24T02:49:01.620+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:49:00+00:00, run_after=2024-02-24T02:50:00+00:00 2024-02-24T02:49:01.690004167Z [2024-02-24T02:49:01.686+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:48:00+00:00 exited with status success for try_number 1 2024-02-24T02:49:01.698854460Z [2024-02-24T02:49:01.698+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:48:00+00:00, map_index=-1, run_start_date=2024-02-24 02:49:00.947323+00:00, run_end_date=2024-02-24 02:49:01.363508+00:00, run_duration=0.416185, state=success, executor_state=success, try_number=1, max_tries=1, job_id=875, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:49:00.148225+00:00, queued_by_job_id=2, pid=12800 2024-02-24T02:49:03.553160572Z [2024-02-24T02:49:03.552+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:49:03.553540761Z [2024-02-24T02:49:03.553+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:48:00+00:00, run_id=scheduled__2024-02-24T02:48:00+00:00, run_start_date=2024-02-24 02:49:00.067662+00:00, run_end_date=2024-02-24 02:49:03.553186+00:00, run_duration=3.485524, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:48:00+00:00, data_interval_end=2024-02-24 02:49:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:49:03.562293891Z [2024-02-24T02:49:03.561+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:49:00+00:00, run_after=2024-02-24T02:50:00+00:00 2024-02-24T02:49:03.609890181Z [2024-02-24T02:49:03.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:48:00+00:00 exited with status success for try_number 1 2024-02-24T02:49:03.616172976Z [2024-02-24T02:49:03.615+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:48:00+00:00, map_index=-1, run_start_date=2024-02-24 02:49:01.972432+00:00, run_end_date=2024-02-24 02:49:03.362101+00:00, run_duration=1.389669, state=success, executor_state=success, try_number=1, max_tries=1, job_id=876, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:49:00.148225+00:00, queued_by_job_id=2, pid=12818 2024-02-24T02:49:04.672434849Z [2024-02-24T02:49:04.671+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:49:04.672851739Z [2024-02-24T02:49:04.672+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:48:00+00:00, run_id=scheduled__2024-02-24T02:48:00+00:00, run_start_date=2024-02-24 02:49:00.068591+00:00, run_end_date=2024-02-24 02:49:04.672351+00:00, run_duration=4.60376, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:48:00+00:00, data_interval_end=2024-02-24 02:49:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:49:04.684347892Z [2024-02-24T02:49:04.683+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:49:00+00:00, run_after=2024-02-24T02:50:00+00:00 2024-02-24T02:49:04.722599099Z [2024-02-24T02:49:04.722+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:48:00+00:00 exited with status success for try_number 1 2024-02-24T02:49:04.732182419Z [2024-02-24T02:49:04.731+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:48:00+00:00, map_index=-1, run_start_date=2024-02-24 02:49:02.111585+00:00, run_end_date=2024-02-24 02:49:04.032983+00:00, run_duration=1.921398, state=success, executor_state=success, try_number=1, max_tries=1, job_id=877, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:49:00.148225+00:00, queued_by_job_id=2, pid=12819 2024-02-24T02:50:00.289826745Z [2024-02-24T02:50:00.289+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:50:00.307512403Z [2024-02-24T02:50:00.307+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:50:00+00:00, run_after=2024-02-24T02:51:00+00:00 2024-02-24T02:50:00.321812006Z [2024-02-24T02:50:00.321+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:50:00+00:00, run_after=2024-02-24T02:51:00+00:00 2024-02-24T02:50:00.336149702Z [2024-02-24T02:50:00.335+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:50:00+00:00, run_after=2024-02-24T02:55:00+00:00 2024-02-24T02:50:00.344113485Z [2024-02-24T02:50:00.343+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:50:00.479443929Z [2024-02-24T02:50:00.478+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-02-24T02:50:00.479480020Z 2024-02-24T02:50:00.479485958Z 2024-02-24T02:50:00.479493023Z 2024-02-24T02:50:00.479498355Z 2024-02-24T02:50:00.479503257Z 2024-02-24T02:50:00.479797729Z [2024-02-24T02:50:00.479+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:50:00.480055242Z [2024-02-24T02:50:00.479+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T02:50:00.480294431Z [2024-02-24T02:50:00.480+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:50:00.480566477Z [2024-02-24T02:50:00.480+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:50:00.480797852Z [2024-02-24T02:50:00.480+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:50:00.481701972Z [2024-02-24T02:50:00.481+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:50:00.481718584Z 2024-02-24T02:50:00.481724407Z 2024-02-24T02:50:00.481729542Z 2024-02-24T02:50:00.481734269Z 2024-02-24T02:50:00.481738965Z 2024-02-24T02:50:00.488098402Z [2024-02-24T02:50:00.487+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T02:50:00.488432849Z [2024-02-24T02:50:00.487+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:50:00.488782481Z [2024-02-24T02:50:00.488+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:50:00.488994309Z [2024-02-24T02:50:00.488+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T02:50:00.489380649Z [2024-02-24T02:50:00.489+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:50:00.489636958Z [2024-02-24T02:50:00.489+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:50:00.490040394Z [2024-02-24T02:50:00.489+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:50:00.490273860Z [2024-02-24T02:50:00.489+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:50:00.490628508Z [2024-02-24T02:50:00.490+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:50:00.490852236Z [2024-02-24T02:50:00.490+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:50:01.063062772Z [2024-02-24T02:50:01.062+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T02:45:00+00:00 exited with status queued for try_number 1 2024-02-24T02:50:01.063310237Z [2024-02-24T02:50:01.063+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:48:00+00:00 exited with status queued for try_number 1 2024-02-24T02:50:01.063532738Z [2024-02-24T02:50:01.063+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:49:00+00:00 exited with status queued for try_number 1 2024-02-24T02:50:01.063745987Z [2024-02-24T02:50:01.063+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:49:00+00:00 exited with status queued for try_number 1 2024-02-24T02:50:01.063930685Z [2024-02-24T02:50:01.063+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:49:00+00:00 exited with status queued for try_number 1 2024-02-24T02:50:01.084702981Z [2024-02-24T02:50:01.084+0000] {scheduler_job.py:635} INFO - Setting external_id for to f29cb0f0-fd9c-4576-9d2b-5e3e4c6b91d4 2024-02-24T02:50:01.084896711Z [2024-02-24T02:50:01.084+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f8bae02-c715-4726-82a2-7e54636d6294 2024-02-24T02:50:01.085078957Z [2024-02-24T02:50:01.084+0000] {scheduler_job.py:635} INFO - Setting external_id for to 26789072-963b-464d-be1a-983489e10671 2024-02-24T02:50:01.086575984Z [2024-02-24T02:50:01.086+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb48ffd5-6daa-48ac-b272-f35adc6a82f9 2024-02-24T02:50:01.086798882Z [2024-02-24T02:50:01.086+0000] {scheduler_job.py:635} INFO - Setting external_id for to c78da6d6-bfcb-4032-b758-dac90ec393b4 2024-02-24T02:50:02.483069632Z [2024-02-24T02:50:02.482+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:50:02.484011013Z [2024-02-24T02:50:02.483+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 02:48:00+00:00, run_id=scheduled__2024-02-24T02:48:00+00:00, run_start_date=2024-02-24 02:50:00.361032+00:00, run_end_date=2024-02-24 02:50:02.483251+00:00, run_duration=2.122219, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:48:00+00:00, data_interval_end=2024-02-24 02:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T02:50:02.499061378Z [2024-02-24T02:50:02.498+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T02:50:00+00:00, run_after=2024-02-24T02:52:00+00:00 2024-02-24T02:50:02.507180124Z [2024-02-24T02:50:02.506+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:50:02.507630445Z [2024-02-24T02:50:02.507+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:49:00+00:00, run_id=scheduled__2024-02-24T02:49:00+00:00, run_start_date=2024-02-24 02:50:00.363476+00:00, run_end_date=2024-02-24 02:50:02.507328+00:00, run_duration=2.143852, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:49:00+00:00, data_interval_end=2024-02-24 02:50:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:50:02.518758691Z [2024-02-24T02:50:02.518+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:50:00+00:00, run_after=2024-02-24T02:51:00+00:00 2024-02-24T02:50:02.583825945Z [2024-02-24T02:50:02.583+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:48:00+00:00 exited with status success for try_number 1 2024-02-24T02:50:02.585664938Z [2024-02-24T02:50:02.583+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:49:00+00:00 exited with status success for try_number 1 2024-02-24T02:50:02.595053412Z [2024-02-24T02:50:02.594+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T02:48:00+00:00, map_index=-1, run_start_date=2024-02-24 02:50:01.695737+00:00, run_end_date=2024-02-24 02:50:02.132301+00:00, run_duration=0.436564, state=success, executor_state=success, try_number=1, max_tries=1, job_id=879, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:50:00.483246+00:00, queued_by_job_id=2, pid=12854 2024-02-24T02:50:02.595430195Z [2024-02-24T02:50:02.595+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:49:00+00:00, map_index=-1, run_start_date=2024-02-24 02:50:01.476716+00:00, run_end_date=2024-02-24 02:50:01.981218+00:00, run_duration=0.504502, state=success, executor_state=success, try_number=1, max_tries=1, job_id=878, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:50:00.483246+00:00, queued_by_job_id=2, pid=12853 2024-02-24T02:50:04.603330957Z [2024-02-24T02:50:04.602+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:50:04.603371306Z 2024-02-24T02:50:04.603454013Z [2024-02-24T02:50:04.603+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:50:04.604372112Z [2024-02-24T02:50:04.604+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:50:04.604388244Z 2024-02-24T02:50:04.608245544Z [2024-02-24T02:50:04.607+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T02:50:04.608500835Z [2024-02-24T02:50:04.608+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:50:04.672162410Z [2024-02-24T02:50:04.671+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T02:45:00+00:00 exited with status queued for try_number 1 2024-02-24T02:50:04.672472668Z [2024-02-24T02:50:04.672+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T02:45:00+00:00 exited with status success for try_number 1 2024-02-24T02:50:04.678691020Z [2024-02-24T02:50:04.678+0000] {scheduler_job.py:635} INFO - Setting external_id for to 591e559b-f8cd-4272-843f-42452976475c 2024-02-24T02:50:04.679008327Z [2024-02-24T02:50:04.678+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T02:45:00+00:00, map_index=-1, run_start_date=2024-02-24 02:50:02.872409+00:00, run_end_date=2024-02-24 02:50:03.330030+00:00, run_duration=0.457621, state=success, executor_state=success, try_number=1, max_tries=1, job_id=880, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:50:00.483246+00:00, queued_by_job_id=2, pid=12878 2024-02-24T02:50:05.375490353Z [2024-02-24T02:50:05.374+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:50:05.375636588Z [2024-02-24T02:50:05.375+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:49:00+00:00, run_id=scheduled__2024-02-24T02:49:00+00:00, run_start_date=2024-02-24 02:50:00.365880+00:00, run_end_date=2024-02-24 02:50:05.375074+00:00, run_duration=5.009194, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:49:00+00:00, data_interval_end=2024-02-24 02:50:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:50:05.386461539Z [2024-02-24T02:50:05.386+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:50:00+00:00, run_after=2024-02-24T02:51:00+00:00 2024-02-24T02:50:05.455223416Z [2024-02-24T02:50:05.454+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:49:00+00:00 exited with status success for try_number 1 2024-02-24T02:50:05.462585154Z [2024-02-24T02:50:05.462+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:49:00+00:00, map_index=-1, run_start_date=2024-02-24 02:50:03.167815+00:00, run_end_date=2024-02-24 02:50:04.856433+00:00, run_duration=1.688618, state=success, executor_state=success, try_number=1, max_tries=1, job_id=882, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:50:00.483246+00:00, queued_by_job_id=2, pid=12885 2024-02-24T02:50:06.525335838Z [2024-02-24T02:50:06.524+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:50:06.525858873Z [2024-02-24T02:50:06.525+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:49:00+00:00, run_id=scheduled__2024-02-24T02:49:00+00:00, run_start_date=2024-02-24 02:50:00.368320+00:00, run_end_date=2024-02-24 02:50:06.525227+00:00, run_duration=6.156907, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:49:00+00:00, data_interval_end=2024-02-24 02:50:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:50:06.536180010Z [2024-02-24T02:50:06.535+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:50:00+00:00, run_after=2024-02-24T02:51:00+00:00 2024-02-24T02:50:06.580517833Z [2024-02-24T02:50:06.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:49:00+00:00 exited with status success for try_number 1 2024-02-24T02:50:06.587059223Z [2024-02-24T02:50:06.586+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:49:00+00:00, map_index=-1, run_start_date=2024-02-24 02:50:02.997322+00:00, run_end_date=2024-02-24 02:50:05.476017+00:00, run_duration=2.478695, state=success, executor_state=success, try_number=1, max_tries=1, job_id=881, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:50:00.483246+00:00, queued_by_job_id=2, pid=12884 2024-02-24T02:50:07.669729668Z [2024-02-24T02:50:07.669+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:50:07.669837918Z 2024-02-24T02:50:07.669879943Z [2024-02-24T02:50:07.669+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:50:07.670651622Z [2024-02-24T02:50:07.670+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:50:07.670692533Z 2024-02-24T02:50:07.673940157Z [2024-02-24T02:50:07.673+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T02:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T02:50:07.674044130Z [2024-02-24T02:50:07.673+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T02:50:07.749499290Z [2024-02-24T02:50:07.743+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T02:45:00+00:00 exited with status queued for try_number 1 2024-02-24T02:50:07.749693606Z [2024-02-24T02:50:07.749+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T02:45:00+00:00 exited with status success for try_number 1 2024-02-24T02:50:07.762968710Z [2024-02-24T02:50:07.762+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b100d74-9882-4655-9df0-d5ce3c9c7e20 2024-02-24T02:50:07.763354549Z [2024-02-24T02:50:07.763+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T02:45:00+00:00, map_index=-1, run_start_date=2024-02-24 02:50:06.279596+00:00, run_end_date=2024-02-24 02:50:06.693107+00:00, run_duration=0.413511, state=success, executor_state=success, try_number=1, max_tries=1, job_id=883, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:50:04.605138+00:00, queued_by_job_id=2, pid=12908 2024-02-24T02:50:09.715175006Z [2024-02-24T02:50:09.714+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:50:09.715206322Z 2024-02-24T02:50:09.715896295Z [2024-02-24T02:50:09.715+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:50:09.718213001Z [2024-02-24T02:50:09.717+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:50:09.718225539Z 2024-02-24T02:50:09.722854146Z [2024-02-24T02:50:09.722+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:50:09.723131042Z [2024-02-24T02:50:09.722+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:50:09.786379965Z [2024-02-24T02:50:09.785+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T02:45:00+00:00 exited with status queued for try_number 1 2024-02-24T02:50:09.800865732Z [2024-02-24T02:50:09.800+0000] {scheduler_job.py:635} INFO - Setting external_id for to 73a19be6-430f-47b9-8bfe-da9ecc404a80 2024-02-24T02:50:09.911293263Z [2024-02-24T02:50:09.910+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T02:45:00+00:00 exited with status success for try_number 1 2024-02-24T02:50:09.919394546Z [2024-02-24T02:50:09.918+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T02:45:00+00:00, map_index=0, run_start_date=2024-02-24 02:50:09.260876+00:00, run_end_date=2024-02-24 02:50:09.643719+00:00, run_duration=0.382843, state=success, executor_state=success, try_number=1, max_tries=1, job_id=884, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:50:07.671091+00:00, queued_by_job_id=2, pid=12916 2024-02-24T02:50:12.077041541Z [2024-02-24T02:50:12.076+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:50:12.077334045Z [2024-02-24T02:50:12.076+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:45:00+00:00, run_id=scheduled__2024-02-24T02:45:00+00:00, run_start_date=2024-02-24 02:50:00.358152+00:00, run_end_date=2024-02-24 02:50:12.076876+00:00, run_duration=11.718724, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:45:00+00:00, data_interval_end=2024-02-24 02:50:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T02:50:12.083634843Z [2024-02-24T02:50:12.083+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:50:00+00:00, run_after=2024-02-24T02:55:00+00:00 2024-02-24T02:50:12.129437856Z [2024-02-24T02:50:12.128+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T02:45:00+00:00 exited with status success for try_number 1 2024-02-24T02:50:12.139786399Z [2024-02-24T02:50:12.139+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T02:45:00+00:00, map_index=-1, run_start_date=2024-02-24 02:50:11.407432+00:00, run_end_date=2024-02-24 02:50:11.808348+00:00, run_duration=0.400916, state=success, executor_state=success, try_number=1, max_tries=1, job_id=885, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:50:09.719313+00:00, queued_by_job_id=2, pid=12924 2024-02-24T02:51:00.562582415Z [2024-02-24T02:51:00.562+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:51:00+00:00, run_after=2024-02-24T02:52:00+00:00 2024-02-24T02:51:00.583157997Z [2024-02-24T02:51:00.582+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:51:00+00:00, run_after=2024-02-24T02:52:00+00:00 2024-02-24T02:51:00.595588861Z [2024-02-24T02:51:00.595+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:51:00.660841710Z [2024-02-24T02:51:00.660+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T02:51:00.660888237Z 2024-02-24T02:51:00.660914152Z 2024-02-24T02:51:00.660923313Z 2024-02-24T02:51:00.660932603Z [2024-02-24T02:51:00.660+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:51:00.660988193Z [2024-02-24T02:51:00.660+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:51:00.660997579Z [2024-02-24T02:51:00.660+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:51:00.661236849Z [2024-02-24T02:51:00.660+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:51:00.661302621Z 2024-02-24T02:51:00.661313347Z 2024-02-24T02:51:00.661322057Z 2024-02-24T02:51:00.664182545Z [2024-02-24T02:51:00.663+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:51:00.664273466Z [2024-02-24T02:51:00.663+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:51:00.664477550Z [2024-02-24T02:51:00.664+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:51:00.664499673Z [2024-02-24T02:51:00.664+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:51:00.664800341Z [2024-02-24T02:51:00.664+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:51:00.664823277Z [2024-02-24T02:51:00.664+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:51:00.975469643Z [2024-02-24T02:51:00.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:50:00+00:00 exited with status queued for try_number 1 2024-02-24T02:51:00.975549469Z [2024-02-24T02:51:00.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:50:00+00:00 exited with status queued for try_number 1 2024-02-24T02:51:00.975662223Z [2024-02-24T02:51:00.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:50:00+00:00 exited with status queued for try_number 1 2024-02-24T02:51:00.991997680Z [2024-02-24T02:51:00.991+0000] {scheduler_job.py:635} INFO - Setting external_id for to f4bb6944-b0d0-4701-b24f-ff8ac4db50f5 2024-02-24T02:51:00.992147125Z [2024-02-24T02:51:00.991+0000] {scheduler_job.py:635} INFO - Setting external_id for to f24bd0f2-496d-4a87-8bc4-b7af23ba4123 2024-02-24T02:51:00.992298558Z [2024-02-24T02:51:00.992+0000] {scheduler_job.py:635} INFO - Setting external_id for to b1f5f0d9-bc9a-47fc-9665-d45bdd4a70c4 2024-02-24T02:51:02.204417500Z [2024-02-24T02:51:02.203+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:51:02.205079919Z [2024-02-24T02:51:02.204+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:50:00+00:00, run_id=scheduled__2024-02-24T02:50:00+00:00, run_start_date=2024-02-24 02:51:00.609605+00:00, run_end_date=2024-02-24 02:51:02.204306+00:00, run_duration=1.594701, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:50:00+00:00, data_interval_end=2024-02-24 02:51:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:51:02.220836170Z [2024-02-24T02:51:02.220+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:51:00+00:00, run_after=2024-02-24T02:52:00+00:00 2024-02-24T02:51:02.283862283Z [2024-02-24T02:51:02.283+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:50:00+00:00 exited with status success for try_number 1 2024-02-24T02:51:02.295524590Z [2024-02-24T02:51:02.295+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:50:00+00:00, map_index=-1, run_start_date=2024-02-24 02:51:01.571540+00:00, run_end_date=2024-02-24 02:51:02.039385+00:00, run_duration=0.467845, state=success, executor_state=success, try_number=1, max_tries=1, job_id=886, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:51:00.661730+00:00, queued_by_job_id=2, pid=12947 2024-02-24T02:51:04.447075507Z [2024-02-24T02:51:04.445+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:51:04.448102924Z [2024-02-24T02:51:04.447+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:50:00+00:00, run_id=scheduled__2024-02-24T02:50:00+00:00, run_start_date=2024-02-24 02:51:00.611700+00:00, run_end_date=2024-02-24 02:51:04.446971+00:00, run_duration=3.835271, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:50:00+00:00, data_interval_end=2024-02-24 02:51:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:51:04.457751383Z [2024-02-24T02:51:04.457+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:51:00+00:00, run_after=2024-02-24T02:52:00+00:00 2024-02-24T02:51:04.523606073Z [2024-02-24T02:51:04.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:50:00+00:00 exited with status success for try_number 1 2024-02-24T02:51:04.529937004Z [2024-02-24T02:51:04.529+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:50:00+00:00, map_index=-1, run_start_date=2024-02-24 02:51:02.449544+00:00, run_end_date=2024-02-24 02:51:03.944203+00:00, run_duration=1.494659, state=success, executor_state=success, try_number=1, max_tries=1, job_id=887, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:51:00.661730+00:00, queued_by_job_id=2, pid=12965 2024-02-24T02:51:05.599691173Z [2024-02-24T02:51:05.598+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:51:05.600617448Z [2024-02-24T02:51:05.599+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:50:00+00:00, run_id=scheduled__2024-02-24T02:50:00+00:00, run_start_date=2024-02-24 02:51:00.612775+00:00, run_end_date=2024-02-24 02:51:05.599559+00:00, run_duration=4.986784, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:50:00+00:00, data_interval_end=2024-02-24 02:51:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:51:05.618774591Z [2024-02-24T02:51:05.618+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:51:00+00:00, run_after=2024-02-24T02:52:00+00:00 2024-02-24T02:51:05.665209221Z [2024-02-24T02:51:05.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:50:00+00:00 exited with status success for try_number 1 2024-02-24T02:51:05.672250613Z [2024-02-24T02:51:05.671+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:50:00+00:00, map_index=-1, run_start_date=2024-02-24 02:51:02.480541+00:00, run_end_date=2024-02-24 02:51:04.815055+00:00, run_duration=2.334514, state=success, executor_state=success, try_number=1, max_tries=1, job_id=888, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:51:00.661730+00:00, queued_by_job_id=2, pid=12966 2024-02-24T02:52:00.379636333Z [2024-02-24T02:52:00.379+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:52:00+00:00, run_after=2024-02-24T02:53:00+00:00 2024-02-24T02:52:00.389203651Z [2024-02-24T02:52:00.388+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:52:00.402608147Z [2024-02-24T02:52:00.402+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:52:00+00:00, run_after=2024-02-24T02:53:00+00:00 2024-02-24T02:52:00.410101248Z [2024-02-24T02:52:00.409+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:52:00.531215389Z [2024-02-24T02:52:00.530+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T02:52:00.531250402Z 2024-02-24T02:52:00.531254502Z 2024-02-24T02:52:00.531257473Z 2024-02-24T02:52:00.531260476Z 2024-02-24T02:52:00.531634584Z [2024-02-24T02:52:00.531+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T02:52:00.532082228Z [2024-02-24T02:52:00.531+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:52:00.532451827Z [2024-02-24T02:52:00.532+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:52:00.532955507Z [2024-02-24T02:52:00.532+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:52:00.533958816Z [2024-02-24T02:52:00.533+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:52:00.533966940Z 2024-02-24T02:52:00.533970552Z 2024-02-24T02:52:00.533973710Z 2024-02-24T02:52:00.533976723Z 2024-02-24T02:52:00.540709134Z [2024-02-24T02:52:00.540+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:52:00.540907641Z [2024-02-24T02:52:00.540+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T02:52:00.541206639Z [2024-02-24T02:52:00.541+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:52:00.541471534Z [2024-02-24T02:52:00.541+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:52:00.541731124Z [2024-02-24T02:52:00.541+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:52:00.541974949Z [2024-02-24T02:52:00.541+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:52:00.542315006Z [2024-02-24T02:52:00.542+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:52:00.542565763Z [2024-02-24T02:52:00.542+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:52:01.018926588Z [2024-02-24T02:52:01.018+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:50:00+00:00 exited with status queued for try_number 1 2024-02-24T02:52:01.018985423Z [2024-02-24T02:52:01.018+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:51:00+00:00 exited with status queued for try_number 1 2024-02-24T02:52:01.019111987Z [2024-02-24T02:52:01.018+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:51:00+00:00 exited with status queued for try_number 1 2024-02-24T02:52:01.019260143Z [2024-02-24T02:52:01.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:51:00+00:00 exited with status queued for try_number 1 2024-02-24T02:52:01.039055218Z [2024-02-24T02:52:01.038+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5540663-9d23-4ccd-a60d-dc33d0e783a7 2024-02-24T02:52:01.039300839Z [2024-02-24T02:52:01.039+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ce0136e-6701-4f2d-aae2-59b04337e614 2024-02-24T02:52:01.039533261Z [2024-02-24T02:52:01.039+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b554985-f814-4fff-8855-1e53b36fb6f8 2024-02-24T02:52:01.039710794Z [2024-02-24T02:52:01.039+0000] {scheduler_job.py:635} INFO - Setting external_id for to 95c01eab-a34e-42ca-b4f6-851d67e6a29d 2024-02-24T02:52:02.455946069Z [2024-02-24T02:52:02.455+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:52:02.457623504Z [2024-02-24T02:52:02.456+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:51:00+00:00, run_id=scheduled__2024-02-24T02:51:00+00:00, run_start_date=2024-02-24 02:52:00.433675+00:00, run_end_date=2024-02-24 02:52:02.455895+00:00, run_duration=2.02222, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:51:00+00:00, data_interval_end=2024-02-24 02:52:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:52:02.468686726Z [2024-02-24T02:52:02.468+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:52:00+00:00, run_after=2024-02-24T02:53:00+00:00 2024-02-24T02:52:02.476449899Z [2024-02-24T02:52:02.476+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:52:02.476780735Z [2024-02-24T02:52:02.476+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 02:50:00+00:00, run_id=scheduled__2024-02-24T02:50:00+00:00, run_start_date=2024-02-24 02:52:00.431342+00:00, run_end_date=2024-02-24 02:52:02.476445+00:00, run_duration=2.045103, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:50:00+00:00, data_interval_end=2024-02-24 02:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T02:52:02.484721866Z [2024-02-24T02:52:02.484+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T02:52:00+00:00, run_after=2024-02-24T02:54:00+00:00 2024-02-24T02:52:02.532527738Z [2024-02-24T02:52:02.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:50:00+00:00 exited with status success for try_number 1 2024-02-24T02:52:02.532708007Z [2024-02-24T02:52:02.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:51:00+00:00 exited with status success for try_number 1 2024-02-24T02:52:02.540062977Z [2024-02-24T02:52:02.539+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T02:50:00+00:00, map_index=-1, run_start_date=2024-02-24 02:52:01.584347+00:00, run_end_date=2024-02-24 02:52:02.251244+00:00, run_duration=0.666897, state=success, executor_state=success, try_number=1, max_tries=1, job_id=890, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:52:00.536338+00:00, queued_by_job_id=2, pid=13000 2024-02-24T02:52:02.540351611Z [2024-02-24T02:52:02.540+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:51:00+00:00, map_index=-1, run_start_date=2024-02-24 02:52:01.492382+00:00, run_end_date=2024-02-24 02:52:02.072406+00:00, run_duration=0.580024, state=success, executor_state=success, try_number=1, max_tries=1, job_id=889, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:52:00.536338+00:00, queued_by_job_id=2, pid=12999 2024-02-24T02:52:04.745517331Z [2024-02-24T02:52:04.744+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T02:52:05.802989146Z [2024-02-24T02:52:05.802+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:52:05.803221773Z [2024-02-24T02:52:05.802+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:51:00+00:00, run_id=scheduled__2024-02-24T02:51:00+00:00, run_start_date=2024-02-24 02:52:00.435864+00:00, run_end_date=2024-02-24 02:52:05.802783+00:00, run_duration=5.366919, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:51:00+00:00, data_interval_end=2024-02-24 02:52:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:52:05.823682385Z [2024-02-24T02:52:05.823+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:52:00+00:00, run_after=2024-02-24T02:53:00+00:00 2024-02-24T02:52:05.834577236Z [2024-02-24T02:52:05.834+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:52:05.834750720Z [2024-02-24T02:52:05.834+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:51:00+00:00, run_id=scheduled__2024-02-24T02:51:00+00:00, run_start_date=2024-02-24 02:52:00.437866+00:00, run_end_date=2024-02-24 02:52:05.834435+00:00, run_duration=5.396569, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:51:00+00:00, data_interval_end=2024-02-24 02:52:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:52:05.844734149Z [2024-02-24T02:52:05.844+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:52:00+00:00, run_after=2024-02-24T02:53:00+00:00 2024-02-24T02:52:05.905206857Z [2024-02-24T02:52:05.904+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:51:00+00:00 exited with status success for try_number 1 2024-02-24T02:52:05.905535296Z [2024-02-24T02:52:05.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:51:00+00:00 exited with status success for try_number 1 2024-02-24T02:52:05.918701695Z [2024-02-24T02:52:05.918+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:51:00+00:00, map_index=-1, run_start_date=2024-02-24 02:52:02.977723+00:00, run_end_date=2024-02-24 02:52:05.364906+00:00, run_duration=2.387183, state=success, executor_state=success, try_number=1, max_tries=1, job_id=891, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:52:00.536338+00:00, queued_by_job_id=2, pid=13023 2024-02-24T02:52:05.919508815Z [2024-02-24T02:52:05.919+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:51:00+00:00, map_index=-1, run_start_date=2024-02-24 02:52:03.027119+00:00, run_end_date=2024-02-24 02:52:05.414412+00:00, run_duration=2.387293, state=success, executor_state=success, try_number=1, max_tries=1, job_id=892, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:52:00.536338+00:00, queued_by_job_id=2, pid=13024 2024-02-24T02:53:01.101321358Z [2024-02-24T02:53:01.100+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:53:00+00:00, run_after=2024-02-24T02:54:00+00:00 2024-02-24T02:53:01.110007917Z [2024-02-24T02:53:01.109+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:53:01.124124586Z [2024-02-24T02:53:01.123+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:53:00+00:00, run_after=2024-02-24T02:54:00+00:00 2024-02-24T02:53:01.185981718Z [2024-02-24T02:53:01.185+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T02:53:01.186006555Z 2024-02-24T02:53:01.186010182Z 2024-02-24T02:53:01.186013656Z 2024-02-24T02:53:01.186247375Z [2024-02-24T02:53:01.186+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:53:01.186435892Z [2024-02-24T02:53:01.186+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:53:01.186637159Z [2024-02-24T02:53:01.186+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:53:01.187261894Z [2024-02-24T02:53:01.187+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:53:01.187272963Z 2024-02-24T02:53:01.187276734Z 2024-02-24T02:53:01.187280327Z 2024-02-24T02:53:01.190991237Z [2024-02-24T02:53:01.190+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:53:01.191159247Z [2024-02-24T02:53:01.191+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:53:01.191439850Z [2024-02-24T02:53:01.191+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:53:01.191649460Z [2024-02-24T02:53:01.191+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:53:01.192006591Z [2024-02-24T02:53:01.191+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:53:01.192224577Z [2024-02-24T02:53:01.192+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:53:01.567519502Z [2024-02-24T02:53:01.566+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:52:00+00:00 exited with status queued for try_number 1 2024-02-24T02:53:01.567710554Z [2024-02-24T02:53:01.567+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:52:00+00:00 exited with status queued for try_number 1 2024-02-24T02:53:01.567783355Z [2024-02-24T02:53:01.567+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:52:00+00:00 exited with status queued for try_number 1 2024-02-24T02:53:01.574975510Z [2024-02-24T02:53:01.574+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea006408-19f6-43de-93b8-5c75c29f4699 2024-02-24T02:53:01.575032852Z [2024-02-24T02:53:01.574+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3095fad7-36f3-4645-b946-fcb222ce8a43 2024-02-24T02:53:01.575130592Z [2024-02-24T02:53:01.575+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c548e59-5a39-4287-8f2d-ad45c9dda1cc 2024-02-24T02:53:03.199356383Z [2024-02-24T02:53:03.198+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:53:03.199704966Z [2024-02-24T02:53:03.199+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:52:00+00:00, run_id=scheduled__2024-02-24T02:52:00+00:00, run_start_date=2024-02-24 02:53:01.134928+00:00, run_end_date=2024-02-24 02:53:03.199268+00:00, run_duration=2.06434, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:52:00+00:00, data_interval_end=2024-02-24 02:53:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:53:03.209718901Z [2024-02-24T02:53:03.209+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:53:00+00:00, run_after=2024-02-24T02:54:00+00:00 2024-02-24T02:53:03.257694052Z [2024-02-24T02:53:03.257+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:52:00+00:00 exited with status success for try_number 1 2024-02-24T02:53:03.264272388Z [2024-02-24T02:53:03.263+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:52:00+00:00, map_index=-1, run_start_date=2024-02-24 02:53:02.299957+00:00, run_end_date=2024-02-24 02:53:03.016836+00:00, run_duration=0.716879, state=success, executor_state=success, try_number=1, max_tries=1, job_id=893, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:53:01.188022+00:00, queued_by_job_id=2, pid=13056 2024-02-24T02:53:08.356804335Z [2024-02-24T02:53:08.356+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:53:08.357168602Z [2024-02-24T02:53:08.356+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:52:00+00:00, run_id=scheduled__2024-02-24T02:52:00+00:00, run_start_date=2024-02-24 02:53:01.136233+00:00, run_end_date=2024-02-24 02:53:08.356536+00:00, run_duration=7.220303, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:52:00+00:00, data_interval_end=2024-02-24 02:53:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:53:08.370293144Z [2024-02-24T02:53:08.369+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:53:00+00:00, run_after=2024-02-24T02:54:00+00:00 2024-02-24T02:53:08.378748910Z [2024-02-24T02:53:08.378+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:53:08.378843241Z [2024-02-24T02:53:08.378+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:52:00+00:00, run_id=scheduled__2024-02-24T02:52:00+00:00, run_start_date=2024-02-24 02:53:01.137349+00:00, run_end_date=2024-02-24 02:53:08.378431+00:00, run_duration=7.241082, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:52:00+00:00, data_interval_end=2024-02-24 02:53:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:53:08.388262781Z [2024-02-24T02:53:08.387+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:53:00+00:00, run_after=2024-02-24T02:54:00+00:00 2024-02-24T02:53:08.432272629Z [2024-02-24T02:53:08.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:52:00+00:00 exited with status success for try_number 1 2024-02-24T02:53:08.432338578Z [2024-02-24T02:53:08.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:52:00+00:00 exited with status success for try_number 1 2024-02-24T02:53:08.447172571Z [2024-02-24T02:53:08.446+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:52:00+00:00, map_index=-1, run_start_date=2024-02-24 02:53:03.942244+00:00, run_end_date=2024-02-24 02:53:07.354314+00:00, run_duration=3.41207, state=success, executor_state=success, try_number=1, max_tries=1, job_id=895, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:53:01.188022+00:00, queued_by_job_id=2, pid=13080 2024-02-24T02:53:08.447794103Z [2024-02-24T02:53:08.447+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:52:00+00:00, map_index=-1, run_start_date=2024-02-24 02:53:03.520635+00:00, run_end_date=2024-02-24 02:53:07.885633+00:00, run_duration=4.364998, state=success, executor_state=success, try_number=1, max_tries=1, job_id=894, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:53:01.188022+00:00, queued_by_job_id=2, pid=13069 2024-02-24T02:54:00.259832847Z [2024-02-24T02:54:00.259+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:54:00.269203792Z [2024-02-24T02:54:00.268+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:54:00.282704231Z [2024-02-24T02:54:00.282+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:54:00+00:00, run_after=2024-02-24T02:55:00+00:00 2024-02-24T02:54:00.296196696Z [2024-02-24T02:54:00.295+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:54:00+00:00, run_after=2024-02-24T02:55:00+00:00 2024-02-24T02:54:00.386242531Z [2024-02-24T02:54:00.385+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T02:54:00.386276593Z 2024-02-24T02:54:00.386283740Z 2024-02-24T02:54:00.386289786Z 2024-02-24T02:54:00.386295626Z 2024-02-24T02:54:00.386415976Z [2024-02-24T02:54:00.386+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T02:54:00.389998394Z [2024-02-24T02:54:00.386+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:54:00.390185583Z [2024-02-24T02:54:00.389+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:54:00.390377916Z [2024-02-24T02:54:00.390+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:54:00.391050859Z [2024-02-24T02:54:00.390+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:54:00.391085239Z 2024-02-24T02:54:00.391092693Z 2024-02-24T02:54:00.391098431Z 2024-02-24T02:54:00.391104038Z 2024-02-24T02:54:00.406664265Z [2024-02-24T02:54:00.406+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:54:00.407102265Z [2024-02-24T02:54:00.406+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T02:54:00.407399081Z [2024-02-24T02:54:00.407+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:54:00.407514848Z [2024-02-24T02:54:00.407+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:54:00.407765618Z [2024-02-24T02:54:00.407+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:54:00.407880130Z [2024-02-24T02:54:00.407+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:54:00.408115106Z [2024-02-24T02:54:00.407+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:54:00.408215999Z [2024-02-24T02:54:00.408+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:54:00.862972358Z [2024-02-24T02:54:00.862+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:52:00+00:00 exited with status queued for try_number 1 2024-02-24T02:54:00.863024313Z [2024-02-24T02:54:00.862+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:53:00+00:00 exited with status queued for try_number 1 2024-02-24T02:54:00.863031614Z [2024-02-24T02:54:00.862+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:53:00+00:00 exited with status queued for try_number 1 2024-02-24T02:54:00.863115533Z [2024-02-24T02:54:00.863+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:53:00+00:00 exited with status queued for try_number 1 2024-02-24T02:54:00.883006094Z [2024-02-24T02:54:00.882+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb33f2d5-07cc-4810-add2-df8da82074c0 2024-02-24T02:54:00.886254305Z [2024-02-24T02:54:00.882+0000] {scheduler_job.py:635} INFO - Setting external_id for to fbe7d1e9-1f9a-4a31-a1ab-b70565c4d436 2024-02-24T02:54:00.886646998Z [2024-02-24T02:54:00.886+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe698709-1bd6-476c-94ad-ca5274305a37 2024-02-24T02:54:00.887109206Z [2024-02-24T02:54:00.886+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe957450-01a3-4b7b-80d7-8b30bc562558 2024-02-24T02:54:03.228453909Z [2024-02-24T02:54:03.227+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:54:03.229026884Z [2024-02-24T02:54:03.228+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:53:00+00:00, run_id=scheduled__2024-02-24T02:53:00+00:00, run_start_date=2024-02-24 02:54:00.311886+00:00, run_end_date=2024-02-24 02:54:03.228344+00:00, run_duration=2.916458, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:53:00+00:00, data_interval_end=2024-02-24 02:54:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:54:03.244408298Z [2024-02-24T02:54:03.244+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:54:00+00:00, run_after=2024-02-24T02:55:00+00:00 2024-02-24T02:54:03.253057523Z [2024-02-24T02:54:03.252+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:54:03.253388975Z [2024-02-24T02:54:03.253+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 02:52:00+00:00, run_id=scheduled__2024-02-24T02:52:00+00:00, run_start_date=2024-02-24 02:54:00.310267+00:00, run_end_date=2024-02-24 02:54:03.252925+00:00, run_duration=2.942658, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:52:00+00:00, data_interval_end=2024-02-24 02:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T02:54:03.261580714Z [2024-02-24T02:54:03.261+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T02:54:00+00:00, run_after=2024-02-24T02:56:00+00:00 2024-02-24T02:54:03.325357805Z [2024-02-24T02:54:03.324+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:52:00+00:00 exited with status success for try_number 1 2024-02-24T02:54:03.325643168Z [2024-02-24T02:54:03.325+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:53:00+00:00 exited with status success for try_number 1 2024-02-24T02:54:03.339903799Z [2024-02-24T02:54:03.339+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:53:00+00:00, map_index=-1, run_start_date=2024-02-24 02:54:01.802839+00:00, run_end_date=2024-02-24 02:54:02.263498+00:00, run_duration=0.460659, state=success, executor_state=success, try_number=1, max_tries=1, job_id=897, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:54:00.398019+00:00, queued_by_job_id=2, pid=13110 2024-02-24T02:54:03.340400664Z [2024-02-24T02:54:03.340+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T02:52:00+00:00, map_index=-1, run_start_date=2024-02-24 02:54:01.660501+00:00, run_end_date=2024-02-24 02:54:02.078873+00:00, run_duration=0.418372, state=success, executor_state=success, try_number=1, max_tries=1, job_id=896, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:54:00.398019+00:00, queued_by_job_id=2, pid=13108 2024-02-24T02:54:04.416595437Z [2024-02-24T02:54:04.416+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:54:04.417079648Z [2024-02-24T02:54:04.416+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:53:00+00:00, run_id=scheduled__2024-02-24T02:53:00+00:00, run_start_date=2024-02-24 02:54:00.313576+00:00, run_end_date=2024-02-24 02:54:04.416481+00:00, run_duration=4.102905, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:53:00+00:00, data_interval_end=2024-02-24 02:54:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:54:04.437044643Z [2024-02-24T02:54:04.436+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:54:00+00:00, run_after=2024-02-24T02:55:00+00:00 2024-02-24T02:54:04.509747882Z [2024-02-24T02:54:04.509+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:53:00+00:00 exited with status success for try_number 1 2024-02-24T02:54:04.517728750Z [2024-02-24T02:54:04.517+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:53:00+00:00, map_index=-1, run_start_date=2024-02-24 02:54:02.890723+00:00, run_end_date=2024-02-24 02:54:04.169478+00:00, run_duration=1.278755, state=success, executor_state=success, try_number=1, max_tries=1, job_id=899, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:54:00.398019+00:00, queued_by_job_id=2, pid=13133 2024-02-24T02:54:05.564602974Z [2024-02-24T02:54:05.564+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:54:05.564839683Z [2024-02-24T02:54:05.564+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:53:00+00:00, run_id=scheduled__2024-02-24T02:53:00+00:00, run_start_date=2024-02-24 02:54:00.314699+00:00, run_end_date=2024-02-24 02:54:05.564512+00:00, run_duration=5.249813, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:53:00+00:00, data_interval_end=2024-02-24 02:54:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:54:05.576104828Z [2024-02-24T02:54:05.575+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:54:00+00:00, run_after=2024-02-24T02:55:00+00:00 2024-02-24T02:54:05.610799465Z [2024-02-24T02:54:05.610+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:53:00+00:00 exited with status success for try_number 1 2024-02-24T02:54:05.616213681Z [2024-02-24T02:54:05.615+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:53:00+00:00, map_index=-1, run_start_date=2024-02-24 02:54:02.664061+00:00, run_end_date=2024-02-24 02:54:04.810637+00:00, run_duration=2.146576, state=success, executor_state=success, try_number=1, max_tries=1, job_id=898, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:54:00.398019+00:00, queued_by_job_id=2, pid=13132 2024-02-24T02:55:00.292309810Z [2024-02-24T02:55:00.287+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:55:00+00:00, run_after=2024-02-24T03:00:00+00:00 2024-02-24T02:55:00.305262070Z [2024-02-24T02:55:00.304+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:55:00.337559967Z [2024-02-24T02:55:00.337+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:55:00+00:00, run_after=2024-02-24T02:56:00+00:00 2024-02-24T02:55:00.361687470Z [2024-02-24T02:55:00.361+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:55:00+00:00, run_after=2024-02-24T02:56:00+00:00 2024-02-24T02:55:00.507131033Z [2024-02-24T02:55:00.506+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T02:55:00.507152801Z 2024-02-24T02:55:00.507156770Z 2024-02-24T02:55:00.507160401Z 2024-02-24T02:55:00.507163769Z 2024-02-24T02:55:00.507204953Z [2024-02-24T02:55:00.507+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:55:00.507263973Z [2024-02-24T02:55:00.507+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:55:00.507327990Z [2024-02-24T02:55:00.507+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:55:00.507400589Z [2024-02-24T02:55:00.507+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:55:00.508284936Z [2024-02-24T02:55:00.508+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:55:00.508294648Z 2024-02-24T02:55:00.508298546Z 2024-02-24T02:55:00.508301901Z 2024-02-24T02:55:00.508305175Z 2024-02-24T02:55:00.515173913Z [2024-02-24T02:55:00.512+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T02:55:00.515532680Z [2024-02-24T02:55:00.515+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:55:00.515957710Z [2024-02-24T02:55:00.515+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:55:00.516229327Z [2024-02-24T02:55:00.516+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:55:00.516621108Z [2024-02-24T02:55:00.516+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:55:00.516845838Z [2024-02-24T02:55:00.516+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:55:00.517184976Z [2024-02-24T02:55:00.517+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:55:00.517380565Z [2024-02-24T02:55:00.517+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:55:01.006919902Z [2024-02-24T02:55:01.006+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T02:50:00+00:00 exited with status queued for try_number 1 2024-02-24T02:55:01.007176394Z [2024-02-24T02:55:01.007+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:54:00+00:00 exited with status queued for try_number 1 2024-02-24T02:55:01.007331744Z [2024-02-24T02:55:01.007+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:54:00+00:00 exited with status queued for try_number 1 2024-02-24T02:55:01.007482696Z [2024-02-24T02:55:01.007+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:54:00+00:00 exited with status queued for try_number 1 2024-02-24T02:55:01.030142029Z [2024-02-24T02:55:01.029+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ff5129c-d543-4b1e-a4a0-5ae05da2cb6a 2024-02-24T02:55:01.041884201Z [2024-02-24T02:55:01.031+0000] {scheduler_job.py:635} INFO - Setting external_id for to c068e9f7-31f0-4f30-942c-8d0f407e76e7 2024-02-24T02:55:01.041909024Z [2024-02-24T02:55:01.031+0000] {scheduler_job.py:635} INFO - Setting external_id for to 025df665-0e02-4a26-a028-9d3ed209667e 2024-02-24T02:55:01.041925032Z [2024-02-24T02:55:01.031+0000] {scheduler_job.py:635} INFO - Setting external_id for to 335b1dca-33e0-4e03-845f-ebb88f488af9 2024-02-24T02:55:03.689897677Z [2024-02-24T02:55:03.688+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:55:03.689983088Z [2024-02-24T02:55:03.689+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:54:00+00:00, run_id=scheduled__2024-02-24T02:54:00+00:00, run_start_date=2024-02-24 02:55:00.392849+00:00, run_end_date=2024-02-24 02:55:03.689479+00:00, run_duration=3.29663, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:54:00+00:00, data_interval_end=2024-02-24 02:55:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:55:03.741098028Z [2024-02-24T02:55:03.739+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:55:00+00:00, run_after=2024-02-24T02:56:00+00:00 2024-02-24T02:55:03.991445866Z [2024-02-24T02:55:03.990+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:54:00+00:00 exited with status success for try_number 1 2024-02-24T02:55:03.999448356Z [2024-02-24T02:55:03.998+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:54:00+00:00, map_index=-1, run_start_date=2024-02-24 02:55:01.854283+00:00, run_end_date=2024-02-24 02:55:02.712826+00:00, run_duration=0.858543, state=success, executor_state=success, try_number=1, max_tries=1, job_id=900, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:55:00.509284+00:00, queued_by_job_id=2, pid=13166 2024-02-24T02:55:06.716586484Z [2024-02-24T02:55:06.715+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:55:06.716918762Z [2024-02-24T02:55:06.716+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:54:00+00:00, run_id=scheduled__2024-02-24T02:54:00+00:00, run_start_date=2024-02-24 02:55:00.394640+00:00, run_end_date=2024-02-24 02:55:06.716481+00:00, run_duration=6.321841, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:54:00+00:00, data_interval_end=2024-02-24 02:55:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:55:06.731244903Z [2024-02-24T02:55:06.730+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:55:00+00:00, run_after=2024-02-24T02:56:00+00:00 2024-02-24T02:55:06.791745368Z [2024-02-24T02:55:06.791+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:55:06.791806206Z 2024-02-24T02:55:06.791849638Z [2024-02-24T02:55:06.791+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:55:06.792784990Z [2024-02-24T02:55:06.792+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:55:06.792869561Z 2024-02-24T02:55:06.801732234Z [2024-02-24T02:55:06.801+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T02:55:06.801868304Z [2024-02-24T02:55:06.801+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:55:06.891335255Z [2024-02-24T02:55:06.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T02:50:00+00:00 exited with status queued for try_number 1 2024-02-24T02:55:06.891470746Z [2024-02-24T02:55:06.891+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T02:50:00+00:00 exited with status success for try_number 1 2024-02-24T02:55:06.891652790Z [2024-02-24T02:55:06.891+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:54:00+00:00 exited with status success for try_number 1 2024-02-24T02:55:06.904279757Z [2024-02-24T02:55:06.903+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:54:00+00:00, map_index=-1, run_start_date=2024-02-24 02:55:04.152556+00:00, run_end_date=2024-02-24 02:55:05.779220+00:00, run_duration=1.626664, state=success, executor_state=success, try_number=1, max_tries=1, job_id=901, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:55:00.509284+00:00, queued_by_job_id=2, pid=13185 2024-02-24T02:55:06.904569535Z [2024-02-24T02:55:06.904+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T02:50:00+00:00, map_index=-1, run_start_date=2024-02-24 02:55:05.071667+00:00, run_end_date=2024-02-24 02:55:05.547726+00:00, run_duration=0.476059, state=success, executor_state=success, try_number=1, max_tries=1, job_id=903, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:55:00.509284+00:00, queued_by_job_id=2, pid=13202 2024-02-24T02:55:06.904890308Z [2024-02-24T02:55:06.904+0000] {scheduler_job.py:635} INFO - Setting external_id for to 63dcbd98-24e5-4508-a9e2-34fec58e461d 2024-02-24T02:55:07.689384130Z [2024-02-24T02:55:07.685+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:55:07.689968481Z [2024-02-24T02:55:07.689+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:54:00+00:00, run_id=scheduled__2024-02-24T02:54:00+00:00, run_start_date=2024-02-24 02:55:00.396138+00:00, run_end_date=2024-02-24 02:55:07.689302+00:00, run_duration=7.293164, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:54:00+00:00, data_interval_end=2024-02-24 02:55:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:55:07.700295249Z [2024-02-24T02:55:07.699+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:55:00+00:00, run_after=2024-02-24T02:56:00+00:00 2024-02-24T02:55:07.752484272Z [2024-02-24T02:55:07.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:54:00+00:00 exited with status success for try_number 1 2024-02-24T02:55:07.758766408Z [2024-02-24T02:55:07.758+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:54:00+00:00, map_index=-1, run_start_date=2024-02-24 02:55:04.426599+00:00, run_end_date=2024-02-24 02:55:07.194542+00:00, run_duration=2.767943, state=success, executor_state=success, try_number=1, max_tries=1, job_id=902, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:55:00.509284+00:00, queued_by_job_id=2, pid=13186 2024-02-24T02:55:09.562942153Z [2024-02-24T02:55:09.562+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:55:09.562965037Z 2024-02-24T02:55:09.563395452Z [2024-02-24T02:55:09.563+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:55:09.564178624Z [2024-02-24T02:55:09.563+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:55:09.564190557Z 2024-02-24T02:55:09.569677861Z [2024-02-24T02:55:09.569+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T02:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T02:55:09.570019372Z [2024-02-24T02:55:09.569+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T02:55:09.650210397Z [2024-02-24T02:55:09.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T02:50:00+00:00 exited with status queued for try_number 1 2024-02-24T02:55:09.650517839Z [2024-02-24T02:55:09.650+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T02:50:00+00:00 exited with status success for try_number 1 2024-02-24T02:55:09.657351490Z [2024-02-24T02:55:09.657+0000] {scheduler_job.py:635} INFO - Setting external_id for to 55b8d7e8-6879-46a6-976b-89b1029bebc9 2024-02-24T02:55:09.657999463Z [2024-02-24T02:55:09.657+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T02:50:00+00:00, map_index=-1, run_start_date=2024-02-24 02:55:08.907748+00:00, run_end_date=2024-02-24 02:55:09.290173+00:00, run_duration=0.382425, state=success, executor_state=success, try_number=1, max_tries=1, job_id=904, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:55:06.793224+00:00, queued_by_job_id=2, pid=13215 2024-02-24T02:55:13.048456983Z [2024-02-24T02:55:13.048+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T02:55:13.048483693Z 2024-02-24T02:55:13.048700104Z [2024-02-24T02:55:13.048+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:55:13.049213256Z [2024-02-24T02:55:13.049+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:55:13.049223767Z 2024-02-24T02:55:13.051974470Z [2024-02-24T02:55:13.051+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:55:13.052473519Z [2024-02-24T02:55:13.052+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T02:55:13.101628815Z [2024-02-24T02:55:13.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T02:50:00+00:00 exited with status queued for try_number 1 2024-02-24T02:55:13.101706472Z [2024-02-24T02:55:13.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T02:50:00+00:00 exited with status success for try_number 1 2024-02-24T02:55:13.110640603Z [2024-02-24T02:55:13.110+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1441418b-6e93-4d76-a78e-884640870282 2024-02-24T02:55:13.110915394Z [2024-02-24T02:55:13.110+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T02:50:00+00:00, map_index=0, run_start_date=2024-02-24 02:55:11.487072+00:00, run_end_date=2024-02-24 02:55:11.824156+00:00, run_duration=0.337084, state=success, executor_state=success, try_number=1, max_tries=1, job_id=905, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:55:09.564730+00:00, queued_by_job_id=2, pid=13223 2024-02-24T02:55:15.876116447Z [2024-02-24T02:55:15.875+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:55:15.877062323Z [2024-02-24T02:55:15.876+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:50:00+00:00, run_id=scheduled__2024-02-24T02:50:00+00:00, run_start_date=2024-02-24 02:55:00.389540+00:00, run_end_date=2024-02-24 02:55:15.876537+00:00, run_duration=15.486997, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:50:00+00:00, data_interval_end=2024-02-24 02:55:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T02:55:15.883525998Z [2024-02-24T02:55:15.883+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:55:00+00:00, run_after=2024-02-24T03:00:00+00:00 2024-02-24T02:55:15.915367567Z [2024-02-24T02:55:15.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T02:50:00+00:00 exited with status success for try_number 1 2024-02-24T02:55:15.921224173Z [2024-02-24T02:55:15.920+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T02:50:00+00:00, map_index=-1, run_start_date=2024-02-24 02:55:14.854348+00:00, run_end_date=2024-02-24 02:55:15.232372+00:00, run_duration=0.378024, state=success, executor_state=success, try_number=1, max_tries=1, job_id=906, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:55:13.049529+00:00, queued_by_job_id=2, pid=13231 2024-02-24T02:56:00.249620766Z [2024-02-24T02:56:00.248+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:56:00.279865871Z [2024-02-24T02:56:00.279+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:56:00+00:00, run_after=2024-02-24T02:57:00+00:00 2024-02-24T02:56:00.289683923Z [2024-02-24T02:56:00.289+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:56:00.315453123Z [2024-02-24T02:56:00.315+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:56:00+00:00, run_after=2024-02-24T02:57:00+00:00 2024-02-24T02:56:00.402297878Z [2024-02-24T02:56:00.401+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T02:56:00.402341718Z 2024-02-24T02:56:00.402384964Z 2024-02-24T02:56:00.402423250Z 2024-02-24T02:56:00.402433074Z 2024-02-24T02:56:00.402460434Z [2024-02-24T02:56:00.402+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T02:56:00.402469475Z [2024-02-24T02:56:00.402+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:56:00.402523773Z [2024-02-24T02:56:00.402+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:56:00.402573815Z [2024-02-24T02:56:00.402+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:56:00.403501725Z [2024-02-24T02:56:00.403+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:56:00.403526000Z 2024-02-24T02:56:00.403566310Z 2024-02-24T02:56:00.403576016Z 2024-02-24T02:56:00.403584811Z 2024-02-24T02:56:00.408861204Z [2024-02-24T02:56:00.408+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:56:00.408920909Z [2024-02-24T02:56:00.408+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T02:56:00.409130328Z [2024-02-24T02:56:00.408+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:56:00.409289759Z [2024-02-24T02:56:00.409+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:56:00.409375910Z [2024-02-24T02:56:00.409+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:56:00.409428072Z [2024-02-24T02:56:00.409+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:56:00.409712916Z [2024-02-24T02:56:00.409+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:56:00.409925776Z [2024-02-24T02:56:00.409+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:56:00.826935045Z [2024-02-24T02:56:00.826+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:54:00+00:00 exited with status queued for try_number 1 2024-02-24T02:56:00.826998788Z [2024-02-24T02:56:00.826+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:55:00+00:00 exited with status queued for try_number 1 2024-02-24T02:56:00.827113551Z [2024-02-24T02:56:00.826+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:55:00+00:00 exited with status queued for try_number 1 2024-02-24T02:56:00.827257677Z [2024-02-24T02:56:00.827+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:55:00+00:00 exited with status queued for try_number 1 2024-02-24T02:56:00.839872252Z [2024-02-24T02:56:00.839+0000] {scheduler_job.py:635} INFO - Setting external_id for to 52c715f5-26a1-431a-be31-7607a01d2386 2024-02-24T02:56:00.840043646Z [2024-02-24T02:56:00.839+0000] {scheduler_job.py:635} INFO - Setting external_id for to fbdfc385-77b9-46ae-b23e-834696c044d9 2024-02-24T02:56:00.840209797Z [2024-02-24T02:56:00.840+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64195eba-73f2-47c0-9d52-8e7eca20898a 2024-02-24T02:56:00.840581935Z [2024-02-24T02:56:00.840+0000] {scheduler_job.py:635} INFO - Setting external_id for to 11b796e2-cf94-48c8-9637-96034f5be62d 2024-02-24T02:56:02.843671483Z [2024-02-24T02:56:02.843+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:56:02.843871766Z [2024-02-24T02:56:02.843+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 02:54:00+00:00, run_id=scheduled__2024-02-24T02:54:00+00:00, run_start_date=2024-02-24 02:56:00.330055+00:00, run_end_date=2024-02-24 02:56:02.843546+00:00, run_duration=2.513491, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:54:00+00:00, data_interval_end=2024-02-24 02:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T02:56:02.860926190Z [2024-02-24T02:56:02.860+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T02:56:00+00:00, run_after=2024-02-24T02:58:00+00:00 2024-02-24T02:56:02.877475256Z [2024-02-24T02:56:02.875+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:56:02.877851947Z [2024-02-24T02:56:02.877+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:55:00+00:00, run_id=scheduled__2024-02-24T02:55:00+00:00, run_start_date=2024-02-24 02:56:00.331334+00:00, run_end_date=2024-02-24 02:56:02.877422+00:00, run_duration=2.546088, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:55:00+00:00, data_interval_end=2024-02-24 02:56:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:56:02.894609542Z [2024-02-24T02:56:02.894+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:56:00+00:00, run_after=2024-02-24T02:57:00+00:00 2024-02-24T02:56:02.964550135Z [2024-02-24T02:56:02.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:54:00+00:00 exited with status success for try_number 1 2024-02-24T02:56:02.964591743Z [2024-02-24T02:56:02.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:55:00+00:00 exited with status success for try_number 1 2024-02-24T02:56:02.973588053Z [2024-02-24T02:56:02.973+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T02:54:00+00:00, map_index=-1, run_start_date=2024-02-24 02:56:01.513371+00:00, run_end_date=2024-02-24 02:56:01.984525+00:00, run_duration=0.471154, state=success, executor_state=success, try_number=1, max_tries=1, job_id=908, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:56:00.405956+00:00, queued_by_job_id=2, pid=13254 2024-02-24T02:56:02.973710870Z [2024-02-24T02:56:02.973+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:55:00+00:00, map_index=-1, run_start_date=2024-02-24 02:56:01.348715+00:00, run_end_date=2024-02-24 02:56:01.797552+00:00, run_duration=0.448837, state=success, executor_state=success, try_number=1, max_tries=1, job_id=907, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:56:00.405956+00:00, queued_by_job_id=2, pid=13253 2024-02-24T02:56:05.111604578Z [2024-02-24T02:56:05.111+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:56:05.111992758Z [2024-02-24T02:56:05.111+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:55:00+00:00, run_id=scheduled__2024-02-24T02:55:00+00:00, run_start_date=2024-02-24 02:56:00.332558+00:00, run_end_date=2024-02-24 02:56:05.111481+00:00, run_duration=4.778923, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:55:00+00:00, data_interval_end=2024-02-24 02:56:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:56:05.124486232Z [2024-02-24T02:56:05.124+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:56:00+00:00, run_after=2024-02-24T02:57:00+00:00 2024-02-24T02:56:05.134887821Z [2024-02-24T02:56:05.134+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:56:05.135237757Z [2024-02-24T02:56:05.135+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:55:00+00:00, run_id=scheduled__2024-02-24T02:55:00+00:00, run_start_date=2024-02-24 02:56:00.333666+00:00, run_end_date=2024-02-24 02:56:05.134786+00:00, run_duration=4.80112, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:55:00+00:00, data_interval_end=2024-02-24 02:56:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:56:05.144338574Z [2024-02-24T02:56:05.144+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:56:00+00:00, run_after=2024-02-24T02:57:00+00:00 2024-02-24T02:56:05.192832516Z [2024-02-24T02:56:05.192+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:55:00+00:00 exited with status success for try_number 1 2024-02-24T02:56:05.201292327Z [2024-02-24T02:56:05.200+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:55:00+00:00, map_index=-1, run_start_date=2024-02-24 02:56:02.557076+00:00, run_end_date=2024-02-24 02:56:04.118416+00:00, run_duration=1.56134, state=success, executor_state=success, try_number=1, max_tries=1, job_id=909, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:56:00.405956+00:00, queued_by_job_id=2, pid=13277 2024-02-24T02:56:05.979051457Z [2024-02-24T02:56:05.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:55:00+00:00 exited with status success for try_number 1 2024-02-24T02:56:05.989295791Z [2024-02-24T02:56:05.988+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:55:00+00:00, map_index=-1, run_start_date=2024-02-24 02:56:02.671702+00:00, run_end_date=2024-02-24 02:56:05.044916+00:00, run_duration=2.373214, state=success, executor_state=success, try_number=1, max_tries=1, job_id=910, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:56:00.405956+00:00, queued_by_job_id=2, pid=13278 2024-02-24T02:57:00.715902752Z [2024-02-24T02:57:00.715+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:57:00+00:00, run_after=2024-02-24T02:58:00+00:00 2024-02-24T02:57:00.726939392Z [2024-02-24T02:57:00.726+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:57:00.740380949Z [2024-02-24T02:57:00.740+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:57:00+00:00, run_after=2024-02-24T02:58:00+00:00 2024-02-24T02:57:00.814993835Z [2024-02-24T02:57:00.814+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T02:57:00.815027837Z 2024-02-24T02:57:00.815034400Z 2024-02-24T02:57:00.815039785Z 2024-02-24T02:57:00.815064963Z [2024-02-24T02:57:00.814+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:57:00.815379978Z [2024-02-24T02:57:00.815+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:57:00.815635547Z [2024-02-24T02:57:00.815+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:57:00.816474137Z [2024-02-24T02:57:00.816+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:57:00.816489590Z 2024-02-24T02:57:00.816494949Z 2024-02-24T02:57:00.816500074Z 2024-02-24T02:57:00.822010874Z [2024-02-24T02:57:00.821+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:57:00.822513800Z [2024-02-24T02:57:00.822+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:57:00.823014839Z [2024-02-24T02:57:00.822+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:57:00.823690487Z [2024-02-24T02:57:00.823+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:57:00.824143918Z [2024-02-24T02:57:00.823+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:57:00.824312031Z [2024-02-24T02:57:00.824+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:57:01.078862666Z [2024-02-24T02:57:01.078+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:56:00+00:00 exited with status queued for try_number 1 2024-02-24T02:57:01.078890434Z [2024-02-24T02:57:01.078+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:56:00+00:00 exited with status queued for try_number 1 2024-02-24T02:57:01.080390699Z [2024-02-24T02:57:01.078+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:56:00+00:00 exited with status queued for try_number 1 2024-02-24T02:57:01.105972144Z [2024-02-24T02:57:01.105+0000] {scheduler_job.py:635} INFO - Setting external_id for to 94be9e83-4dad-423b-8aca-9fa06efe3256 2024-02-24T02:57:01.106155042Z [2024-02-24T02:57:01.105+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a79f126-6459-4257-b4fb-91a145950085 2024-02-24T02:57:01.106379866Z [2024-02-24T02:57:01.106+0000] {scheduler_job.py:635} INFO - Setting external_id for to f84291e8-805e-4bdf-b372-7c69b3480467 2024-02-24T02:57:03.015115732Z [2024-02-24T02:57:03.014+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:57:03.015579145Z [2024-02-24T02:57:03.015+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:56:00+00:00, run_id=scheduled__2024-02-24T02:56:00+00:00, run_start_date=2024-02-24 02:57:00.753297+00:00, run_end_date=2024-02-24 02:57:03.015188+00:00, run_duration=2.261891, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:56:00+00:00, data_interval_end=2024-02-24 02:57:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:57:03.026994828Z [2024-02-24T02:57:03.026+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:57:00+00:00, run_after=2024-02-24T02:58:00+00:00 2024-02-24T02:57:03.084769240Z [2024-02-24T02:57:03.082+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:56:00+00:00 exited with status success for try_number 1 2024-02-24T02:57:03.091857668Z [2024-02-24T02:57:03.091+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:56:00+00:00, map_index=-1, run_start_date=2024-02-24 02:57:01.742386+00:00, run_end_date=2024-02-24 02:57:02.204507+00:00, run_duration=0.462121, state=success, executor_state=success, try_number=1, max_tries=1, job_id=911, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:57:00.817677+00:00, queued_by_job_id=2, pid=13310 2024-02-24T02:57:04.872393705Z [2024-02-24T02:57:04.871+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T02:57:05.920595426Z [2024-02-24T02:57:05.920+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:57:05.920816709Z [2024-02-24T02:57:05.920+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:56:00+00:00, run_id=scheduled__2024-02-24T02:56:00+00:00, run_start_date=2024-02-24 02:57:00.755231+00:00, run_end_date=2024-02-24 02:57:05.920497+00:00, run_duration=5.165266, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:56:00+00:00, data_interval_end=2024-02-24 02:57:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:57:05.931047087Z [2024-02-24T02:57:05.930+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:57:00+00:00, run_after=2024-02-24T02:58:00+00:00 2024-02-24T02:57:05.938877746Z [2024-02-24T02:57:05.938+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:57:05.939060254Z [2024-02-24T02:57:05.938+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:56:00+00:00, run_id=scheduled__2024-02-24T02:56:00+00:00, run_start_date=2024-02-24 02:57:00.756368+00:00, run_end_date=2024-02-24 02:57:05.938789+00:00, run_duration=5.182421, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:56:00+00:00, data_interval_end=2024-02-24 02:57:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:57:05.949054890Z [2024-02-24T02:57:05.948+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:57:00+00:00, run_after=2024-02-24T02:58:00+00:00 2024-02-24T02:57:05.992688413Z [2024-02-24T02:57:05.991+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:56:00+00:00 exited with status success for try_number 1 2024-02-24T02:57:05.992752233Z [2024-02-24T02:57:05.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:56:00+00:00 exited with status success for try_number 1 2024-02-24T02:57:06.003372370Z [2024-02-24T02:57:06.002+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:56:00+00:00, map_index=-1, run_start_date=2024-02-24 02:57:02.967504+00:00, run_end_date=2024-02-24 02:57:04.828961+00:00, run_duration=1.861457, state=success, executor_state=success, try_number=1, max_tries=1, job_id=912, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:57:00.817677+00:00, queued_by_job_id=2, pid=13328 2024-02-24T02:57:06.003598975Z [2024-02-24T02:57:06.003+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:56:00+00:00, map_index=-1, run_start_date=2024-02-24 02:57:02.987193+00:00, run_end_date=2024-02-24 02:57:04.993693+00:00, run_duration=2.0065, state=success, executor_state=success, try_number=1, max_tries=1, job_id=913, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:57:00.817677+00:00, queued_by_job_id=2, pid=13329 2024-02-24T02:58:00.092330798Z [2024-02-24T02:58:00.091+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:58:00.101561027Z [2024-02-24T02:58:00.101+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:58:00.116758363Z [2024-02-24T02:58:00.116+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:58:00+00:00, run_after=2024-02-24T02:59:00+00:00 2024-02-24T02:58:00.130527405Z [2024-02-24T02:58:00.130+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:58:00+00:00, run_after=2024-02-24T02:59:00+00:00 2024-02-24T02:58:00.237538677Z [2024-02-24T02:58:00.237+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T02:58:00.237570659Z 2024-02-24T02:58:00.237577430Z 2024-02-24T02:58:00.237581489Z 2024-02-24T02:58:00.237584896Z 2024-02-24T02:58:00.237931731Z [2024-02-24T02:58:00.237+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T02:58:00.238205686Z [2024-02-24T02:58:00.238+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:58:00.238439386Z [2024-02-24T02:58:00.238+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:58:00.238603433Z [2024-02-24T02:58:00.238+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:58:00.239381463Z [2024-02-24T02:58:00.239+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:58:00.239396417Z 2024-02-24T02:58:00.239402374Z 2024-02-24T02:58:00.239407585Z 2024-02-24T02:58:00.239413357Z 2024-02-24T02:58:00.246658324Z [2024-02-24T02:58:00.246+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:58:00.246924404Z [2024-02-24T02:58:00.246+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T02:58:00.247306219Z [2024-02-24T02:58:00.247+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:58:00.247566635Z [2024-02-24T02:58:00.247+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:58:00.247921725Z [2024-02-24T02:58:00.247+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:58:00.248151113Z [2024-02-24T02:58:00.247+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:58:00.248491631Z [2024-02-24T02:58:00.248+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:58:00.248745339Z [2024-02-24T02:58:00.248+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:58:00.518059713Z [2024-02-24T02:58:00.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:56:00+00:00 exited with status queued for try_number 1 2024-02-24T02:58:00.518257394Z [2024-02-24T02:58:00.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:57:00+00:00 exited with status queued for try_number 1 2024-02-24T02:58:00.518496546Z [2024-02-24T02:58:00.518+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:57:00+00:00 exited with status queued for try_number 1 2024-02-24T02:58:00.518647386Z [2024-02-24T02:58:00.518+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:57:00+00:00 exited with status queued for try_number 1 2024-02-24T02:58:00.528167176Z [2024-02-24T02:58:00.527+0000] {scheduler_job.py:635} INFO - Setting external_id for to abdbca2f-bb1b-4f1b-b06e-79d6e8734477 2024-02-24T02:58:00.528376339Z [2024-02-24T02:58:00.528+0000] {scheduler_job.py:635} INFO - Setting external_id for to f1614b17-9905-4dc0-95ce-9c41f3bae042 2024-02-24T02:58:00.528559845Z [2024-02-24T02:58:00.528+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba6fb015-a566-4723-883c-020f879887e9 2024-02-24T02:58:00.529251660Z [2024-02-24T02:58:00.528+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5e68ee1-e0ee-490b-963d-745c66e50b81 2024-02-24T02:58:01.700725746Z [2024-02-24T02:58:01.700+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:58:01.701633446Z [2024-02-24T02:58:01.701+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 02:56:00+00:00, run_id=scheduled__2024-02-24T02:56:00+00:00, run_start_date=2024-02-24 02:58:00.143732+00:00, run_end_date=2024-02-24 02:58:01.700867+00:00, run_duration=1.557135, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:56:00+00:00, data_interval_end=2024-02-24 02:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T02:58:01.716839592Z [2024-02-24T02:58:01.716+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T02:58:00+00:00, run_after=2024-02-24T03:00:00+00:00 2024-02-24T02:58:01.727878523Z [2024-02-24T02:58:01.727+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:58:01.728360985Z [2024-02-24T02:58:01.728+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:57:00+00:00, run_id=scheduled__2024-02-24T02:57:00+00:00, run_start_date=2024-02-24 02:58:00.144903+00:00, run_end_date=2024-02-24 02:58:01.727929+00:00, run_duration=1.583026, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:57:00+00:00, data_interval_end=2024-02-24 02:58:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:58:01.746104242Z [2024-02-24T02:58:01.745+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:58:00+00:00, run_after=2024-02-24T02:59:00+00:00 2024-02-24T02:58:01.833076508Z [2024-02-24T02:58:01.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:56:00+00:00 exited with status success for try_number 1 2024-02-24T02:58:01.833678143Z [2024-02-24T02:58:01.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:57:00+00:00 exited with status success for try_number 1 2024-02-24T02:58:01.847106706Z [2024-02-24T02:58:01.846+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:57:00+00:00, map_index=-1, run_start_date=2024-02-24 02:58:01.092722+00:00, run_end_date=2024-02-24 02:58:01.575480+00:00, run_duration=0.482758, state=success, executor_state=success, try_number=1, max_tries=1, job_id=914, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:58:00.240731+00:00, queued_by_job_id=2, pid=13362 2024-02-24T02:58:01.847539382Z [2024-02-24T02:58:01.847+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T02:56:00+00:00, map_index=-1, run_start_date=2024-02-24 02:58:01.118993+00:00, run_end_date=2024-02-24 02:58:01.531416+00:00, run_duration=0.412423, state=success, executor_state=success, try_number=1, max_tries=1, job_id=915, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:58:00.240731+00:00, queued_by_job_id=2, pid=13363 2024-02-24T02:58:04.039304979Z [2024-02-24T02:58:04.038+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:58:04.039448762Z [2024-02-24T02:58:04.039+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:57:00+00:00, run_id=scheduled__2024-02-24T02:57:00+00:00, run_start_date=2024-02-24 02:58:00.146134+00:00, run_end_date=2024-02-24 02:58:04.039150+00:00, run_duration=3.893016, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:57:00+00:00, data_interval_end=2024-02-24 02:58:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:58:04.051105560Z [2024-02-24T02:58:04.050+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:58:00+00:00, run_after=2024-02-24T02:59:00+00:00 2024-02-24T02:58:04.100254651Z [2024-02-24T02:58:04.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:57:00+00:00 exited with status success for try_number 1 2024-02-24T02:58:04.109725167Z [2024-02-24T02:58:04.109+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:57:00+00:00, map_index=-1, run_start_date=2024-02-24 02:58:02.493845+00:00, run_end_date=2024-02-24 02:58:03.868699+00:00, run_duration=1.374854, state=success, executor_state=success, try_number=1, max_tries=1, job_id=917, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:58:00.240731+00:00, queued_by_job_id=2, pid=13387 2024-02-24T02:58:05.163841063Z [2024-02-24T02:58:05.163+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:58:05.164321376Z [2024-02-24T02:58:05.164+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:57:00+00:00, run_id=scheduled__2024-02-24T02:57:00+00:00, run_start_date=2024-02-24 02:58:00.147185+00:00, run_end_date=2024-02-24 02:58:05.163960+00:00, run_duration=5.016775, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:57:00+00:00, data_interval_end=2024-02-24 02:58:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:58:05.174072271Z [2024-02-24T02:58:05.173+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:58:00+00:00, run_after=2024-02-24T02:59:00+00:00 2024-02-24T02:58:05.215499538Z [2024-02-24T02:58:05.215+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:57:00+00:00 exited with status success for try_number 1 2024-02-24T02:58:05.223996581Z [2024-02-24T02:58:05.223+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:57:00+00:00, map_index=-1, run_start_date=2024-02-24 02:58:02.432291+00:00, run_end_date=2024-02-24 02:58:04.258526+00:00, run_duration=1.826235, state=success, executor_state=success, try_number=1, max_tries=1, job_id=916, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:58:00.240731+00:00, queued_by_job_id=2, pid=13386 2024-02-24T02:59:00.493166920Z [2024-02-24T02:59:00.492+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:59:00+00:00, run_after=2024-02-24T03:00:00+00:00 2024-02-24T02:59:00.506122028Z [2024-02-24T02:59:00.505+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:59:00+00:00, run_after=2024-02-24T03:00:00+00:00 2024-02-24T02:59:00.513250559Z [2024-02-24T02:59:00.512+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T02:59:00.587125420Z [2024-02-24T02:59:00.586+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T02:59:00.587176708Z 2024-02-24T02:59:00.587187398Z 2024-02-24T02:59:00.587196234Z 2024-02-24T02:59:00.587291576Z [2024-02-24T02:59:00.587+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:59:00.587509926Z [2024-02-24T02:59:00.587+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T02:59:00.587705378Z [2024-02-24T02:59:00.587+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T02:59:00.588452608Z [2024-02-24T02:59:00.588+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T02:59:00.588463357Z 2024-02-24T02:59:00.588469226Z 2024-02-24T02:59:00.588474910Z 2024-02-24T02:59:00.594232587Z [2024-02-24T02:59:00.593+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:59:00.594584639Z [2024-02-24T02:59:00.594+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T02:59:00.594964346Z [2024-02-24T02:59:00.594+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:59:00.595124462Z [2024-02-24T02:59:00.594+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T02:59:00.595410816Z [2024-02-24T02:59:00.595+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T02:59:00.595583433Z [2024-02-24T02:59:00.595+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T02:59:00.808020756Z [2024-02-24T02:59:00.807+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:58:00+00:00 exited with status queued for try_number 1 2024-02-24T02:59:00.810278863Z [2024-02-24T02:59:00.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:58:00+00:00 exited with status queued for try_number 1 2024-02-24T02:59:00.810494234Z [2024-02-24T02:59:00.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:58:00+00:00 exited with status queued for try_number 1 2024-02-24T02:59:00.818227082Z [2024-02-24T02:59:00.817+0000] {scheduler_job.py:635} INFO - Setting external_id for to 074e122d-7814-41b9-9480-8044cadbf778 2024-02-24T02:59:00.818500741Z [2024-02-24T02:59:00.818+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8df0677f-8551-4cfd-82e4-c64d1bd49f77 2024-02-24T02:59:00.818744779Z [2024-02-24T02:59:00.818+0000] {scheduler_job.py:635} INFO - Setting external_id for to 240e4671-2480-4c39-a00a-8394014815e6 2024-02-24T02:59:02.013247899Z [2024-02-24T02:59:02.012+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:59:02.013973813Z [2024-02-24T02:59:02.013+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:58:00+00:00, run_id=scheduled__2024-02-24T02:58:00+00:00, run_start_date=2024-02-24 02:59:00.526456+00:00, run_end_date=2024-02-24 02:59:02.013355+00:00, run_duration=1.486899, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:58:00+00:00, data_interval_end=2024-02-24 02:59:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T02:59:02.030981616Z [2024-02-24T02:59:02.030+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T02:59:00+00:00, run_after=2024-02-24T03:00:00+00:00 2024-02-24T02:59:02.097441574Z [2024-02-24T02:59:02.094+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:58:00+00:00 exited with status success for try_number 1 2024-02-24T02:59:02.108819228Z [2024-02-24T02:59:02.108+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:58:00+00:00, map_index=-1, run_start_date=2024-02-24 02:59:01.383689+00:00, run_end_date=2024-02-24 02:59:01.776050+00:00, run_duration=0.392361, state=success, executor_state=success, try_number=1, max_tries=1, job_id=918, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:59:00.589454+00:00, queued_by_job_id=2, pid=13419 2024-02-24T02:59:04.005424604Z [2024-02-24T02:59:04.004+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:59:04.006053490Z [2024-02-24T02:59:04.005+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:58:00+00:00, run_id=scheduled__2024-02-24T02:58:00+00:00, run_start_date=2024-02-24 02:59:00.527829+00:00, run_end_date=2024-02-24 02:59:04.005619+00:00, run_duration=3.47779, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:58:00+00:00, data_interval_end=2024-02-24 02:59:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T02:59:04.017061341Z [2024-02-24T02:59:04.016+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:59:00+00:00, run_after=2024-02-24T03:00:00+00:00 2024-02-24T02:59:05.133324729Z [2024-02-24T02:59:05.132+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T02:59:05.133863093Z [2024-02-24T02:59:05.133+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:58:00+00:00, run_id=scheduled__2024-02-24T02:58:00+00:00, run_start_date=2024-02-24 02:59:00.529010+00:00, run_end_date=2024-02-24 02:59:05.133249+00:00, run_duration=4.604239, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:58:00+00:00, data_interval_end=2024-02-24 02:59:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T02:59:05.143340330Z [2024-02-24T02:59:05.142+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T02:59:00+00:00, run_after=2024-02-24T03:00:00+00:00 2024-02-24T02:59:05.180244146Z [2024-02-24T02:59:05.179+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:58:00+00:00 exited with status success for try_number 1 2024-02-24T02:59:05.180272043Z [2024-02-24T02:59:05.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:58:00+00:00 exited with status success for try_number 1 2024-02-24T02:59:05.186640682Z [2024-02-24T02:59:05.186+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:58:00+00:00, map_index=-1, run_start_date=2024-02-24 02:59:02.582249+00:00, run_end_date=2024-02-24 02:59:03.948878+00:00, run_duration=1.366629, state=success, executor_state=success, try_number=1, max_tries=1, job_id=920, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:59:00.589454+00:00, queued_by_job_id=2, pid=13438 2024-02-24T02:59:05.186758338Z [2024-02-24T02:59:05.186+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:58:00+00:00, map_index=-1, run_start_date=2024-02-24 02:59:02.560444+00:00, run_end_date=2024-02-24 02:59:04.214581+00:00, run_duration=1.654137, state=success, executor_state=success, try_number=1, max_tries=1, job_id=919, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 02:59:00.589454+00:00, queued_by_job_id=2, pid=13437 2024-02-24T03:00:00.912841434Z [2024-02-24T03:00:00.912+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:00:00.920159463Z [2024-02-24T03:00:00.919+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:00:00.933119804Z [2024-02-24T03:00:00.932+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:00:00+00:00, run_after=2024-02-24T03:01:00+00:00 2024-02-24T03:00:00.945563795Z [2024-02-24T03:00:00.945+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:00:00+00:00, run_after=2024-02-24T03:05:00+00:00 2024-02-24T03:00:00.959428984Z [2024-02-24T03:00:00.959+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:00:00+00:00, run_after=2024-02-24T03:01:00+00:00 2024-02-24T03:00:01.052897354Z [2024-02-24T03:00:01.052+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-02-24T03:00:01.052926763Z 2024-02-24T03:00:01.052930394Z 2024-02-24T03:00:01.052934186Z 2024-02-24T03:00:01.052937595Z 2024-02-24T03:00:01.052940830Z 2024-02-24T03:00:01.053175656Z [2024-02-24T03:00:01.052+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:00:01.053515306Z [2024-02-24T03:00:01.053+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T03:00:01.054111841Z [2024-02-24T03:00:01.053+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:00:01.054627989Z [2024-02-24T03:00:01.054+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:00:01.055175144Z [2024-02-24T03:00:01.054+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:00:01.058536488Z [2024-02-24T03:00:01.058+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:00:01.058560833Z 2024-02-24T03:00:01.058565778Z 2024-02-24T03:00:01.058570463Z 2024-02-24T03:00:01.058574562Z 2024-02-24T03:00:01.058578554Z 2024-02-24T03:00:01.065342924Z [2024-02-24T03:00:01.064+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T03:00:01.065703985Z [2024-02-24T03:00:01.065+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T03:00:01.066076808Z [2024-02-24T03:00:01.065+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:00:01.066261453Z [2024-02-24T03:00:01.066+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T03:00:01.066559200Z [2024-02-24T03:00:01.066+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:00:01.066732531Z [2024-02-24T03:00:01.066+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:00:01.067281754Z [2024-02-24T03:00:01.066+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:00:01.067290607Z [2024-02-24T03:00:01.067+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:00:01.067537914Z [2024-02-24T03:00:01.067+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T02:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:00:01.067709329Z [2024-02-24T03:00:01.067+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:00:01.662008332Z [2024-02-24T03:00:01.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T02:55:00+00:00 exited with status queued for try_number 1 2024-02-24T03:00:01.664243289Z [2024-02-24T03:00:01.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:58:00+00:00 exited with status queued for try_number 1 2024-02-24T03:00:01.664461157Z [2024-02-24T03:00:01.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:59:00+00:00 exited with status queued for try_number 1 2024-02-24T03:00:01.664641676Z [2024-02-24T03:00:01.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:59:00+00:00 exited with status queued for try_number 1 2024-02-24T03:00:01.664809702Z [2024-02-24T03:00:01.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:59:00+00:00 exited with status queued for try_number 1 2024-02-24T03:00:01.692561708Z [2024-02-24T03:00:01.692+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d838799-4d1e-4b3d-b0d0-8a8c3b1cd803 2024-02-24T03:00:01.692632604Z [2024-02-24T03:00:01.692+0000] {scheduler_job.py:635} INFO - Setting external_id for to b11e03b6-cde2-434e-b809-cb052f344f96 2024-02-24T03:00:01.692699725Z [2024-02-24T03:00:01.692+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9015d9bd-dde0-49b0-8880-df2c918eaa2f 2024-02-24T03:00:01.692831728Z [2024-02-24T03:00:01.692+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15d2ff8e-4aa6-485f-86e4-de31465763af 2024-02-24T03:00:01.692924823Z [2024-02-24T03:00:01.692+0000] {scheduler_job.py:635} INFO - Setting external_id for to a9d73144-6009-4903-8923-bd7ee7d69fdd 2024-02-24T03:00:04.204568118Z [2024-02-24T03:00:04.204+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:00:04.204937807Z [2024-02-24T03:00:04.204+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 02:59:00+00:00, run_id=scheduled__2024-02-24T02:59:00+00:00, run_start_date=2024-02-24 03:00:00.977817+00:00, run_end_date=2024-02-24 03:00:04.204558+00:00, run_duration=3.226741, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:59:00+00:00, data_interval_end=2024-02-24 03:00:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:00:04.215009769Z [2024-02-24T03:00:04.214+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:00:00+00:00, run_after=2024-02-24T03:01:00+00:00 2024-02-24T03:00:04.234238214Z [2024-02-24T03:00:04.233+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:00:04.234611090Z [2024-02-24T03:00:04.234+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 02:58:00+00:00, run_id=scheduled__2024-02-24T02:58:00+00:00, run_start_date=2024-02-24 03:00:00.976549+00:00, run_end_date=2024-02-24 03:00:04.234241+00:00, run_duration=3.257692, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:58:00+00:00, data_interval_end=2024-02-24 03:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T03:00:04.244022748Z [2024-02-24T03:00:04.243+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T03:00:00+00:00, run_after=2024-02-24T03:02:00+00:00 2024-02-24T03:00:04.312258882Z [2024-02-24T03:00:04.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T02:58:00+00:00 exited with status success for try_number 1 2024-02-24T03:00:04.312290112Z [2024-02-24T03:00:04.311+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:59:00+00:00 exited with status success for try_number 1 2024-02-24T03:00:04.322640474Z [2024-02-24T03:00:04.322+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T02:58:00+00:00, map_index=-1, run_start_date=2024-02-24 03:00:02.488874+00:00, run_end_date=2024-02-24 03:00:03.044761+00:00, run_duration=0.555887, state=success, executor_state=success, try_number=1, max_tries=1, job_id=922, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:00:01.060573+00:00, queued_by_job_id=2, pid=13473 2024-02-24T03:00:04.323255469Z [2024-02-24T03:00:04.322+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:59:00+00:00, map_index=-1, run_start_date=2024-02-24 03:00:02.243763+00:00, run_end_date=2024-02-24 03:00:03.123698+00:00, run_duration=0.879935, state=success, executor_state=success, try_number=1, max_tries=1, job_id=921, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:00:01.060573+00:00, queued_by_job_id=2, pid=13471 2024-02-24T03:00:04.988507969Z [2024-02-24T03:00:04.987+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:00:04.988554089Z 2024-02-24T03:00:04.989249662Z [2024-02-24T03:00:04.988+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:00:04.990699241Z [2024-02-24T03:00:04.990+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:00:04.990722550Z 2024-02-24T03:00:04.995399810Z [2024-02-24T03:00:04.994+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T03:00:04.995887640Z [2024-02-24T03:00:04.995+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T03:00:05.049680819Z [2024-02-24T03:00:05.049+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T02:55:00+00:00 exited with status queued for try_number 1 2024-02-24T03:00:05.050001570Z [2024-02-24T03:00:05.049+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T02:55:00+00:00 exited with status success for try_number 1 2024-02-24T03:00:05.055772934Z [2024-02-24T03:00:05.055+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0035d6ff-87a9-41e5-b391-3756db174745 2024-02-24T03:00:05.056103905Z [2024-02-24T03:00:05.055+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T02:55:00+00:00, map_index=-1, run_start_date=2024-02-24 03:00:03.899179+00:00, run_end_date=2024-02-24 03:00:04.312217+00:00, run_duration=0.413038, state=success, executor_state=success, try_number=1, max_tries=1, job_id=924, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:00:01.060573+00:00, queued_by_job_id=2, pid=13502 2024-02-24T03:00:06.235048402Z [2024-02-24T03:00:06.234+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:00:06.235379159Z [2024-02-24T03:00:06.235+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:59:00+00:00, run_id=scheduled__2024-02-24T02:59:00+00:00, run_start_date=2024-02-24 03:00:00.978992+00:00, run_end_date=2024-02-24 03:00:06.234996+00:00, run_duration=5.256004, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:59:00+00:00, data_interval_end=2024-02-24 03:00:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:00:06.246720500Z [2024-02-24T03:00:06.246+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:00:00+00:00, run_after=2024-02-24T03:01:00+00:00 2024-02-24T03:00:06.253810374Z [2024-02-24T03:00:06.253+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:00:06.254076032Z [2024-02-24T03:00:06.253+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:59:00+00:00, run_id=scheduled__2024-02-24T02:59:00+00:00, run_start_date=2024-02-24 03:00:00.980044+00:00, run_end_date=2024-02-24 03:00:06.253677+00:00, run_duration=5.273633, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:59:00+00:00, data_interval_end=2024-02-24 03:00:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:00:06.263648926Z [2024-02-24T03:00:06.263+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:00:00+00:00, run_after=2024-02-24T03:01:00+00:00 2024-02-24T03:00:06.319817367Z [2024-02-24T03:00:06.319+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:59:00+00:00 exited with status success for try_number 1 2024-02-24T03:00:06.320285915Z [2024-02-24T03:00:06.319+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T02:59:00+00:00 exited with status success for try_number 1 2024-02-24T03:00:06.331166484Z [2024-02-24T03:00:06.330+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:59:00+00:00, map_index=-1, run_start_date=2024-02-24 03:00:03.944677+00:00, run_end_date=2024-02-24 03:00:05.422037+00:00, run_duration=1.47736, state=success, executor_state=success, try_number=1, max_tries=1, job_id=925, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:00:01.060573+00:00, queued_by_job_id=2, pid=13503 2024-02-24T03:00:06.331594026Z [2024-02-24T03:00:06.331+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T02:59:00+00:00, map_index=-1, run_start_date=2024-02-24 03:00:03.641700+00:00, run_end_date=2024-02-24 03:00:06.059637+00:00, run_duration=2.417937, state=success, executor_state=success, try_number=1, max_tries=1, job_id=923, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:00:01.060573+00:00, queued_by_job_id=2, pid=13491 2024-02-24T03:00:07.400790122Z [2024-02-24T03:00:07.400+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:00:07.400847345Z 2024-02-24T03:00:07.401048104Z [2024-02-24T03:00:07.400+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:00:07.401755503Z [2024-02-24T03:00:07.401+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:00:07.401782299Z 2024-02-24T03:00:07.404545854Z [2024-02-24T03:00:07.404+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T02:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T03:00:07.404783894Z [2024-02-24T03:00:07.404+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T03:00:07.456938668Z [2024-02-24T03:00:07.456+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T02:55:00+00:00 exited with status queued for try_number 1 2024-02-24T03:00:07.457144444Z [2024-02-24T03:00:07.456+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T02:55:00+00:00 exited with status success for try_number 1 2024-02-24T03:00:07.464984025Z [2024-02-24T03:00:07.464+0000] {scheduler_job.py:635} INFO - Setting external_id for to b69ecde2-7d72-447c-a029-f5990c731262 2024-02-24T03:00:07.465372045Z [2024-02-24T03:00:07.465+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T02:55:00+00:00, map_index=-1, run_start_date=2024-02-24 03:00:06.608522+00:00, run_end_date=2024-02-24 03:00:06.959033+00:00, run_duration=0.350511, state=success, executor_state=success, try_number=1, max_tries=1, job_id=926, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:00:04.991492+00:00, queued_by_job_id=2, pid=13526 2024-02-24T03:00:09.719291858Z [2024-02-24T03:00:09.718+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:00:09.719331566Z 2024-02-24T03:00:09.719771519Z [2024-02-24T03:00:09.719+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:00:09.720516300Z [2024-02-24T03:00:09.720+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:00:09.720552416Z 2024-02-24T03:00:09.723065506Z [2024-02-24T03:00:09.722+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:00:09.723297201Z [2024-02-24T03:00:09.722+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T03:00:09.797602129Z [2024-02-24T03:00:09.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T02:55:00+00:00 exited with status queued for try_number 1 2024-02-24T03:00:09.797649356Z [2024-02-24T03:00:09.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T02:55:00+00:00 exited with status success for try_number 1 2024-02-24T03:00:09.804739042Z [2024-02-24T03:00:09.804+0000] {scheduler_job.py:635} INFO - Setting external_id for to 38f1cf53-cfd1-46a7-9c3f-198ea9380098 2024-02-24T03:00:09.804880795Z [2024-02-24T03:00:09.804+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T02:55:00+00:00, map_index=0, run_start_date=2024-02-24 03:00:09.052393+00:00, run_end_date=2024-02-24 03:00:09.434182+00:00, run_duration=0.381789, state=success, executor_state=success, try_number=1, max_tries=1, job_id=927, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:00:07.402190+00:00, queued_by_job_id=2, pid=13534 2024-02-24T03:00:12.349431042Z [2024-02-24T03:00:12.348+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:00:12.350475180Z [2024-02-24T03:00:12.350+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 02:55:00+00:00, run_id=scheduled__2024-02-24T02:55:00+00:00, run_start_date=2024-02-24 03:00:00.975057+00:00, run_end_date=2024-02-24 03:00:12.349934+00:00, run_duration=11.374877, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 02:55:00+00:00, data_interval_end=2024-02-24 03:00:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T03:00:12.368345256Z [2024-02-24T03:00:12.367+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:00:00+00:00, run_after=2024-02-24T03:05:00+00:00 2024-02-24T03:00:12.410541475Z [2024-02-24T03:00:12.408+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T02:55:00+00:00 exited with status success for try_number 1 2024-02-24T03:00:12.414308486Z [2024-02-24T03:00:12.413+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T02:55:00+00:00, map_index=-1, run_start_date=2024-02-24 03:00:11.398778+00:00, run_end_date=2024-02-24 03:00:11.782079+00:00, run_duration=0.383301, state=success, executor_state=success, try_number=1, max_tries=1, job_id=928, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:00:09.721033+00:00, queued_by_job_id=2, pid=13542 2024-02-24T03:01:00.038132395Z [2024-02-24T03:01:00.037+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:01:00+00:00, run_after=2024-02-24T03:02:00+00:00 2024-02-24T03:01:00.051047458Z [2024-02-24T03:01:00.050+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:01:00+00:00, run_after=2024-02-24T03:02:00+00:00 2024-02-24T03:01:00.059136452Z [2024-02-24T03:01:00.058+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:01:00.148082415Z [2024-02-24T03:01:00.147+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T03:01:00.148108972Z 2024-02-24T03:01:00.148115706Z 2024-02-24T03:01:00.148121328Z 2024-02-24T03:01:00.148366876Z [2024-02-24T03:01:00.148+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:01:00.148713602Z [2024-02-24T03:01:00.148+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:01:00.149010261Z [2024-02-24T03:01:00.148+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:01:00.150085018Z [2024-02-24T03:01:00.149+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:01:00.150099095Z 2024-02-24T03:01:00.150104666Z 2024-02-24T03:01:00.150110072Z 2024-02-24T03:01:00.155094580Z [2024-02-24T03:01:00.154+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:01:00.155299816Z [2024-02-24T03:01:00.154+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:01:00.155773298Z [2024-02-24T03:01:00.155+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:01:00.156007944Z [2024-02-24T03:01:00.155+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:01:00.156372363Z [2024-02-24T03:01:00.156+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:01:00.156713759Z [2024-02-24T03:01:00.156+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:01:00.671065667Z [2024-02-24T03:01:00.670+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:00:00+00:00 exited with status queued for try_number 1 2024-02-24T03:01:00.671128799Z [2024-02-24T03:01:00.670+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:00:00+00:00 exited with status queued for try_number 1 2024-02-24T03:01:00.671246626Z [2024-02-24T03:01:00.671+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:00:00+00:00 exited with status queued for try_number 1 2024-02-24T03:01:00.691961688Z [2024-02-24T03:01:00.690+0000] {scheduler_job.py:635} INFO - Setting external_id for to ec7d74a7-76ee-48b0-8863-877bba1de2f1 2024-02-24T03:01:00.691984007Z [2024-02-24T03:01:00.691+0000] {scheduler_job.py:635} INFO - Setting external_id for to f5a922f0-51e2-4f84-b922-83bb966ba6e1 2024-02-24T03:01:00.691987583Z [2024-02-24T03:01:00.691+0000] {scheduler_job.py:635} INFO - Setting external_id for to 89447d3f-58c7-4d33-9493-dfcbbfdd7a3c 2024-02-24T03:01:03.054418479Z [2024-02-24T03:01:03.053+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:01:03.054713058Z [2024-02-24T03:01:03.054+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:00:00+00:00, run_id=scheduled__2024-02-24T03:00:00+00:00, run_start_date=2024-02-24 03:01:00.067946+00:00, run_end_date=2024-02-24 03:01:03.054242+00:00, run_duration=2.986296, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:00:00+00:00, data_interval_end=2024-02-24 03:01:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:01:03.065316561Z [2024-02-24T03:01:03.064+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:01:00+00:00, run_after=2024-02-24T03:02:00+00:00 2024-02-24T03:01:03.131922203Z [2024-02-24T03:01:03.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:00:00+00:00 exited with status success for try_number 1 2024-02-24T03:01:03.138571092Z [2024-02-24T03:01:03.138+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:00:00+00:00, map_index=-1, run_start_date=2024-02-24 03:01:01.240644+00:00, run_end_date=2024-02-24 03:01:01.811420+00:00, run_duration=0.570776, state=success, executor_state=success, try_number=1, max_tries=1, job_id=929, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:01:00.151638+00:00, queued_by_job_id=2, pid=13564 2024-02-24T03:01:04.459531063Z [2024-02-24T03:01:04.459+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:01:04.459696920Z [2024-02-24T03:01:04.459+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:00:00+00:00, run_id=scheduled__2024-02-24T03:00:00+00:00, run_start_date=2024-02-24 03:01:00.069137+00:00, run_end_date=2024-02-24 03:01:04.459425+00:00, run_duration=4.390288, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:00:00+00:00, data_interval_end=2024-02-24 03:01:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:01:04.469974072Z [2024-02-24T03:01:04.469+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:01:00+00:00, run_after=2024-02-24T03:02:00+00:00 2024-02-24T03:01:04.478162676Z [2024-02-24T03:01:04.477+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:01:04.478231075Z [2024-02-24T03:01:04.478+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:00:00+00:00, run_id=scheduled__2024-02-24T03:00:00+00:00, run_start_date=2024-02-24 03:01:00.070347+00:00, run_end_date=2024-02-24 03:01:04.478021+00:00, run_duration=4.407674, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:00:00+00:00, data_interval_end=2024-02-24 03:01:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:01:04.497324648Z [2024-02-24T03:01:04.496+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:01:00+00:00, run_after=2024-02-24T03:02:00+00:00 2024-02-24T03:01:04.536938516Z [2024-02-24T03:01:04.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:00:00+00:00 exited with status success for try_number 1 2024-02-24T03:01:04.537032463Z [2024-02-24T03:01:04.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:00:00+00:00 exited with status success for try_number 1 2024-02-24T03:01:04.543763299Z [2024-02-24T03:01:04.543+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:00:00+00:00, map_index=-1, run_start_date=2024-02-24 03:01:02.215682+00:00, run_end_date=2024-02-24 03:01:03.949986+00:00, run_duration=1.734304, state=success, executor_state=success, try_number=1, max_tries=1, job_id=930, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:01:00.151638+00:00, queued_by_job_id=2, pid=13582 2024-02-24T03:01:04.543935683Z [2024-02-24T03:01:04.543+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:00:00+00:00, map_index=-1, run_start_date=2024-02-24 03:01:02.278712+00:00, run_end_date=2024-02-24 03:01:03.701060+00:00, run_duration=1.422348, state=success, executor_state=success, try_number=1, max_tries=1, job_id=931, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:01:00.151638+00:00, queued_by_job_id=2, pid=13583 2024-02-24T03:02:00.865910905Z [2024-02-24T03:02:00.865+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:02:00+00:00, run_after=2024-02-24T03:03:00+00:00 2024-02-24T03:02:00.884851293Z [2024-02-24T03:02:00.884+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:02:00.905190826Z [2024-02-24T03:02:00.904+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:02:00+00:00, run_after=2024-02-24T03:03:00+00:00 2024-02-24T03:02:00.917221215Z [2024-02-24T03:02:00.916+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:02:01.053111373Z [2024-02-24T03:02:01.052+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T03:02:01.053134069Z 2024-02-24T03:02:01.053138076Z 2024-02-24T03:02:01.053141373Z 2024-02-24T03:02:01.053178294Z 2024-02-24T03:02:01.053274772Z [2024-02-24T03:02:01.053+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T03:02:01.053484499Z [2024-02-24T03:02:01.053+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:02:01.053602779Z [2024-02-24T03:02:01.053+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:02:01.053816734Z [2024-02-24T03:02:01.053+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:02:01.054524753Z [2024-02-24T03:02:01.054+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:02:01.054536960Z 2024-02-24T03:02:01.054541351Z 2024-02-24T03:02:01.054549412Z 2024-02-24T03:02:01.054553227Z 2024-02-24T03:02:01.059427770Z [2024-02-24T03:02:01.059+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:02:01.059650995Z [2024-02-24T03:02:01.059+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T03:02:01.059975643Z [2024-02-24T03:02:01.059+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:02:01.060264715Z [2024-02-24T03:02:01.059+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:02:01.063065431Z [2024-02-24T03:02:01.061+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:02:01.063299944Z [2024-02-24T03:02:01.063+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:02:01.063668910Z [2024-02-24T03:02:01.063+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:02:01.063830673Z [2024-02-24T03:02:01.063+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:02:01.646652102Z [2024-02-24T03:02:01.645+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:00:00+00:00 exited with status queued for try_number 1 2024-02-24T03:02:01.649669408Z [2024-02-24T03:02:01.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:01:00+00:00 exited with status queued for try_number 1 2024-02-24T03:02:01.649931752Z [2024-02-24T03:02:01.649+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:01:00+00:00 exited with status queued for try_number 1 2024-02-24T03:02:01.650029485Z [2024-02-24T03:02:01.649+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:01:00+00:00 exited with status queued for try_number 1 2024-02-24T03:02:01.665308482Z [2024-02-24T03:02:01.664+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e0100c8-326d-4faf-8edc-7eefcd517bdd 2024-02-24T03:02:01.665742187Z [2024-02-24T03:02:01.665+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a4cf202-35be-4b94-a975-2f9153513a7b 2024-02-24T03:02:01.667900651Z [2024-02-24T03:02:01.667+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17b12bf9-006b-44fe-b2fe-6de365a6a19d 2024-02-24T03:02:01.669282780Z [2024-02-24T03:02:01.667+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a2f8976-db24-4b11-aa55-d044cf68c5fc 2024-02-24T03:02:02.948309657Z [2024-02-24T03:02:02.947+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:02:02.950775173Z [2024-02-24T03:02:02.950+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 03:00:00+00:00, run_id=scheduled__2024-02-24T03:00:00+00:00, run_start_date=2024-02-24 03:02:00.933919+00:00, run_end_date=2024-02-24 03:02:02.948248+00:00, run_duration=2.014329, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:00:00+00:00, data_interval_end=2024-02-24 03:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T03:02:02.967200501Z [2024-02-24T03:02:02.966+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T03:02:00+00:00, run_after=2024-02-24T03:04:00+00:00 2024-02-24T03:02:03.729149139Z [2024-02-24T03:02:03.728+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:02:03.729930978Z [2024-02-24T03:02:03.729+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:01:00+00:00, run_id=scheduled__2024-02-24T03:01:00+00:00, run_start_date=2024-02-24 03:02:00.936123+00:00, run_end_date=2024-02-24 03:02:03.729240+00:00, run_duration=2.793117, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:01:00+00:00, data_interval_end=2024-02-24 03:02:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:02:03.745111962Z [2024-02-24T03:02:03.744+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:02:00+00:00, run_after=2024-02-24T03:03:00+00:00 2024-02-24T03:02:03.817285370Z [2024-02-24T03:02:03.816+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:00:00+00:00 exited with status success for try_number 1 2024-02-24T03:02:03.820110892Z [2024-02-24T03:02:03.817+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:01:00+00:00 exited with status success for try_number 1 2024-02-24T03:02:03.829032472Z [2024-02-24T03:02:03.828+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:01:00+00:00, map_index=-1, run_start_date=2024-02-24 03:02:02.353289+00:00, run_end_date=2024-02-24 03:02:02.980067+00:00, run_duration=0.626778, state=success, executor_state=success, try_number=1, max_tries=1, job_id=933, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:02:01.055524+00:00, queued_by_job_id=2, pid=13617 2024-02-24T03:02:03.830724269Z [2024-02-24T03:02:03.829+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T03:00:00+00:00, map_index=-1, run_start_date=2024-02-24 03:02:02.287396+00:00, run_end_date=2024-02-24 03:02:02.882086+00:00, run_duration=0.59469, state=success, executor_state=success, try_number=1, max_tries=1, job_id=932, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:02:01.055524+00:00, queued_by_job_id=2, pid=13616 2024-02-24T03:02:04.999944227Z [2024-02-24T03:02:04.999+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T03:02:06.055913042Z [2024-02-24T03:02:06.055+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:02:06.056423747Z [2024-02-24T03:02:06.056+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:01:00+00:00, run_id=scheduled__2024-02-24T03:01:00+00:00, run_start_date=2024-02-24 03:02:00.938394+00:00, run_end_date=2024-02-24 03:02:06.056005+00:00, run_duration=5.117611, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:01:00+00:00, data_interval_end=2024-02-24 03:02:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:02:06.071274819Z [2024-02-24T03:02:06.070+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:02:00+00:00, run_after=2024-02-24T03:03:00+00:00 2024-02-24T03:02:06.136590164Z [2024-02-24T03:02:06.135+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:01:00+00:00 exited with status success for try_number 1 2024-02-24T03:02:06.145297508Z [2024-02-24T03:02:06.144+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:01:00+00:00, map_index=-1, run_start_date=2024-02-24 03:02:03.711777+00:00, run_end_date=2024-02-24 03:02:05.834655+00:00, run_duration=2.122878, state=success, executor_state=success, try_number=1, max_tries=1, job_id=934, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:02:01.055524+00:00, queued_by_job_id=2, pid=13640 2024-02-24T03:02:07.893014995Z [2024-02-24T03:02:07.892+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:02:07.893228163Z [2024-02-24T03:02:07.893+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:01:00+00:00, run_id=scheduled__2024-02-24T03:01:00+00:00, run_start_date=2024-02-24 03:02:00.940281+00:00, run_end_date=2024-02-24 03:02:07.892896+00:00, run_duration=6.952615, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:01:00+00:00, data_interval_end=2024-02-24 03:02:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:02:07.901430619Z [2024-02-24T03:02:07.901+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:02:00+00:00, run_after=2024-02-24T03:03:00+00:00 2024-02-24T03:02:07.929070626Z [2024-02-24T03:02:07.928+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:01:00+00:00 exited with status success for try_number 1 2024-02-24T03:02:07.933973979Z [2024-02-24T03:02:07.933+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:01:00+00:00, map_index=-1, run_start_date=2024-02-24 03:02:04.064049+00:00, run_end_date=2024-02-24 03:02:06.900261+00:00, run_duration=2.836212, state=success, executor_state=success, try_number=1, max_tries=1, job_id=935, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:02:01.055524+00:00, queued_by_job_id=2, pid=13641 2024-02-24T03:03:00.667390931Z [2024-02-24T03:03:00.666+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:03:00.679521749Z [2024-02-24T03:03:00.679+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:03:00+00:00, run_after=2024-02-24T03:04:00+00:00 2024-02-24T03:03:00.692203266Z [2024-02-24T03:03:00.691+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:03:00+00:00, run_after=2024-02-24T03:04:00+00:00 2024-02-24T03:03:00.774220860Z [2024-02-24T03:03:00.773+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T03:03:00.774271700Z 2024-02-24T03:03:00.774283258Z 2024-02-24T03:03:00.774292727Z 2024-02-24T03:03:00.774789642Z [2024-02-24T03:03:00.774+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:03:00.775288350Z [2024-02-24T03:03:00.774+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:03:00.775681713Z [2024-02-24T03:03:00.775+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:03:00.776872732Z [2024-02-24T03:03:00.776+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:03:00.776897211Z 2024-02-24T03:03:00.776906548Z 2024-02-24T03:03:00.776915169Z 2024-02-24T03:03:00.782213806Z [2024-02-24T03:03:00.781+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:03:00.782647750Z [2024-02-24T03:03:00.782+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:03:00.783268005Z [2024-02-24T03:03:00.783+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:03:00.783728391Z [2024-02-24T03:03:00.783+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:03:00.784354959Z [2024-02-24T03:03:00.784+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:03:00.784800392Z [2024-02-24T03:03:00.784+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:03:01.017934897Z [2024-02-24T03:03:01.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:02:00+00:00 exited with status queued for try_number 1 2024-02-24T03:03:01.018203761Z [2024-02-24T03:03:01.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:02:00+00:00 exited with status queued for try_number 1 2024-02-24T03:03:01.018356236Z [2024-02-24T03:03:01.018+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:02:00+00:00 exited with status queued for try_number 1 2024-02-24T03:03:01.026351356Z [2024-02-24T03:03:01.026+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad3aace4-57fb-493f-b343-49e18cd5ca29 2024-02-24T03:03:01.037144174Z [2024-02-24T03:03:01.026+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e7ea37e-4bad-4915-9b9e-f25e4c65a4fd 2024-02-24T03:03:01.037167225Z [2024-02-24T03:03:01.035+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ab35738-d1eb-48cc-b357-a9a4c3a3408d 2024-02-24T03:03:02.130951754Z [2024-02-24T03:03:02.130+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:03:02.131121792Z [2024-02-24T03:03:02.130+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:02:00+00:00, run_id=scheduled__2024-02-24T03:02:00+00:00, run_start_date=2024-02-24 03:03:00.702834+00:00, run_end_date=2024-02-24 03:03:02.130830+00:00, run_duration=1.427996, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:02:00+00:00, data_interval_end=2024-02-24 03:03:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:03:02.141730422Z [2024-02-24T03:03:02.141+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:03:00+00:00, run_after=2024-02-24T03:04:00+00:00 2024-02-24T03:03:02.214796918Z [2024-02-24T03:03:02.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:02:00+00:00 exited with status success for try_number 1 2024-02-24T03:03:02.222526449Z [2024-02-24T03:03:02.222+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:02:00+00:00, map_index=-1, run_start_date=2024-02-24 03:03:01.560926+00:00, run_end_date=2024-02-24 03:03:01.982583+00:00, run_duration=0.421657, state=success, executor_state=success, try_number=1, max_tries=1, job_id=936, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:03:00.778361+00:00, queued_by_job_id=2, pid=13672 2024-02-24T03:03:05.151708909Z [2024-02-24T03:03:05.151+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:03:05.152087753Z [2024-02-24T03:03:05.151+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:02:00+00:00, run_id=scheduled__2024-02-24T03:02:00+00:00, run_start_date=2024-02-24 03:03:00.707395+00:00, run_end_date=2024-02-24 03:03:05.151609+00:00, run_duration=4.444214, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:02:00+00:00, data_interval_end=2024-02-24 03:03:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:03:05.161816118Z [2024-02-24T03:03:05.161+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:03:00+00:00, run_after=2024-02-24T03:04:00+00:00 2024-02-24T03:03:05.168541495Z [2024-02-24T03:03:05.168+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:03:05.168691643Z [2024-02-24T03:03:05.168+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:02:00+00:00, run_id=scheduled__2024-02-24T03:02:00+00:00, run_start_date=2024-02-24 03:03:00.704857+00:00, run_end_date=2024-02-24 03:03:05.168441+00:00, run_duration=4.463584, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:02:00+00:00, data_interval_end=2024-02-24 03:03:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:03:05.178223269Z [2024-02-24T03:03:05.177+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:03:00+00:00, run_after=2024-02-24T03:04:00+00:00 2024-02-24T03:03:05.208346691Z [2024-02-24T03:03:05.207+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:02:00+00:00 exited with status success for try_number 1 2024-02-24T03:03:05.208408426Z [2024-02-24T03:03:05.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:02:00+00:00 exited with status success for try_number 1 2024-02-24T03:03:05.216482360Z [2024-02-24T03:03:05.216+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:02:00+00:00, map_index=-1, run_start_date=2024-02-24 03:03:02.936030+00:00, run_end_date=2024-02-24 03:03:04.560561+00:00, run_duration=1.624531, state=success, executor_state=success, try_number=1, max_tries=1, job_id=938, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:03:00.778361+00:00, queued_by_job_id=2, pid=13691 2024-02-24T03:03:05.216561002Z [2024-02-24T03:03:05.216+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:02:00+00:00, map_index=-1, run_start_date=2024-02-24 03:03:02.701380+00:00, run_end_date=2024-02-24 03:03:04.770975+00:00, run_duration=2.069595, state=success, executor_state=success, try_number=1, max_tries=1, job_id=937, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:03:00.778361+00:00, queued_by_job_id=2, pid=13690 2024-02-24T03:04:00.637251943Z [2024-02-24T03:04:00.636+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:04:00+00:00, run_after=2024-02-24T03:05:00+00:00 2024-02-24T03:04:00.644500119Z [2024-02-24T03:04:00.644+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:04:00.650619578Z [2024-02-24T03:04:00.650+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:04:00.662023522Z [2024-02-24T03:04:00.661+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:04:00+00:00, run_after=2024-02-24T03:05:00+00:00 2024-02-24T03:04:00.762776563Z [2024-02-24T03:04:00.762+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T03:04:00.762861074Z 2024-02-24T03:04:00.762872656Z 2024-02-24T03:04:00.762911554Z 2024-02-24T03:04:00.762918674Z 2024-02-24T03:04:00.762939041Z [2024-02-24T03:04:00.762+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T03:04:00.763193343Z [2024-02-24T03:04:00.763+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:04:00.763271305Z [2024-02-24T03:04:00.763+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:04:00.763429647Z [2024-02-24T03:04:00.763+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:04:00.764040025Z [2024-02-24T03:04:00.763+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:04:00.764056131Z 2024-02-24T03:04:00.764065126Z 2024-02-24T03:04:00.764147521Z 2024-02-24T03:04:00.764156430Z 2024-02-24T03:04:00.767500173Z [2024-02-24T03:04:00.767+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:04:00.767646965Z [2024-02-24T03:04:00.767+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T03:04:00.767946097Z [2024-02-24T03:04:00.767+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:04:00.768049325Z [2024-02-24T03:04:00.767+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:04:00.768284290Z [2024-02-24T03:04:00.768+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:04:00.768430637Z [2024-02-24T03:04:00.768+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:04:00.768723574Z [2024-02-24T03:04:00.768+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:04:00.768878662Z [2024-02-24T03:04:00.768+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:04:01.064060405Z [2024-02-24T03:04:01.063+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:02:00+00:00 exited with status queued for try_number 1 2024-02-24T03:04:01.064100164Z [2024-02-24T03:04:01.063+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:03:00+00:00 exited with status queued for try_number 1 2024-02-24T03:04:01.066137896Z [2024-02-24T03:04:01.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:03:00+00:00 exited with status queued for try_number 1 2024-02-24T03:04:01.066307089Z [2024-02-24T03:04:01.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:03:00+00:00 exited with status queued for try_number 1 2024-02-24T03:04:01.074560863Z [2024-02-24T03:04:01.074+0000] {scheduler_job.py:635} INFO - Setting external_id for to a97919a9-7160-41fe-ba2e-988effbed9d9 2024-02-24T03:04:01.074642155Z [2024-02-24T03:04:01.074+0000] {scheduler_job.py:635} INFO - Setting external_id for to 01b8cccf-6744-4ec9-900a-089d147056c4 2024-02-24T03:04:01.074740723Z [2024-02-24T03:04:01.074+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e373529-4d79-48b6-af45-90055fffffc2 2024-02-24T03:04:01.074854307Z [2024-02-24T03:04:01.074+0000] {scheduler_job.py:635} INFO - Setting external_id for to c91fb7e3-8662-4600-a19a-9bf1c872241e 2024-02-24T03:04:02.346788826Z [2024-02-24T03:04:02.346+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:04:02.347341301Z [2024-02-24T03:04:02.347+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:03:00+00:00, run_id=scheduled__2024-02-24T03:03:00+00:00, run_start_date=2024-02-24 03:04:00.679334+00:00, run_end_date=2024-02-24 03:04:02.346965+00:00, run_duration=1.667631, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:03:00+00:00, data_interval_end=2024-02-24 03:04:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:04:02.365836627Z [2024-02-24T03:04:02.365+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:04:00+00:00, run_after=2024-02-24T03:05:00+00:00 2024-02-24T03:04:02.473497706Z [2024-02-24T03:04:02.473+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:03:00+00:00 exited with status success for try_number 1 2024-02-24T03:04:02.482366050Z [2024-02-24T03:04:02.481+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:03:00+00:00, map_index=-1, run_start_date=2024-02-24 03:04:01.685434+00:00, run_end_date=2024-02-24 03:04:02.037860+00:00, run_duration=0.352426, state=success, executor_state=success, try_number=1, max_tries=1, job_id=939, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:04:00.764887+00:00, queued_by_job_id=2, pid=13724 2024-02-24T03:04:03.571754192Z [2024-02-24T03:04:03.571+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:04:03.572102306Z [2024-02-24T03:04:03.571+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 03:02:00+00:00, run_id=scheduled__2024-02-24T03:02:00+00:00, run_start_date=2024-02-24 03:04:00.676848+00:00, run_end_date=2024-02-24 03:04:03.571739+00:00, run_duration=2.894891, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:02:00+00:00, data_interval_end=2024-02-24 03:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T03:04:03.590846251Z [2024-02-24T03:04:03.590+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T03:04:00+00:00, run_after=2024-02-24T03:06:00+00:00 2024-02-24T03:04:03.652124996Z [2024-02-24T03:04:03.651+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:02:00+00:00 exited with status success for try_number 1 2024-02-24T03:04:03.657546379Z [2024-02-24T03:04:03.657+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T03:02:00+00:00, map_index=-1, run_start_date=2024-02-24 03:04:02.204827+00:00, run_end_date=2024-02-24 03:04:02.763388+00:00, run_duration=0.558561, state=success, executor_state=success, try_number=1, max_tries=1, job_id=940, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:04:00.764887+00:00, queued_by_job_id=2, pid=13732 2024-02-24T03:04:06.509340989Z [2024-02-24T03:04:06.508+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:04:06.509753491Z [2024-02-24T03:04:06.509+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:03:00+00:00, run_id=scheduled__2024-02-24T03:03:00+00:00, run_start_date=2024-02-24 03:04:00.681361+00:00, run_end_date=2024-02-24 03:04:06.509107+00:00, run_duration=5.827746, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:03:00+00:00, data_interval_end=2024-02-24 03:04:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:04:06.521642974Z [2024-02-24T03:04:06.521+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:04:00+00:00, run_after=2024-02-24T03:05:00+00:00 2024-02-24T03:04:06.530926471Z [2024-02-24T03:04:06.530+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:04:06.531371076Z [2024-02-24T03:04:06.531+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:03:00+00:00, run_id=scheduled__2024-02-24T03:03:00+00:00, run_start_date=2024-02-24 03:04:00.683516+00:00, run_end_date=2024-02-24 03:04:06.530838+00:00, run_duration=5.847322, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:03:00+00:00, data_interval_end=2024-02-24 03:04:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:04:06.549431494Z [2024-02-24T03:04:06.548+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:04:00+00:00, run_after=2024-02-24T03:05:00+00:00 2024-02-24T03:04:06.601968089Z [2024-02-24T03:04:06.601+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:03:00+00:00 exited with status success for try_number 1 2024-02-24T03:04:06.602276624Z [2024-02-24T03:04:06.601+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:03:00+00:00 exited with status success for try_number 1 2024-02-24T03:04:06.613735367Z [2024-02-24T03:04:06.613+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:03:00+00:00, map_index=-1, run_start_date=2024-02-24 03:04:03.105346+00:00, run_end_date=2024-02-24 03:04:05.651784+00:00, run_duration=2.546438, state=success, executor_state=success, try_number=1, max_tries=1, job_id=941, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:04:00.764887+00:00, queued_by_job_id=2, pid=13748 2024-02-24T03:04:06.614289939Z [2024-02-24T03:04:06.613+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:03:00+00:00, map_index=-1, run_start_date=2024-02-24 03:04:03.135280+00:00, run_end_date=2024-02-24 03:04:06.016305+00:00, run_duration=2.881025, state=success, executor_state=success, try_number=1, max_tries=1, job_id=942, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:04:00.764887+00:00, queued_by_job_id=2, pid=13749 2024-02-24T03:04:38.812508064Z [2024-02-24T03:04:38.811+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:04:38.812559863Z 2024-02-24T03:04:38.813156429Z [2024-02-24T03:04:38.812+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-02-24T03:04:38.814419488Z [2024-02-24T03:04:38.814+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:04:38.814439914Z 2024-02-24T03:04:38.818286398Z [2024-02-24T03:04:38.817+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240224030437_611949', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:04:38.818792410Z [2024-02-24T03:04:38.818+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240224030437_611949', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-02-24T03:04:38.889297276Z [2024-02-24T03:04:38.888+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240224030437_611949 exited with status queued for try_number 1 2024-02-24T03:04:38.896586689Z [2024-02-24T03:04:38.896+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5052ad15-cda0-4fb3-9cad-080c5cd01ef2 2024-02-24T03:04:41.159894731Z [2024-02-24T03:04:41.159+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:04:41.160182993Z [2024-02-24T03:04:41.159+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-02-24 03:04:38.023733+00:00, run_id=vdu_down_20240224030437_611949, run_start_date=2024-02-24 03:04:38.763552+00:00, run_end_date=2024-02-24 03:04:41.159891+00:00, run_duration=2.396339, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-02-24 03:04:38.023733+00:00, data_interval_end=2024-02-24 03:04:38.023733+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-02-24T03:04:41.162991864Z [2024-02-24T03:04:41.162+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-02-24T03:04:41.229945857Z [2024-02-24T03:04:41.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240224030437_611949 exited with status success for try_number 1 2024-02-24T03:04:41.240145239Z [2024-02-24T03:04:41.239+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240224030437_611949, map_index=-1, run_start_date=2024-02-24 03:04:39.580265+00:00, run_end_date=2024-02-24 03:04:40.048556+00:00, run_duration=0.468291, state=success, executor_state=success, try_number=1, max_tries=1, job_id=943, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:04:38.815180+00:00, queued_by_job_id=2, pid=13761 2024-02-24T03:05:00.331038627Z [2024-02-24T03:05:00.330+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:05:00+00:00, run_after=2024-02-24T03:06:00+00:00 2024-02-24T03:05:00.347596408Z [2024-02-24T03:05:00.347+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:05:00+00:00, run_after=2024-02-24T03:06:00+00:00 2024-02-24T03:05:00.357389604Z [2024-02-24T03:05:00.357+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:05:00.370404035Z [2024-02-24T03:05:00.370+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:05:00+00:00, run_after=2024-02-24T03:10:00+00:00 2024-02-24T03:05:00.476333369Z [2024-02-24T03:05:00.475+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T03:05:00.476360159Z 2024-02-24T03:05:00.476368620Z 2024-02-24T03:05:00.476375732Z 2024-02-24T03:05:00.476382777Z 2024-02-24T03:05:00.476992029Z [2024-02-24T03:05:00.476+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:05:00.477485621Z [2024-02-24T03:05:00.477+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:05:00.478003907Z [2024-02-24T03:05:00.477+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:05:00.478463271Z [2024-02-24T03:05:00.478+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:05:00.480000477Z [2024-02-24T03:05:00.479+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:05:00.480012397Z 2024-02-24T03:05:00.480017463Z 2024-02-24T03:05:00.480021746Z 2024-02-24T03:05:00.480025938Z 2024-02-24T03:05:00.485820680Z [2024-02-24T03:05:00.485+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T03:05:00.486119548Z [2024-02-24T03:05:00.485+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T03:05:00.486801358Z [2024-02-24T03:05:00.486+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:05:00.487216147Z [2024-02-24T03:05:00.486+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:05:00.487709539Z [2024-02-24T03:05:00.487+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:05:00.487931832Z [2024-02-24T03:05:00.487+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:05:00.488379170Z [2024-02-24T03:05:00.488+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:05:00.488902111Z [2024-02-24T03:05:00.488+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:05:01.065868918Z [2024-02-24T03:05:01.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T03:00:00+00:00 exited with status queued for try_number 1 2024-02-24T03:05:01.066031398Z [2024-02-24T03:05:01.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:04:00+00:00 exited with status queued for try_number 1 2024-02-24T03:05:01.066137360Z [2024-02-24T03:05:01.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:04:00+00:00 exited with status queued for try_number 1 2024-02-24T03:05:01.066251034Z [2024-02-24T03:05:01.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:04:00+00:00 exited with status queued for try_number 1 2024-02-24T03:05:01.075641389Z [2024-02-24T03:05:01.074+0000] {scheduler_job.py:635} INFO - Setting external_id for to 658ee2c2-108f-4ff1-86d1-03956f985f4b 2024-02-24T03:05:01.075781207Z [2024-02-24T03:05:01.075+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ed50b98-f1db-42e9-8008-b8dcdcde9455 2024-02-24T03:05:01.075945858Z [2024-02-24T03:05:01.075+0000] {scheduler_job.py:635} INFO - Setting external_id for to d0748c9e-b3c0-4e3f-8759-b5aa245cdb64 2024-02-24T03:05:01.076088391Z [2024-02-24T03:05:01.075+0000] {scheduler_job.py:635} INFO - Setting external_id for to a1c691c2-270c-4a73-909c-715fa1466513 2024-02-24T03:05:02.386343820Z [2024-02-24T03:05:02.383+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:05:02.386364257Z [2024-02-24T03:05:02.383+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:04:00+00:00, run_id=scheduled__2024-02-24T03:04:00+00:00, run_start_date=2024-02-24 03:05:00.384414+00:00, run_end_date=2024-02-24 03:05:02.383375+00:00, run_duration=1.998961, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:04:00+00:00, data_interval_end=2024-02-24 03:05:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:05:02.401269566Z [2024-02-24T03:05:02.399+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:05:00+00:00, run_after=2024-02-24T03:06:00+00:00 2024-02-24T03:05:02.493722341Z [2024-02-24T03:05:02.491+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:04:00+00:00 exited with status success for try_number 1 2024-02-24T03:05:02.504053668Z [2024-02-24T03:05:02.503+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:04:00+00:00, map_index=-1, run_start_date=2024-02-24 03:05:01.389009+00:00, run_end_date=2024-02-24 03:05:01.729738+00:00, run_duration=0.340729, state=success, executor_state=success, try_number=1, max_tries=1, job_id=944, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:05:00.481620+00:00, queued_by_job_id=2, pid=13794 2024-02-24T03:05:04.257888024Z [2024-02-24T03:05:04.257+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:05:04.258419738Z [2024-02-24T03:05:04.258+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:04:00+00:00, run_id=scheduled__2024-02-24T03:04:00+00:00, run_start_date=2024-02-24 03:05:00.385663+00:00, run_end_date=2024-02-24 03:05:04.257837+00:00, run_duration=3.872174, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:04:00+00:00, data_interval_end=2024-02-24 03:05:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:05:04.281182862Z [2024-02-24T03:05:04.280+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:05:00+00:00, run_after=2024-02-24T03:06:00+00:00 2024-02-24T03:05:04.326896698Z [2024-02-24T03:05:04.326+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:05:04.326935483Z 2024-02-24T03:05:04.327411418Z [2024-02-24T03:05:04.326+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:05:04.328993078Z [2024-02-24T03:05:04.328+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:05:04.329019767Z 2024-02-24T03:05:04.334119231Z [2024-02-24T03:05:04.333+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T03:05:04.334444986Z [2024-02-24T03:05:04.334+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T03:05:04.400249292Z [2024-02-24T03:05:04.399+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T03:00:00+00:00 exited with status queued for try_number 1 2024-02-24T03:05:04.400301867Z [2024-02-24T03:05:04.400+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T03:00:00+00:00 exited with status success for try_number 1 2024-02-24T03:05:04.400595467Z [2024-02-24T03:05:04.400+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:04:00+00:00 exited with status success for try_number 1 2024-02-24T03:05:04.411023055Z [2024-02-24T03:05:04.410+0000] {scheduler_job.py:635} INFO - Setting external_id for to d9240f0a-d175-4a77-a575-8ddd7796410b 2024-02-24T03:05:04.411387925Z [2024-02-24T03:05:04.410+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T03:00:00+00:00, map_index=-1, run_start_date=2024-02-24 03:05:02.704301+00:00, run_end_date=2024-02-24 03:05:03.217135+00:00, run_duration=0.512834, state=success, executor_state=success, try_number=1, max_tries=1, job_id=947, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:05:00.481620+00:00, queued_by_job_id=2, pid=13820 2024-02-24T03:05:04.411743873Z [2024-02-24T03:05:04.411+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:04:00+00:00, map_index=-1, run_start_date=2024-02-24 03:05:02.558336+00:00, run_end_date=2024-02-24 03:05:04.146193+00:00, run_duration=1.587857, state=success, executor_state=success, try_number=1, max_tries=1, job_id=945, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:05:00.481620+00:00, queued_by_job_id=2, pid=13818 2024-02-24T03:05:05.731545276Z [2024-02-24T03:05:05.730+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:05:05.731847582Z [2024-02-24T03:05:05.731+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:04:00+00:00, run_id=scheduled__2024-02-24T03:04:00+00:00, run_start_date=2024-02-24 03:05:00.387023+00:00, run_end_date=2024-02-24 03:05:05.731492+00:00, run_duration=5.344469, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:04:00+00:00, data_interval_end=2024-02-24 03:05:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:05:05.745140776Z [2024-02-24T03:05:05.744+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:05:00+00:00, run_after=2024-02-24T03:06:00+00:00 2024-02-24T03:05:05.813282699Z [2024-02-24T03:05:05.812+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:04:00+00:00 exited with status success for try_number 1 2024-02-24T03:05:05.821132723Z [2024-02-24T03:05:05.820+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:04:00+00:00, map_index=-1, run_start_date=2024-02-24 03:05:02.591772+00:00, run_end_date=2024-02-24 03:05:04.742319+00:00, run_duration=2.150547, state=success, executor_state=success, try_number=1, max_tries=1, job_id=946, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:05:00.481620+00:00, queued_by_job_id=2, pid=13819 2024-02-24T03:05:06.915199354Z [2024-02-24T03:05:06.914+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:05:06.915239705Z 2024-02-24T03:05:06.915373505Z [2024-02-24T03:05:06.915+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:05:06.916254451Z [2024-02-24T03:05:06.915+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:05:06.916289340Z 2024-02-24T03:05:06.920132339Z [2024-02-24T03:05:06.919+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T03:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T03:05:06.920368093Z [2024-02-24T03:05:06.920+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T03:05:06.978797803Z [2024-02-24T03:05:06.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T03:00:00+00:00 exited with status queued for try_number 1 2024-02-24T03:05:06.979051780Z [2024-02-24T03:05:06.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T03:00:00+00:00 exited with status success for try_number 1 2024-02-24T03:05:06.988860999Z [2024-02-24T03:05:06.988+0000] {scheduler_job.py:635} INFO - Setting external_id for to e878a15b-0bdd-4be4-b6bc-715ae190e856 2024-02-24T03:05:06.989080484Z [2024-02-24T03:05:06.988+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T03:00:00+00:00, map_index=-1, run_start_date=2024-02-24 03:05:06.004551+00:00, run_end_date=2024-02-24 03:05:06.380509+00:00, run_duration=0.375958, state=success, executor_state=success, try_number=1, max_tries=1, job_id=948, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:05:04.330056+00:00, queued_by_job_id=2, pid=13843 2024-02-24T03:05:09.283069236Z [2024-02-24T03:05:09.282+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:05:09.283121269Z 2024-02-24T03:05:09.283165198Z [2024-02-24T03:05:09.282+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:05:09.283687833Z [2024-02-24T03:05:09.283+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:05:09.283749498Z 2024-02-24T03:05:09.286515102Z [2024-02-24T03:05:09.286+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:05:09.286579352Z [2024-02-24T03:05:09.286+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T03:05:09.347435588Z [2024-02-24T03:05:09.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T03:00:00+00:00 exited with status queued for try_number 1 2024-02-24T03:05:09.347676659Z [2024-02-24T03:05:09.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T03:00:00+00:00 exited with status success for try_number 1 2024-02-24T03:05:09.362529233Z [2024-02-24T03:05:09.361+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f005e27-0500-44f7-a971-ea4dcc162374 2024-02-24T03:05:09.362925763Z [2024-02-24T03:05:09.362+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T03:00:00+00:00, map_index=0, run_start_date=2024-02-24 03:05:08.519491+00:00, run_end_date=2024-02-24 03:05:08.906658+00:00, run_duration=0.387167, state=success, executor_state=success, try_number=1, max_tries=1, job_id=949, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:05:06.916669+00:00, queued_by_job_id=2, pid=13851 2024-02-24T03:05:11.592673720Z [2024-02-24T03:05:11.592+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:05:11.593261733Z [2024-02-24T03:05:11.592+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:00:00+00:00, run_id=scheduled__2024-02-24T03:00:00+00:00, run_start_date=2024-02-24 03:05:00.383054+00:00, run_end_date=2024-02-24 03:05:11.592714+00:00, run_duration=11.20966, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:00:00+00:00, data_interval_end=2024-02-24 03:05:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T03:05:11.602415366Z [2024-02-24T03:05:11.601+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:05:00+00:00, run_after=2024-02-24T03:10:00+00:00 2024-02-24T03:05:11.646418974Z [2024-02-24T03:05:11.645+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T03:00:00+00:00 exited with status success for try_number 1 2024-02-24T03:05:11.655303790Z [2024-02-24T03:05:11.654+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T03:00:00+00:00, map_index=-1, run_start_date=2024-02-24 03:05:10.959383+00:00, run_end_date=2024-02-24 03:05:11.333952+00:00, run_duration=0.374569, state=success, executor_state=success, try_number=1, max_tries=1, job_id=950, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:05:09.284129+00:00, queued_by_job_id=2, pid=13859 2024-02-24T03:06:00.191105152Z [2024-02-24T03:06:00.190+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:06:00.203098457Z [2024-02-24T03:06:00.202+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:06:00.232347841Z [2024-02-24T03:06:00.231+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:06:00+00:00, run_after=2024-02-24T03:07:00+00:00 2024-02-24T03:06:00.249175489Z [2024-02-24T03:06:00.248+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:06:00+00:00, run_after=2024-02-24T03:07:00+00:00 2024-02-24T03:06:00.363566209Z [2024-02-24T03:06:00.362+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T03:06:00.363604815Z 2024-02-24T03:06:00.363613995Z 2024-02-24T03:06:00.363621771Z 2024-02-24T03:06:00.363629012Z 2024-02-24T03:06:00.363987542Z [2024-02-24T03:06:00.363+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T03:06:00.364371181Z [2024-02-24T03:06:00.364+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:06:00.365114833Z [2024-02-24T03:06:00.364+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:06:00.365553270Z [2024-02-24T03:06:00.365+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:06:00.366921564Z [2024-02-24T03:06:00.366+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:06:00.366933144Z 2024-02-24T03:06:00.366936763Z 2024-02-24T03:06:00.366939714Z 2024-02-24T03:06:00.366942671Z 2024-02-24T03:06:00.376191832Z [2024-02-24T03:06:00.375+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T03:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:06:00.376446660Z [2024-02-24T03:06:00.376+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T03:06:00.376814526Z [2024-02-24T03:06:00.376+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:06:00.377016316Z [2024-02-24T03:06:00.376+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:06:00.377334848Z [2024-02-24T03:06:00.377+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:06:00.377504972Z [2024-02-24T03:06:00.377+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:06:00.377834679Z [2024-02-24T03:06:00.377+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:06:00.378027020Z [2024-02-24T03:06:00.377+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:06:00.771003907Z [2024-02-24T03:06:00.770+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:04:00+00:00 exited with status queued for try_number 1 2024-02-24T03:06:00.771137741Z [2024-02-24T03:06:00.770+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:05:00+00:00 exited with status queued for try_number 1 2024-02-24T03:06:00.771239056Z [2024-02-24T03:06:00.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:05:00+00:00 exited with status queued for try_number 1 2024-02-24T03:06:00.771364045Z [2024-02-24T03:06:00.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:05:00+00:00 exited with status queued for try_number 1 2024-02-24T03:06:00.791057127Z [2024-02-24T03:06:00.790+0000] {scheduler_job.py:635} INFO - Setting external_id for to a0fd9d65-92a2-428e-b254-545c93a789b8 2024-02-24T03:06:00.794315057Z [2024-02-24T03:06:00.794+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea09c0cc-8ad7-42c4-9d17-480eba48be51 2024-02-24T03:06:00.794571117Z [2024-02-24T03:06:00.794+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9b997629-80d9-404c-88e5-cb60f99f3405 2024-02-24T03:06:00.794746094Z [2024-02-24T03:06:00.794+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc07fd05-8168-4c94-8770-075803bb0bfc 2024-02-24T03:06:02.121296040Z [2024-02-24T03:06:02.120+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:06:02.121540549Z [2024-02-24T03:06:02.121+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 03:04:00+00:00, run_id=scheduled__2024-02-24T03:04:00+00:00, run_start_date=2024-02-24 03:06:00.266795+00:00, run_end_date=2024-02-24 03:06:02.121204+00:00, run_duration=1.854409, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:04:00+00:00, data_interval_end=2024-02-24 03:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T03:06:02.133317780Z [2024-02-24T03:06:02.132+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T03:06:00+00:00, run_after=2024-02-24T03:08:00+00:00 2024-02-24T03:06:02.140879287Z [2024-02-24T03:06:02.140+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:06:02.141020138Z [2024-02-24T03:06:02.140+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:05:00+00:00, run_id=scheduled__2024-02-24T03:05:00+00:00, run_start_date=2024-02-24 03:06:00.269580+00:00, run_end_date=2024-02-24 03:06:02.140774+00:00, run_duration=1.871194, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:05:00+00:00, data_interval_end=2024-02-24 03:06:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:06:02.155617286Z [2024-02-24T03:06:02.155+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:06:00+00:00, run_after=2024-02-24T03:07:00+00:00 2024-02-24T03:06:02.219163383Z [2024-02-24T03:06:02.218+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:04:00+00:00 exited with status success for try_number 1 2024-02-24T03:06:02.222211612Z [2024-02-24T03:06:02.219+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:05:00+00:00 exited with status success for try_number 1 2024-02-24T03:06:02.237700463Z [2024-02-24T03:06:02.237+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T03:04:00+00:00, map_index=-1, run_start_date=2024-02-24 03:06:01.194605+00:00, run_end_date=2024-02-24 03:06:01.648327+00:00, run_duration=0.453722, state=success, executor_state=success, try_number=1, max_tries=1, job_id=951, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:06:00.369585+00:00, queued_by_job_id=2, pid=13882 2024-02-24T03:06:02.238082551Z [2024-02-24T03:06:02.237+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:05:00+00:00, map_index=-1, run_start_date=2024-02-24 03:06:01.338459+00:00, run_end_date=2024-02-24 03:06:01.741668+00:00, run_duration=0.403209, state=success, executor_state=success, try_number=1, max_tries=1, job_id=952, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:06:00.369585+00:00, queued_by_job_id=2, pid=13883 2024-02-24T03:06:04.755503970Z [2024-02-24T03:06:04.754+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:06:04.755758738Z [2024-02-24T03:06:04.755+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:05:00+00:00, run_id=scheduled__2024-02-24T03:05:00+00:00, run_start_date=2024-02-24 03:06:00.271937+00:00, run_end_date=2024-02-24 03:06:04.755257+00:00, run_duration=4.48332, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:05:00+00:00, data_interval_end=2024-02-24 03:06:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:06:04.777888515Z [2024-02-24T03:06:04.777+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:06:00+00:00, run_after=2024-02-24T03:07:00+00:00 2024-02-24T03:06:04.788059421Z [2024-02-24T03:06:04.787+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:06:04.788286323Z [2024-02-24T03:06:04.787+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:05:00+00:00, run_id=scheduled__2024-02-24T03:05:00+00:00, run_start_date=2024-02-24 03:06:00.274766+00:00, run_end_date=2024-02-24 03:06:04.787875+00:00, run_duration=4.513109, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:05:00+00:00, data_interval_end=2024-02-24 03:06:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:06:04.799110874Z [2024-02-24T03:06:04.798+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:06:00+00:00, run_after=2024-02-24T03:07:00+00:00 2024-02-24T03:06:04.832856183Z [2024-02-24T03:06:04.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:05:00+00:00 exited with status success for try_number 1 2024-02-24T03:06:04.833192035Z [2024-02-24T03:06:04.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:05:00+00:00 exited with status success for try_number 1 2024-02-24T03:06:04.841490698Z [2024-02-24T03:06:04.841+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:05:00+00:00, map_index=-1, run_start_date=2024-02-24 03:06:02.424344+00:00, run_end_date=2024-02-24 03:06:03.770492+00:00, run_duration=1.346148, state=success, executor_state=success, try_number=1, max_tries=1, job_id=954, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:06:00.369585+00:00, queued_by_job_id=2, pid=13907 2024-02-24T03:06:04.841894945Z [2024-02-24T03:06:04.841+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:05:00+00:00, map_index=-1, run_start_date=2024-02-24 03:06:02.391660+00:00, run_end_date=2024-02-24 03:06:04.245397+00:00, run_duration=1.853737, state=success, executor_state=success, try_number=1, max_tries=1, job_id=953, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:06:00.369585+00:00, queued_by_job_id=2, pid=13906 2024-02-24T03:06:38.551404031Z [2024-02-24T03:06:38.550+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:06:38.551433198Z 2024-02-24T03:06:38.551640251Z [2024-02-24T03:06:38.551+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-02-24T03:06:38.552439058Z [2024-02-24T03:06:38.552+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:06:38.552451556Z 2024-02-24T03:06:38.560247392Z [2024-02-24T03:06:38.559+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240224030637_634119', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:06:38.560691570Z [2024-02-24T03:06:38.560+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240224030637_634119', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-02-24T03:06:38.620752620Z [2024-02-24T03:06:38.620+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240224030637_634119 exited with status queued for try_number 1 2024-02-24T03:06:38.626530295Z [2024-02-24T03:06:38.626+0000] {scheduler_job.py:635} INFO - Setting external_id for to 951263ac-f075-4d5d-a367-aad8a4346ba2 2024-02-24T03:06:39.762016720Z [2024-02-24T03:06:39.761+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:06:39.762602757Z [2024-02-24T03:06:39.762+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-02-24 03:06:38.022235+00:00, run_id=vdu_down_20240224030637_634119, run_start_date=2024-02-24 03:06:38.506971+00:00, run_end_date=2024-02-24 03:06:39.761855+00:00, run_duration=1.254884, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-02-24 03:06:38.022235+00:00, data_interval_end=2024-02-24 03:06:38.022235+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-02-24T03:06:39.768735009Z [2024-02-24T03:06:39.768+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-02-24T03:06:40.877023723Z [2024-02-24T03:06:40.876+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240224030637_634119 exited with status success for try_number 1 2024-02-24T03:06:40.883127503Z [2024-02-24T03:06:40.882+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240224030637_634119, map_index=-1, run_start_date=2024-02-24 03:06:39.228135+00:00, run_end_date=2024-02-24 03:06:39.675691+00:00, run_duration=0.447556, state=success, executor_state=success, try_number=1, max_tries=1, job_id=955, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:06:38.553490+00:00, queued_by_job_id=2, pid=13919 2024-02-24T03:07:00.985232343Z [2024-02-24T03:07:00.983+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:07:00+00:00, run_after=2024-02-24T03:08:00+00:00 2024-02-24T03:07:01.004942001Z [2024-02-24T03:07:01.003+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:07:01.028829055Z [2024-02-24T03:07:01.028+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:07:00+00:00, run_after=2024-02-24T03:08:00+00:00 2024-02-24T03:07:01.154845660Z [2024-02-24T03:07:01.154+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T03:07:01.154881723Z 2024-02-24T03:07:01.154887869Z 2024-02-24T03:07:01.154892450Z 2024-02-24T03:07:01.155394549Z [2024-02-24T03:07:01.154+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:07:01.155989536Z [2024-02-24T03:07:01.155+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:07:01.156400801Z [2024-02-24T03:07:01.156+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:07:01.157387227Z [2024-02-24T03:07:01.157+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:07:01.157398859Z 2024-02-24T03:07:01.157402649Z 2024-02-24T03:07:01.157407338Z 2024-02-24T03:07:01.162148714Z [2024-02-24T03:07:01.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:07:01.162407018Z [2024-02-24T03:07:01.162+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:07:01.162883145Z [2024-02-24T03:07:01.162+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:07:01.163161670Z [2024-02-24T03:07:01.162+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:07:01.163958926Z [2024-02-24T03:07:01.163+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:07:01.164329249Z [2024-02-24T03:07:01.164+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:07:01.545593389Z [2024-02-24T03:07:01.545+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:06:00+00:00 exited with status queued for try_number 1 2024-02-24T03:07:01.545704234Z [2024-02-24T03:07:01.545+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:06:00+00:00 exited with status queued for try_number 1 2024-02-24T03:07:01.545886197Z [2024-02-24T03:07:01.545+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:06:00+00:00 exited with status queued for try_number 1 2024-02-24T03:07:01.556763680Z [2024-02-24T03:07:01.556+0000] {scheduler_job.py:635} INFO - Setting external_id for to e52921bd-03dc-409b-9670-06d0c218e331 2024-02-24T03:07:01.557087909Z [2024-02-24T03:07:01.556+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7b053ac-4a60-4159-b35b-b87839817b8d 2024-02-24T03:07:01.557350182Z [2024-02-24T03:07:01.557+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a600979-33ef-42f1-8b3b-67e2a947cacf 2024-02-24T03:07:02.929321956Z [2024-02-24T03:07:02.928+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:07:02.929824440Z [2024-02-24T03:07:02.929+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:06:00+00:00, run_id=scheduled__2024-02-24T03:06:00+00:00, run_start_date=2024-02-24 03:07:01.046781+00:00, run_end_date=2024-02-24 03:07:02.929407+00:00, run_duration=1.882626, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:06:00+00:00, data_interval_end=2024-02-24 03:07:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:07:02.951437959Z [2024-02-24T03:07:02.951+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:07:00+00:00, run_after=2024-02-24T03:08:00+00:00 2024-02-24T03:07:03.008815544Z [2024-02-24T03:07:03.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:06:00+00:00 exited with status success for try_number 1 2024-02-24T03:07:03.015698132Z [2024-02-24T03:07:03.015+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:06:00+00:00, map_index=-1, run_start_date=2024-02-24 03:07:02.160160+00:00, run_end_date=2024-02-24 03:07:02.567154+00:00, run_duration=0.406994, state=success, executor_state=success, try_number=1, max_tries=1, job_id=956, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:07:01.159357+00:00, queued_by_job_id=2, pid=13951 2024-02-24T03:07:05.114285290Z [2024-02-24T03:07:05.113+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T03:07:06.394501934Z [2024-02-24T03:07:06.394+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:07:06.394882346Z [2024-02-24T03:07:06.394+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:06:00+00:00, run_id=scheduled__2024-02-24T03:06:00+00:00, run_start_date=2024-02-24 03:07:01.048707+00:00, run_end_date=2024-02-24 03:07:06.394596+00:00, run_duration=5.345889, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:06:00+00:00, data_interval_end=2024-02-24 03:07:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:07:06.408492813Z [2024-02-24T03:07:06.408+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:07:00+00:00, run_after=2024-02-24T03:08:00+00:00 2024-02-24T03:07:06.450579681Z [2024-02-24T03:07:06.450+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:06:00+00:00 exited with status success for try_number 1 2024-02-24T03:07:06.457669175Z [2024-02-24T03:07:06.456+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:06:00+00:00, map_index=-1, run_start_date=2024-02-24 03:07:03.260095+00:00, run_end_date=2024-02-24 03:07:05.672554+00:00, run_duration=2.412459, state=success, executor_state=success, try_number=1, max_tries=1, job_id=957, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:07:01.159357+00:00, queued_by_job_id=2, pid=13969 2024-02-24T03:07:06.912001117Z [2024-02-24T03:07:06.911+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:07:06.912586348Z [2024-02-24T03:07:06.912+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:06:00+00:00, run_id=scheduled__2024-02-24T03:06:00+00:00, run_start_date=2024-02-24 03:07:01.050431+00:00, run_end_date=2024-02-24 03:07:06.912110+00:00, run_duration=5.861679, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:06:00+00:00, data_interval_end=2024-02-24 03:07:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:07:06.928615780Z [2024-02-24T03:07:06.928+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:07:00+00:00, run_after=2024-02-24T03:08:00+00:00 2024-02-24T03:07:06.967985907Z [2024-02-24T03:07:06.967+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:06:00+00:00 exited with status success for try_number 1 2024-02-24T03:07:06.972983302Z [2024-02-24T03:07:06.972+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:06:00+00:00, map_index=-1, run_start_date=2024-02-24 03:07:03.311694+00:00, run_end_date=2024-02-24 03:07:06.423315+00:00, run_duration=3.111621, state=success, executor_state=success, try_number=1, max_tries=1, job_id=958, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:07:01.159357+00:00, queued_by_job_id=2, pid=13970 2024-02-24T03:08:00.897851448Z [2024-02-24T03:08:00.897+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:08:00.910527954Z [2024-02-24T03:08:00.910+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:08:00+00:00, run_after=2024-02-24T03:09:00+00:00 2024-02-24T03:08:00.921741932Z [2024-02-24T03:08:00.921+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:08:00+00:00, run_after=2024-02-24T03:09:00+00:00 2024-02-24T03:08:00.928997153Z [2024-02-24T03:08:00.928+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:08:01.055677224Z [2024-02-24T03:08:01.055+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T03:08:01.055703300Z 2024-02-24T03:08:01.055707702Z 2024-02-24T03:08:01.055711026Z 2024-02-24T03:08:01.055714225Z 2024-02-24T03:08:01.055882943Z [2024-02-24T03:08:01.055+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T03:08:01.056402386Z [2024-02-24T03:08:01.056+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:08:01.056605838Z [2024-02-24T03:08:01.056+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:08:01.056853587Z [2024-02-24T03:08:01.056+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:08:01.057717820Z [2024-02-24T03:08:01.057+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:08:01.057733995Z 2024-02-24T03:08:01.057738567Z 2024-02-24T03:08:01.057764820Z 2024-02-24T03:08:01.057801719Z 2024-02-24T03:08:01.061635729Z [2024-02-24T03:08:01.061+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T03:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:08:01.061804539Z [2024-02-24T03:08:01.061+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T03:08:01.062124237Z [2024-02-24T03:08:01.061+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:08:01.062318647Z [2024-02-24T03:08:01.062+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:08:01.062619874Z [2024-02-24T03:08:01.062+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:08:01.062806338Z [2024-02-24T03:08:01.062+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:08:01.063050196Z [2024-02-24T03:08:01.062+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:08:01.063199240Z [2024-02-24T03:08:01.063+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:08:01.992755622Z [2024-02-24T03:08:01.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:06:00+00:00 exited with status queued for try_number 1 2024-02-24T03:08:01.992804187Z [2024-02-24T03:08:01.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:07:00+00:00 exited with status queued for try_number 1 2024-02-24T03:08:01.993072051Z [2024-02-24T03:08:01.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:07:00+00:00 exited with status queued for try_number 1 2024-02-24T03:08:01.993131498Z [2024-02-24T03:08:01.993+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:07:00+00:00 exited with status queued for try_number 1 2024-02-24T03:08:02.004226129Z [2024-02-24T03:08:02.003+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb5b0554-7973-407f-b363-9820dbf17880 2024-02-24T03:08:02.004418642Z [2024-02-24T03:08:02.004+0000] {scheduler_job.py:635} INFO - Setting external_id for to b89c79b8-ae54-4bbf-8594-39ea31de25e4 2024-02-24T03:08:02.005936309Z [2024-02-24T03:08:02.005+0000] {scheduler_job.py:635} INFO - Setting external_id for to df2a1450-fe2c-41e9-b8ff-f9f5a0c91b45 2024-02-24T03:08:02.006122349Z [2024-02-24T03:08:02.005+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9ce8d819-bc83-4467-a458-89eb136d1880 2024-02-24T03:08:02.771568215Z [2024-02-24T03:08:02.771+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:08:02.771745219Z [2024-02-24T03:08:02.771+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:07:00+00:00, run_id=scheduled__2024-02-24T03:07:00+00:00, run_start_date=2024-02-24 03:08:00.947346+00:00, run_end_date=2024-02-24 03:08:02.771469+00:00, run_duration=1.824123, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:07:00+00:00, data_interval_end=2024-02-24 03:08:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:08:02.780642013Z [2024-02-24T03:08:02.780+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:08:00+00:00, run_after=2024-02-24T03:09:00+00:00 2024-02-24T03:08:02.788338068Z [2024-02-24T03:08:02.787+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:08:02.788365802Z [2024-02-24T03:08:02.788+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 03:06:00+00:00, run_id=scheduled__2024-02-24T03:06:00+00:00, run_start_date=2024-02-24 03:08:00.944507+00:00, run_end_date=2024-02-24 03:08:02.788073+00:00, run_duration=1.843566, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:06:00+00:00, data_interval_end=2024-02-24 03:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T03:08:02.799021158Z [2024-02-24T03:08:02.798+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T03:08:00+00:00, run_after=2024-02-24T03:10:00+00:00 2024-02-24T03:08:02.888341483Z [2024-02-24T03:08:02.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:06:00+00:00 exited with status success for try_number 1 2024-02-24T03:08:02.888373843Z [2024-02-24T03:08:02.888+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:07:00+00:00 exited with status success for try_number 1 2024-02-24T03:08:02.897306554Z [2024-02-24T03:08:02.896+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:07:00+00:00, map_index=-1, run_start_date=2024-02-24 03:08:02.068285+00:00, run_end_date=2024-02-24 03:08:02.486972+00:00, run_duration=0.418687, state=success, executor_state=success, try_number=1, max_tries=1, job_id=960, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:08:01.058874+00:00, queued_by_job_id=2, pid=14005 2024-02-24T03:08:02.897634500Z [2024-02-24T03:08:02.897+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T03:06:00+00:00, map_index=-1, run_start_date=2024-02-24 03:08:01.934005+00:00, run_end_date=2024-02-24 03:08:02.513356+00:00, run_duration=0.579351, state=success, executor_state=success, try_number=1, max_tries=1, job_id=959, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:08:01.058874+00:00, queued_by_job_id=2, pid=14004 2024-02-24T03:08:05.573961051Z [2024-02-24T03:08:05.572+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:08:05.574367261Z [2024-02-24T03:08:05.574+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:07:00+00:00, run_id=scheduled__2024-02-24T03:07:00+00:00, run_start_date=2024-02-24 03:08:00.949366+00:00, run_end_date=2024-02-24 03:08:05.573945+00:00, run_duration=4.624579, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:07:00+00:00, data_interval_end=2024-02-24 03:08:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:08:05.586521621Z [2024-02-24T03:08:05.586+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:08:00+00:00, run_after=2024-02-24T03:09:00+00:00 2024-02-24T03:08:05.599640231Z [2024-02-24T03:08:05.599+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:08:05.600009724Z [2024-02-24T03:08:05.599+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:07:00+00:00, run_id=scheduled__2024-02-24T03:07:00+00:00, run_start_date=2024-02-24 03:08:00.951176+00:00, run_end_date=2024-02-24 03:08:05.599567+00:00, run_duration=4.648391, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:07:00+00:00, data_interval_end=2024-02-24 03:08:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:08:05.610647201Z [2024-02-24T03:08:05.610+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:08:00+00:00, run_after=2024-02-24T03:09:00+00:00 2024-02-24T03:08:05.657362631Z [2024-02-24T03:08:05.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:07:00+00:00 exited with status success for try_number 1 2024-02-24T03:08:05.658122256Z [2024-02-24T03:08:05.657+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:07:00+00:00 exited with status success for try_number 1 2024-02-24T03:08:05.667320354Z [2024-02-24T03:08:05.666+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:07:00+00:00, map_index=-1, run_start_date=2024-02-24 03:08:03.270232+00:00, run_end_date=2024-02-24 03:08:05.019852+00:00, run_duration=1.74962, state=success, executor_state=success, try_number=1, max_tries=1, job_id=961, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:08:01.058874+00:00, queued_by_job_id=2, pid=14023 2024-02-24T03:08:05.667633248Z [2024-02-24T03:08:05.667+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:07:00+00:00, map_index=-1, run_start_date=2024-02-24 03:08:03.558749+00:00, run_end_date=2024-02-24 03:08:05.220886+00:00, run_duration=1.662137, state=success, executor_state=success, try_number=1, max_tries=1, job_id=962, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:08:01.058874+00:00, queued_by_job_id=2, pid=14029 2024-02-24T03:09:00.918012628Z [2024-02-24T03:09:00.917+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:09:00+00:00, run_after=2024-02-24T03:10:00+00:00 2024-02-24T03:09:00.933296069Z [2024-02-24T03:09:00.932+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:09:00+00:00, run_after=2024-02-24T03:10:00+00:00 2024-02-24T03:09:00.939794159Z [2024-02-24T03:09:00.939+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:09:01.009630561Z [2024-02-24T03:09:01.009+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T03:09:01.009664577Z 2024-02-24T03:09:01.009670653Z 2024-02-24T03:09:01.009676209Z 2024-02-24T03:09:01.009826345Z [2024-02-24T03:09:01.009+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:09:01.010188173Z [2024-02-24T03:09:01.009+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:09:01.010291755Z [2024-02-24T03:09:01.010+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:09:01.011229446Z [2024-02-24T03:09:01.010+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:09:01.011256560Z 2024-02-24T03:09:01.011265877Z 2024-02-24T03:09:01.011274569Z 2024-02-24T03:09:01.016453386Z [2024-02-24T03:09:01.015+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:09:01.016489793Z [2024-02-24T03:09:01.016+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:09:01.016790731Z [2024-02-24T03:09:01.016+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:09:01.017057265Z [2024-02-24T03:09:01.016+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:09:01.017436447Z [2024-02-24T03:09:01.017+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:09:01.017675240Z [2024-02-24T03:09:01.017+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:09:01.327851357Z [2024-02-24T03:09:01.327+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:08:00+00:00 exited with status queued for try_number 1 2024-02-24T03:09:01.327940130Z [2024-02-24T03:09:01.327+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:08:00+00:00 exited with status queued for try_number 1 2024-02-24T03:09:01.328072938Z [2024-02-24T03:09:01.327+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:08:00+00:00 exited with status queued for try_number 1 2024-02-24T03:09:01.337584411Z [2024-02-24T03:09:01.337+0000] {scheduler_job.py:635} INFO - Setting external_id for to d936223b-4ad5-470b-8a7f-c8f6eba7a981 2024-02-24T03:09:01.337692276Z [2024-02-24T03:09:01.337+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a42b1b1-d198-4881-8edb-7dfeccb794c3 2024-02-24T03:09:01.337814821Z [2024-02-24T03:09:01.337+0000] {scheduler_job.py:635} INFO - Setting external_id for to cee0bf9a-2170-4efc-a707-27d5e121c5ac 2024-02-24T03:09:02.462072862Z [2024-02-24T03:09:02.461+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:09:02.462544603Z [2024-02-24T03:09:02.462+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:08:00+00:00, run_id=scheduled__2024-02-24T03:08:00+00:00, run_start_date=2024-02-24 03:09:00.949740+00:00, run_end_date=2024-02-24 03:09:02.462175+00:00, run_duration=1.512435, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:08:00+00:00, data_interval_end=2024-02-24 03:09:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:09:02.471936368Z [2024-02-24T03:09:02.471+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:09:00+00:00, run_after=2024-02-24T03:10:00+00:00 2024-02-24T03:09:02.515279607Z [2024-02-24T03:09:02.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:08:00+00:00 exited with status success for try_number 1 2024-02-24T03:09:02.520987439Z [2024-02-24T03:09:02.520+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:08:00+00:00, map_index=-1, run_start_date=2024-02-24 03:09:01.844377+00:00, run_end_date=2024-02-24 03:09:02.251187+00:00, run_duration=0.40681, state=success, executor_state=success, try_number=1, max_tries=1, job_id=963, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:09:01.012026+00:00, queued_by_job_id=2, pid=14061 2024-02-24T03:09:04.938713434Z [2024-02-24T03:09:04.938+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:09:04.938895530Z [2024-02-24T03:09:04.938+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:08:00+00:00, run_id=scheduled__2024-02-24T03:08:00+00:00, run_start_date=2024-02-24 03:09:00.951371+00:00, run_end_date=2024-02-24 03:09:04.938606+00:00, run_duration=3.987235, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:08:00+00:00, data_interval_end=2024-02-24 03:09:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:09:04.951749462Z [2024-02-24T03:09:04.951+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:09:00+00:00, run_after=2024-02-24T03:10:00+00:00 2024-02-24T03:09:04.999590687Z [2024-02-24T03:09:04.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:08:00+00:00 exited with status success for try_number 1 2024-02-24T03:09:05.006319535Z [2024-02-24T03:09:05.005+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:08:00+00:00, map_index=-1, run_start_date=2024-02-24 03:09:02.937516+00:00, run_end_date=2024-02-24 03:09:04.564609+00:00, run_duration=1.627093, state=success, executor_state=success, try_number=1, max_tries=1, job_id=964, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:09:01.012026+00:00, queued_by_job_id=2, pid=14079 2024-02-24T03:09:05.963417237Z [2024-02-24T03:09:05.962+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:09:05.963678058Z [2024-02-24T03:09:05.963+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:08:00+00:00, run_id=scheduled__2024-02-24T03:08:00+00:00, run_start_date=2024-02-24 03:09:00.952656+00:00, run_end_date=2024-02-24 03:09:05.963230+00:00, run_duration=5.010574, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:08:00+00:00, data_interval_end=2024-02-24 03:09:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:09:05.972437724Z [2024-02-24T03:09:05.972+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:09:00+00:00, run_after=2024-02-24T03:10:00+00:00 2024-02-24T03:09:06.016088190Z [2024-02-24T03:09:06.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:08:00+00:00 exited with status success for try_number 1 2024-02-24T03:09:06.023628363Z [2024-02-24T03:09:06.023+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:08:00+00:00, map_index=-1, run_start_date=2024-02-24 03:09:03.010919+00:00, run_end_date=2024-02-24 03:09:05.403940+00:00, run_duration=2.393021, state=success, executor_state=success, try_number=1, max_tries=1, job_id=965, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:09:01.012026+00:00, queued_by_job_id=2, pid=14080 2024-02-24T03:10:00.861995071Z [2024-02-24T03:10:00.861+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:10:00+00:00, run_after=2024-02-24T03:15:00+00:00 2024-02-24T03:10:00.875524407Z [2024-02-24T03:10:00.874+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:10:00+00:00, run_after=2024-02-24T03:11:00+00:00 2024-02-24T03:10:00.889837767Z [2024-02-24T03:10:00.889+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:10:00+00:00, run_after=2024-02-24T03:11:00+00:00 2024-02-24T03:10:00.905999373Z [2024-02-24T03:10:00.905+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:10:00.914882879Z [2024-02-24T03:10:00.914+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:10:01.041090677Z [2024-02-24T03:10:01.040+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-02-24T03:10:01.041131011Z 2024-02-24T03:10:01.041134676Z 2024-02-24T03:10:01.041138449Z 2024-02-24T03:10:01.041141510Z 2024-02-24T03:10:01.041144607Z 2024-02-24T03:10:01.041360525Z [2024-02-24T03:10:01.040+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:10:01.041600596Z [2024-02-24T03:10:01.041+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T03:10:01.041818525Z [2024-02-24T03:10:01.041+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:10:01.042106020Z [2024-02-24T03:10:01.041+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:10:01.042364415Z [2024-02-24T03:10:01.042+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:10:01.042985753Z [2024-02-24T03:10:01.042+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:10:01.042994133Z 2024-02-24T03:10:01.042998978Z 2024-02-24T03:10:01.043003255Z 2024-02-24T03:10:01.043007248Z 2024-02-24T03:10:01.043011123Z 2024-02-24T03:10:01.048017652Z [2024-02-24T03:10:01.047+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T03:10:01.048275684Z [2024-02-24T03:10:01.048+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T03:10:01.048692163Z [2024-02-24T03:10:01.048+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T03:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:10:01.048911627Z [2024-02-24T03:10:01.048+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T03:10:01.049221270Z [2024-02-24T03:10:01.049+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:10:01.049391983Z [2024-02-24T03:10:01.049+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:10:01.049669605Z [2024-02-24T03:10:01.049+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:10:01.049814735Z [2024-02-24T03:10:01.049+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:10:01.050033927Z [2024-02-24T03:10:01.049+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:10:01.050162799Z [2024-02-24T03:10:01.050+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:10:01.546346586Z [2024-02-24T03:10:01.545+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T03:05:00+00:00 exited with status queued for try_number 1 2024-02-24T03:10:01.546598523Z [2024-02-24T03:10:01.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:08:00+00:00 exited with status queued for try_number 1 2024-02-24T03:10:01.546781697Z [2024-02-24T03:10:01.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:09:00+00:00 exited with status queued for try_number 1 2024-02-24T03:10:01.546941546Z [2024-02-24T03:10:01.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:09:00+00:00 exited with status queued for try_number 1 2024-02-24T03:10:01.547104317Z [2024-02-24T03:10:01.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:09:00+00:00 exited with status queued for try_number 1 2024-02-24T03:10:01.556344951Z [2024-02-24T03:10:01.556+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2ca393aa-6995-485f-9e38-36a051c19957 2024-02-24T03:10:01.558250943Z [2024-02-24T03:10:01.557+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6ecb7e1-917d-4810-9c87-512426e7eeae 2024-02-24T03:10:01.558542301Z [2024-02-24T03:10:01.558+0000] {scheduler_job.py:635} INFO - Setting external_id for to 19fcb199-92fa-4a06-8ef9-48a983a9ae5e 2024-02-24T03:10:01.558774528Z [2024-02-24T03:10:01.558+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b48d1d8-887a-45f7-a9e2-c02b04ec2963 2024-02-24T03:10:01.558981124Z [2024-02-24T03:10:01.558+0000] {scheduler_job.py:635} INFO - Setting external_id for to d9bc9d3d-6fbb-494c-a897-df51470c134f 2024-02-24T03:10:04.098086465Z [2024-02-24T03:10:04.096+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:10:04.098493810Z [2024-02-24T03:10:04.098+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 03:08:00+00:00, run_id=scheduled__2024-02-24T03:08:00+00:00, run_start_date=2024-02-24 03:10:00.929656+00:00, run_end_date=2024-02-24 03:10:04.098059+00:00, run_duration=3.168403, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:08:00+00:00, data_interval_end=2024-02-24 03:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T03:10:04.109045947Z [2024-02-24T03:10:04.108+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T03:10:00+00:00, run_after=2024-02-24T03:12:00+00:00 2024-02-24T03:10:04.119899395Z [2024-02-24T03:10:04.119+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:10:04.120160978Z [2024-02-24T03:10:04.119+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:09:00+00:00, run_id=scheduled__2024-02-24T03:09:00+00:00, run_start_date=2024-02-24 03:10:00.930884+00:00, run_end_date=2024-02-24 03:10:04.119839+00:00, run_duration=3.188955, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:09:00+00:00, data_interval_end=2024-02-24 03:10:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:10:04.133507635Z [2024-02-24T03:10:04.133+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:10:00+00:00, run_after=2024-02-24T03:11:00+00:00 2024-02-24T03:10:04.181763592Z [2024-02-24T03:10:04.181+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:10:04.181831289Z 2024-02-24T03:10:04.182006706Z [2024-02-24T03:10:04.181+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:10:04.182611051Z [2024-02-24T03:10:04.182+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:10:04.182618871Z 2024-02-24T03:10:04.186384197Z [2024-02-24T03:10:04.186+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T03:10:04.186580851Z [2024-02-24T03:10:04.186+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T03:10:04.245597743Z [2024-02-24T03:10:04.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T03:05:00+00:00 exited with status queued for try_number 1 2024-02-24T03:10:04.245705236Z [2024-02-24T03:10:04.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T03:05:00+00:00 exited with status success for try_number 1 2024-02-24T03:10:04.245884279Z [2024-02-24T03:10:04.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:08:00+00:00 exited with status success for try_number 1 2024-02-24T03:10:04.246007820Z [2024-02-24T03:10:04.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:09:00+00:00 exited with status success for try_number 1 2024-02-24T03:10:04.254242291Z [2024-02-24T03:10:04.253+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T03:05:00+00:00, map_index=-1, run_start_date=2024-02-24 03:10:03.533917+00:00, run_end_date=2024-02-24 03:10:03.965644+00:00, run_duration=0.431727, state=success, executor_state=success, try_number=1, max_tries=1, job_id=968, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:10:01.044026+00:00, queued_by_job_id=2, pid=14133 2024-02-24T03:10:04.254438316Z [2024-02-24T03:10:04.254+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:09:00+00:00, map_index=-1, run_start_date=2024-02-24 03:10:02.480297+00:00, run_end_date=2024-02-24 03:10:03.125970+00:00, run_duration=0.645673, state=success, executor_state=success, try_number=1, max_tries=1, job_id=966, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:10:01.044026+00:00, queued_by_job_id=2, pid=14114 2024-02-24T03:10:04.254629320Z [2024-02-24T03:10:04.254+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T03:08:00+00:00, map_index=-1, run_start_date=2024-02-24 03:10:02.607865+00:00, run_end_date=2024-02-24 03:10:03.220564+00:00, run_duration=0.612699, state=success, executor_state=success, try_number=1, max_tries=1, job_id=967, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:10:01.044026+00:00, queued_by_job_id=2, pid=14116 2024-02-24T03:10:04.254861032Z [2024-02-24T03:10:04.254+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c681b51-db4a-42e1-910b-02d081ff720e 2024-02-24T03:10:06.267776831Z [2024-02-24T03:10:06.267+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:10:06.268089960Z [2024-02-24T03:10:06.267+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:09:00+00:00, run_id=scheduled__2024-02-24T03:09:00+00:00, run_start_date=2024-02-24 03:10:00.933357+00:00, run_end_date=2024-02-24 03:10:06.267717+00:00, run_duration=5.33436, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:09:00+00:00, data_interval_end=2024-02-24 03:10:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:10:06.287793384Z [2024-02-24T03:10:06.287+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:10:00+00:00, run_after=2024-02-24T03:11:00+00:00 2024-02-24T03:10:06.338816251Z [2024-02-24T03:10:06.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:09:00+00:00 exited with status success for try_number 1 2024-02-24T03:10:06.346806172Z [2024-02-24T03:10:06.346+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:09:00+00:00, map_index=-1, run_start_date=2024-02-24 03:10:03.960640+00:00, run_end_date=2024-02-24 03:10:05.839029+00:00, run_duration=1.878389, state=success, executor_state=success, try_number=1, max_tries=1, job_id=969, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:10:01.044026+00:00, queued_by_job_id=2, pid=14145 2024-02-24T03:10:07.420030709Z [2024-02-24T03:10:07.419+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:10:07.420385695Z [2024-02-24T03:10:07.420+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:09:00+00:00, run_id=scheduled__2024-02-24T03:09:00+00:00, run_start_date=2024-02-24 03:10:00.932063+00:00, run_end_date=2024-02-24 03:10:07.419897+00:00, run_duration=6.487834, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:09:00+00:00, data_interval_end=2024-02-24 03:10:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:10:07.435054311Z [2024-02-24T03:10:07.434+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:10:00+00:00, run_after=2024-02-24T03:11:00+00:00 2024-02-24T03:10:07.480853959Z [2024-02-24T03:10:07.480+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:10:07.480903652Z 2024-02-24T03:10:07.481310171Z [2024-02-24T03:10:07.481+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:10:07.482620751Z [2024-02-24T03:10:07.482+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:10:07.482637135Z 2024-02-24T03:10:07.488144289Z [2024-02-24T03:10:07.487+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T03:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T03:10:07.488905522Z [2024-02-24T03:10:07.488+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T03:10:07.549079811Z [2024-02-24T03:10:07.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T03:05:00+00:00 exited with status queued for try_number 1 2024-02-24T03:10:07.549182297Z [2024-02-24T03:10:07.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:09:00+00:00 exited with status success for try_number 1 2024-02-24T03:10:07.549202077Z [2024-02-24T03:10:07.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T03:05:00+00:00 exited with status success for try_number 1 2024-02-24T03:10:07.562463818Z [2024-02-24T03:10:07.561+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:09:00+00:00, map_index=-1, run_start_date=2024-02-24 03:10:04.616946+00:00, run_end_date=2024-02-24 03:10:06.174253+00:00, run_duration=1.557307, state=success, executor_state=success, try_number=1, max_tries=1, job_id=970, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:10:01.044026+00:00, queued_by_job_id=2, pid=14157 2024-02-24T03:10:07.562505636Z [2024-02-24T03:10:07.562+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T03:05:00+00:00, map_index=-1, run_start_date=2024-02-24 03:10:05.885589+00:00, run_end_date=2024-02-24 03:10:06.320392+00:00, run_duration=0.434803, state=success, executor_state=success, try_number=1, max_tries=1, job_id=971, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:10:04.183176+00:00, queued_by_job_id=2, pid=14169 2024-02-24T03:10:07.562650287Z [2024-02-24T03:10:07.562+0000] {scheduler_job.py:635} INFO - Setting external_id for to c55eed07-6eae-4dc3-91f3-b165240eff75 2024-02-24T03:10:09.820060124Z [2024-02-24T03:10:09.819+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:10:09.820108123Z 2024-02-24T03:10:09.820116552Z [2024-02-24T03:10:09.819+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:10:09.820905873Z [2024-02-24T03:10:09.820+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:10:09.820918440Z 2024-02-24T03:10:09.823850959Z [2024-02-24T03:10:09.823+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:10:09.824005277Z [2024-02-24T03:10:09.823+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T03:10:09.874044473Z [2024-02-24T03:10:09.873+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T03:05:00+00:00 exited with status queued for try_number 1 2024-02-24T03:10:09.874528725Z [2024-02-24T03:10:09.873+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T03:05:00+00:00 exited with status success for try_number 1 2024-02-24T03:10:09.883773003Z [2024-02-24T03:10:09.883+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35483362-f0f1-489c-a7f5-7e95f4501c78 2024-02-24T03:10:09.884326568Z [2024-02-24T03:10:09.884+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T03:05:00+00:00, map_index=0, run_start_date=2024-02-24 03:10:09.145977+00:00, run_end_date=2024-02-24 03:10:09.540506+00:00, run_duration=0.394529, state=success, executor_state=success, try_number=1, max_tries=1, job_id=972, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:10:07.483224+00:00, queued_by_job_id=2, pid=14177 2024-02-24T03:10:12.165110553Z [2024-02-24T03:10:12.164+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:10:12.165233512Z [2024-02-24T03:10:12.164+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:05:00+00:00, run_id=scheduled__2024-02-24T03:05:00+00:00, run_start_date=2024-02-24 03:10:00.928112+00:00, run_end_date=2024-02-24 03:10:12.164886+00:00, run_duration=11.236774, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:05:00+00:00, data_interval_end=2024-02-24 03:10:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T03:10:12.172905915Z [2024-02-24T03:10:12.172+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:10:00+00:00, run_after=2024-02-24T03:15:00+00:00 2024-02-24T03:10:12.215528602Z [2024-02-24T03:10:12.215+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T03:05:00+00:00 exited with status success for try_number 1 2024-02-24T03:10:12.222347901Z [2024-02-24T03:10:12.221+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T03:05:00+00:00, map_index=-1, run_start_date=2024-02-24 03:10:11.548225+00:00, run_end_date=2024-02-24 03:10:11.947957+00:00, run_duration=0.399732, state=success, executor_state=success, try_number=1, max_tries=1, job_id=973, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:10:09.821390+00:00, queued_by_job_id=2, pid=14185 2024-02-24T03:11:00.120240451Z [2024-02-24T03:11:00.119+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:11:00+00:00, run_after=2024-02-24T03:12:00+00:00 2024-02-24T03:11:00.131733053Z [2024-02-24T03:11:00.131+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:11:00.148342823Z [2024-02-24T03:11:00.148+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:11:00+00:00, run_after=2024-02-24T03:12:00+00:00 2024-02-24T03:11:00.243081784Z [2024-02-24T03:11:00.242+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T03:11:00.243116311Z 2024-02-24T03:11:00.243124458Z 2024-02-24T03:11:00.243128740Z 2024-02-24T03:11:00.243781179Z [2024-02-24T03:11:00.243+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:11:00.244075212Z [2024-02-24T03:11:00.243+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:11:00.244282530Z [2024-02-24T03:11:00.244+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:11:00.245042672Z [2024-02-24T03:11:00.244+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:11:00.245056025Z 2024-02-24T03:11:00.245061557Z 2024-02-24T03:11:00.245066901Z 2024-02-24T03:11:00.248824551Z [2024-02-24T03:11:00.248+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:11:00.249080238Z [2024-02-24T03:11:00.248+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:11:00.249474889Z [2024-02-24T03:11:00.249+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:11:00.249723223Z [2024-02-24T03:11:00.249+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:11:00.250078823Z [2024-02-24T03:11:00.249+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:11:00.250326118Z [2024-02-24T03:11:00.250+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:11:00.530864920Z [2024-02-24T03:11:00.530+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:10:00+00:00 exited with status queued for try_number 1 2024-02-24T03:11:00.530903473Z [2024-02-24T03:11:00.530+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:10:00+00:00 exited with status queued for try_number 1 2024-02-24T03:11:00.531037055Z [2024-02-24T03:11:00.530+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:10:00+00:00 exited with status queued for try_number 1 2024-02-24T03:11:00.555065056Z [2024-02-24T03:11:00.554+0000] {scheduler_job.py:635} INFO - Setting external_id for to d33f539c-aa66-444c-be7f-cd9ca65fd3fd 2024-02-24T03:11:00.555111608Z [2024-02-24T03:11:00.554+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5bdb8313-e49b-4410-909e-4f9368aba901 2024-02-24T03:11:00.555203286Z [2024-02-24T03:11:00.555+0000] {scheduler_job.py:635} INFO - Setting external_id for to ce4f6c2b-e0fc-4af3-851e-7e06712a8fba 2024-02-24T03:11:02.013642590Z [2024-02-24T03:11:02.013+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:11:02.014224559Z [2024-02-24T03:11:02.013+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:10:00+00:00, run_id=scheduled__2024-02-24T03:10:00+00:00, run_start_date=2024-02-24 03:11:00.162521+00:00, run_end_date=2024-02-24 03:11:02.013529+00:00, run_duration=1.851008, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:10:00+00:00, data_interval_end=2024-02-24 03:11:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:11:02.024695067Z [2024-02-24T03:11:02.024+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:11:00+00:00, run_after=2024-02-24T03:12:00+00:00 2024-02-24T03:11:02.094413644Z [2024-02-24T03:11:02.093+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:10:00+00:00 exited with status success for try_number 1 2024-02-24T03:11:02.100209294Z [2024-02-24T03:11:02.099+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:10:00+00:00, map_index=-1, run_start_date=2024-02-24 03:11:01.141302+00:00, run_end_date=2024-02-24 03:11:01.616071+00:00, run_duration=0.474769, state=success, executor_state=success, try_number=1, max_tries=1, job_id=974, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:11:00.246025+00:00, queued_by_job_id=2, pid=14207 2024-02-24T03:11:04.268868426Z [2024-02-24T03:11:04.268+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:11:04.269566201Z [2024-02-24T03:11:04.269+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:10:00+00:00, run_id=scheduled__2024-02-24T03:10:00+00:00, run_start_date=2024-02-24 03:11:00.164970+00:00, run_end_date=2024-02-24 03:11:04.268857+00:00, run_duration=4.103887, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:10:00+00:00, data_interval_end=2024-02-24 03:11:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:11:04.291861171Z [2024-02-24T03:11:04.291+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:11:00+00:00, run_after=2024-02-24T03:12:00+00:00 2024-02-24T03:11:04.338582373Z [2024-02-24T03:11:04.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:10:00+00:00 exited with status success for try_number 1 2024-02-24T03:11:04.345131401Z [2024-02-24T03:11:04.344+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:10:00+00:00, map_index=-1, run_start_date=2024-02-24 03:11:02.515749+00:00, run_end_date=2024-02-24 03:11:04.152215+00:00, run_duration=1.636466, state=success, executor_state=success, try_number=1, max_tries=1, job_id=976, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:11:00.246025+00:00, queued_by_job_id=2, pid=14226 2024-02-24T03:11:05.400265098Z [2024-02-24T03:11:05.399+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:11:05.400520357Z [2024-02-24T03:11:05.400+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:10:00+00:00, run_id=scheduled__2024-02-24T03:10:00+00:00, run_start_date=2024-02-24 03:11:00.167212+00:00, run_end_date=2024-02-24 03:11:05.400056+00:00, run_duration=5.232844, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:10:00+00:00, data_interval_end=2024-02-24 03:11:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:11:05.410712705Z [2024-02-24T03:11:05.410+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:11:00+00:00, run_after=2024-02-24T03:12:00+00:00 2024-02-24T03:11:05.444224459Z [2024-02-24T03:11:05.443+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:10:00+00:00 exited with status success for try_number 1 2024-02-24T03:11:05.451357961Z [2024-02-24T03:11:05.450+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:10:00+00:00, map_index=-1, run_start_date=2024-02-24 03:11:02.347888+00:00, run_end_date=2024-02-24 03:11:04.425840+00:00, run_duration=2.077952, state=success, executor_state=success, try_number=1, max_tries=1, job_id=975, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:11:00.246025+00:00, queued_by_job_id=2, pid=14225 2024-02-24T03:12:00.041381183Z [2024-02-24T03:12:00.040+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:12:00.057455517Z [2024-02-24T03:12:00.057+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:12:00+00:00, run_after=2024-02-24T03:13:00+00:00 2024-02-24T03:12:00.064777190Z [2024-02-24T03:12:00.064+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:12:00.076566839Z [2024-02-24T03:12:00.076+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:12:00+00:00, run_after=2024-02-24T03:13:00+00:00 2024-02-24T03:12:00.172804883Z [2024-02-24T03:12:00.172+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T03:12:00.172840687Z 2024-02-24T03:12:00.172847267Z 2024-02-24T03:12:00.172853178Z 2024-02-24T03:12:00.172859252Z 2024-02-24T03:12:00.173086347Z [2024-02-24T03:12:00.172+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T03:12:00.173396082Z [2024-02-24T03:12:00.173+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:12:00.173636137Z [2024-02-24T03:12:00.173+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:12:00.173914246Z [2024-02-24T03:12:00.173+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:12:00.174824518Z [2024-02-24T03:12:00.174+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:12:00.174840278Z 2024-02-24T03:12:00.174846764Z 2024-02-24T03:12:00.174851954Z 2024-02-24T03:12:00.174857056Z 2024-02-24T03:12:00.179864553Z [2024-02-24T03:12:00.179+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:12:00.180089178Z [2024-02-24T03:12:00.179+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T03:12:00.180544029Z [2024-02-24T03:12:00.180+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:12:00.180771862Z [2024-02-24T03:12:00.180+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:12:00.181168672Z [2024-02-24T03:12:00.180+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:12:00.181179034Z [2024-02-24T03:12:00.181+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:12:00.181620915Z [2024-02-24T03:12:00.181+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:12:00.181841359Z [2024-02-24T03:12:00.181+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:12:00.482399375Z [2024-02-24T03:12:00.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:10:00+00:00 exited with status queued for try_number 1 2024-02-24T03:12:00.482566338Z [2024-02-24T03:12:00.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:11:00+00:00 exited with status queued for try_number 1 2024-02-24T03:12:00.482685171Z [2024-02-24T03:12:00.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:11:00+00:00 exited with status queued for try_number 1 2024-02-24T03:12:00.482797536Z [2024-02-24T03:12:00.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:11:00+00:00 exited with status queued for try_number 1 2024-02-24T03:12:00.492943241Z [2024-02-24T03:12:00.492+0000] {scheduler_job.py:635} INFO - Setting external_id for to 07e0491d-8e6c-42cb-9175-781d89429cd4 2024-02-24T03:12:00.493128613Z [2024-02-24T03:12:00.492+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe16ba4c-ac06-49a6-ad2d-e8f4319d001a 2024-02-24T03:12:00.493341651Z [2024-02-24T03:12:00.493+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c16456f-f128-4648-8e74-a4478d3078ed 2024-02-24T03:12:00.493503397Z [2024-02-24T03:12:00.493+0000] {scheduler_job.py:635} INFO - Setting external_id for to 68ec09eb-d78a-4abd-a030-dc11b119e6a7 2024-02-24T03:12:01.706554186Z [2024-02-24T03:12:01.705+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:12:01.707517128Z [2024-02-24T03:12:01.707+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 03:10:00+00:00, run_id=scheduled__2024-02-24T03:10:00+00:00, run_start_date=2024-02-24 03:12:00.091011+00:00, run_end_date=2024-02-24 03:12:01.706737+00:00, run_duration=1.615726, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:10:00+00:00, data_interval_end=2024-02-24 03:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T03:12:01.717417746Z [2024-02-24T03:12:01.716+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T03:12:00+00:00, run_after=2024-02-24T03:14:00+00:00 2024-02-24T03:12:01.816201331Z [2024-02-24T03:12:01.815+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:10:00+00:00 exited with status success for try_number 1 2024-02-24T03:12:01.822252214Z [2024-02-24T03:12:01.821+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T03:10:00+00:00, map_index=-1, run_start_date=2024-02-24 03:12:00.938084+00:00, run_end_date=2024-02-24 03:12:01.473561+00:00, run_duration=0.535477, state=success, executor_state=success, try_number=1, max_tries=1, job_id=977, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:12:00.176093+00:00, queued_by_job_id=2, pid=14260 2024-02-24T03:12:01.914992603Z [2024-02-24T03:12:01.914+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:12:01.915296757Z [2024-02-24T03:12:01.915+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:11:00+00:00, run_id=scheduled__2024-02-24T03:11:00+00:00, run_start_date=2024-02-24 03:12:00.092371+00:00, run_end_date=2024-02-24 03:12:01.914899+00:00, run_duration=1.822528, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:11:00+00:00, data_interval_end=2024-02-24 03:12:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:12:01.924957552Z [2024-02-24T03:12:01.924+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:12:00+00:00, run_after=2024-02-24T03:13:00+00:00 2024-02-24T03:12:01.991927512Z [2024-02-24T03:12:01.991+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:11:00+00:00 exited with status success for try_number 1 2024-02-24T03:12:01.998936692Z [2024-02-24T03:12:01.998+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:11:00+00:00, map_index=-1, run_start_date=2024-02-24 03:12:01.231991+00:00, run_end_date=2024-02-24 03:12:01.744118+00:00, run_duration=0.512127, state=success, executor_state=success, try_number=1, max_tries=1, job_id=978, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:12:00.176093+00:00, queued_by_job_id=2, pid=14261 2024-02-24T03:12:04.197723122Z [2024-02-24T03:12:04.197+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:12:04.200775897Z [2024-02-24T03:12:04.200+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:11:00+00:00, run_id=scheduled__2024-02-24T03:11:00+00:00, run_start_date=2024-02-24 03:12:00.094678+00:00, run_end_date=2024-02-24 03:12:04.200318+00:00, run_duration=4.10564, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:11:00+00:00, data_interval_end=2024-02-24 03:12:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:12:04.211843712Z [2024-02-24T03:12:04.211+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:12:00+00:00, run_after=2024-02-24T03:13:00+00:00 2024-02-24T03:12:04.265316191Z [2024-02-24T03:12:04.264+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:11:00+00:00 exited with status success for try_number 1 2024-02-24T03:12:04.274412952Z [2024-02-24T03:12:04.274+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:11:00+00:00, map_index=-1, run_start_date=2024-02-24 03:12:02.602995+00:00, run_end_date=2024-02-24 03:12:04.073069+00:00, run_duration=1.470074, state=success, executor_state=success, try_number=1, max_tries=1, job_id=980, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:12:00.176093+00:00, queued_by_job_id=2, pid=14285 2024-02-24T03:12:05.164587361Z [2024-02-24T03:12:05.164+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:12:05.164939344Z [2024-02-24T03:12:05.164+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:11:00+00:00, run_id=scheduled__2024-02-24T03:11:00+00:00, run_start_date=2024-02-24 03:12:00.093590+00:00, run_end_date=2024-02-24 03:12:05.164395+00:00, run_duration=5.070805, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:11:00+00:00, data_interval_end=2024-02-24 03:12:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:12:05.174970038Z [2024-02-24T03:12:05.174+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:12:00+00:00, run_after=2024-02-24T03:13:00+00:00 2024-02-24T03:12:05.216263230Z [2024-02-24T03:12:05.215+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:11:00+00:00 exited with status success for try_number 1 2024-02-24T03:12:05.224799700Z [2024-02-24T03:12:05.224+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:11:00+00:00, map_index=-1, run_start_date=2024-02-24 03:12:02.301962+00:00, run_end_date=2024-02-24 03:12:04.131375+00:00, run_duration=1.829413, state=success, executor_state=success, try_number=1, max_tries=1, job_id=979, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:12:00.176093+00:00, queued_by_job_id=2, pid=14281 2024-02-24T03:12:05.237723897Z [2024-02-24T03:12:05.237+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T03:13:00.972263678Z [2024-02-24T03:13:00.971+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:13:00.991169936Z [2024-02-24T03:13:00.990+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:13:00+00:00, run_after=2024-02-24T03:14:00+00:00 2024-02-24T03:13:01.013675489Z [2024-02-24T03:13:01.013+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:13:00+00:00, run_after=2024-02-24T03:14:00+00:00 2024-02-24T03:13:01.124858810Z [2024-02-24T03:13:01.124+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T03:13:01.124903746Z 2024-02-24T03:13:01.124912452Z 2024-02-24T03:13:01.124919783Z 2024-02-24T03:13:01.125866379Z [2024-02-24T03:13:01.125+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:13:01.126336937Z [2024-02-24T03:13:01.126+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:13:01.126703017Z [2024-02-24T03:13:01.126+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:13:01.128138082Z [2024-02-24T03:13:01.127+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:13:01.128153277Z 2024-02-24T03:13:01.128162333Z 2024-02-24T03:13:01.128169744Z 2024-02-24T03:13:01.135500464Z [2024-02-24T03:13:01.135+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:13:01.135741767Z [2024-02-24T03:13:01.135+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:13:01.136126999Z [2024-02-24T03:13:01.135+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:13:01.136358963Z [2024-02-24T03:13:01.136+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:13:01.136784293Z [2024-02-24T03:13:01.136+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:13:01.137017423Z [2024-02-24T03:13:01.136+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:13:01.447512085Z [2024-02-24T03:13:01.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:12:00+00:00 exited with status queued for try_number 1 2024-02-24T03:13:01.447723851Z [2024-02-24T03:13:01.447+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:12:00+00:00 exited with status queued for try_number 1 2024-02-24T03:13:01.447893126Z [2024-02-24T03:13:01.447+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:12:00+00:00 exited with status queued for try_number 1 2024-02-24T03:13:01.455871434Z [2024-02-24T03:13:01.455+0000] {scheduler_job.py:635} INFO - Setting external_id for to b1a1d2a2-ed65-4fa9-a806-be928afeed20 2024-02-24T03:13:01.456126033Z [2024-02-24T03:13:01.455+0000] {scheduler_job.py:635} INFO - Setting external_id for to e36fdfec-abe8-40df-96e2-889acf816dbb 2024-02-24T03:13:01.456344592Z [2024-02-24T03:13:01.456+0000] {scheduler_job.py:635} INFO - Setting external_id for to 273aa18d-78bd-4931-9350-34433e8c6115 2024-02-24T03:13:02.711544999Z [2024-02-24T03:13:02.710+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:13:02.712911239Z [2024-02-24T03:13:02.711+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:12:00+00:00, run_id=scheduled__2024-02-24T03:12:00+00:00, run_start_date=2024-02-24 03:13:01.047698+00:00, run_end_date=2024-02-24 03:13:02.711457+00:00, run_duration=1.663759, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:12:00+00:00, data_interval_end=2024-02-24 03:13:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:13:02.724537435Z [2024-02-24T03:13:02.724+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:13:00+00:00, run_after=2024-02-24T03:14:00+00:00 2024-02-24T03:13:02.851348646Z [2024-02-24T03:13:02.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:12:00+00:00 exited with status success for try_number 1 2024-02-24T03:13:02.872930850Z [2024-02-24T03:13:02.871+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:12:00+00:00, map_index=-1, run_start_date=2024-02-24 03:13:02.015758+00:00, run_end_date=2024-02-24 03:13:02.455129+00:00, run_duration=0.439371, state=success, executor_state=success, try_number=1, max_tries=1, job_id=981, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:13:01.130227+00:00, queued_by_job_id=2, pid=14317 2024-02-24T03:13:06.176613884Z [2024-02-24T03:13:06.176+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:13:06.177215666Z [2024-02-24T03:13:06.176+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:12:00+00:00, run_id=scheduled__2024-02-24T03:12:00+00:00, run_start_date=2024-02-24 03:13:01.048878+00:00, run_end_date=2024-02-24 03:13:06.176832+00:00, run_duration=5.127954, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:12:00+00:00, data_interval_end=2024-02-24 03:13:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:13:06.189621938Z [2024-02-24T03:13:06.189+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:13:00+00:00, run_after=2024-02-24T03:14:00+00:00 2024-02-24T03:13:06.198096717Z [2024-02-24T03:13:06.197+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:13:06.198488676Z [2024-02-24T03:13:06.198+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:12:00+00:00, run_id=scheduled__2024-02-24T03:12:00+00:00, run_start_date=2024-02-24 03:13:01.049877+00:00, run_end_date=2024-02-24 03:13:06.198194+00:00, run_duration=5.148317, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:12:00+00:00, data_interval_end=2024-02-24 03:13:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:13:06.207982412Z [2024-02-24T03:13:06.207+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:13:00+00:00, run_after=2024-02-24T03:14:00+00:00 2024-02-24T03:13:06.259986071Z [2024-02-24T03:13:06.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:12:00+00:00 exited with status success for try_number 1 2024-02-24T03:13:06.260083222Z [2024-02-24T03:13:06.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:12:00+00:00 exited with status success for try_number 1 2024-02-24T03:13:06.268202706Z [2024-02-24T03:13:06.267+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:12:00+00:00, map_index=-1, run_start_date=2024-02-24 03:13:03.540361+00:00, run_end_date=2024-02-24 03:13:05.614539+00:00, run_duration=2.074178, state=success, executor_state=success, try_number=1, max_tries=1, job_id=983, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:13:01.130227+00:00, queued_by_job_id=2, pid=14336 2024-02-24T03:13:06.268566377Z [2024-02-24T03:13:06.268+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:12:00+00:00, map_index=-1, run_start_date=2024-02-24 03:13:03.265525+00:00, run_end_date=2024-02-24 03:13:05.713459+00:00, run_duration=2.447934, state=success, executor_state=success, try_number=1, max_tries=1, job_id=982, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:13:01.130227+00:00, queued_by_job_id=2, pid=14330 2024-02-24T03:14:00.824995817Z [2024-02-24T03:14:00.824+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:14:00.839602768Z [2024-02-24T03:14:00.839+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:14:00+00:00, run_after=2024-02-24T03:15:00+00:00 2024-02-24T03:14:00.846643227Z [2024-02-24T03:14:00.846+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:14:00.871044771Z [2024-02-24T03:14:00.870+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:14:00+00:00, run_after=2024-02-24T03:15:00+00:00 2024-02-24T03:14:00.953680084Z [2024-02-24T03:14:00.953+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T03:14:00.953723674Z 2024-02-24T03:14:00.953734645Z 2024-02-24T03:14:00.953743403Z 2024-02-24T03:14:00.953752113Z 2024-02-24T03:14:00.953762133Z [2024-02-24T03:14:00.953+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T03:14:00.953837512Z [2024-02-24T03:14:00.953+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:14:00.953857916Z [2024-02-24T03:14:00.953+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:14:00.953891431Z [2024-02-24T03:14:00.953+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:14:00.954513665Z [2024-02-24T03:14:00.954+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:14:00.954533225Z 2024-02-24T03:14:00.954543370Z 2024-02-24T03:14:00.954552021Z 2024-02-24T03:14:00.954586666Z 2024-02-24T03:14:00.959986226Z [2024-02-24T03:14:00.959+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:14:00.960548188Z [2024-02-24T03:14:00.960+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T03:14:00.961392489Z [2024-02-24T03:14:00.960+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:14:00.962050713Z [2024-02-24T03:14:00.961+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:14:00.962937741Z [2024-02-24T03:14:00.962+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:14:00.965713471Z [2024-02-24T03:14:00.964+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:14:00.965749138Z [2024-02-24T03:14:00.964+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:14:00.965758391Z [2024-02-24T03:14:00.964+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:14:01.479704191Z [2024-02-24T03:14:01.478+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:12:00+00:00 exited with status queued for try_number 1 2024-02-24T03:14:01.480021690Z [2024-02-24T03:14:01.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:13:00+00:00 exited with status queued for try_number 1 2024-02-24T03:14:01.480272756Z [2024-02-24T03:14:01.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:13:00+00:00 exited with status queued for try_number 1 2024-02-24T03:14:01.480514466Z [2024-02-24T03:14:01.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:13:00+00:00 exited with status queued for try_number 1 2024-02-24T03:14:01.503885748Z [2024-02-24T03:14:01.503+0000] {scheduler_job.py:635} INFO - Setting external_id for to 936fe6c3-6055-4cb7-bc23-0919d98024bb 2024-02-24T03:14:01.503914214Z [2024-02-24T03:14:01.503+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a3df314-cc13-4cf6-b33e-3162e64d5bd1 2024-02-24T03:14:01.503993175Z [2024-02-24T03:14:01.503+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3524e120-d08b-4201-b87f-2ec55f2c1b4c 2024-02-24T03:14:01.510657863Z [2024-02-24T03:14:01.503+0000] {scheduler_job.py:635} INFO - Setting external_id for to 499f6a3f-dcd7-455b-b4a5-b82146f304fc 2024-02-24T03:14:02.759138246Z [2024-02-24T03:14:02.758+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:14:02.759941780Z [2024-02-24T03:14:02.759+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 03:12:00+00:00, run_id=scheduled__2024-02-24T03:12:00+00:00, run_start_date=2024-02-24 03:14:00.885492+00:00, run_end_date=2024-02-24 03:14:02.759068+00:00, run_duration=1.873576, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:12:00+00:00, data_interval_end=2024-02-24 03:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T03:14:02.768361531Z [2024-02-24T03:14:02.768+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T03:14:00+00:00, run_after=2024-02-24T03:16:00+00:00 2024-02-24T03:14:02.775147459Z [2024-02-24T03:14:02.774+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:14:02.775320585Z [2024-02-24T03:14:02.775+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:13:00+00:00, run_id=scheduled__2024-02-24T03:13:00+00:00, run_start_date=2024-02-24 03:14:00.887197+00:00, run_end_date=2024-02-24 03:14:02.775093+00:00, run_duration=1.887896, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:13:00+00:00, data_interval_end=2024-02-24 03:14:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:14:02.788169924Z [2024-02-24T03:14:02.787+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:14:00+00:00, run_after=2024-02-24T03:15:00+00:00 2024-02-24T03:14:02.840362068Z [2024-02-24T03:14:02.840+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:12:00+00:00 exited with status success for try_number 1 2024-02-24T03:14:02.840694432Z [2024-02-24T03:14:02.840+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:13:00+00:00 exited with status success for try_number 1 2024-02-24T03:14:02.848612607Z [2024-02-24T03:14:02.848+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T03:12:00+00:00, map_index=-1, run_start_date=2024-02-24 03:14:01.963596+00:00, run_end_date=2024-02-24 03:14:02.418474+00:00, run_duration=0.454878, state=success, executor_state=success, try_number=1, max_tries=1, job_id=984, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:14:00.955214+00:00, queued_by_job_id=2, pid=14369 2024-02-24T03:14:02.849182061Z [2024-02-24T03:14:02.848+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:13:00+00:00, map_index=-1, run_start_date=2024-02-24 03:14:02.007887+00:00, run_end_date=2024-02-24 03:14:02.505371+00:00, run_duration=0.497484, state=success, executor_state=success, try_number=1, max_tries=1, job_id=985, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:14:00.955214+00:00, queued_by_job_id=2, pid=14370 2024-02-24T03:14:07.106240321Z [2024-02-24T03:14:07.105+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:14:07.107558763Z [2024-02-24T03:14:07.107+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:13:00+00:00, run_id=scheduled__2024-02-24T03:13:00+00:00, run_start_date=2024-02-24 03:14:00.888536+00:00, run_end_date=2024-02-24 03:14:07.106855+00:00, run_duration=6.218319, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:13:00+00:00, data_interval_end=2024-02-24 03:14:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:14:07.134181215Z [2024-02-24T03:14:07.133+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:14:00+00:00, run_after=2024-02-24T03:15:00+00:00 2024-02-24T03:14:07.172955783Z [2024-02-24T03:14:07.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:13:00+00:00 exited with status success for try_number 1 2024-02-24T03:14:07.178082188Z [2024-02-24T03:14:07.177+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:13:00+00:00, map_index=-1, run_start_date=2024-02-24 03:14:03.296546+00:00, run_end_date=2024-02-24 03:14:06.161303+00:00, run_duration=2.864757, state=success, executor_state=success, try_number=1, max_tries=1, job_id=986, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:14:00.955214+00:00, queued_by_job_id=2, pid=14388 2024-02-24T03:14:07.457431351Z [2024-02-24T03:14:07.456+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:14:07.458183703Z [2024-02-24T03:14:07.457+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:13:00+00:00, run_id=scheduled__2024-02-24T03:13:00+00:00, run_start_date=2024-02-24 03:14:00.889614+00:00, run_end_date=2024-02-24 03:14:07.457564+00:00, run_duration=6.56795, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:13:00+00:00, data_interval_end=2024-02-24 03:14:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:14:07.471171883Z [2024-02-24T03:14:07.470+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:14:00+00:00, run_after=2024-02-24T03:15:00+00:00 2024-02-24T03:14:07.505766016Z [2024-02-24T03:14:07.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:13:00+00:00 exited with status success for try_number 1 2024-02-24T03:14:07.510416505Z [2024-02-24T03:14:07.510+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:13:00+00:00, map_index=-1, run_start_date=2024-02-24 03:14:03.732153+00:00, run_end_date=2024-02-24 03:14:07.136382+00:00, run_duration=3.404229, state=success, executor_state=success, try_number=1, max_tries=1, job_id=987, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:14:00.955214+00:00, queued_by_job_id=2, pid=14399 2024-02-24T03:15:00.675945149Z [2024-02-24T03:15:00.675+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:15:00.691553468Z [2024-02-24T03:15:00.691+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:15:00+00:00, run_after=2024-02-24T03:20:00+00:00 2024-02-24T03:15:00.705943101Z [2024-02-24T03:15:00.705+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:15:00+00:00, run_after=2024-02-24T03:16:00+00:00 2024-02-24T03:15:00.718734848Z [2024-02-24T03:15:00.718+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:15:00+00:00, run_after=2024-02-24T03:16:00+00:00 2024-02-24T03:15:00.826127320Z [2024-02-24T03:15:00.825+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T03:15:00.826156522Z 2024-02-24T03:15:00.826167534Z 2024-02-24T03:15:00.826172198Z 2024-02-24T03:15:00.826176518Z 2024-02-24T03:15:00.826228903Z [2024-02-24T03:15:00.826+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:15:00.826467024Z [2024-02-24T03:15:00.826+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:15:00.826648094Z [2024-02-24T03:15:00.826+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:15:00.826862834Z [2024-02-24T03:15:00.826+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:15:00.827959514Z [2024-02-24T03:15:00.827+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:15:00.827972708Z 2024-02-24T03:15:00.827977482Z 2024-02-24T03:15:00.828027050Z 2024-02-24T03:15:00.828032101Z 2024-02-24T03:15:00.838649403Z [2024-02-24T03:15:00.838+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T03:15:00.838880448Z [2024-02-24T03:15:00.838+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T03:15:00.839223186Z [2024-02-24T03:15:00.839+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:15:00.839496922Z [2024-02-24T03:15:00.839+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:15:00.839909240Z [2024-02-24T03:15:00.839+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:15:00.840243743Z [2024-02-24T03:15:00.840+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:15:00.848689364Z [2024-02-24T03:15:00.848+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:15:00.848982295Z [2024-02-24T03:15:00.848+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:15:01.468826820Z [2024-02-24T03:15:01.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T03:10:00+00:00 exited with status queued for try_number 1 2024-02-24T03:15:01.468895143Z [2024-02-24T03:15:01.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:14:00+00:00 exited with status queued for try_number 1 2024-02-24T03:15:01.468899990Z [2024-02-24T03:15:01.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:14:00+00:00 exited with status queued for try_number 1 2024-02-24T03:15:01.468977087Z [2024-02-24T03:15:01.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:14:00+00:00 exited with status queued for try_number 1 2024-02-24T03:15:01.484725031Z [2024-02-24T03:15:01.484+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c42b177-ab71-43e4-be17-2191295a2170 2024-02-24T03:15:01.484791295Z [2024-02-24T03:15:01.484+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7357e51a-3def-4c34-8c8d-4e25d565ad5c 2024-02-24T03:15:01.484898897Z [2024-02-24T03:15:01.484+0000] {scheduler_job.py:635} INFO - Setting external_id for to a3d0dd50-1339-4df5-80d2-51fcd6a634f2 2024-02-24T03:15:01.484995575Z [2024-02-24T03:15:01.484+0000] {scheduler_job.py:635} INFO - Setting external_id for to b0a39be0-64c8-4f17-85cf-a2b06c6212f2 2024-02-24T03:15:04.034539617Z [2024-02-24T03:15:04.034+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:15:04.034802911Z [2024-02-24T03:15:04.034+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:14:00+00:00, run_id=scheduled__2024-02-24T03:14:00+00:00, run_start_date=2024-02-24 03:15:00.732608+00:00, run_end_date=2024-02-24 03:15:04.034452+00:00, run_duration=3.301844, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:14:00+00:00, data_interval_end=2024-02-24 03:15:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:15:04.056744861Z [2024-02-24T03:15:04.056+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:15:00+00:00, run_after=2024-02-24T03:16:00+00:00 2024-02-24T03:15:04.235499516Z [2024-02-24T03:15:04.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:14:00+00:00 exited with status success for try_number 1 2024-02-24T03:15:04.248783844Z [2024-02-24T03:15:04.248+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:14:00+00:00, map_index=-1, run_start_date=2024-02-24 03:15:02.276113+00:00, run_end_date=2024-02-24 03:15:03.098122+00:00, run_duration=0.822009, state=success, executor_state=success, try_number=1, max_tries=1, job_id=988, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:15:00.829960+00:00, queued_by_job_id=2, pid=14429 2024-02-24T03:15:04.715754879Z [2024-02-24T03:15:04.715+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:15:04.715788905Z 2024-02-24T03:15:04.715844163Z [2024-02-24T03:15:04.715+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:15:04.717465748Z [2024-02-24T03:15:04.717+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:15:04.717482463Z 2024-02-24T03:15:04.720402280Z [2024-02-24T03:15:04.720+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T03:15:04.720480951Z [2024-02-24T03:15:04.720+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T03:15:04.798179674Z [2024-02-24T03:15:04.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T03:10:00+00:00 exited with status queued for try_number 1 2024-02-24T03:15:04.798510949Z [2024-02-24T03:15:04.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T03:10:00+00:00 exited with status success for try_number 1 2024-02-24T03:15:04.807796502Z [2024-02-24T03:15:04.807+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3cc3761-c135-470e-aeea-c193ccac333c 2024-02-24T03:15:04.808176706Z [2024-02-24T03:15:04.807+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T03:10:00+00:00, map_index=-1, run_start_date=2024-02-24 03:15:03.681494+00:00, run_end_date=2024-02-24 03:15:04.300517+00:00, run_duration=0.619023, state=success, executor_state=success, try_number=1, max_tries=1, job_id=990, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:15:00.829960+00:00, queued_by_job_id=2, pid=14451 2024-02-24T03:15:05.964250895Z [2024-02-24T03:15:05.963+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:15:05.964564094Z [2024-02-24T03:15:05.964+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:14:00+00:00, run_id=scheduled__2024-02-24T03:14:00+00:00, run_start_date=2024-02-24 03:15:00.735626+00:00, run_end_date=2024-02-24 03:15:05.964180+00:00, run_duration=5.228554, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:14:00+00:00, data_interval_end=2024-02-24 03:15:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:15:05.974055059Z [2024-02-24T03:15:05.973+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:15:00+00:00, run_after=2024-02-24T03:16:00+00:00 2024-02-24T03:15:06.043825021Z [2024-02-24T03:15:06.043+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:14:00+00:00 exited with status success for try_number 1 2024-02-24T03:15:06.052337121Z [2024-02-24T03:15:06.051+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:14:00+00:00, map_index=-1, run_start_date=2024-02-24 03:15:03.761572+00:00, run_end_date=2024-02-24 03:15:05.182045+00:00, run_duration=1.420473, state=success, executor_state=success, try_number=1, max_tries=1, job_id=989, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:15:00.829960+00:00, queued_by_job_id=2, pid=14452 2024-02-24T03:15:07.096135018Z [2024-02-24T03:15:07.095+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:15:07.096450744Z [2024-02-24T03:15:07.096+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:14:00+00:00, run_id=scheduled__2024-02-24T03:14:00+00:00, run_start_date=2024-02-24 03:15:00.738483+00:00, run_end_date=2024-02-24 03:15:07.095983+00:00, run_duration=6.3575, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:14:00+00:00, data_interval_end=2024-02-24 03:15:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:15:07.105913791Z [2024-02-24T03:15:07.105+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:15:00+00:00, run_after=2024-02-24T03:16:00+00:00 2024-02-24T03:15:07.137935422Z [2024-02-24T03:15:07.137+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:15:07.137977450Z 2024-02-24T03:15:07.138275983Z [2024-02-24T03:15:07.137+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:15:07.138959297Z [2024-02-24T03:15:07.138+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:15:07.138970651Z 2024-02-24T03:15:07.142255877Z [2024-02-24T03:15:07.141+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T03:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T03:15:07.142716772Z [2024-02-24T03:15:07.142+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T03:15:07.189518129Z [2024-02-24T03:15:07.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T03:10:00+00:00 exited with status queued for try_number 1 2024-02-24T03:15:07.189588114Z [2024-02-24T03:15:07.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:14:00+00:00 exited with status success for try_number 1 2024-02-24T03:15:07.189724923Z [2024-02-24T03:15:07.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T03:10:00+00:00 exited with status success for try_number 1 2024-02-24T03:15:07.198856811Z [2024-02-24T03:15:07.198+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:14:00+00:00, map_index=-1, run_start_date=2024-02-24 03:15:04.083927+00:00, run_end_date=2024-02-24 03:15:06.032789+00:00, run_duration=1.948862, state=success, executor_state=success, try_number=1, max_tries=1, job_id=991, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:15:00.829960+00:00, queued_by_job_id=2, pid=14453 2024-02-24T03:15:07.199047254Z [2024-02-24T03:15:07.198+0000] {scheduler_job.py:635} INFO - Setting external_id for to 04625b9b-d874-4d1b-a235-9ded7f379d9e 2024-02-24T03:15:07.199209907Z [2024-02-24T03:15:07.199+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T03:10:00+00:00, map_index=-1, run_start_date=2024-02-24 03:15:06.451622+00:00, run_end_date=2024-02-24 03:15:06.814809+00:00, run_duration=0.363187, state=success, executor_state=success, try_number=1, max_tries=1, job_id=992, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:15:04.718100+00:00, queued_by_job_id=2, pid=14476 2024-02-24T03:15:09.895082091Z [2024-02-24T03:15:09.894+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:15:09.895117995Z 2024-02-24T03:15:09.895237360Z [2024-02-24T03:15:09.894+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:15:09.895916744Z [2024-02-24T03:15:09.895+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:15:09.895931229Z 2024-02-24T03:15:09.899199027Z [2024-02-24T03:15:09.898+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:15:09.899383928Z [2024-02-24T03:15:09.899+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T03:15:09.967376684Z [2024-02-24T03:15:09.966+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T03:10:00+00:00 exited with status queued for try_number 1 2024-02-24T03:15:09.967565751Z [2024-02-24T03:15:09.967+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T03:10:00+00:00 exited with status success for try_number 1 2024-02-24T03:15:09.974873787Z [2024-02-24T03:15:09.974+0000] {scheduler_job.py:635} INFO - Setting external_id for to 108133ca-c064-4b9b-8bf2-e9fe595f0e5f 2024-02-24T03:15:09.975092410Z [2024-02-24T03:15:09.974+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T03:10:00+00:00, map_index=0, run_start_date=2024-02-24 03:15:08.987179+00:00, run_end_date=2024-02-24 03:15:09.361758+00:00, run_duration=0.374579, state=success, executor_state=success, try_number=1, max_tries=1, job_id=993, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:15:07.139442+00:00, queued_by_job_id=2, pid=14484 2024-02-24T03:15:12.214661429Z [2024-02-24T03:15:12.214+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:15:12.215308175Z [2024-02-24T03:15:12.214+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:10:00+00:00, run_id=scheduled__2024-02-24T03:10:00+00:00, run_start_date=2024-02-24 03:15:00.731123+00:00, run_end_date=2024-02-24 03:15:12.214513+00:00, run_duration=11.48339, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:10:00+00:00, data_interval_end=2024-02-24 03:15:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T03:15:12.226422808Z [2024-02-24T03:15:12.225+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:15:00+00:00, run_after=2024-02-24T03:20:00+00:00 2024-02-24T03:15:12.276989617Z [2024-02-24T03:15:12.276+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T03:10:00+00:00 exited with status success for try_number 1 2024-02-24T03:15:12.285059224Z [2024-02-24T03:15:12.284+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T03:10:00+00:00, map_index=-1, run_start_date=2024-02-24 03:15:11.535800+00:00, run_end_date=2024-02-24 03:15:11.897242+00:00, run_duration=0.361442, state=success, executor_state=success, try_number=1, max_tries=1, job_id=994, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:15:09.896352+00:00, queued_by_job_id=2, pid=14492 2024-02-24T03:16:00.664463138Z [2024-02-24T03:16:00.664+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:16:00.680188446Z [2024-02-24T03:16:00.679+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:16:00+00:00, run_after=2024-02-24T03:17:00+00:00 2024-02-24T03:16:00.692966034Z [2024-02-24T03:16:00.692+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:16:00+00:00, run_after=2024-02-24T03:17:00+00:00 2024-02-24T03:16:00.701608632Z [2024-02-24T03:16:00.701+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:16:00.799340083Z [2024-02-24T03:16:00.798+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T03:16:00.799371815Z 2024-02-24T03:16:00.799378017Z 2024-02-24T03:16:00.799383120Z 2024-02-24T03:16:00.799409914Z 2024-02-24T03:16:00.799543079Z [2024-02-24T03:16:00.799+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T03:16:00.799790104Z [2024-02-24T03:16:00.799+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:16:00.799987631Z [2024-02-24T03:16:00.799+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:16:00.800218680Z [2024-02-24T03:16:00.799+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:16:00.801093519Z [2024-02-24T03:16:00.800+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:16:00.801109377Z 2024-02-24T03:16:00.801133461Z 2024-02-24T03:16:00.801138807Z 2024-02-24T03:16:00.801143718Z 2024-02-24T03:16:00.806051040Z [2024-02-24T03:16:00.805+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:16:00.806147191Z [2024-02-24T03:16:00.805+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T03:16:00.806442443Z [2024-02-24T03:16:00.806+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:16:00.806558665Z [2024-02-24T03:16:00.806+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:16:00.806752725Z [2024-02-24T03:16:00.806+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:16:00.806896292Z [2024-02-24T03:16:00.806+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:16:00.807098085Z [2024-02-24T03:16:00.806+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:16:00.807216578Z [2024-02-24T03:16:00.807+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:16:01.140303666Z [2024-02-24T03:16:01.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:14:00+00:00 exited with status queued for try_number 1 2024-02-24T03:16:01.142457675Z [2024-02-24T03:16:01.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:15:00+00:00 exited with status queued for try_number 1 2024-02-24T03:16:01.142488420Z [2024-02-24T03:16:01.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:15:00+00:00 exited with status queued for try_number 1 2024-02-24T03:16:01.142613112Z [2024-02-24T03:16:01.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:15:00+00:00 exited with status queued for try_number 1 2024-02-24T03:16:01.163103293Z [2024-02-24T03:16:01.162+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9bc09de6-5c12-435c-b187-2967b92a7fa9 2024-02-24T03:16:01.163160519Z [2024-02-24T03:16:01.163+0000] {scheduler_job.py:635} INFO - Setting external_id for to d37e3529-179d-473a-9d24-e5bba167d506 2024-02-24T03:16:01.163285554Z [2024-02-24T03:16:01.163+0000] {scheduler_job.py:635} INFO - Setting external_id for to a708e093-4472-44ac-a6e6-62df6b72ab70 2024-02-24T03:16:01.163383505Z [2024-02-24T03:16:01.163+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f4e8282-70a4-4da3-8995-3ca6f9462375 2024-02-24T03:16:02.558275561Z [2024-02-24T03:16:02.557+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:16:02.558831215Z [2024-02-24T03:16:02.558+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 03:14:00+00:00, run_id=scheduled__2024-02-24T03:14:00+00:00, run_start_date=2024-02-24 03:16:00.713743+00:00, run_end_date=2024-02-24 03:16:02.558387+00:00, run_duration=1.844644, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:14:00+00:00, data_interval_end=2024-02-24 03:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T03:16:02.568911365Z [2024-02-24T03:16:02.568+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T03:16:00+00:00, run_after=2024-02-24T03:18:00+00:00 2024-02-24T03:16:02.582244754Z [2024-02-24T03:16:02.581+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:16:02.583104912Z [2024-02-24T03:16:02.582+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:15:00+00:00, run_id=scheduled__2024-02-24T03:15:00+00:00, run_start_date=2024-02-24 03:16:00.714995+00:00, run_end_date=2024-02-24 03:16:02.582411+00:00, run_duration=1.867416, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:15:00+00:00, data_interval_end=2024-02-24 03:16:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:16:02.597760221Z [2024-02-24T03:16:02.597+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:16:00+00:00, run_after=2024-02-24T03:17:00+00:00 2024-02-24T03:16:02.699711739Z [2024-02-24T03:16:02.686+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:14:00+00:00 exited with status success for try_number 1 2024-02-24T03:16:02.699743459Z [2024-02-24T03:16:02.686+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:15:00+00:00 exited with status success for try_number 1 2024-02-24T03:16:02.723952916Z [2024-02-24T03:16:02.711+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T03:14:00+00:00, map_index=-1, run_start_date=2024-02-24 03:16:01.678087+00:00, run_end_date=2024-02-24 03:16:02.147356+00:00, run_duration=0.469269, state=success, executor_state=success, try_number=1, max_tries=1, job_id=995, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:16:00.802433+00:00, queued_by_job_id=2, pid=14515 2024-02-24T03:16:02.723979376Z [2024-02-24T03:16:02.711+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:15:00+00:00, map_index=-1, run_start_date=2024-02-24 03:16:01.863821+00:00, run_end_date=2024-02-24 03:16:02.313948+00:00, run_duration=0.450127, state=success, executor_state=success, try_number=1, max_tries=1, job_id=996, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:16:00.802433+00:00, queued_by_job_id=2, pid=14516 2024-02-24T03:16:05.963088384Z [2024-02-24T03:16:05.962+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:16:05.963581984Z [2024-02-24T03:16:05.963+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:15:00+00:00, run_id=scheduled__2024-02-24T03:15:00+00:00, run_start_date=2024-02-24 03:16:00.716053+00:00, run_end_date=2024-02-24 03:16:05.963231+00:00, run_duration=5.247178, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:15:00+00:00, data_interval_end=2024-02-24 03:16:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:16:05.973989377Z [2024-02-24T03:16:05.973+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:16:00+00:00, run_after=2024-02-24T03:17:00+00:00 2024-02-24T03:16:06.016569826Z [2024-02-24T03:16:06.016+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:15:00+00:00 exited with status success for try_number 1 2024-02-24T03:16:06.024424825Z [2024-02-24T03:16:06.023+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:15:00+00:00, map_index=-1, run_start_date=2024-02-24 03:16:03.079037+00:00, run_end_date=2024-02-24 03:16:05.366562+00:00, run_duration=2.287525, state=success, executor_state=success, try_number=1, max_tries=1, job_id=997, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:16:00.802433+00:00, queued_by_job_id=2, pid=14534 2024-02-24T03:16:07.408037468Z [2024-02-24T03:16:07.407+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:16:07.408274650Z [2024-02-24T03:16:07.407+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:15:00+00:00, run_id=scheduled__2024-02-24T03:15:00+00:00, run_start_date=2024-02-24 03:16:00.717237+00:00, run_end_date=2024-02-24 03:16:07.407771+00:00, run_duration=6.690534, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:15:00+00:00, data_interval_end=2024-02-24 03:16:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:16:07.417491887Z [2024-02-24T03:16:07.417+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:16:00+00:00, run_after=2024-02-24T03:17:00+00:00 2024-02-24T03:16:07.446223924Z [2024-02-24T03:16:07.445+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:15:00+00:00 exited with status success for try_number 1 2024-02-24T03:16:07.454514841Z [2024-02-24T03:16:07.453+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:15:00+00:00, map_index=-1, run_start_date=2024-02-24 03:16:03.292295+00:00, run_end_date=2024-02-24 03:16:06.300919+00:00, run_duration=3.008624, state=success, executor_state=success, try_number=1, max_tries=1, job_id=998, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:16:00.802433+00:00, queued_by_job_id=2, pid=14540 2024-02-24T03:17:00.280162429Z [2024-02-24T03:17:00.279+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:17:00+00:00, run_after=2024-02-24T03:18:00+00:00 2024-02-24T03:17:00.291232753Z [2024-02-24T03:17:00.290+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:17:00.303544495Z [2024-02-24T03:17:00.303+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:17:00+00:00, run_after=2024-02-24T03:18:00+00:00 2024-02-24T03:17:00.375623156Z [2024-02-24T03:17:00.375+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T03:17:00.375660885Z 2024-02-24T03:17:00.375668426Z 2024-02-24T03:17:00.375674439Z 2024-02-24T03:17:00.376009354Z [2024-02-24T03:17:00.375+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:17:00.376240336Z [2024-02-24T03:17:00.376+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:17:00.376340062Z [2024-02-24T03:17:00.376+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:17:00.377251854Z [2024-02-24T03:17:00.376+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:17:00.377260327Z 2024-02-24T03:17:00.377263882Z 2024-02-24T03:17:00.377267202Z 2024-02-24T03:17:00.381749973Z [2024-02-24T03:17:00.381+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:17:00.381807091Z [2024-02-24T03:17:00.381+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:17:00.382112149Z [2024-02-24T03:17:00.381+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:17:00.382211311Z [2024-02-24T03:17:00.382+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:17:00.382501252Z [2024-02-24T03:17:00.382+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:17:00.382641136Z [2024-02-24T03:17:00.382+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:17:00.571838314Z [2024-02-24T03:17:00.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:16:00+00:00 exited with status queued for try_number 1 2024-02-24T03:17:00.571908016Z [2024-02-24T03:17:00.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:16:00+00:00 exited with status queued for try_number 1 2024-02-24T03:17:00.571948499Z [2024-02-24T03:17:00.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:16:00+00:00 exited with status queued for try_number 1 2024-02-24T03:17:00.580417446Z [2024-02-24T03:17:00.579+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81ae1a3f-3f63-4f78-b49f-ac3e4a87592d 2024-02-24T03:17:00.580486969Z [2024-02-24T03:17:00.580+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c2a03f4-55c4-460d-8c63-1537b12f522f 2024-02-24T03:17:00.580606492Z [2024-02-24T03:17:00.580+0000] {scheduler_job.py:635} INFO - Setting external_id for to ffded87a-215f-4dfd-8620-d3072ae19b94 2024-02-24T03:17:01.719049156Z [2024-02-24T03:17:01.718+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:17:01.719611544Z [2024-02-24T03:17:01.719+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:16:00+00:00, run_id=scheduled__2024-02-24T03:16:00+00:00, run_start_date=2024-02-24 03:17:00.313997+00:00, run_end_date=2024-02-24 03:17:01.718946+00:00, run_duration=1.404949, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:16:00+00:00, data_interval_end=2024-02-24 03:17:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:17:01.736226589Z [2024-02-24T03:17:01.735+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:17:00+00:00, run_after=2024-02-24T03:18:00+00:00 2024-02-24T03:17:01.804816985Z [2024-02-24T03:17:01.804+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:16:00+00:00 exited with status success for try_number 1 2024-02-24T03:17:01.822030775Z [2024-02-24T03:17:01.821+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:16:00+00:00, map_index=-1, run_start_date=2024-02-24 03:17:01.159035+00:00, run_end_date=2024-02-24 03:17:01.539402+00:00, run_duration=0.380367, state=success, executor_state=success, try_number=1, max_tries=1, job_id=999, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:17:00.378384+00:00, queued_by_job_id=2, pid=14572 2024-02-24T03:17:04.308799911Z [2024-02-24T03:17:04.308+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:17:04.309280053Z [2024-02-24T03:17:04.308+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:16:00+00:00, run_id=scheduled__2024-02-24T03:16:00+00:00, run_start_date=2024-02-24 03:17:00.315424+00:00, run_end_date=2024-02-24 03:17:04.308705+00:00, run_duration=3.993281, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:16:00+00:00, data_interval_end=2024-02-24 03:17:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:17:04.322921696Z [2024-02-24T03:17:04.322+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:17:00+00:00, run_after=2024-02-24T03:18:00+00:00 2024-02-24T03:17:04.332082147Z [2024-02-24T03:17:04.331+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:17:04.332387932Z [2024-02-24T03:17:04.332+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:16:00+00:00, run_id=scheduled__2024-02-24T03:16:00+00:00, run_start_date=2024-02-24 03:17:00.316623+00:00, run_end_date=2024-02-24 03:17:04.331990+00:00, run_duration=4.015367, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:16:00+00:00, data_interval_end=2024-02-24 03:17:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:17:04.345416241Z [2024-02-24T03:17:04.344+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:17:00+00:00, run_after=2024-02-24T03:18:00+00:00 2024-02-24T03:17:04.394408362Z [2024-02-24T03:17:04.393+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:16:00+00:00 exited with status success for try_number 1 2024-02-24T03:17:04.394469156Z [2024-02-24T03:17:04.394+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:16:00+00:00 exited with status success for try_number 1 2024-02-24T03:17:04.403742329Z [2024-02-24T03:17:04.403+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:16:00+00:00, map_index=-1, run_start_date=2024-02-24 03:17:02.306906+00:00, run_end_date=2024-02-24 03:17:04.122324+00:00, run_duration=1.815418, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1001, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:17:00.378384+00:00, queued_by_job_id=2, pid=14591 2024-02-24T03:17:04.403976890Z [2024-02-24T03:17:04.403+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:16:00+00:00, map_index=-1, run_start_date=2024-02-24 03:17:02.268111+00:00, run_end_date=2024-02-24 03:17:03.562686+00:00, run_duration=1.294575, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1000, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:17:00.378384+00:00, queued_by_job_id=2, pid=14590 2024-02-24T03:17:05.299161918Z [2024-02-24T03:17:05.298+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T03:18:00.622457178Z [2024-02-24T03:18:00.621+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:18:00+00:00, run_after=2024-02-24T03:19:00+00:00 2024-02-24T03:18:00.636687092Z [2024-02-24T03:18:00.636+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:18:00+00:00, run_after=2024-02-24T03:19:00+00:00 2024-02-24T03:18:00.645677970Z [2024-02-24T03:18:00.645+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:18:00.654771607Z [2024-02-24T03:18:00.654+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:18:00.742735570Z [2024-02-24T03:18:00.742+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T03:18:00.742760991Z 2024-02-24T03:18:00.742765460Z 2024-02-24T03:18:00.742768809Z 2024-02-24T03:18:00.742772022Z 2024-02-24T03:18:00.743224338Z [2024-02-24T03:18:00.742+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T03:18:00.743304723Z [2024-02-24T03:18:00.743+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:18:00.743484164Z [2024-02-24T03:18:00.743+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:18:00.743707204Z [2024-02-24T03:18:00.743+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:18:00.744420888Z [2024-02-24T03:18:00.744+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:18:00.744434313Z 2024-02-24T03:18:00.744444163Z 2024-02-24T03:18:00.744470510Z 2024-02-24T03:18:00.744479016Z 2024-02-24T03:18:00.748290752Z [2024-02-24T03:18:00.748+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:18:00.748513903Z [2024-02-24T03:18:00.748+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T03:18:00.748860411Z [2024-02-24T03:18:00.748+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:18:00.749024626Z [2024-02-24T03:18:00.748+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:18:00.749292104Z [2024-02-24T03:18:00.749+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:18:00.749478388Z [2024-02-24T03:18:00.749+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:18:00.749732527Z [2024-02-24T03:18:00.749+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:18:00.750057174Z [2024-02-24T03:18:00.749+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:18:01.283095112Z [2024-02-24T03:18:01.282+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:16:00+00:00 exited with status queued for try_number 1 2024-02-24T03:18:01.283419245Z [2024-02-24T03:18:01.283+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:17:00+00:00 exited with status queued for try_number 1 2024-02-24T03:18:01.283688804Z [2024-02-24T03:18:01.283+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:17:00+00:00 exited with status queued for try_number 1 2024-02-24T03:18:01.283918428Z [2024-02-24T03:18:01.283+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:17:00+00:00 exited with status queued for try_number 1 2024-02-24T03:18:01.321922647Z [2024-02-24T03:18:01.319+0000] {scheduler_job.py:635} INFO - Setting external_id for to 49ea1dde-5d31-4e0d-8f48-8704fea45a61 2024-02-24T03:18:01.321954843Z [2024-02-24T03:18:01.319+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c091156-7c98-42cb-8f9b-1ddc834415ed 2024-02-24T03:18:01.321958511Z [2024-02-24T03:18:01.320+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3ae93e13-b5be-4b77-be58-7018b3507b6f 2024-02-24T03:18:01.321961920Z [2024-02-24T03:18:01.320+0000] {scheduler_job.py:635} INFO - Setting external_id for to c2a1fd1c-b704-46e9-8243-8cfcd0a64650 2024-02-24T03:18:02.504443615Z [2024-02-24T03:18:02.503+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:18:02.504716241Z [2024-02-24T03:18:02.504+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 03:16:00+00:00, run_id=scheduled__2024-02-24T03:16:00+00:00, run_start_date=2024-02-24 03:18:00.666025+00:00, run_end_date=2024-02-24 03:18:02.504307+00:00, run_duration=1.838282, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:16:00+00:00, data_interval_end=2024-02-24 03:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T03:18:02.512351574Z [2024-02-24T03:18:02.511+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T03:18:00+00:00, run_after=2024-02-24T03:20:00+00:00 2024-02-24T03:18:02.519566790Z [2024-02-24T03:18:02.519+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:18:02.519604796Z [2024-02-24T03:18:02.519+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:17:00+00:00, run_id=scheduled__2024-02-24T03:17:00+00:00, run_start_date=2024-02-24 03:18:00.667364+00:00, run_end_date=2024-02-24 03:18:02.519375+00:00, run_duration=1.852011, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:17:00+00:00, data_interval_end=2024-02-24 03:18:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:18:02.529750580Z [2024-02-24T03:18:02.529+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:18:00+00:00, run_after=2024-02-24T03:19:00+00:00 2024-02-24T03:18:02.590746907Z [2024-02-24T03:18:02.590+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:16:00+00:00 exited with status success for try_number 1 2024-02-24T03:18:02.593842078Z [2024-02-24T03:18:02.590+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:17:00+00:00 exited with status success for try_number 1 2024-02-24T03:18:02.606764133Z [2024-02-24T03:18:02.606+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T03:16:00+00:00, map_index=-1, run_start_date=2024-02-24 03:18:01.795957+00:00, run_end_date=2024-02-24 03:18:02.247428+00:00, run_duration=0.451471, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1003, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:18:00.745404+00:00, queued_by_job_id=2, pid=14625 2024-02-24T03:18:02.607130084Z [2024-02-24T03:18:02.606+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:17:00+00:00, map_index=-1, run_start_date=2024-02-24 03:18:01.729415+00:00, run_end_date=2024-02-24 03:18:02.167756+00:00, run_duration=0.438341, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1002, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:18:00.745404+00:00, queued_by_job_id=2, pid=14624 2024-02-24T03:18:06.120632872Z [2024-02-24T03:18:06.120+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:18:06.121125651Z [2024-02-24T03:18:06.120+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:17:00+00:00, run_id=scheduled__2024-02-24T03:17:00+00:00, run_start_date=2024-02-24 03:18:00.669637+00:00, run_end_date=2024-02-24 03:18:06.120761+00:00, run_duration=5.451124, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:17:00+00:00, data_interval_end=2024-02-24 03:18:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:18:06.131033481Z [2024-02-24T03:18:06.130+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:18:00+00:00, run_after=2024-02-24T03:19:00+00:00 2024-02-24T03:18:06.137935885Z [2024-02-24T03:18:06.137+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:18:06.138369339Z [2024-02-24T03:18:06.138+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:17:00+00:00, run_id=scheduled__2024-02-24T03:17:00+00:00, run_start_date=2024-02-24 03:18:00.668538+00:00, run_end_date=2024-02-24 03:18:06.137760+00:00, run_duration=5.469222, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:17:00+00:00, data_interval_end=2024-02-24 03:18:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:18:06.148069997Z [2024-02-24T03:18:06.147+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:18:00+00:00, run_after=2024-02-24T03:19:00+00:00 2024-02-24T03:18:06.182762208Z [2024-02-24T03:18:06.182+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:17:00+00:00 exited with status success for try_number 1 2024-02-24T03:18:06.182948711Z [2024-02-24T03:18:06.182+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:17:00+00:00 exited with status success for try_number 1 2024-02-24T03:18:06.191335742Z [2024-02-24T03:18:06.190+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:17:00+00:00, map_index=-1, run_start_date=2024-02-24 03:18:02.972801+00:00, run_end_date=2024-02-24 03:18:05.698483+00:00, run_duration=2.725682, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1004, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:18:00.745404+00:00, queued_by_job_id=2, pid=14648 2024-02-24T03:18:06.191535125Z [2024-02-24T03:18:06.191+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:17:00+00:00, map_index=-1, run_start_date=2024-02-24 03:18:03.145658+00:00, run_end_date=2024-02-24 03:18:05.724083+00:00, run_duration=2.578425, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1005, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:18:00.745404+00:00, queued_by_job_id=2, pid=14649 2024-02-24T03:19:01.051757077Z [2024-02-24T03:19:01.050+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:19:01.070520378Z [2024-02-24T03:19:01.070+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:19:00+00:00, run_after=2024-02-24T03:20:00+00:00 2024-02-24T03:19:01.085757968Z [2024-02-24T03:19:01.085+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:19:00+00:00, run_after=2024-02-24T03:20:00+00:00 2024-02-24T03:19:01.175039590Z [2024-02-24T03:19:01.174+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T03:19:01.175066239Z 2024-02-24T03:19:01.175070068Z 2024-02-24T03:19:01.175073438Z 2024-02-24T03:19:01.175172990Z [2024-02-24T03:19:01.174+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:19:01.175417239Z [2024-02-24T03:19:01.175+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:19:01.175611068Z [2024-02-24T03:19:01.175+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:19:01.177151371Z [2024-02-24T03:19:01.176+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:19:01.177172125Z 2024-02-24T03:19:01.177181620Z 2024-02-24T03:19:01.177186488Z 2024-02-24T03:19:01.183066503Z [2024-02-24T03:19:01.182+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:19:01.183322488Z [2024-02-24T03:19:01.183+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:19:01.183738838Z [2024-02-24T03:19:01.183+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:19:01.183864054Z [2024-02-24T03:19:01.183+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:19:01.184165743Z [2024-02-24T03:19:01.183+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:19:01.184268815Z [2024-02-24T03:19:01.184+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:19:01.517486119Z [2024-02-24T03:19:01.516+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:18:00+00:00 exited with status queued for try_number 1 2024-02-24T03:19:01.518040885Z [2024-02-24T03:19:01.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:18:00+00:00 exited with status queued for try_number 1 2024-02-24T03:19:01.518341805Z [2024-02-24T03:19:01.518+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:18:00+00:00 exited with status queued for try_number 1 2024-02-24T03:19:01.531377011Z [2024-02-24T03:19:01.530+0000] {scheduler_job.py:635} INFO - Setting external_id for to 27906433-a8cf-465c-a3f4-196fc348c904 2024-02-24T03:19:01.531880232Z [2024-02-24T03:19:01.531+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35ed2632-f9ec-42f7-a246-580997b08bcf 2024-02-24T03:19:01.532280947Z [2024-02-24T03:19:01.532+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4957f3dd-b365-49f3-a70a-c7a3ae7118c0 2024-02-24T03:19:03.774129418Z [2024-02-24T03:19:03.757+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:19:03.774155152Z [2024-02-24T03:19:03.770+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:18:00+00:00, run_id=scheduled__2024-02-24T03:18:00+00:00, run_start_date=2024-02-24 03:19:01.100039+00:00, run_end_date=2024-02-24 03:19:03.770811+00:00, run_duration=2.670772, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:18:00+00:00, data_interval_end=2024-02-24 03:19:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:19:03.795011501Z [2024-02-24T03:19:03.794+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:19:00+00:00, run_after=2024-02-24T03:20:00+00:00 2024-02-24T03:19:03.846662218Z [2024-02-24T03:19:03.846+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:18:00+00:00 exited with status success for try_number 1 2024-02-24T03:19:03.852025294Z [2024-02-24T03:19:03.851+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:18:00+00:00, map_index=-1, run_start_date=2024-02-24 03:19:02.300278+00:00, run_end_date=2024-02-24 03:19:02.868805+00:00, run_duration=0.568527, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1006, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:19:01.178611+00:00, queued_by_job_id=2, pid=14681 2024-02-24T03:19:05.988869608Z [2024-02-24T03:19:05.988+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:19:05.989215023Z [2024-02-24T03:19:05.988+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:18:00+00:00, run_id=scheduled__2024-02-24T03:18:00+00:00, run_start_date=2024-02-24 03:19:01.101543+00:00, run_end_date=2024-02-24 03:19:05.988682+00:00, run_duration=4.887139, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:18:00+00:00, data_interval_end=2024-02-24 03:19:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:19:05.998937783Z [2024-02-24T03:19:05.998+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:19:00+00:00, run_after=2024-02-24T03:20:00+00:00 2024-02-24T03:19:06.005744147Z [2024-02-24T03:19:06.005+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:19:06.006146287Z [2024-02-24T03:19:06.005+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:18:00+00:00, run_id=scheduled__2024-02-24T03:18:00+00:00, run_start_date=2024-02-24 03:19:01.102872+00:00, run_end_date=2024-02-24 03:19:06.005621+00:00, run_duration=4.902749, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:18:00+00:00, data_interval_end=2024-02-24 03:19:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:19:06.015897325Z [2024-02-24T03:19:06.015+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:19:00+00:00, run_after=2024-02-24T03:20:00+00:00 2024-02-24T03:19:06.055721362Z [2024-02-24T03:19:06.055+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:18:00+00:00 exited with status success for try_number 1 2024-02-24T03:19:06.060961978Z [2024-02-24T03:19:06.060+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:18:00+00:00, map_index=-1, run_start_date=2024-02-24 03:19:03.574420+00:00, run_end_date=2024-02-24 03:19:05.279948+00:00, run_duration=1.705528, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1007, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:19:01.178611+00:00, queued_by_job_id=2, pid=14699 2024-02-24T03:19:07.139535759Z [2024-02-24T03:19:07.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:18:00+00:00 exited with status success for try_number 1 2024-02-24T03:19:07.146429516Z [2024-02-24T03:19:07.146+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:18:00+00:00, map_index=-1, run_start_date=2024-02-24 03:19:03.604236+00:00, run_end_date=2024-02-24 03:19:05.948503+00:00, run_duration=2.344267, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1008, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:19:01.178611+00:00, queued_by_job_id=2, pid=14700 2024-02-24T03:20:00.500383917Z [2024-02-24T03:20:00.499+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:20:00+00:00, run_after=2024-02-24T03:25:00+00:00 2024-02-24T03:20:00.516411639Z [2024-02-24T03:20:00.515+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:20:00.540190121Z [2024-02-24T03:20:00.539+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:20:00+00:00, run_after=2024-02-24T03:21:00+00:00 2024-02-24T03:20:00.556449025Z [2024-02-24T03:20:00.556+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:20:00+00:00, run_after=2024-02-24T03:21:00+00:00 2024-02-24T03:20:00.565170932Z [2024-02-24T03:20:00.564+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:20:00.687692156Z [2024-02-24T03:20:00.687+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-02-24T03:20:00.687717788Z 2024-02-24T03:20:00.687722584Z 2024-02-24T03:20:00.687727184Z 2024-02-24T03:20:00.687730891Z 2024-02-24T03:20:00.687734938Z 2024-02-24T03:20:00.687981175Z [2024-02-24T03:20:00.687+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:20:00.688204060Z [2024-02-24T03:20:00.688+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T03:20:00.688413116Z [2024-02-24T03:20:00.688+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:20:00.688634344Z [2024-02-24T03:20:00.688+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:20:00.688832262Z [2024-02-24T03:20:00.688+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:20:00.689673714Z [2024-02-24T03:20:00.689+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:20:00.689687588Z 2024-02-24T03:20:00.689691971Z 2024-02-24T03:20:00.689695959Z 2024-02-24T03:20:00.689699866Z 2024-02-24T03:20:00.689703655Z 2024-02-24T03:20:00.695448033Z [2024-02-24T03:20:00.695+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T03:20:00.695705452Z [2024-02-24T03:20:00.695+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T03:20:00.696947263Z [2024-02-24T03:20:00.695+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:20:00.697349624Z [2024-02-24T03:20:00.697+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T03:20:00.697819325Z [2024-02-24T03:20:00.697+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:20:00.698065391Z [2024-02-24T03:20:00.697+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:20:00.698487635Z [2024-02-24T03:20:00.698+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:20:00.698791302Z [2024-02-24T03:20:00.698+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:20:00.699226650Z [2024-02-24T03:20:00.699+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:20:00.699543968Z [2024-02-24T03:20:00.699+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:20:01.031312888Z [2024-02-24T03:20:01.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T03:15:00+00:00 exited with status queued for try_number 1 2024-02-24T03:20:01.031376628Z [2024-02-24T03:20:01.031+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:18:00+00:00 exited with status queued for try_number 1 2024-02-24T03:20:01.031479556Z [2024-02-24T03:20:01.031+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:19:00+00:00 exited with status queued for try_number 1 2024-02-24T03:20:01.031575240Z [2024-02-24T03:20:01.031+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:19:00+00:00 exited with status queued for try_number 1 2024-02-24T03:20:01.031679752Z [2024-02-24T03:20:01.031+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:19:00+00:00 exited with status queued for try_number 1 2024-02-24T03:20:01.041194309Z [2024-02-24T03:20:01.040+0000] {scheduler_job.py:635} INFO - Setting external_id for to 461c6e34-e7a6-464f-b065-f3dbaf0b4457 2024-02-24T03:20:01.041372825Z [2024-02-24T03:20:01.041+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb6e11ab-b54f-496c-b244-cec18b85b993 2024-02-24T03:20:01.041558167Z [2024-02-24T03:20:01.041+0000] {scheduler_job.py:635} INFO - Setting external_id for to d97c63cc-f98d-4005-9ac4-045397b1c5b1 2024-02-24T03:20:01.041720241Z [2024-02-24T03:20:01.041+0000] {scheduler_job.py:635} INFO - Setting external_id for to b1121e6c-699d-4382-8f64-a537336fa18d 2024-02-24T03:20:01.041913443Z [2024-02-24T03:20:01.041+0000] {scheduler_job.py:635} INFO - Setting external_id for to d495f7c8-8d47-4875-b0ce-f6827b30a3c3 2024-02-24T03:20:03.653788140Z [2024-02-24T03:20:03.653+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:20:03.654654819Z [2024-02-24T03:20:03.654+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 03:18:00+00:00, run_id=scheduled__2024-02-24T03:18:00+00:00, run_start_date=2024-02-24 03:20:00.581324+00:00, run_end_date=2024-02-24 03:20:03.653681+00:00, run_duration=3.072357, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:18:00+00:00, data_interval_end=2024-02-24 03:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T03:20:03.668782071Z [2024-02-24T03:20:03.668+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T03:20:00+00:00, run_after=2024-02-24T03:22:00+00:00 2024-02-24T03:20:03.719964602Z [2024-02-24T03:20:03.719+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:20:03.719991142Z [2024-02-24T03:20:03.719+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:19:00+00:00, run_id=scheduled__2024-02-24T03:19:00+00:00, run_start_date=2024-02-24 03:20:00.583040+00:00, run_end_date=2024-02-24 03:20:03.719403+00:00, run_duration=3.136363, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:19:00+00:00, data_interval_end=2024-02-24 03:20:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:20:03.744189981Z [2024-02-24T03:20:03.743+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:20:00+00:00, run_after=2024-02-24T03:21:00+00:00 2024-02-24T03:20:03.815776615Z [2024-02-24T03:20:03.815+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:20:03.815805144Z 2024-02-24T03:20:03.815890519Z [2024-02-24T03:20:03.815+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:20:03.816833892Z [2024-02-24T03:20:03.816+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:20:03.816845494Z 2024-02-24T03:20:03.820929090Z [2024-02-24T03:20:03.820+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T03:20:03.821102471Z [2024-02-24T03:20:03.820+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T03:20:03.921141585Z [2024-02-24T03:20:03.919+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T03:15:00+00:00 exited with status queued for try_number 1 2024-02-24T03:20:03.921167040Z [2024-02-24T03:20:03.919+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T03:15:00+00:00 exited with status success for try_number 1 2024-02-24T03:20:03.921173010Z [2024-02-24T03:20:03.919+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:18:00+00:00 exited with status success for try_number 1 2024-02-24T03:20:03.921177151Z [2024-02-24T03:20:03.920+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:19:00+00:00 exited with status success for try_number 1 2024-02-24T03:20:03.929588661Z [2024-02-24T03:20:03.929+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:19:00+00:00, map_index=-1, run_start_date=2024-02-24 03:20:01.988289+00:00, run_end_date=2024-02-24 03:20:02.507259+00:00, run_duration=0.51897, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1009, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:20:00.690906+00:00, queued_by_job_id=2, pid=14736 2024-02-24T03:20:03.930394724Z [2024-02-24T03:20:03.929+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T03:18:00+00:00, map_index=-1, run_start_date=2024-02-24 03:20:02.117258+00:00, run_end_date=2024-02-24 03:20:02.593833+00:00, run_duration=0.476575, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1010, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:20:00.690906+00:00, queued_by_job_id=2, pid=14737 2024-02-24T03:20:03.930776504Z [2024-02-24T03:20:03.930+0000] {scheduler_job.py:635} INFO - Setting external_id for to c7b8e34f-7922-41d9-bf7c-e8d5a6400191 2024-02-24T03:20:03.930995499Z [2024-02-24T03:20:03.930+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T03:15:00+00:00, map_index=-1, run_start_date=2024-02-24 03:20:03.042954+00:00, run_end_date=2024-02-24 03:20:03.473564+00:00, run_duration=0.43061, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1011, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:20:00.690906+00:00, queued_by_job_id=2, pid=14755 2024-02-24T03:20:05.639914496Z [2024-02-24T03:20:05.639+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:20:05.640234482Z [2024-02-24T03:20:05.640+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:19:00+00:00, run_id=scheduled__2024-02-24T03:19:00+00:00, run_start_date=2024-02-24 03:20:00.584235+00:00, run_end_date=2024-02-24 03:20:05.639807+00:00, run_duration=5.055572, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:19:00+00:00, data_interval_end=2024-02-24 03:20:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:20:05.650208174Z [2024-02-24T03:20:05.649+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:20:00+00:00, run_after=2024-02-24T03:21:00+00:00 2024-02-24T03:20:05.659010977Z [2024-02-24T03:20:05.658+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:20:05.659270247Z [2024-02-24T03:20:05.659+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:19:00+00:00, run_id=scheduled__2024-02-24T03:19:00+00:00, run_start_date=2024-02-24 03:20:00.585445+00:00, run_end_date=2024-02-24 03:20:05.658945+00:00, run_duration=5.0735, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:19:00+00:00, data_interval_end=2024-02-24 03:20:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:20:05.671411732Z [2024-02-24T03:20:05.671+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:20:00+00:00, run_after=2024-02-24T03:21:00+00:00 2024-02-24T03:20:05.753095171Z [2024-02-24T03:20:05.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:19:00+00:00 exited with status success for try_number 1 2024-02-24T03:20:05.753374561Z [2024-02-24T03:20:05.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:19:00+00:00 exited with status success for try_number 1 2024-02-24T03:20:05.762098641Z [2024-02-24T03:20:05.761+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:19:00+00:00, map_index=-1, run_start_date=2024-02-24 03:20:03.447155+00:00, run_end_date=2024-02-24 03:20:04.832789+00:00, run_duration=1.385634, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1013, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:20:00.690906+00:00, queued_by_job_id=2, pid=14772 2024-02-24T03:20:05.762584125Z [2024-02-24T03:20:05.762+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:19:00+00:00, map_index=-1, run_start_date=2024-02-24 03:20:03.358381+00:00, run_end_date=2024-02-24 03:20:05.107873+00:00, run_duration=1.749492, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1012, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:20:00.690906+00:00, queued_by_job_id=2, pid=14766 2024-02-24T03:20:06.844442736Z [2024-02-24T03:20:06.844+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:20:06.844479655Z 2024-02-24T03:20:06.844856838Z [2024-02-24T03:20:06.844+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:20:06.845825894Z [2024-02-24T03:20:06.845+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:20:06.845857904Z 2024-02-24T03:20:06.848950662Z [2024-02-24T03:20:06.848+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T03:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T03:20:06.849336410Z [2024-02-24T03:20:06.848+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T03:20:06.913552695Z [2024-02-24T03:20:06.912+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T03:15:00+00:00 exited with status queued for try_number 1 2024-02-24T03:20:06.913817008Z [2024-02-24T03:20:06.913+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T03:15:00+00:00 exited with status success for try_number 1 2024-02-24T03:20:06.923114738Z [2024-02-24T03:20:06.922+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ce38fe2-699d-4965-bc9b-42b280d69b41 2024-02-24T03:20:06.923398962Z [2024-02-24T03:20:06.923+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T03:15:00+00:00, map_index=-1, run_start_date=2024-02-24 03:20:05.514302+00:00, run_end_date=2024-02-24 03:20:05.912513+00:00, run_duration=0.398211, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1014, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:20:03.817426+00:00, queued_by_job_id=2, pid=14790 2024-02-24T03:20:09.037653580Z [2024-02-24T03:20:09.037+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:20:09.037716011Z 2024-02-24T03:20:09.037727342Z [2024-02-24T03:20:09.037+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:20:09.038371049Z [2024-02-24T03:20:09.038+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:20:09.038380636Z 2024-02-24T03:20:09.041030796Z [2024-02-24T03:20:09.040+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:20:09.041105517Z [2024-02-24T03:20:09.040+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T03:20:09.105284343Z [2024-02-24T03:20:09.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T03:15:00+00:00 exited with status queued for try_number 1 2024-02-24T03:20:09.105366408Z [2024-02-24T03:20:09.105+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T03:15:00+00:00 exited with status success for try_number 1 2024-02-24T03:20:09.115400117Z [2024-02-24T03:20:09.114+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9274643f-237a-4053-8b70-49d649f9a79f 2024-02-24T03:20:09.115637458Z [2024-02-24T03:20:09.115+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T03:15:00+00:00, map_index=0, run_start_date=2024-02-24 03:20:08.455388+00:00, run_end_date=2024-02-24 03:20:08.825951+00:00, run_duration=0.370563, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1015, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:20:06.846260+00:00, queued_by_job_id=2, pid=14798 2024-02-24T03:20:11.847855965Z [2024-02-24T03:20:11.846+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:20:11.847886979Z [2024-02-24T03:20:11.846+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:15:00+00:00, run_id=scheduled__2024-02-24T03:15:00+00:00, run_start_date=2024-02-24 03:20:00.579971+00:00, run_end_date=2024-02-24 03:20:11.846851+00:00, run_duration=11.26688, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:15:00+00:00, data_interval_end=2024-02-24 03:20:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T03:20:11.857076506Z [2024-02-24T03:20:11.856+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:20:00+00:00, run_after=2024-02-24T03:25:00+00:00 2024-02-24T03:20:11.897262227Z [2024-02-24T03:20:11.896+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T03:15:00+00:00 exited with status success for try_number 1 2024-02-24T03:20:11.903347555Z [2024-02-24T03:20:11.902+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T03:15:00+00:00, map_index=-1, run_start_date=2024-02-24 03:20:10.905317+00:00, run_end_date=2024-02-24 03:20:11.340929+00:00, run_duration=0.435612, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1016, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:20:09.038788+00:00, queued_by_job_id=2, pid=14806 2024-02-24T03:21:00.454604811Z [2024-02-24T03:21:00.454+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:21:00.482105711Z [2024-02-24T03:21:00.481+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:21:00+00:00, run_after=2024-02-24T03:22:00+00:00 2024-02-24T03:21:00.511445365Z [2024-02-24T03:21:00.511+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:21:00+00:00, run_after=2024-02-24T03:22:00+00:00 2024-02-24T03:21:00.605715339Z [2024-02-24T03:21:00.605+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T03:21:00.605745614Z 2024-02-24T03:21:00.605751033Z 2024-02-24T03:21:00.605754539Z 2024-02-24T03:21:00.605764121Z [2024-02-24T03:21:00.605+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:21:00.605929546Z [2024-02-24T03:21:00.605+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:21:00.606022123Z [2024-02-24T03:21:00.605+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:21:00.606894473Z [2024-02-24T03:21:00.606+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:21:00.606904975Z 2024-02-24T03:21:00.606910275Z 2024-02-24T03:21:00.606914780Z 2024-02-24T03:21:00.614587153Z [2024-02-24T03:21:00.609+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:21:00.614686934Z [2024-02-24T03:21:00.610+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:21:00.614713782Z [2024-02-24T03:21:00.610+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:21:00.614720656Z [2024-02-24T03:21:00.610+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:21:00.614727112Z [2024-02-24T03:21:00.610+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:21:00.614733285Z [2024-02-24T03:21:00.610+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:21:00.947788048Z [2024-02-24T03:21:00.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:20:00+00:00 exited with status queued for try_number 1 2024-02-24T03:21:00.948112121Z [2024-02-24T03:21:00.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:20:00+00:00 exited with status queued for try_number 1 2024-02-24T03:21:00.948401556Z [2024-02-24T03:21:00.948+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:20:00+00:00 exited with status queued for try_number 1 2024-02-24T03:21:00.959849103Z [2024-02-24T03:21:00.959+0000] {scheduler_job.py:635} INFO - Setting external_id for to c4ebe7f7-70ca-4085-bc59-0c568db1033d 2024-02-24T03:21:00.960191209Z [2024-02-24T03:21:00.959+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80fc70ac-7895-4b71-ad76-8c3b54cbe9ba 2024-02-24T03:21:00.960414847Z [2024-02-24T03:21:00.960+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e44d3d6-5ed9-45f7-9380-cf6eb384494a 2024-02-24T03:21:03.396159489Z [2024-02-24T03:21:03.395+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:21:03.397314367Z [2024-02-24T03:21:03.395+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:20:00+00:00, run_id=scheduled__2024-02-24T03:20:00+00:00, run_start_date=2024-02-24 03:21:00.527529+00:00, run_end_date=2024-02-24 03:21:03.395495+00:00, run_duration=2.867966, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:20:00+00:00, data_interval_end=2024-02-24 03:21:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:21:03.412668577Z [2024-02-24T03:21:03.412+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:21:00+00:00, run_after=2024-02-24T03:22:00+00:00 2024-02-24T03:21:03.712030920Z [2024-02-24T03:21:03.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:20:00+00:00 exited with status success for try_number 1 2024-02-24T03:21:03.722190435Z [2024-02-24T03:21:03.721+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:20:00+00:00, map_index=-1, run_start_date=2024-02-24 03:21:01.778021+00:00, run_end_date=2024-02-24 03:21:02.472074+00:00, run_duration=0.694053, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1017, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:21:00.607512+00:00, queued_by_job_id=2, pid=14828 2024-02-24T03:21:08.228383615Z [2024-02-24T03:21:08.227+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:21:08.228475479Z [2024-02-24T03:21:08.228+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:20:00+00:00, run_id=scheduled__2024-02-24T03:20:00+00:00, run_start_date=2024-02-24 03:21:00.528958+00:00, run_end_date=2024-02-24 03:21:08.228000+00:00, run_duration=7.699042, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:20:00+00:00, data_interval_end=2024-02-24 03:21:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:21:08.237058626Z [2024-02-24T03:21:08.236+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:21:00+00:00, run_after=2024-02-24T03:22:00+00:00 2024-02-24T03:21:08.243420882Z [2024-02-24T03:21:08.242+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:21:08.243473418Z [2024-02-24T03:21:08.243+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:20:00+00:00, run_id=scheduled__2024-02-24T03:20:00+00:00, run_start_date=2024-02-24 03:21:00.530261+00:00, run_end_date=2024-02-24 03:21:08.243137+00:00, run_duration=7.712876, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:20:00+00:00, data_interval_end=2024-02-24 03:21:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:21:08.253391459Z [2024-02-24T03:21:08.252+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:21:00+00:00, run_after=2024-02-24T03:22:00+00:00 2024-02-24T03:21:08.294570925Z [2024-02-24T03:21:08.293+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:20:00+00:00 exited with status success for try_number 1 2024-02-24T03:21:08.295233563Z [2024-02-24T03:21:08.294+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:20:00+00:00 exited with status success for try_number 1 2024-02-24T03:21:08.304858449Z [2024-02-24T03:21:08.304+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:20:00+00:00, map_index=-1, run_start_date=2024-02-24 03:21:03.380924+00:00, run_end_date=2024-02-24 03:21:07.766383+00:00, run_duration=4.385459, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1018, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:21:00.607512+00:00, queued_by_job_id=2, pid=14841 2024-02-24T03:21:08.305360353Z [2024-02-24T03:21:08.305+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:20:00+00:00, map_index=-1, run_start_date=2024-02-24 03:21:03.857902+00:00, run_end_date=2024-02-24 03:21:07.664150+00:00, run_duration=3.806248, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1019, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:21:00.607512+00:00, queued_by_job_id=2, pid=14847 2024-02-24T03:22:00.109007008Z [2024-02-24T03:22:00.108+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:22:00.128729505Z [2024-02-24T03:22:00.128+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:22:00+00:00, run_after=2024-02-24T03:23:00+00:00 2024-02-24T03:22:00.144223417Z [2024-02-24T03:22:00.143+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:22:00+00:00, run_after=2024-02-24T03:23:00+00:00 2024-02-24T03:22:00.152319888Z [2024-02-24T03:22:00.152+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:22:00.252001409Z [2024-02-24T03:22:00.251+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T03:22:00.252035942Z 2024-02-24T03:22:00.252043717Z 2024-02-24T03:22:00.252050343Z 2024-02-24T03:22:00.252056857Z 2024-02-24T03:22:00.252224635Z [2024-02-24T03:22:00.251+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T03:22:00.252469189Z [2024-02-24T03:22:00.252+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:22:00.252763746Z [2024-02-24T03:22:00.252+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:22:00.252990563Z [2024-02-24T03:22:00.252+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:22:00.253851177Z [2024-02-24T03:22:00.253+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:22:00.253878786Z 2024-02-24T03:22:00.253914071Z 2024-02-24T03:22:00.253923191Z 2024-02-24T03:22:00.253952149Z 2024-02-24T03:22:00.258540158Z [2024-02-24T03:22:00.258+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:22:00.258838146Z [2024-02-24T03:22:00.258+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T03:22:00.259241584Z [2024-02-24T03:22:00.259+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:22:00.259465470Z [2024-02-24T03:22:00.259+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:22:00.259819805Z [2024-02-24T03:22:00.259+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:22:00.260066216Z [2024-02-24T03:22:00.259+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:22:00.260497658Z [2024-02-24T03:22:00.260+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:22:00.260767349Z [2024-02-24T03:22:00.260+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:22:00.647180871Z [2024-02-24T03:22:00.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:20:00+00:00 exited with status queued for try_number 1 2024-02-24T03:22:00.647207802Z [2024-02-24T03:22:00.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:21:00+00:00 exited with status queued for try_number 1 2024-02-24T03:22:00.647262647Z [2024-02-24T03:22:00.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:21:00+00:00 exited with status queued for try_number 1 2024-02-24T03:22:00.647400409Z [2024-02-24T03:22:00.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:21:00+00:00 exited with status queued for try_number 1 2024-02-24T03:22:00.655973275Z [2024-02-24T03:22:00.655+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b5ccc97-7aa1-478f-9fde-df8744efedbe 2024-02-24T03:22:00.656017005Z [2024-02-24T03:22:00.655+0000] {scheduler_job.py:635} INFO - Setting external_id for to b974f35d-bcf8-4611-8af0-67179b819069 2024-02-24T03:22:00.656287291Z [2024-02-24T03:22:00.656+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c3e1a63-8b6f-4175-bb06-56292dfc10f9 2024-02-24T03:22:00.656424852Z [2024-02-24T03:22:00.656+0000] {scheduler_job.py:635} INFO - Setting external_id for to c4de449f-f15f-49b6-a005-c5f19afc7ccb 2024-02-24T03:22:01.899135431Z [2024-02-24T03:22:01.898+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:22:01.899945110Z [2024-02-24T03:22:01.899+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 03:20:00+00:00, run_id=scheduled__2024-02-24T03:20:00+00:00, run_start_date=2024-02-24 03:22:00.168349+00:00, run_end_date=2024-02-24 03:22:01.899375+00:00, run_duration=1.731026, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:20:00+00:00, data_interval_end=2024-02-24 03:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T03:22:01.911959951Z [2024-02-24T03:22:01.911+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T03:22:00+00:00, run_after=2024-02-24T03:24:00+00:00 2024-02-24T03:22:01.919692207Z [2024-02-24T03:22:01.919+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:22:01.920107043Z [2024-02-24T03:22:01.919+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:21:00+00:00, run_id=scheduled__2024-02-24T03:21:00+00:00, run_start_date=2024-02-24 03:22:00.169646+00:00, run_end_date=2024-02-24 03:22:01.919606+00:00, run_duration=1.74996, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:21:00+00:00, data_interval_end=2024-02-24 03:22:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:22:01.930051157Z [2024-02-24T03:22:01.929+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:22:00+00:00, run_after=2024-02-24T03:23:00+00:00 2024-02-24T03:22:01.986570455Z [2024-02-24T03:22:01.986+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:20:00+00:00 exited with status success for try_number 1 2024-02-24T03:22:01.988705870Z [2024-02-24T03:22:01.986+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:21:00+00:00 exited with status success for try_number 1 2024-02-24T03:22:01.995610737Z [2024-02-24T03:22:01.995+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T03:20:00+00:00, map_index=-1, run_start_date=2024-02-24 03:22:01.100554+00:00, run_end_date=2024-02-24 03:22:01.575147+00:00, run_duration=0.474593, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1020, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:22:00.254830+00:00, queued_by_job_id=2, pid=14880 2024-02-24T03:22:01.995925816Z [2024-02-24T03:22:01.995+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:21:00+00:00, map_index=-1, run_start_date=2024-02-24 03:22:01.199849+00:00, run_end_date=2024-02-24 03:22:01.674106+00:00, run_duration=0.474257, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1021, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:22:00.254830+00:00, queued_by_job_id=2, pid=14881 2024-02-24T03:22:05.289023132Z [2024-02-24T03:22:05.288+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:22:05.290534238Z [2024-02-24T03:22:05.290+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:21:00+00:00, run_id=scheduled__2024-02-24T03:21:00+00:00, run_start_date=2024-02-24 03:22:00.171058+00:00, run_end_date=2024-02-24 03:22:05.289161+00:00, run_duration=5.118103, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:21:00+00:00, data_interval_end=2024-02-24 03:22:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:22:05.299908038Z [2024-02-24T03:22:05.299+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:22:00+00:00, run_after=2024-02-24T03:23:00+00:00 2024-02-24T03:22:05.308207057Z [2024-02-24T03:22:05.307+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:22:05.308544518Z [2024-02-24T03:22:05.308+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:21:00+00:00, run_id=scheduled__2024-02-24T03:21:00+00:00, run_start_date=2024-02-24 03:22:00.172159+00:00, run_end_date=2024-02-24 03:22:05.308093+00:00, run_duration=5.135934, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:21:00+00:00, data_interval_end=2024-02-24 03:22:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:22:05.317638759Z [2024-02-24T03:22:05.317+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:22:00+00:00, run_after=2024-02-24T03:23:00+00:00 2024-02-24T03:22:05.357863053Z [2024-02-24T03:22:05.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:21:00+00:00 exited with status success for try_number 1 2024-02-24T03:22:05.358019229Z [2024-02-24T03:22:05.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:21:00+00:00 exited with status success for try_number 1 2024-02-24T03:22:05.369537711Z [2024-02-24T03:22:05.368+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:21:00+00:00, map_index=-1, run_start_date=2024-02-24 03:22:02.616629+00:00, run_end_date=2024-02-24 03:22:04.599557+00:00, run_duration=1.982928, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1023, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:22:00.254830+00:00, queued_by_job_id=2, pid=14905 2024-02-24T03:22:05.369661399Z [2024-02-24T03:22:05.369+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:21:00+00:00, map_index=-1, run_start_date=2024-02-24 03:22:02.388271+00:00, run_end_date=2024-02-24 03:22:04.865253+00:00, run_duration=2.476982, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1022, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:22:00.254830+00:00, queued_by_job_id=2, pid=14904 2024-02-24T03:22:05.382188829Z [2024-02-24T03:22:05.381+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T03:23:01.087287107Z [2024-02-24T03:23:01.086+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:23:00+00:00, run_after=2024-02-24T03:24:00+00:00 2024-02-24T03:23:01.101709142Z [2024-02-24T03:23:01.101+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:23:01.122559736Z [2024-02-24T03:23:01.122+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:23:00+00:00, run_after=2024-02-24T03:24:00+00:00 2024-02-24T03:23:01.238338509Z [2024-02-24T03:23:01.237+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T03:23:01.238363075Z 2024-02-24T03:23:01.238367032Z 2024-02-24T03:23:01.238370234Z 2024-02-24T03:23:01.238373437Z [2024-02-24T03:23:01.237+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:23:01.238380519Z [2024-02-24T03:23:01.237+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:23:01.238383974Z [2024-02-24T03:23:01.237+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:23:01.239036946Z [2024-02-24T03:23:01.238+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:23:01.239045105Z 2024-02-24T03:23:01.239048670Z 2024-02-24T03:23:01.239065193Z 2024-02-24T03:23:01.250021322Z [2024-02-24T03:23:01.246+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:23:01.250040281Z [2024-02-24T03:23:01.247+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:23:01.250043920Z [2024-02-24T03:23:01.247+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:23:01.250047202Z [2024-02-24T03:23:01.247+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:23:01.250050476Z [2024-02-24T03:23:01.248+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:23:01.250053855Z [2024-02-24T03:23:01.248+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:23:01.601553078Z [2024-02-24T03:23:01.601+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:22:00+00:00 exited with status queued for try_number 1 2024-02-24T03:23:01.603612010Z [2024-02-24T03:23:01.601+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:22:00+00:00 exited with status queued for try_number 1 2024-02-24T03:23:01.603755695Z [2024-02-24T03:23:01.603+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:22:00+00:00 exited with status queued for try_number 1 2024-02-24T03:23:01.630702625Z [2024-02-24T03:23:01.630+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6b214a0-ba1c-4472-a5d9-35f3b40c194f 2024-02-24T03:23:01.631045675Z [2024-02-24T03:23:01.630+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0dbfcc24-c465-4b2d-9adc-f09262494809 2024-02-24T03:23:01.632704079Z [2024-02-24T03:23:01.631+0000] {scheduler_job.py:635} INFO - Setting external_id for to f9c70666-b377-47c1-bc56-13a0a8cf6412 2024-02-24T03:23:02.971638361Z [2024-02-24T03:23:02.971+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:23:02.972148018Z [2024-02-24T03:23:02.971+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:22:00+00:00, run_id=scheduled__2024-02-24T03:22:00+00:00, run_start_date=2024-02-24 03:23:01.138973+00:00, run_end_date=2024-02-24 03:23:02.971736+00:00, run_duration=1.832763, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:22:00+00:00, data_interval_end=2024-02-24 03:23:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:23:02.984500290Z [2024-02-24T03:23:02.984+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:23:00+00:00, run_after=2024-02-24T03:24:00+00:00 2024-02-24T03:23:04.180415748Z [2024-02-24T03:23:04.179+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:22:00+00:00 exited with status success for try_number 1 2024-02-24T03:23:04.189138110Z [2024-02-24T03:23:04.188+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:22:00+00:00, map_index=-1, run_start_date=2024-02-24 03:23:02.339386+00:00, run_end_date=2024-02-24 03:23:02.905557+00:00, run_duration=0.566171, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1024, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:23:01.240695+00:00, queued_by_job_id=2, pid=14936 2024-02-24T03:23:06.346679633Z [2024-02-24T03:23:06.346+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:23:06.346774725Z [2024-02-24T03:23:06.346+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:22:00+00:00, run_id=scheduled__2024-02-24T03:22:00+00:00, run_start_date=2024-02-24 03:23:01.140887+00:00, run_end_date=2024-02-24 03:23:06.346386+00:00, run_duration=5.205499, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:22:00+00:00, data_interval_end=2024-02-24 03:23:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:23:06.361753648Z [2024-02-24T03:23:06.361+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:23:00+00:00, run_after=2024-02-24T03:24:00+00:00 2024-02-24T03:23:06.414024671Z [2024-02-24T03:23:06.413+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:22:00+00:00 exited with status success for try_number 1 2024-02-24T03:23:06.419698062Z [2024-02-24T03:23:06.419+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:22:00+00:00, map_index=-1, run_start_date=2024-02-24 03:23:03.662261+00:00, run_end_date=2024-02-24 03:23:05.631543+00:00, run_duration=1.969282, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1025, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:23:01.240695+00:00, queued_by_job_id=2, pid=14954 2024-02-24T03:23:07.470905903Z [2024-02-24T03:23:07.470+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:23:07.471256364Z [2024-02-24T03:23:07.470+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:22:00+00:00, run_id=scheduled__2024-02-24T03:22:00+00:00, run_start_date=2024-02-24 03:23:01.142676+00:00, run_end_date=2024-02-24 03:23:07.470722+00:00, run_duration=6.328046, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:22:00+00:00, data_interval_end=2024-02-24 03:23:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:23:07.480410721Z [2024-02-24T03:23:07.480+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:23:00+00:00, run_after=2024-02-24T03:24:00+00:00 2024-02-24T03:23:07.508740259Z [2024-02-24T03:23:07.508+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:22:00+00:00 exited with status success for try_number 1 2024-02-24T03:23:07.519316690Z [2024-02-24T03:23:07.518+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:22:00+00:00, map_index=-1, run_start_date=2024-02-24 03:23:03.624761+00:00, run_end_date=2024-02-24 03:23:06.405699+00:00, run_duration=2.780938, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1026, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:23:01.240695+00:00, queued_by_job_id=2, pid=14955 2024-02-24T03:24:00.990721613Z [2024-02-24T03:24:00.990+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:24:01.020555935Z [2024-02-24T03:24:01.020+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:24:00+00:00, run_after=2024-02-24T03:25:00+00:00 2024-02-24T03:24:01.037752541Z [2024-02-24T03:24:01.037+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:24:01.074421788Z [2024-02-24T03:24:01.073+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:24:00+00:00, run_after=2024-02-24T03:25:00+00:00 2024-02-24T03:24:01.182720969Z [2024-02-24T03:24:01.182+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T03:24:01.182765388Z 2024-02-24T03:24:01.182770133Z 2024-02-24T03:24:01.182773550Z 2024-02-24T03:24:01.182776840Z 2024-02-24T03:24:01.182788944Z [2024-02-24T03:24:01.182+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T03:24:01.182859271Z [2024-02-24T03:24:01.182+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:24:01.182933858Z [2024-02-24T03:24:01.182+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:24:01.182999992Z [2024-02-24T03:24:01.182+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:24:01.186624428Z [2024-02-24T03:24:01.183+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:24:01.186643712Z 2024-02-24T03:24:01.186648087Z 2024-02-24T03:24:01.186651344Z 2024-02-24T03:24:01.186654805Z 2024-02-24T03:24:01.190909500Z [2024-02-24T03:24:01.190+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T03:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:24:01.191020133Z [2024-02-24T03:24:01.190+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T03:24:01.191251391Z [2024-02-24T03:24:01.191+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:24:01.191354581Z [2024-02-24T03:24:01.191+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:24:01.191543180Z [2024-02-24T03:24:01.191+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:24:01.192920875Z [2024-02-24T03:24:01.191+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:24:01.193123235Z [2024-02-24T03:24:01.192+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:24:01.193262594Z [2024-02-24T03:24:01.193+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:24:01.699070609Z [2024-02-24T03:24:01.698+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:22:00+00:00 exited with status queued for try_number 1 2024-02-24T03:24:01.702376598Z [2024-02-24T03:24:01.701+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:23:00+00:00 exited with status queued for try_number 1 2024-02-24T03:24:01.702747426Z [2024-02-24T03:24:01.702+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:23:00+00:00 exited with status queued for try_number 1 2024-02-24T03:24:01.703029137Z [2024-02-24T03:24:01.702+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:23:00+00:00 exited with status queued for try_number 1 2024-02-24T03:24:01.732905986Z [2024-02-24T03:24:01.731+0000] {scheduler_job.py:635} INFO - Setting external_id for to 257855bd-a9a1-456a-a36e-09c3d982aa1f 2024-02-24T03:24:01.734020658Z [2024-02-24T03:24:01.733+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2106e27-07fb-4cb4-856b-02f9d7947553 2024-02-24T03:24:01.734998627Z [2024-02-24T03:24:01.734+0000] {scheduler_job.py:635} INFO - Setting external_id for to f260c454-0209-4245-9920-788d780e40c8 2024-02-24T03:24:01.735731914Z [2024-02-24T03:24:01.735+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7cc13ce6-6194-488b-a6fa-a94c769a3904 2024-02-24T03:24:03.295347493Z [2024-02-24T03:24:03.294+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:24:03.295752210Z [2024-02-24T03:24:03.295+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:23:00+00:00, run_id=scheduled__2024-02-24T03:23:00+00:00, run_start_date=2024-02-24 03:24:01.095551+00:00, run_end_date=2024-02-24 03:24:03.295212+00:00, run_duration=2.199661, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:23:00+00:00, data_interval_end=2024-02-24 03:24:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:24:03.313946230Z [2024-02-24T03:24:03.313+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:24:00+00:00, run_after=2024-02-24T03:25:00+00:00 2024-02-24T03:24:03.970127265Z [2024-02-24T03:24:03.969+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:24:03.970294021Z [2024-02-24T03:24:03.970+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 03:22:00+00:00, run_id=scheduled__2024-02-24T03:22:00+00:00, run_start_date=2024-02-24 03:24:01.093660+00:00, run_end_date=2024-02-24 03:24:03.970005+00:00, run_duration=2.876345, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:22:00+00:00, data_interval_end=2024-02-24 03:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T03:24:03.984590438Z [2024-02-24T03:24:03.984+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T03:24:00+00:00, run_after=2024-02-24T03:26:00+00:00 2024-02-24T03:24:04.057397478Z [2024-02-24T03:24:04.057+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:22:00+00:00 exited with status success for try_number 1 2024-02-24T03:24:04.057594784Z [2024-02-24T03:24:04.057+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:23:00+00:00 exited with status success for try_number 1 2024-02-24T03:24:04.066682892Z [2024-02-24T03:24:04.066+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:23:00+00:00, map_index=-1, run_start_date=2024-02-24 03:24:02.459785+00:00, run_end_date=2024-02-24 03:24:03.161126+00:00, run_duration=0.701341, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1027, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:24:01.187583+00:00, queued_by_job_id=2, pid=14988 2024-02-24T03:24:04.067324341Z [2024-02-24T03:24:04.066+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T03:22:00+00:00, map_index=-1, run_start_date=2024-02-24 03:24:02.614933+00:00, run_end_date=2024-02-24 03:24:03.414520+00:00, run_duration=0.799587, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1028, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:24:01.187583+00:00, queued_by_job_id=2, pid=14989 2024-02-24T03:24:08.452842872Z [2024-02-24T03:24:08.452+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:24:08.453457714Z [2024-02-24T03:24:08.453+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:23:00+00:00, run_id=scheduled__2024-02-24T03:23:00+00:00, run_start_date=2024-02-24 03:24:01.098953+00:00, run_end_date=2024-02-24 03:24:08.452945+00:00, run_duration=7.353992, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:23:00+00:00, data_interval_end=2024-02-24 03:24:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:24:08.467189155Z [2024-02-24T03:24:08.466+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:24:00+00:00, run_after=2024-02-24T03:25:00+00:00 2024-02-24T03:24:08.476499664Z [2024-02-24T03:24:08.476+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:24:08.476885603Z [2024-02-24T03:24:08.476+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:23:00+00:00, run_id=scheduled__2024-02-24T03:23:00+00:00, run_start_date=2024-02-24 03:24:01.097257+00:00, run_end_date=2024-02-24 03:24:08.476549+00:00, run_duration=7.379292, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:23:00+00:00, data_interval_end=2024-02-24 03:24:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:24:08.488741429Z [2024-02-24T03:24:08.488+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:24:00+00:00, run_after=2024-02-24T03:25:00+00:00 2024-02-24T03:24:08.554665040Z [2024-02-24T03:24:08.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:23:00+00:00 exited with status success for try_number 1 2024-02-24T03:24:08.556833350Z [2024-02-24T03:24:08.556+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:23:00+00:00 exited with status success for try_number 1 2024-02-24T03:24:08.564490557Z [2024-02-24T03:24:08.564+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:23:00+00:00, map_index=-1, run_start_date=2024-02-24 03:24:04.471047+00:00, run_end_date=2024-02-24 03:24:07.838157+00:00, run_duration=3.36711, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1030, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:24:01.187583+00:00, queued_by_job_id=2, pid=15018 2024-02-24T03:24:08.564779830Z [2024-02-24T03:24:08.564+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:23:00+00:00, map_index=-1, run_start_date=2024-02-24 03:24:03.885402+00:00, run_end_date=2024-02-24 03:24:07.890926+00:00, run_duration=4.005524, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1029, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:24:01.187583+00:00, queued_by_job_id=2, pid=15007 2024-02-24T03:25:00.941470632Z [2024-02-24T03:25:00.940+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:25:00+00:00, run_after=2024-02-24T03:26:00+00:00 2024-02-24T03:25:00.963071020Z [2024-02-24T03:25:00.962+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:25:00+00:00, run_after=2024-02-24T03:26:00+00:00 2024-02-24T03:25:00.971098034Z [2024-02-24T03:25:00.970+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:25:00.984433584Z [2024-02-24T03:25:00.984+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:25:00+00:00, run_after=2024-02-24T03:30:00+00:00 2024-02-24T03:25:01.107530448Z [2024-02-24T03:25:01.107+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T03:25:01.107560269Z 2024-02-24T03:25:01.107566018Z 2024-02-24T03:25:01.107570553Z 2024-02-24T03:25:01.107575147Z 2024-02-24T03:25:01.107806761Z [2024-02-24T03:25:01.107+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:25:01.108052321Z [2024-02-24T03:25:01.107+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:25:01.108233247Z [2024-02-24T03:25:01.108+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:25:01.108383780Z [2024-02-24T03:25:01.108+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:25:01.109189796Z [2024-02-24T03:25:01.108+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:25:01.109200235Z 2024-02-24T03:25:01.109203798Z 2024-02-24T03:25:01.109207232Z 2024-02-24T03:25:01.109210526Z 2024-02-24T03:25:01.114080874Z [2024-02-24T03:25:01.113+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T03:25:01.114737396Z [2024-02-24T03:25:01.114+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T03:25:01.115155419Z [2024-02-24T03:25:01.114+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:25:01.115354736Z [2024-02-24T03:25:01.115+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:25:01.115705065Z [2024-02-24T03:25:01.115+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:25:01.115978988Z [2024-02-24T03:25:01.115+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:25:01.116313820Z [2024-02-24T03:25:01.116+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:25:01.116507650Z [2024-02-24T03:25:01.116+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:25:01.670552635Z [2024-02-24T03:25:01.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T03:20:00+00:00 exited with status queued for try_number 1 2024-02-24T03:25:01.671025978Z [2024-02-24T03:25:01.670+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:24:00+00:00 exited with status queued for try_number 1 2024-02-24T03:25:01.671321789Z [2024-02-24T03:25:01.671+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:24:00+00:00 exited with status queued for try_number 1 2024-02-24T03:25:01.671564344Z [2024-02-24T03:25:01.671+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:24:00+00:00 exited with status queued for try_number 1 2024-02-24T03:25:01.688347919Z [2024-02-24T03:25:01.687+0000] {scheduler_job.py:635} INFO - Setting external_id for to dbbe2cad-9636-4c6e-bbb6-b44cb408a67b 2024-02-24T03:25:01.688962228Z [2024-02-24T03:25:01.688+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f452f47-ee05-407e-a205-ec099056a3e8 2024-02-24T03:25:01.689333460Z [2024-02-24T03:25:01.689+0000] {scheduler_job.py:635} INFO - Setting external_id for to ec6b5e55-283e-4bd5-9a55-d73908a50dd1 2024-02-24T03:25:01.689656198Z [2024-02-24T03:25:01.689+0000] {scheduler_job.py:635} INFO - Setting external_id for to 94ec6a26-6b54-4610-9aa3-9b712b43bc21 2024-02-24T03:25:04.007246146Z [2024-02-24T03:25:04.006+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:25:04.008378913Z [2024-02-24T03:25:04.008+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:24:00+00:00, run_id=scheduled__2024-02-24T03:24:00+00:00, run_start_date=2024-02-24 03:25:01.001517+00:00, run_end_date=2024-02-24 03:25:04.007956+00:00, run_duration=3.006439, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:24:00+00:00, data_interval_end=2024-02-24 03:25:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:25:04.022194379Z [2024-02-24T03:25:04.021+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:25:00+00:00, run_after=2024-02-24T03:26:00+00:00 2024-02-24T03:25:04.113723642Z [2024-02-24T03:25:04.113+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:24:00+00:00 exited with status success for try_number 1 2024-02-24T03:25:04.119786758Z [2024-02-24T03:25:04.119+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:24:00+00:00, map_index=-1, run_start_date=2024-02-24 03:25:02.496305+00:00, run_end_date=2024-02-24 03:25:03.088842+00:00, run_duration=0.592537, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1031, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:25:01.110385+00:00, queued_by_job_id=2, pid=15049 2024-02-24T03:25:04.983955340Z [2024-02-24T03:25:04.983+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:25:04.983989163Z 2024-02-24T03:25:04.984004043Z [2024-02-24T03:25:04.983+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:25:04.984755713Z [2024-02-24T03:25:04.984+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:25:04.984775502Z 2024-02-24T03:25:04.987560556Z [2024-02-24T03:25:04.987+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T03:25:04.987752519Z [2024-02-24T03:25:04.987+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T03:25:05.061542904Z [2024-02-24T03:25:05.058+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T03:20:00+00:00 exited with status queued for try_number 1 2024-02-24T03:25:05.062019762Z [2024-02-24T03:25:05.061+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T03:20:00+00:00 exited with status success for try_number 1 2024-02-24T03:25:05.075625403Z [2024-02-24T03:25:05.075+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7cf11050-8b3f-410e-a8d5-8d7f74102bb1 2024-02-24T03:25:05.075982616Z [2024-02-24T03:25:05.075+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T03:20:00+00:00, map_index=-1, run_start_date=2024-02-24 03:25:03.547782+00:00, run_end_date=2024-02-24 03:25:04.062191+00:00, run_duration=0.514409, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1032, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:25:01.110385+00:00, queued_by_job_id=2, pid=15070 2024-02-24T03:25:06.297221863Z [2024-02-24T03:25:06.296+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:25:06.297714385Z [2024-02-24T03:25:06.297+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:24:00+00:00, run_id=scheduled__2024-02-24T03:24:00+00:00, run_start_date=2024-02-24 03:25:01.003875+00:00, run_end_date=2024-02-24 03:25:06.297054+00:00, run_duration=5.293179, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:24:00+00:00, data_interval_end=2024-02-24 03:25:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:25:06.310225101Z [2024-02-24T03:25:06.309+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:25:00+00:00, run_after=2024-02-24T03:26:00+00:00 2024-02-24T03:25:06.328220595Z [2024-02-24T03:25:06.327+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:25:06.329492106Z [2024-02-24T03:25:06.328+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:24:00+00:00, run_id=scheduled__2024-02-24T03:24:00+00:00, run_start_date=2024-02-24 03:25:01.005877+00:00, run_end_date=2024-02-24 03:25:06.328362+00:00, run_duration=5.322485, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:24:00+00:00, data_interval_end=2024-02-24 03:25:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:25:06.352985900Z [2024-02-24T03:25:06.352+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:25:00+00:00, run_after=2024-02-24T03:26:00+00:00 2024-02-24T03:25:06.416909556Z [2024-02-24T03:25:06.416+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:24:00+00:00 exited with status success for try_number 1 2024-02-24T03:25:06.417179543Z [2024-02-24T03:25:06.416+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:24:00+00:00 exited with status success for try_number 1 2024-02-24T03:25:06.429214791Z [2024-02-24T03:25:06.428+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:24:00+00:00, map_index=-1, run_start_date=2024-02-24 03:25:03.751448+00:00, run_end_date=2024-02-24 03:25:05.987649+00:00, run_duration=2.236201, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1034, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:25:01.110385+00:00, queued_by_job_id=2, pid=15072 2024-02-24T03:25:06.429653868Z [2024-02-24T03:25:06.429+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:24:00+00:00, map_index=-1, run_start_date=2024-02-24 03:25:03.717088+00:00, run_end_date=2024-02-24 03:25:05.623068+00:00, run_duration=1.90598, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1033, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:25:01.110385+00:00, queued_by_job_id=2, pid=15071 2024-02-24T03:25:07.509739201Z [2024-02-24T03:25:07.509+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:25:07.509868603Z 2024-02-24T03:25:07.510056937Z [2024-02-24T03:25:07.509+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:25:07.511100422Z [2024-02-24T03:25:07.510+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:25:07.511114788Z 2024-02-24T03:25:07.514324766Z [2024-02-24T03:25:07.514+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T03:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T03:25:07.514411754Z [2024-02-24T03:25:07.514+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T03:25:07.594994030Z [2024-02-24T03:25:07.594+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T03:20:00+00:00 exited with status queued for try_number 1 2024-02-24T03:25:07.595235378Z [2024-02-24T03:25:07.594+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T03:20:00+00:00 exited with status success for try_number 1 2024-02-24T03:25:07.603066177Z [2024-02-24T03:25:07.602+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3184e30f-307b-48f5-8ee2-f440d0835bc4 2024-02-24T03:25:07.603695833Z [2024-02-24T03:25:07.603+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T03:20:00+00:00, map_index=-1, run_start_date=2024-02-24 03:25:06.862793+00:00, run_end_date=2024-02-24 03:25:07.235001+00:00, run_duration=0.372208, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1035, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:25:04.985148+00:00, queued_by_job_id=2, pid=15095 2024-02-24T03:25:09.919883254Z [2024-02-24T03:25:09.919+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:25:09.919906366Z 2024-02-24T03:25:09.920233786Z [2024-02-24T03:25:09.920+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:25:09.920823801Z [2024-02-24T03:25:09.920+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:25:09.920832768Z 2024-02-24T03:25:09.923281941Z [2024-02-24T03:25:09.923+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:25:09.923504659Z [2024-02-24T03:25:09.923+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T03:25:09.994758904Z [2024-02-24T03:25:09.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T03:20:00+00:00 exited with status queued for try_number 1 2024-02-24T03:25:09.995120051Z [2024-02-24T03:25:09.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T03:20:00+00:00 exited with status success for try_number 1 2024-02-24T03:25:10.006506170Z [2024-02-24T03:25:10.005+0000] {scheduler_job.py:635} INFO - Setting external_id for to a6b6a3a7-6549-4deb-ac40-f64a592d8f0c 2024-02-24T03:25:10.006881939Z [2024-02-24T03:25:10.006+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T03:20:00+00:00, map_index=0, run_start_date=2024-02-24 03:25:09.139177+00:00, run_end_date=2024-02-24 03:25:09.506258+00:00, run_duration=0.367081, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1036, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:25:07.511795+00:00, queued_by_job_id=2, pid=15103 2024-02-24T03:25:12.551438458Z [2024-02-24T03:25:12.551+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:25:12.551862755Z [2024-02-24T03:25:12.551+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:20:00+00:00, run_id=scheduled__2024-02-24T03:20:00+00:00, run_start_date=2024-02-24 03:25:00.999316+00:00, run_end_date=2024-02-24 03:25:12.551351+00:00, run_duration=11.552035, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:20:00+00:00, data_interval_end=2024-02-24 03:25:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T03:25:12.558424661Z [2024-02-24T03:25:12.558+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:25:00+00:00, run_after=2024-02-24T03:30:00+00:00 2024-02-24T03:25:12.588573608Z [2024-02-24T03:25:12.588+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T03:20:00+00:00 exited with status success for try_number 1 2024-02-24T03:25:12.594686049Z [2024-02-24T03:25:12.594+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T03:20:00+00:00, map_index=-1, run_start_date=2024-02-24 03:25:11.748581+00:00, run_end_date=2024-02-24 03:25:12.141254+00:00, run_duration=0.392673, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1037, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:25:09.921245+00:00, queued_by_job_id=2, pid=15111 2024-02-24T03:26:00.075504775Z [2024-02-24T03:26:00.074+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:26:00.089023541Z [2024-02-24T03:26:00.088+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:26:00.105590524Z [2024-02-24T03:26:00.105+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:26:00+00:00, run_after=2024-02-24T03:27:00+00:00 2024-02-24T03:26:00.131654317Z [2024-02-24T03:26:00.130+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:26:00+00:00, run_after=2024-02-24T03:27:00+00:00 2024-02-24T03:26:00.241530099Z [2024-02-24T03:26:00.241+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T03:26:00.241563369Z 2024-02-24T03:26:00.241571172Z 2024-02-24T03:26:00.241577579Z 2024-02-24T03:26:00.241584042Z 2024-02-24T03:26:00.241857425Z [2024-02-24T03:26:00.241+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T03:26:00.242275341Z [2024-02-24T03:26:00.242+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:26:00.242604110Z [2024-02-24T03:26:00.242+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:26:00.242908553Z [2024-02-24T03:26:00.242+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:26:00.243703663Z [2024-02-24T03:26:00.243+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:26:00.243715254Z 2024-02-24T03:26:00.243722075Z 2024-02-24T03:26:00.243728431Z 2024-02-24T03:26:00.243735156Z 2024-02-24T03:26:00.248954348Z [2024-02-24T03:26:00.248+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T03:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:26:00.248999268Z [2024-02-24T03:26:00.248+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T03:26:00.249379176Z [2024-02-24T03:26:00.249+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:26:00.249570441Z [2024-02-24T03:26:00.249+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:26:00.249952026Z [2024-02-24T03:26:00.249+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:26:00.250145687Z [2024-02-24T03:26:00.249+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:26:00.250414967Z [2024-02-24T03:26:00.250+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:26:00.250526506Z [2024-02-24T03:26:00.250+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:26:00.592408816Z [2024-02-24T03:26:00.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:24:00+00:00 exited with status queued for try_number 1 2024-02-24T03:26:00.592490699Z [2024-02-24T03:26:00.592+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:25:00+00:00 exited with status queued for try_number 1 2024-02-24T03:26:00.592614041Z [2024-02-24T03:26:00.592+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:25:00+00:00 exited with status queued for try_number 1 2024-02-24T03:26:00.592748099Z [2024-02-24T03:26:00.592+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:25:00+00:00 exited with status queued for try_number 1 2024-02-24T03:26:00.601537805Z [2024-02-24T03:26:00.601+0000] {scheduler_job.py:635} INFO - Setting external_id for to e12dfefb-a7ca-424f-b43a-d4b5f87b8939 2024-02-24T03:26:00.601568587Z [2024-02-24T03:26:00.601+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b6031b5-48f1-4e65-b6e4-4c8e81f0f646 2024-02-24T03:26:00.601683090Z [2024-02-24T03:26:00.601+0000] {scheduler_job.py:635} INFO - Setting external_id for to f85c3395-c643-48b8-8e03-baa85c6ff160 2024-02-24T03:26:00.601822338Z [2024-02-24T03:26:00.601+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0126bfde-be6f-4a00-9365-0377f8e35514 2024-02-24T03:26:02.188287935Z [2024-02-24T03:26:02.187+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:26:02.189010067Z [2024-02-24T03:26:02.188+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 03:24:00+00:00, run_id=scheduled__2024-02-24T03:24:00+00:00, run_start_date=2024-02-24 03:26:00.157318+00:00, run_end_date=2024-02-24 03:26:02.188226+00:00, run_duration=2.030908, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:24:00+00:00, data_interval_end=2024-02-24 03:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T03:26:02.202625539Z [2024-02-24T03:26:02.202+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T03:26:00+00:00, run_after=2024-02-24T03:28:00+00:00 2024-02-24T03:26:02.212550979Z [2024-02-24T03:26:02.212+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:26:02.213095001Z [2024-02-24T03:26:02.212+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:25:00+00:00, run_id=scheduled__2024-02-24T03:25:00+00:00, run_start_date=2024-02-24 03:26:00.160188+00:00, run_end_date=2024-02-24 03:26:02.212442+00:00, run_duration=2.052254, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:25:00+00:00, data_interval_end=2024-02-24 03:26:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:26:02.224573572Z [2024-02-24T03:26:02.224+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:26:00+00:00, run_after=2024-02-24T03:27:00+00:00 2024-02-24T03:26:02.292156452Z [2024-02-24T03:26:02.291+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:24:00+00:00 exited with status success for try_number 1 2024-02-24T03:26:02.292321832Z [2024-02-24T03:26:02.292+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:25:00+00:00 exited with status success for try_number 1 2024-02-24T03:26:02.303993094Z [2024-02-24T03:26:02.303+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T03:24:00+00:00, map_index=-1, run_start_date=2024-02-24 03:26:01.024666+00:00, run_end_date=2024-02-24 03:26:01.522108+00:00, run_duration=0.497442, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1038, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:26:00.244817+00:00, queued_by_job_id=2, pid=15134 2024-02-24T03:26:02.304143872Z [2024-02-24T03:26:02.303+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:25:00+00:00, map_index=-1, run_start_date=2024-02-24 03:26:01.076787+00:00, run_end_date=2024-02-24 03:26:01.607263+00:00, run_duration=0.530476, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1039, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:26:00.244817+00:00, queued_by_job_id=2, pid=15135 2024-02-24T03:26:04.467949494Z [2024-02-24T03:26:04.467+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:26:04.468256145Z [2024-02-24T03:26:04.467+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:25:00+00:00, run_id=scheduled__2024-02-24T03:25:00+00:00, run_start_date=2024-02-24 03:26:00.162620+00:00, run_end_date=2024-02-24 03:26:04.467864+00:00, run_duration=4.305244, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:25:00+00:00, data_interval_end=2024-02-24 03:26:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:26:04.477079398Z [2024-02-24T03:26:04.476+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:26:00+00:00, run_after=2024-02-24T03:27:00+00:00 2024-02-24T03:26:04.540458474Z [2024-02-24T03:26:04.540+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:25:00+00:00 exited with status success for try_number 1 2024-02-24T03:26:04.550035747Z [2024-02-24T03:26:04.549+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:25:00+00:00, map_index=-1, run_start_date=2024-02-24 03:26:02.478031+00:00, run_end_date=2024-02-24 03:26:04.076371+00:00, run_duration=1.59834, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1041, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:26:00.244817+00:00, queued_by_job_id=2, pid=15159 2024-02-24T03:26:05.595265738Z [2024-02-24T03:26:05.594+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:26:05.595756756Z [2024-02-24T03:26:05.595+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:25:00+00:00, run_id=scheduled__2024-02-24T03:25:00+00:00, run_start_date=2024-02-24 03:26:00.164741+00:00, run_end_date=2024-02-24 03:26:05.595173+00:00, run_duration=5.430432, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:25:00+00:00, data_interval_end=2024-02-24 03:26:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:26:05.604527040Z [2024-02-24T03:26:05.604+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:26:00+00:00, run_after=2024-02-24T03:27:00+00:00 2024-02-24T03:26:05.635997816Z [2024-02-24T03:26:05.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:25:00+00:00 exited with status success for try_number 1 2024-02-24T03:26:05.641375343Z [2024-02-24T03:26:05.641+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:25:00+00:00, map_index=-1, run_start_date=2024-02-24 03:26:02.474948+00:00, run_end_date=2024-02-24 03:26:04.512315+00:00, run_duration=2.037367, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1040, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:26:00.244817+00:00, queued_by_job_id=2, pid=15158 2024-02-24T03:27:00.139101917Z [2024-02-24T03:27:00.138+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:27:00.153622883Z [2024-02-24T03:27:00.153+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:27:00+00:00, run_after=2024-02-24T03:28:00+00:00 2024-02-24T03:27:00.166674574Z [2024-02-24T03:27:00.166+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:27:00+00:00, run_after=2024-02-24T03:28:00+00:00 2024-02-24T03:27:00.265904377Z [2024-02-24T03:27:00.265+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T03:27:00.265945128Z 2024-02-24T03:27:00.265954265Z 2024-02-24T03:27:00.265961501Z 2024-02-24T03:27:00.266352727Z [2024-02-24T03:27:00.265+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:27:00.266811101Z [2024-02-24T03:27:00.266+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:27:00.267173926Z [2024-02-24T03:27:00.266+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:27:00.268897809Z [2024-02-24T03:27:00.268+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:27:00.268928017Z 2024-02-24T03:27:00.268938775Z 2024-02-24T03:27:00.268948584Z 2024-02-24T03:27:00.275345481Z [2024-02-24T03:27:00.274+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:27:00.275576355Z [2024-02-24T03:27:00.275+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:27:00.275973504Z [2024-02-24T03:27:00.275+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:27:00.276199324Z [2024-02-24T03:27:00.275+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:27:00.276601770Z [2024-02-24T03:27:00.276+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:27:00.276870228Z [2024-02-24T03:27:00.276+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:27:00.507662784Z [2024-02-24T03:27:00.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:26:00+00:00 exited with status queued for try_number 1 2024-02-24T03:27:00.507848467Z [2024-02-24T03:27:00.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:26:00+00:00 exited with status queued for try_number 1 2024-02-24T03:27:00.508010212Z [2024-02-24T03:27:00.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:26:00+00:00 exited with status queued for try_number 1 2024-02-24T03:27:00.515359346Z [2024-02-24T03:27:00.515+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3f52894-a461-4b64-b32f-7c3b1ba824e0 2024-02-24T03:27:00.515585863Z [2024-02-24T03:27:00.515+0000] {scheduler_job.py:635} INFO - Setting external_id for to c119c70c-e50c-4f48-937d-40ae4a074442 2024-02-24T03:27:00.515779321Z [2024-02-24T03:27:00.515+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd189cbe-c57f-44a1-a44b-c8d4a731b5e5 2024-02-24T03:27:01.647304320Z [2024-02-24T03:27:01.646+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:27:01.647490017Z [2024-02-24T03:27:01.647+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:26:00+00:00, run_id=scheduled__2024-02-24T03:26:00+00:00, run_start_date=2024-02-24 03:27:00.180385+00:00, run_end_date=2024-02-24 03:27:01.647174+00:00, run_duration=1.466789, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:26:00+00:00, data_interval_end=2024-02-24 03:27:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:27:01.656827339Z [2024-02-24T03:27:01.656+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:27:00+00:00, run_after=2024-02-24T03:28:00+00:00 2024-02-24T03:27:01.720284185Z [2024-02-24T03:27:01.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:26:00+00:00 exited with status success for try_number 1 2024-02-24T03:27:01.725402372Z [2024-02-24T03:27:01.725+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:26:00+00:00, map_index=-1, run_start_date=2024-02-24 03:27:01.010418+00:00, run_end_date=2024-02-24 03:27:01.402649+00:00, run_duration=0.392231, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1042, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:27:00.270391+00:00, queued_by_job_id=2, pid=15192 2024-02-24T03:27:03.841130819Z [2024-02-24T03:27:03.840+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:27:03.841374361Z [2024-02-24T03:27:03.841+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:26:00+00:00, run_id=scheduled__2024-02-24T03:26:00+00:00, run_start_date=2024-02-24 03:27:00.181652+00:00, run_end_date=2024-02-24 03:27:03.841037+00:00, run_duration=3.659385, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:26:00+00:00, data_interval_end=2024-02-24 03:27:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:27:03.852444774Z [2024-02-24T03:27:03.852+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:27:00+00:00, run_after=2024-02-24T03:28:00+00:00 2024-02-24T03:27:03.921394731Z [2024-02-24T03:27:03.921+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:26:00+00:00 exited with status success for try_number 1 2024-02-24T03:27:03.927004811Z [2024-02-24T03:27:03.926+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:26:00+00:00, map_index=-1, run_start_date=2024-02-24 03:27:02.079908+00:00, run_end_date=2024-02-24 03:27:03.294733+00:00, run_duration=1.214825, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1043, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:27:00.270391+00:00, queued_by_job_id=2, pid=15210 2024-02-24T03:27:04.999015925Z [2024-02-24T03:27:04.998+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:27:04.999218130Z [2024-02-24T03:27:04.998+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:26:00+00:00, run_id=scheduled__2024-02-24T03:26:00+00:00, run_start_date=2024-02-24 03:27:00.182921+00:00, run_end_date=2024-02-24 03:27:04.998772+00:00, run_duration=4.815851, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:26:00+00:00, data_interval_end=2024-02-24 03:27:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:27:05.022551264Z [2024-02-24T03:27:05.022+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:27:00+00:00, run_after=2024-02-24T03:28:00+00:00 2024-02-24T03:27:05.056036900Z [2024-02-24T03:27:05.055+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:26:00+00:00 exited with status success for try_number 1 2024-02-24T03:27:05.061515473Z [2024-02-24T03:27:05.061+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:26:00+00:00, map_index=-1, run_start_date=2024-02-24 03:27:02.251348+00:00, run_end_date=2024-02-24 03:27:03.919034+00:00, run_duration=1.667686, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1044, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:27:00.270391+00:00, queued_by_job_id=2, pid=15211 2024-02-24T03:27:05.434285493Z [2024-02-24T03:27:05.433+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T03:28:01.067833741Z [2024-02-24T03:28:01.067+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:28:01.099141247Z [2024-02-24T03:28:01.098+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:28:00+00:00, run_after=2024-02-24T03:29:00+00:00 2024-02-24T03:28:01.117105167Z [2024-02-24T03:28:01.116+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:28:00+00:00, run_after=2024-02-24T03:29:00+00:00 2024-02-24T03:28:01.127675558Z [2024-02-24T03:28:01.127+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:28:01.249673577Z [2024-02-24T03:28:01.249+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T03:28:01.249750876Z 2024-02-24T03:28:01.249756141Z 2024-02-24T03:28:01.249759427Z 2024-02-24T03:28:01.249762567Z 2024-02-24T03:28:01.250043234Z [2024-02-24T03:28:01.249+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T03:28:01.250356128Z [2024-02-24T03:28:01.250+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:28:01.250882342Z [2024-02-24T03:28:01.250+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:28:01.250923313Z [2024-02-24T03:28:01.250+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:28:01.253816687Z [2024-02-24T03:28:01.251+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:28:01.253832459Z 2024-02-24T03:28:01.253836964Z 2024-02-24T03:28:01.253840375Z 2024-02-24T03:28:01.253843893Z 2024-02-24T03:28:01.256595781Z [2024-02-24T03:28:01.255+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T03:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:28:01.256626084Z [2024-02-24T03:28:01.255+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T03:28:01.256632392Z [2024-02-24T03:28:01.255+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:28:01.256635598Z [2024-02-24T03:28:01.255+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:28:01.256638790Z [2024-02-24T03:28:01.255+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:28:01.256642128Z [2024-02-24T03:28:01.256+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:28:01.256658249Z [2024-02-24T03:28:01.256+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:28:01.256661835Z [2024-02-24T03:28:01.256+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:28:01.500622807Z [2024-02-24T03:28:01.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:26:00+00:00 exited with status queued for try_number 1 2024-02-24T03:28:01.500749200Z [2024-02-24T03:28:01.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:27:00+00:00 exited with status queued for try_number 1 2024-02-24T03:28:01.500754897Z [2024-02-24T03:28:01.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:27:00+00:00 exited with status queued for try_number 1 2024-02-24T03:28:01.500824922Z [2024-02-24T03:28:01.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:27:00+00:00 exited with status queued for try_number 1 2024-02-24T03:28:01.513670851Z [2024-02-24T03:28:01.513+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5bb9a71-e632-4ac5-9827-68ef790df62c 2024-02-24T03:28:01.513752883Z [2024-02-24T03:28:01.513+0000] {scheduler_job.py:635} INFO - Setting external_id for to d768ce7e-f8ba-46cf-b326-49cf9018b6e2 2024-02-24T03:28:01.513878209Z [2024-02-24T03:28:01.513+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f848ee9-52dc-469a-a5f4-e4c8d4760e7b 2024-02-24T03:28:01.513975478Z [2024-02-24T03:28:01.513+0000] {scheduler_job.py:635} INFO - Setting external_id for to 00ec61e9-760c-4abb-9734-452143c5db3c 2024-02-24T03:28:02.960375523Z [2024-02-24T03:28:02.959+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:28:02.960820690Z [2024-02-24T03:28:02.960+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 03:26:00+00:00, run_id=scheduled__2024-02-24T03:26:00+00:00, run_start_date=2024-02-24 03:28:01.143778+00:00, run_end_date=2024-02-24 03:28:02.960280+00:00, run_duration=1.816502, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:26:00+00:00, data_interval_end=2024-02-24 03:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T03:28:02.969509883Z [2024-02-24T03:28:02.969+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T03:28:00+00:00, run_after=2024-02-24T03:30:00+00:00 2024-02-24T03:28:02.977092755Z [2024-02-24T03:28:02.976+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:28:02.977259945Z [2024-02-24T03:28:02.977+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:27:00+00:00, run_id=scheduled__2024-02-24T03:27:00+00:00, run_start_date=2024-02-24 03:28:01.145076+00:00, run_end_date=2024-02-24 03:28:02.976989+00:00, run_duration=1.831913, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:27:00+00:00, data_interval_end=2024-02-24 03:28:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:28:02.988287316Z [2024-02-24T03:28:02.987+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:28:00+00:00, run_after=2024-02-24T03:29:00+00:00 2024-02-24T03:28:03.050439673Z [2024-02-24T03:28:03.049+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:26:00+00:00 exited with status success for try_number 1 2024-02-24T03:28:03.050551084Z [2024-02-24T03:28:03.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:27:00+00:00 exited with status success for try_number 1 2024-02-24T03:28:03.060686029Z [2024-02-24T03:28:03.060+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T03:26:00+00:00, map_index=-1, run_start_date=2024-02-24 03:28:02.189102+00:00, run_end_date=2024-02-24 03:28:02.731029+00:00, run_duration=0.541927, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1046, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:28:01.252438+00:00, queued_by_job_id=2, pid=15244 2024-02-24T03:28:03.060973333Z [2024-02-24T03:28:03.060+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:27:00+00:00, map_index=-1, run_start_date=2024-02-24 03:28:02.187831+00:00, run_end_date=2024-02-24 03:28:02.735156+00:00, run_duration=0.547325, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1045, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:28:01.252438+00:00, queued_by_job_id=2, pid=15245 2024-02-24T03:28:09.244203341Z [2024-02-24T03:28:09.243+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:28:09.244766873Z [2024-02-24T03:28:09.244+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:27:00+00:00, run_id=scheduled__2024-02-24T03:27:00+00:00, run_start_date=2024-02-24 03:28:01.146219+00:00, run_end_date=2024-02-24 03:28:09.244106+00:00, run_duration=8.097887, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:27:00+00:00, data_interval_end=2024-02-24 03:28:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:28:09.263109408Z [2024-02-24T03:28:09.262+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:28:00+00:00, run_after=2024-02-24T03:29:00+00:00 2024-02-24T03:28:09.329839595Z [2024-02-24T03:28:09.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:27:00+00:00 exited with status success for try_number 1 2024-02-24T03:28:09.336794153Z [2024-02-24T03:28:09.336+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:27:00+00:00, map_index=-1, run_start_date=2024-02-24 03:28:03.735188+00:00, run_end_date=2024-02-24 03:28:08.350217+00:00, run_duration=4.615029, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1047, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:28:01.252438+00:00, queued_by_job_id=2, pid=15268 2024-02-24T03:28:10.383392933Z [2024-02-24T03:28:10.382+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:28:10.383546414Z [2024-02-24T03:28:10.383+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:27:00+00:00, run_id=scheduled__2024-02-24T03:27:00+00:00, run_start_date=2024-02-24 03:28:01.147302+00:00, run_end_date=2024-02-24 03:28:10.383244+00:00, run_duration=9.235942, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:27:00+00:00, data_interval_end=2024-02-24 03:28:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:28:10.392618839Z [2024-02-24T03:28:10.392+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:28:00+00:00, run_after=2024-02-24T03:29:00+00:00 2024-02-24T03:28:10.434067920Z [2024-02-24T03:28:10.433+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:27:00+00:00 exited with status success for try_number 1 2024-02-24T03:28:10.443142193Z [2024-02-24T03:28:10.442+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:27:00+00:00, map_index=-1, run_start_date=2024-02-24 03:28:03.762279+00:00, run_end_date=2024-02-24 03:28:09.645574+00:00, run_duration=5.883295, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1048, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:28:01.252438+00:00, queued_by_job_id=2, pid=15269 2024-02-24T03:29:00.974608287Z [2024-02-24T03:29:00.974+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:29:00.991132350Z [2024-02-24T03:29:00.990+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:29:00+00:00, run_after=2024-02-24T03:30:00+00:00 2024-02-24T03:29:01.005065611Z [2024-02-24T03:29:01.004+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:29:00+00:00, run_after=2024-02-24T03:30:00+00:00 2024-02-24T03:29:01.105964144Z [2024-02-24T03:29:01.105+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T03:29:01.106009570Z 2024-02-24T03:29:01.106015492Z 2024-02-24T03:29:01.106020213Z 2024-02-24T03:29:01.106385694Z [2024-02-24T03:29:01.106+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:29:01.106732283Z [2024-02-24T03:29:01.106+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:29:01.107108039Z [2024-02-24T03:29:01.106+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:29:01.108126839Z [2024-02-24T03:29:01.107+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:29:01.108164381Z 2024-02-24T03:29:01.108183397Z 2024-02-24T03:29:01.108198687Z 2024-02-24T03:29:01.117958644Z [2024-02-24T03:29:01.117+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:29:01.119046568Z [2024-02-24T03:29:01.118+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:29:01.119294160Z [2024-02-24T03:29:01.118+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:29:01.119794278Z [2024-02-24T03:29:01.119+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:29:01.120371579Z [2024-02-24T03:29:01.120+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:29:01.120964341Z [2024-02-24T03:29:01.120+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:29:01.504280348Z [2024-02-24T03:29:01.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:28:00+00:00 exited with status queued for try_number 1 2024-02-24T03:29:01.504503306Z [2024-02-24T03:29:01.504+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:28:00+00:00 exited with status queued for try_number 1 2024-02-24T03:29:01.504764409Z [2024-02-24T03:29:01.504+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:28:00+00:00 exited with status queued for try_number 1 2024-02-24T03:29:01.526732759Z [2024-02-24T03:29:01.526+0000] {scheduler_job.py:635} INFO - Setting external_id for to 571094dc-2dea-4eb7-bb75-7a9b777e311b 2024-02-24T03:29:01.527229725Z [2024-02-24T03:29:01.526+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa982102-ce6b-4325-a945-efce1aeb76fe 2024-02-24T03:29:01.527675505Z [2024-02-24T03:29:01.527+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c8f407a-ef2d-478f-8c16-e7d75f4bb06d 2024-02-24T03:29:02.736109579Z [2024-02-24T03:29:02.735+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:29:02.736310854Z [2024-02-24T03:29:02.736+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:28:00+00:00, run_id=scheduled__2024-02-24T03:28:00+00:00, run_start_date=2024-02-24 03:29:01.015474+00:00, run_end_date=2024-02-24 03:29:02.736024+00:00, run_duration=1.72055, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:28:00+00:00, data_interval_end=2024-02-24 03:29:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:29:02.750962270Z [2024-02-24T03:29:02.750+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:29:00+00:00, run_after=2024-02-24T03:30:00+00:00 2024-02-24T03:29:02.850505243Z [2024-02-24T03:29:02.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:28:00+00:00 exited with status success for try_number 1 2024-02-24T03:29:02.857680226Z [2024-02-24T03:29:02.857+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:28:00+00:00, map_index=-1, run_start_date=2024-02-24 03:29:02.068249+00:00, run_end_date=2024-02-24 03:29:02.506418+00:00, run_duration=0.438169, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1049, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:29:01.109682+00:00, queued_by_job_id=2, pid=15301 2024-02-24T03:29:04.827007539Z [2024-02-24T03:29:04.826+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:29:04.827434204Z [2024-02-24T03:29:04.827+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:28:00+00:00, run_id=scheduled__2024-02-24T03:28:00+00:00, run_start_date=2024-02-24 03:29:01.016775+00:00, run_end_date=2024-02-24 03:29:04.826870+00:00, run_duration=3.810095, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:28:00+00:00, data_interval_end=2024-02-24 03:29:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:29:04.836278483Z [2024-02-24T03:29:04.835+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:29:00+00:00, run_after=2024-02-24T03:30:00+00:00 2024-02-24T03:29:04.880463789Z [2024-02-24T03:29:04.879+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:28:00+00:00 exited with status success for try_number 1 2024-02-24T03:29:04.887050186Z [2024-02-24T03:29:04.886+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:28:00+00:00, map_index=-1, run_start_date=2024-02-24 03:29:03.031546+00:00, run_end_date=2024-02-24 03:29:04.687056+00:00, run_duration=1.65551, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1050, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:29:01.109682+00:00, queued_by_job_id=2, pid=15319 2024-02-24T03:29:05.954272053Z [2024-02-24T03:29:05.953+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:29:05.954570350Z [2024-02-24T03:29:05.954+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:28:00+00:00, run_id=scheduled__2024-02-24T03:28:00+00:00, run_start_date=2024-02-24 03:29:01.017887+00:00, run_end_date=2024-02-24 03:29:05.954040+00:00, run_duration=4.936153, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:28:00+00:00, data_interval_end=2024-02-24 03:29:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:29:05.966776510Z [2024-02-24T03:29:05.966+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:29:00+00:00, run_after=2024-02-24T03:30:00+00:00 2024-02-24T03:29:06.013674807Z [2024-02-24T03:29:06.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:28:00+00:00 exited with status success for try_number 1 2024-02-24T03:29:06.024868258Z [2024-02-24T03:29:06.024+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:28:00+00:00, map_index=-1, run_start_date=2024-02-24 03:29:03.129175+00:00, run_end_date=2024-02-24 03:29:05.404055+00:00, run_duration=2.27488, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1051, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:29:01.109682+00:00, queued_by_job_id=2, pid=15320 2024-02-24T03:30:00.905869019Z [2024-02-24T03:30:00.905+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:30:00+00:00, run_after=2024-02-24T03:31:00+00:00 2024-02-24T03:30:00.921357953Z [2024-02-24T03:30:00.920+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:30:00.935055272Z [2024-02-24T03:30:00.934+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:30:00.962484743Z [2024-02-24T03:30:00.961+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:30:00+00:00, run_after=2024-02-24T03:35:00+00:00 2024-02-24T03:30:00.985719785Z [2024-02-24T03:30:00.985+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:30:00+00:00, run_after=2024-02-24T03:31:00+00:00 2024-02-24T03:30:01.115689488Z [2024-02-24T03:30:01.115+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-02-24T03:30:01.115714516Z 2024-02-24T03:30:01.115718325Z 2024-02-24T03:30:01.115722409Z 2024-02-24T03:30:01.115725592Z 2024-02-24T03:30:01.115729169Z 2024-02-24T03:30:01.118393444Z [2024-02-24T03:30:01.115+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:30:01.118563682Z [2024-02-24T03:30:01.118+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T03:30:01.118720814Z [2024-02-24T03:30:01.118+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:30:01.118875875Z [2024-02-24T03:30:01.118+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:30:01.119057298Z [2024-02-24T03:30:01.118+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:30:01.119823628Z [2024-02-24T03:30:01.119+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:30:01.119835977Z 2024-02-24T03:30:01.119840091Z 2024-02-24T03:30:01.119843703Z 2024-02-24T03:30:01.119847227Z 2024-02-24T03:30:01.119850252Z 2024-02-24T03:30:01.125032927Z [2024-02-24T03:30:01.124+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T03:30:01.125271941Z [2024-02-24T03:30:01.124+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T03:30:01.125551680Z [2024-02-24T03:30:01.125+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T03:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:30:01.125703596Z [2024-02-24T03:30:01.125+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T03:30:01.126082832Z [2024-02-24T03:30:01.125+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:30:01.126226393Z [2024-02-24T03:30:01.126+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:30:01.126395469Z [2024-02-24T03:30:01.126+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:30:01.126536334Z [2024-02-24T03:30:01.126+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:30:01.126828511Z [2024-02-24T03:30:01.126+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:30:01.127006930Z [2024-02-24T03:30:01.126+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:30:01.677437866Z [2024-02-24T03:30:01.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T03:25:00+00:00 exited with status queued for try_number 1 2024-02-24T03:30:01.677535778Z [2024-02-24T03:30:01.677+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:28:00+00:00 exited with status queued for try_number 1 2024-02-24T03:30:01.677694641Z [2024-02-24T03:30:01.677+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:29:00+00:00 exited with status queued for try_number 1 2024-02-24T03:30:01.678133319Z [2024-02-24T03:30:01.677+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:29:00+00:00 exited with status queued for try_number 1 2024-02-24T03:30:01.678227570Z [2024-02-24T03:30:01.678+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:29:00+00:00 exited with status queued for try_number 1 2024-02-24T03:30:01.700264173Z [2024-02-24T03:30:01.699+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c4effee-1637-4ea9-8308-93a3edd77943 2024-02-24T03:30:01.700454426Z [2024-02-24T03:30:01.700+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b031671-d4ab-44cd-aced-0b0765b48a02 2024-02-24T03:30:01.700622941Z [2024-02-24T03:30:01.700+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05664788-d992-4866-9cfd-75caff32c967 2024-02-24T03:30:01.700799139Z [2024-02-24T03:30:01.700+0000] {scheduler_job.py:635} INFO - Setting external_id for to 12f83cd6-a071-4c7f-a93f-9081dafda427 2024-02-24T03:30:01.700954169Z [2024-02-24T03:30:01.700+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0741dadc-01ea-4dfe-8e90-7d1dd2d8b8f1 2024-02-24T03:30:03.103956052Z [2024-02-24T03:30:03.103+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:30:03.104290430Z [2024-02-24T03:30:03.104+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 03:28:00+00:00, run_id=scheduled__2024-02-24T03:28:00+00:00, run_start_date=2024-02-24 03:30:01.005487+00:00, run_end_date=2024-02-24 03:30:03.103895+00:00, run_duration=2.098408, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:28:00+00:00, data_interval_end=2024-02-24 03:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T03:30:03.128250022Z [2024-02-24T03:30:03.127+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T03:30:00+00:00, run_after=2024-02-24T03:32:00+00:00 2024-02-24T03:30:03.330703907Z [2024-02-24T03:30:03.330+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:28:00+00:00 exited with status success for try_number 1 2024-02-24T03:30:03.347063524Z [2024-02-24T03:30:03.346+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T03:28:00+00:00, map_index=-1, run_start_date=2024-02-24 03:30:02.340230+00:00, run_end_date=2024-02-24 03:30:02.992431+00:00, run_duration=0.652201, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1052, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:30:01.120977+00:00, queued_by_job_id=2, pid=15354 2024-02-24T03:30:04.402001197Z [2024-02-24T03:30:04.401+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:30:04.402393648Z [2024-02-24T03:30:04.402+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:29:00+00:00, run_id=scheduled__2024-02-24T03:29:00+00:00, run_start_date=2024-02-24 03:30:01.007141+00:00, run_end_date=2024-02-24 03:30:04.401995+00:00, run_duration=3.394854, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:29:00+00:00, data_interval_end=2024-02-24 03:30:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:30:04.413343594Z [2024-02-24T03:30:04.412+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:30:00+00:00, run_after=2024-02-24T03:31:00+00:00 2024-02-24T03:30:04.507931228Z [2024-02-24T03:30:04.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:29:00+00:00 exited with status success for try_number 1 2024-02-24T03:30:04.515611655Z [2024-02-24T03:30:04.515+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:29:00+00:00, map_index=-1, run_start_date=2024-02-24 03:30:02.383402+00:00, run_end_date=2024-02-24 03:30:03.209937+00:00, run_duration=0.826535, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1053, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:30:01.120977+00:00, queued_by_job_id=2, pid=15355 2024-02-24T03:30:05.010451451Z [2024-02-24T03:30:05.009+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:30:05.010566228Z 2024-02-24T03:30:05.010895276Z [2024-02-24T03:30:05.010+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:30:05.011967962Z [2024-02-24T03:30:05.011+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:30:05.011992373Z 2024-02-24T03:30:05.016737141Z [2024-02-24T03:30:05.016+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T03:30:05.017032802Z [2024-02-24T03:30:05.016+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T03:30:05.097204205Z [2024-02-24T03:30:05.096+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T03:25:00+00:00 exited with status queued for try_number 1 2024-02-24T03:30:05.097480058Z [2024-02-24T03:30:05.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T03:25:00+00:00 exited with status success for try_number 1 2024-02-24T03:30:05.106828544Z [2024-02-24T03:30:05.106+0000] {scheduler_job.py:635} INFO - Setting external_id for to f71bb301-ae22-4f99-b5c4-a02c669b8233 2024-02-24T03:30:05.107080183Z [2024-02-24T03:30:05.106+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T03:25:00+00:00, map_index=-1, run_start_date=2024-02-24 03:30:04.112604+00:00, run_end_date=2024-02-24 03:30:04.509005+00:00, run_duration=0.396401, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1055, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:30:01.120977+00:00, queued_by_job_id=2, pid=15385 2024-02-24T03:30:06.341972273Z [2024-02-24T03:30:06.341+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:30:06.342798454Z [2024-02-24T03:30:06.342+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:29:00+00:00, run_id=scheduled__2024-02-24T03:29:00+00:00, run_start_date=2024-02-24 03:30:01.008824+00:00, run_end_date=2024-02-24 03:30:06.342263+00:00, run_duration=5.333439, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:29:00+00:00, data_interval_end=2024-02-24 03:30:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:30:06.352826557Z [2024-02-24T03:30:06.352+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:30:00+00:00, run_after=2024-02-24T03:31:00+00:00 2024-02-24T03:30:06.361104416Z [2024-02-24T03:30:06.360+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:30:06.361609126Z [2024-02-24T03:30:06.361+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:29:00+00:00, run_id=scheduled__2024-02-24T03:29:00+00:00, run_start_date=2024-02-24 03:30:01.010522+00:00, run_end_date=2024-02-24 03:30:06.361219+00:00, run_duration=5.350697, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:29:00+00:00, data_interval_end=2024-02-24 03:30:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:30:06.372561826Z [2024-02-24T03:30:06.372+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:30:00+00:00, run_after=2024-02-24T03:31:00+00:00 2024-02-24T03:30:06.432581442Z [2024-02-24T03:30:06.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:29:00+00:00 exited with status success for try_number 1 2024-02-24T03:30:06.433198644Z [2024-02-24T03:30:06.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:29:00+00:00 exited with status success for try_number 1 2024-02-24T03:30:06.442611540Z [2024-02-24T03:30:06.442+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:29:00+00:00, map_index=-1, run_start_date=2024-02-24 03:30:04.060775+00:00, run_end_date=2024-02-24 03:30:05.409066+00:00, run_duration=1.348291, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1054, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:30:01.120977+00:00, queued_by_job_id=2, pid=15380 2024-02-24T03:30:06.443359669Z [2024-02-24T03:30:06.443+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:29:00+00:00, map_index=-1, run_start_date=2024-02-24 03:30:04.306969+00:00, run_end_date=2024-02-24 03:30:06.136627+00:00, run_duration=1.829658, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1056, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:30:01.120977+00:00, queued_by_job_id=2, pid=15386 2024-02-24T03:30:07.508668797Z [2024-02-24T03:30:07.508+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:30:07.508704221Z 2024-02-24T03:30:07.509157374Z [2024-02-24T03:30:07.508+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:30:07.510065321Z [2024-02-24T03:30:07.509+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:30:07.510078960Z 2024-02-24T03:30:07.513284216Z [2024-02-24T03:30:07.512+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T03:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T03:30:07.513664683Z [2024-02-24T03:30:07.513+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T03:30:07.576086373Z [2024-02-24T03:30:07.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T03:25:00+00:00 exited with status queued for try_number 1 2024-02-24T03:30:07.576506941Z [2024-02-24T03:30:07.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T03:25:00+00:00 exited with status success for try_number 1 2024-02-24T03:30:07.586242252Z [2024-02-24T03:30:07.585+0000] {scheduler_job.py:635} INFO - Setting external_id for to 006f834e-4124-40f3-a302-fc9c2b6cdbb6 2024-02-24T03:30:07.586775348Z [2024-02-24T03:30:07.586+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T03:25:00+00:00, map_index=-1, run_start_date=2024-02-24 03:30:06.762606+00:00, run_end_date=2024-02-24 03:30:07.134761+00:00, run_duration=0.372155, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1057, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:30:05.012898+00:00, queued_by_job_id=2, pid=15409 2024-02-24T03:30:11.325318596Z [2024-02-24T03:30:11.324+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:30:11.325365334Z 2024-02-24T03:30:11.325458112Z [2024-02-24T03:30:11.325+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:30:11.326548121Z [2024-02-24T03:30:11.326+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:30:11.326565499Z 2024-02-24T03:30:11.330144256Z [2024-02-24T03:30:11.329+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:30:11.330683809Z [2024-02-24T03:30:11.330+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T03:30:11.394110696Z [2024-02-24T03:30:11.393+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T03:25:00+00:00 exited with status queued for try_number 1 2024-02-24T03:30:11.394201664Z [2024-02-24T03:30:11.394+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T03:25:00+00:00 exited with status success for try_number 1 2024-02-24T03:30:11.401879607Z [2024-02-24T03:30:11.401+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7949c671-7801-4c13-90fa-edd89a3db699 2024-02-24T03:30:11.402381558Z [2024-02-24T03:30:11.402+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T03:25:00+00:00, map_index=0, run_start_date=2024-02-24 03:30:09.106482+00:00, run_end_date=2024-02-24 03:30:10.460393+00:00, run_duration=1.353911, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1058, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:30:07.510594+00:00, queued_by_job_id=2, pid=15417 2024-02-24T03:30:13.916339490Z [2024-02-24T03:30:13.915+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:30:13.916463704Z [2024-02-24T03:30:13.916+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:25:00+00:00, run_id=scheduled__2024-02-24T03:25:00+00:00, run_start_date=2024-02-24 03:30:01.003404+00:00, run_end_date=2024-02-24 03:30:13.916137+00:00, run_duration=12.912733, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:25:00+00:00, data_interval_end=2024-02-24 03:30:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T03:30:13.923355184Z [2024-02-24T03:30:13.922+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:30:00+00:00, run_after=2024-02-24T03:35:00+00:00 2024-02-24T03:30:13.950928406Z [2024-02-24T03:30:13.950+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T03:25:00+00:00 exited with status success for try_number 1 2024-02-24T03:30:13.957323410Z [2024-02-24T03:30:13.956+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T03:25:00+00:00, map_index=-1, run_start_date=2024-02-24 03:30:13.043796+00:00, run_end_date=2024-02-24 03:30:13.413444+00:00, run_duration=0.369648, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1059, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:30:11.327073+00:00, queued_by_job_id=2, pid=15430 2024-02-24T03:31:00.109283568Z [2024-02-24T03:31:00.108+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:31:00.122170034Z [2024-02-24T03:31:00.121+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:31:00+00:00, run_after=2024-02-24T03:32:00+00:00 2024-02-24T03:31:00.135043164Z [2024-02-24T03:31:00.134+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:31:00+00:00, run_after=2024-02-24T03:32:00+00:00 2024-02-24T03:31:00.218322934Z [2024-02-24T03:31:00.217+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T03:31:00.218459784Z 2024-02-24T03:31:00.218471285Z 2024-02-24T03:31:00.218477471Z 2024-02-24T03:31:00.218585180Z [2024-02-24T03:31:00.218+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:31:00.218605106Z [2024-02-24T03:31:00.218+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:31:00.218629860Z [2024-02-24T03:31:00.218+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:31:00.220595037Z [2024-02-24T03:31:00.220+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:31:00.220641147Z 2024-02-24T03:31:00.220678503Z 2024-02-24T03:31:00.220685281Z 2024-02-24T03:31:00.225145933Z [2024-02-24T03:31:00.224+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:31:00.225202822Z [2024-02-24T03:31:00.224+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:31:00.225305476Z [2024-02-24T03:31:00.225+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:31:00.225354392Z [2024-02-24T03:31:00.225+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:31:00.225557708Z [2024-02-24T03:31:00.225+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:31:00.225630787Z [2024-02-24T03:31:00.225+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:31:00.500932621Z [2024-02-24T03:31:00.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:30:00+00:00 exited with status queued for try_number 1 2024-02-24T03:31:00.500974670Z [2024-02-24T03:31:00.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:30:00+00:00 exited with status queued for try_number 1 2024-02-24T03:31:00.500981076Z [2024-02-24T03:31:00.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:30:00+00:00 exited with status queued for try_number 1 2024-02-24T03:31:00.514964422Z [2024-02-24T03:31:00.514+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9100e571-561b-463c-91fb-470687351edd 2024-02-24T03:31:00.514998351Z [2024-02-24T03:31:00.514+0000] {scheduler_job.py:635} INFO - Setting external_id for to 92d08d74-c984-45bf-8e3e-c6b16e45ef24 2024-02-24T03:31:00.515088004Z [2024-02-24T03:31:00.514+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8530a004-27fb-4c0b-89fd-b6c2ae4d2d42 2024-02-24T03:31:02.071485556Z [2024-02-24T03:31:02.071+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:31:02.071860562Z [2024-02-24T03:31:02.071+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:30:00+00:00, run_id=scheduled__2024-02-24T03:30:00+00:00, run_start_date=2024-02-24 03:31:00.152047+00:00, run_end_date=2024-02-24 03:31:02.071471+00:00, run_duration=1.919424, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:30:00+00:00, data_interval_end=2024-02-24 03:31:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:31:02.083549283Z [2024-02-24T03:31:02.083+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:31:00+00:00, run_after=2024-02-24T03:32:00+00:00 2024-02-24T03:31:02.133440442Z [2024-02-24T03:31:02.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:30:00+00:00 exited with status success for try_number 1 2024-02-24T03:31:02.142004269Z [2024-02-24T03:31:02.141+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:30:00+00:00, map_index=-1, run_start_date=2024-02-24 03:31:01.335526+00:00, run_end_date=2024-02-24 03:31:01.868882+00:00, run_duration=0.533356, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1060, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:31:00.221179+00:00, queued_by_job_id=2, pid=15452 2024-02-24T03:31:04.288848638Z [2024-02-24T03:31:04.288+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:31:04.289421655Z [2024-02-24T03:31:04.289+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:30:00+00:00, run_id=scheduled__2024-02-24T03:30:00+00:00, run_start_date=2024-02-24 03:31:00.153518+00:00, run_end_date=2024-02-24 03:31:04.288730+00:00, run_duration=4.135212, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:30:00+00:00, data_interval_end=2024-02-24 03:31:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:31:04.304091162Z [2024-02-24T03:31:04.303+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:31:00+00:00, run_after=2024-02-24T03:32:00+00:00 2024-02-24T03:31:04.354180193Z [2024-02-24T03:31:04.353+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:30:00+00:00 exited with status success for try_number 1 2024-02-24T03:31:04.362859987Z [2024-02-24T03:31:04.362+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:30:00+00:00, map_index=-1, run_start_date=2024-02-24 03:31:02.431728+00:00, run_end_date=2024-02-24 03:31:04.208757+00:00, run_duration=1.777029, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1062, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:31:00.221179+00:00, queued_by_job_id=2, pid=15471 2024-02-24T03:31:05.404572749Z [2024-02-24T03:31:05.404+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:31:05.405120027Z [2024-02-24T03:31:05.404+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:30:00+00:00, run_id=scheduled__2024-02-24T03:30:00+00:00, run_start_date=2024-02-24 03:31:00.154698+00:00, run_end_date=2024-02-24 03:31:05.404525+00:00, run_duration=5.249827, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:30:00+00:00, data_interval_end=2024-02-24 03:31:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:31:05.417798094Z [2024-02-24T03:31:05.417+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:31:00+00:00, run_after=2024-02-24T03:32:00+00:00 2024-02-24T03:31:05.454895455Z [2024-02-24T03:31:05.454+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:30:00+00:00 exited with status success for try_number 1 2024-02-24T03:31:05.461802397Z [2024-02-24T03:31:05.461+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:30:00+00:00, map_index=-1, run_start_date=2024-02-24 03:31:02.299317+00:00, run_end_date=2024-02-24 03:31:04.921630+00:00, run_duration=2.622313, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1061, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:31:00.221179+00:00, queued_by_job_id=2, pid=15470 2024-02-24T03:32:00.380262549Z [2024-02-24T03:32:00.379+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:32:00.388111060Z [2024-02-24T03:32:00.387+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:32:00.402134537Z [2024-02-24T03:32:00.401+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:32:00+00:00, run_after=2024-02-24T03:33:00+00:00 2024-02-24T03:32:00.419825743Z [2024-02-24T03:32:00.419+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:32:00+00:00, run_after=2024-02-24T03:33:00+00:00 2024-02-24T03:32:00.505308670Z [2024-02-24T03:32:00.504+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T03:32:00.505341673Z 2024-02-24T03:32:00.505349265Z 2024-02-24T03:32:00.505355196Z 2024-02-24T03:32:00.505379473Z 2024-02-24T03:32:00.505400082Z [2024-02-24T03:32:00.505+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T03:32:00.505411636Z [2024-02-24T03:32:00.505+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:32:00.505539908Z [2024-02-24T03:32:00.505+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:32:00.505580780Z [2024-02-24T03:32:00.505+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:32:00.506952915Z [2024-02-24T03:32:00.506+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:32:00.506971740Z 2024-02-24T03:32:00.506978805Z 2024-02-24T03:32:00.506985090Z 2024-02-24T03:32:00.506990876Z 2024-02-24T03:32:00.513855190Z [2024-02-24T03:32:00.512+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:32:00.513892863Z [2024-02-24T03:32:00.513+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T03:32:00.514127808Z [2024-02-24T03:32:00.513+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:32:00.514235303Z [2024-02-24T03:32:00.514+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:32:00.514413703Z [2024-02-24T03:32:00.514+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:32:00.514433675Z [2024-02-24T03:32:00.514+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:32:00.514650246Z [2024-02-24T03:32:00.514+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:32:00.514703758Z [2024-02-24T03:32:00.514+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:32:00.810531262Z [2024-02-24T03:32:00.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:30:00+00:00 exited with status queued for try_number 1 2024-02-24T03:32:00.810604370Z [2024-02-24T03:32:00.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:31:00+00:00 exited with status queued for try_number 1 2024-02-24T03:32:00.810609441Z [2024-02-24T03:32:00.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:31:00+00:00 exited with status queued for try_number 1 2024-02-24T03:32:00.810680417Z [2024-02-24T03:32:00.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:31:00+00:00 exited with status queued for try_number 1 2024-02-24T03:32:00.820907209Z [2024-02-24T03:32:00.820+0000] {scheduler_job.py:635} INFO - Setting external_id for to 85f11f66-563f-4400-999d-c38b6529268d 2024-02-24T03:32:00.820996319Z [2024-02-24T03:32:00.820+0000] {scheduler_job.py:635} INFO - Setting external_id for to 016dd26a-05bb-422e-a1b6-3bf495897ca5 2024-02-24T03:32:00.821146667Z [2024-02-24T03:32:00.820+0000] {scheduler_job.py:635} INFO - Setting external_id for to e1522587-6d14-4f9f-be0b-00f45b2f30f1 2024-02-24T03:32:00.821251103Z [2024-02-24T03:32:00.821+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa9de7a3-6a68-48f3-b03d-aa836753478d 2024-02-24T03:32:02.921872493Z [2024-02-24T03:32:02.921+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:32:02.923242704Z [2024-02-24T03:32:02.921+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 03:30:00+00:00, run_id=scheduled__2024-02-24T03:30:00+00:00, run_start_date=2024-02-24 03:32:00.433355+00:00, run_end_date=2024-02-24 03:32:02.921695+00:00, run_duration=2.48834, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:30:00+00:00, data_interval_end=2024-02-24 03:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T03:32:02.933538120Z [2024-02-24T03:32:02.932+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T03:32:00+00:00, run_after=2024-02-24T03:34:00+00:00 2024-02-24T03:32:02.942256760Z [2024-02-24T03:32:02.941+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:32:02.942682299Z [2024-02-24T03:32:02.942+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:31:00+00:00, run_id=scheduled__2024-02-24T03:31:00+00:00, run_start_date=2024-02-24 03:32:00.434671+00:00, run_end_date=2024-02-24 03:32:02.942187+00:00, run_duration=2.507516, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:31:00+00:00, data_interval_end=2024-02-24 03:32:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:32:02.958626051Z [2024-02-24T03:32:02.958+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:32:00+00:00, run_after=2024-02-24T03:33:00+00:00 2024-02-24T03:32:03.010548539Z [2024-02-24T03:32:03.010+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:30:00+00:00 exited with status success for try_number 1 2024-02-24T03:32:03.010615318Z [2024-02-24T03:32:03.010+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:31:00+00:00 exited with status success for try_number 1 2024-02-24T03:32:03.019637658Z [2024-02-24T03:32:03.019+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:31:00+00:00, map_index=-1, run_start_date=2024-02-24 03:32:01.357864+00:00, run_end_date=2024-02-24 03:32:01.845822+00:00, run_duration=0.487958, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1063, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:32:00.508592+00:00, queued_by_job_id=2, pid=15504 2024-02-24T03:32:03.019747473Z [2024-02-24T03:32:03.019+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T03:30:00+00:00, map_index=-1, run_start_date=2024-02-24 03:32:01.479161+00:00, run_end_date=2024-02-24 03:32:01.985361+00:00, run_duration=0.5062, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1064, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:32:00.508592+00:00, queued_by_job_id=2, pid=15505 2024-02-24T03:32:05.164099341Z [2024-02-24T03:32:05.163+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:32:05.164679124Z [2024-02-24T03:32:05.164+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:31:00+00:00, run_id=scheduled__2024-02-24T03:31:00+00:00, run_start_date=2024-02-24 03:32:00.436944+00:00, run_end_date=2024-02-24 03:32:05.163997+00:00, run_duration=4.727053, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:31:00+00:00, data_interval_end=2024-02-24 03:32:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:32:05.179286701Z [2024-02-24T03:32:05.178+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:32:00+00:00, run_after=2024-02-24T03:33:00+00:00 2024-02-24T03:32:05.189755842Z [2024-02-24T03:32:05.189+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:32:05.190307717Z [2024-02-24T03:32:05.190+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:31:00+00:00, run_id=scheduled__2024-02-24T03:31:00+00:00, run_start_date=2024-02-24 03:32:00.435792+00:00, run_end_date=2024-02-24 03:32:05.189661+00:00, run_duration=4.753869, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:31:00+00:00, data_interval_end=2024-02-24 03:32:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:32:05.207230344Z [2024-02-24T03:32:05.205+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:32:00+00:00, run_after=2024-02-24T03:33:00+00:00 2024-02-24T03:32:05.242564038Z [2024-02-24T03:32:05.242+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:31:00+00:00 exited with status success for try_number 1 2024-02-24T03:32:05.243001037Z [2024-02-24T03:32:05.242+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:31:00+00:00 exited with status success for try_number 1 2024-02-24T03:32:05.252010006Z [2024-02-24T03:32:05.251+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:31:00+00:00, map_index=-1, run_start_date=2024-02-24 03:32:03.273728+00:00, run_end_date=2024-02-24 03:32:04.738175+00:00, run_duration=1.464447, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1066, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:32:00.508592+00:00, queued_by_job_id=2, pid=15529 2024-02-24T03:32:05.252514076Z [2024-02-24T03:32:05.252+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:31:00+00:00, map_index=-1, run_start_date=2024-02-24 03:32:03.041308+00:00, run_end_date=2024-02-24 03:32:04.899573+00:00, run_duration=1.858265, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1065, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:32:00.508592+00:00, queued_by_job_id=2, pid=15523 2024-02-24T03:32:05.503088091Z [2024-02-24T03:32:05.502+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T03:33:00.622197999Z [2024-02-24T03:33:00.621+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:33:00+00:00, run_after=2024-02-24T03:34:00+00:00 2024-02-24T03:33:00.641090124Z [2024-02-24T03:33:00.640+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:33:00+00:00, run_after=2024-02-24T03:34:00+00:00 2024-02-24T03:33:00.651124047Z [2024-02-24T03:33:00.650+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:33:00.755508466Z [2024-02-24T03:33:00.755+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T03:33:00.755537299Z 2024-02-24T03:33:00.755540912Z 2024-02-24T03:33:00.755558859Z 2024-02-24T03:33:00.755845919Z [2024-02-24T03:33:00.755+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:33:00.756069788Z [2024-02-24T03:33:00.755+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:33:00.756257644Z [2024-02-24T03:33:00.756+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:33:00.757038605Z [2024-02-24T03:33:00.756+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:33:00.757063846Z 2024-02-24T03:33:00.757067554Z 2024-02-24T03:33:00.757070793Z 2024-02-24T03:33:00.760251898Z [2024-02-24T03:33:00.760+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:33:00.760511558Z [2024-02-24T03:33:00.760+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:33:00.760912329Z [2024-02-24T03:33:00.760+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:33:00.761129905Z [2024-02-24T03:33:00.760+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:33:00.761439021Z [2024-02-24T03:33:00.761+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:33:00.761639449Z [2024-02-24T03:33:00.761+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:33:00.983608561Z [2024-02-24T03:33:00.983+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:32:00+00:00 exited with status queued for try_number 1 2024-02-24T03:33:00.983681132Z [2024-02-24T03:33:00.983+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:32:00+00:00 exited with status queued for try_number 1 2024-02-24T03:33:00.983819204Z [2024-02-24T03:33:00.983+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:32:00+00:00 exited with status queued for try_number 1 2024-02-24T03:33:00.990926630Z [2024-02-24T03:33:00.990+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0780ed71-a986-442d-bed8-35197d4f882f 2024-02-24T03:33:00.991030603Z [2024-02-24T03:33:00.990+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ecda74f-e7c1-4186-8975-a90a70143821 2024-02-24T03:33:00.991216534Z [2024-02-24T03:33:00.991+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c63047b-753b-427e-bb8e-c9f98509124d 2024-02-24T03:33:02.517250983Z [2024-02-24T03:33:02.515+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:33:02.517851612Z [2024-02-24T03:33:02.517+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:32:00+00:00, run_id=scheduled__2024-02-24T03:32:00+00:00, run_start_date=2024-02-24 03:33:00.674986+00:00, run_end_date=2024-02-24 03:33:02.517195+00:00, run_duration=1.842209, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:32:00+00:00, data_interval_end=2024-02-24 03:33:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:33:02.538974413Z [2024-02-24T03:33:02.538+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:33:00+00:00, run_after=2024-02-24T03:34:00+00:00 2024-02-24T03:33:02.624256121Z [2024-02-24T03:33:02.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:32:00+00:00 exited with status success for try_number 1 2024-02-24T03:33:02.636799423Z [2024-02-24T03:33:02.635+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:32:00+00:00, map_index=-1, run_start_date=2024-02-24 03:33:01.678564+00:00, run_end_date=2024-02-24 03:33:02.201963+00:00, run_duration=0.523399, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1067, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:33:00.757967+00:00, queued_by_job_id=2, pid=15561 2024-02-24T03:33:04.821476246Z [2024-02-24T03:33:04.820+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:33:04.822191458Z [2024-02-24T03:33:04.821+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:32:00+00:00, run_id=scheduled__2024-02-24T03:32:00+00:00, run_start_date=2024-02-24 03:33:00.678921+00:00, run_end_date=2024-02-24 03:33:04.821715+00:00, run_duration=4.142794, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:32:00+00:00, data_interval_end=2024-02-24 03:33:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:33:04.843357866Z [2024-02-24T03:33:04.842+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:33:00+00:00, run_after=2024-02-24T03:34:00+00:00 2024-02-24T03:33:04.854303629Z [2024-02-24T03:33:04.853+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:33:04.854820636Z [2024-02-24T03:33:04.854+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:32:00+00:00, run_id=scheduled__2024-02-24T03:32:00+00:00, run_start_date=2024-02-24 03:33:00.677046+00:00, run_end_date=2024-02-24 03:33:04.854158+00:00, run_duration=4.177112, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:32:00+00:00, data_interval_end=2024-02-24 03:33:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:33:04.866697509Z [2024-02-24T03:33:04.866+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:33:00+00:00, run_after=2024-02-24T03:34:00+00:00 2024-02-24T03:33:04.909880499Z [2024-02-24T03:33:04.909+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:32:00+00:00 exited with status success for try_number 1 2024-02-24T03:33:04.909978173Z [2024-02-24T03:33:04.909+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:32:00+00:00 exited with status success for try_number 1 2024-02-24T03:33:04.919854852Z [2024-02-24T03:33:04.919+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:32:00+00:00, map_index=-1, run_start_date=2024-02-24 03:33:02.968277+00:00, run_end_date=2024-02-24 03:33:04.230544+00:00, run_duration=1.262267, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1069, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:33:00.757967+00:00, queued_by_job_id=2, pid=15580 2024-02-24T03:33:04.920077666Z [2024-02-24T03:33:04.919+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:32:00+00:00, map_index=-1, run_start_date=2024-02-24 03:33:02.685085+00:00, run_end_date=2024-02-24 03:33:04.494081+00:00, run_duration=1.808996, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1068, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:33:00.757967+00:00, queued_by_job_id=2, pid=15574 2024-02-24T03:34:00.548310221Z [2024-02-24T03:34:00.547+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:34:00+00:00, run_after=2024-02-24T03:35:00+00:00 2024-02-24T03:34:00.556311469Z [2024-02-24T03:34:00.555+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:34:00.570315922Z [2024-02-24T03:34:00.570+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:34:00+00:00, run_after=2024-02-24T03:35:00+00:00 2024-02-24T03:34:00.582094637Z [2024-02-24T03:34:00.581+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:34:00.676745906Z [2024-02-24T03:34:00.676+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T03:34:00.676791760Z 2024-02-24T03:34:00.676802304Z 2024-02-24T03:34:00.676811161Z 2024-02-24T03:34:00.676819662Z 2024-02-24T03:34:00.676930111Z [2024-02-24T03:34:00.676+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T03:34:00.677099710Z [2024-02-24T03:34:00.676+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:34:00.677252680Z [2024-02-24T03:34:00.677+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:34:00.677393124Z [2024-02-24T03:34:00.677+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:34:00.678149960Z [2024-02-24T03:34:00.677+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:34:00.678163813Z 2024-02-24T03:34:00.678167493Z 2024-02-24T03:34:00.678170624Z 2024-02-24T03:34:00.678173780Z 2024-02-24T03:34:00.683489865Z [2024-02-24T03:34:00.683+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T03:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:34:00.683665083Z [2024-02-24T03:34:00.683+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T03:34:00.683933826Z [2024-02-24T03:34:00.683+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:34:00.684141811Z [2024-02-24T03:34:00.683+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:34:00.684487802Z [2024-02-24T03:34:00.684+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:34:00.684668449Z [2024-02-24T03:34:00.684+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:34:00.684924499Z [2024-02-24T03:34:00.684+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:34:00.685129051Z [2024-02-24T03:34:00.684+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:34:01.238786146Z [2024-02-24T03:34:01.237+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:32:00+00:00 exited with status queued for try_number 1 2024-02-24T03:34:01.238811927Z [2024-02-24T03:34:01.237+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:33:00+00:00 exited with status queued for try_number 1 2024-02-24T03:34:01.242068157Z [2024-02-24T03:34:01.237+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:33:00+00:00 exited with status queued for try_number 1 2024-02-24T03:34:01.242096252Z [2024-02-24T03:34:01.240+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:33:00+00:00 exited with status queued for try_number 1 2024-02-24T03:34:01.269905149Z [2024-02-24T03:34:01.269+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a7d8177-a107-4e95-aacf-e203b4bbbfe6 2024-02-24T03:34:01.272672284Z [2024-02-24T03:34:01.270+0000] {scheduler_job.py:635} INFO - Setting external_id for to 369223cc-0e7b-45ad-8055-ab5ec45de018 2024-02-24T03:34:01.272694006Z [2024-02-24T03:34:01.270+0000] {scheduler_job.py:635} INFO - Setting external_id for to 18159417-d6e1-4241-a3db-5e740b135e83 2024-02-24T03:34:01.272697762Z [2024-02-24T03:34:01.270+0000] {scheduler_job.py:635} INFO - Setting external_id for to b0ae5865-4f82-4669-848f-1236f3414f4a 2024-02-24T03:34:02.623267888Z [2024-02-24T03:34:02.622+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:34:02.623725896Z [2024-02-24T03:34:02.623+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 03:32:00+00:00, run_id=scheduled__2024-02-24T03:32:00+00:00, run_start_date=2024-02-24 03:34:00.598957+00:00, run_end_date=2024-02-24 03:34:02.623168+00:00, run_duration=2.024211, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:32:00+00:00, data_interval_end=2024-02-24 03:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T03:34:02.642695481Z [2024-02-24T03:34:02.642+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T03:34:00+00:00, run_after=2024-02-24T03:36:00+00:00 2024-02-24T03:34:02.665544495Z [2024-02-24T03:34:02.665+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:34:02.665729908Z [2024-02-24T03:34:02.665+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:33:00+00:00, run_id=scheduled__2024-02-24T03:33:00+00:00, run_start_date=2024-02-24 03:34:00.601036+00:00, run_end_date=2024-02-24 03:34:02.665453+00:00, run_duration=2.064417, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:33:00+00:00, data_interval_end=2024-02-24 03:34:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:34:02.693579864Z [2024-02-24T03:34:02.693+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:34:00+00:00, run_after=2024-02-24T03:35:00+00:00 2024-02-24T03:34:02.831110361Z [2024-02-24T03:34:02.830+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:32:00+00:00 exited with status success for try_number 1 2024-02-24T03:34:02.856770886Z [2024-02-24T03:34:02.856+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T03:32:00+00:00, map_index=-1, run_start_date=2024-02-24 03:34:01.987004+00:00, run_end_date=2024-02-24 03:34:02.524550+00:00, run_duration=0.537546, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1071, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:34:00.679305+00:00, queued_by_job_id=2, pid=15613 2024-02-24T03:34:03.652280257Z [2024-02-24T03:34:03.651+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:33:00+00:00 exited with status success for try_number 1 2024-02-24T03:34:03.668876241Z [2024-02-24T03:34:03.666+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:33:00+00:00, map_index=-1, run_start_date=2024-02-24 03:34:02.010305+00:00, run_end_date=2024-02-24 03:34:02.505589+00:00, run_duration=0.495284, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1070, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:34:00.679305+00:00, queued_by_job_id=2, pid=15615 2024-02-24T03:34:05.811929129Z [2024-02-24T03:34:05.811+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:34:05.813951642Z [2024-02-24T03:34:05.811+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:33:00+00:00, run_id=scheduled__2024-02-24T03:33:00+00:00, run_start_date=2024-02-24 03:34:00.602557+00:00, run_end_date=2024-02-24 03:34:05.811824+00:00, run_duration=5.209267, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:33:00+00:00, data_interval_end=2024-02-24 03:34:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:34:05.827160455Z [2024-02-24T03:34:05.826+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:34:00+00:00, run_after=2024-02-24T03:35:00+00:00 2024-02-24T03:34:05.837504373Z [2024-02-24T03:34:05.837+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:34:05.838234325Z [2024-02-24T03:34:05.837+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:33:00+00:00, run_id=scheduled__2024-02-24T03:33:00+00:00, run_start_date=2024-02-24 03:34:00.603908+00:00, run_end_date=2024-02-24 03:34:05.837711+00:00, run_duration=5.233803, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:33:00+00:00, data_interval_end=2024-02-24 03:34:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:34:05.851220144Z [2024-02-24T03:34:05.850+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:34:00+00:00, run_after=2024-02-24T03:35:00+00:00 2024-02-24T03:34:05.892869667Z [2024-02-24T03:34:05.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:33:00+00:00 exited with status success for try_number 1 2024-02-24T03:34:05.893222256Z [2024-02-24T03:34:05.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:33:00+00:00 exited with status success for try_number 1 2024-02-24T03:34:05.903086566Z [2024-02-24T03:34:05.902+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:33:00+00:00, map_index=-1, run_start_date=2024-02-24 03:34:03.262577+00:00, run_end_date=2024-02-24 03:34:04.867898+00:00, run_duration=1.605321, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1072, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:34:00.679305+00:00, queued_by_job_id=2, pid=15632 2024-02-24T03:34:05.903624917Z [2024-02-24T03:34:05.903+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:33:00+00:00, map_index=-1, run_start_date=2024-02-24 03:34:03.730452+00:00, run_end_date=2024-02-24 03:34:05.665527+00:00, run_duration=1.935075, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1073, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:34:00.679305+00:00, queued_by_job_id=2, pid=15643 2024-02-24T03:35:00.662818340Z [2024-02-24T03:35:00.662+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:35:00+00:00, run_after=2024-02-24T03:36:00+00:00 2024-02-24T03:35:00.678506545Z [2024-02-24T03:35:00.678+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:35:00.693786354Z [2024-02-24T03:35:00.693+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:35:00+00:00, run_after=2024-02-24T03:40:00+00:00 2024-02-24T03:35:00.707542357Z [2024-02-24T03:35:00.707+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:35:00+00:00, run_after=2024-02-24T03:36:00+00:00 2024-02-24T03:35:00.822225806Z [2024-02-24T03:35:00.821+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T03:35:00.822259211Z 2024-02-24T03:35:00.822265397Z 2024-02-24T03:35:00.822269984Z 2024-02-24T03:35:00.822274679Z 2024-02-24T03:35:00.822406068Z [2024-02-24T03:35:00.822+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:35:00.822604345Z [2024-02-24T03:35:00.822+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:35:00.822793382Z [2024-02-24T03:35:00.822+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:35:00.822902255Z [2024-02-24T03:35:00.822+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:35:00.823995839Z [2024-02-24T03:35:00.823+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:35:00.824023025Z 2024-02-24T03:35:00.824036622Z 2024-02-24T03:35:00.824047822Z 2024-02-24T03:35:00.824058861Z 2024-02-24T03:35:00.833036127Z [2024-02-24T03:35:00.832+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T03:35:00.833211474Z [2024-02-24T03:35:00.832+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T03:35:00.833546998Z [2024-02-24T03:35:00.833+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:35:00.833726599Z [2024-02-24T03:35:00.833+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:35:00.834152798Z [2024-02-24T03:35:00.833+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:35:00.834275201Z [2024-02-24T03:35:00.834+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:35:00.834471793Z [2024-02-24T03:35:00.834+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:35:00.834547329Z [2024-02-24T03:35:00.834+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:35:01.134649983Z [2024-02-24T03:35:01.133+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T03:30:00+00:00 exited with status queued for try_number 1 2024-02-24T03:35:01.135053158Z [2024-02-24T03:35:01.134+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:34:00+00:00 exited with status queued for try_number 1 2024-02-24T03:35:01.135380831Z [2024-02-24T03:35:01.135+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:34:00+00:00 exited with status queued for try_number 1 2024-02-24T03:35:01.135544005Z [2024-02-24T03:35:01.135+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:34:00+00:00 exited with status queued for try_number 1 2024-02-24T03:35:01.144274574Z [2024-02-24T03:35:01.143+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c6fe0c9-1990-49cb-980a-4b35721d05f5 2024-02-24T03:35:01.144586364Z [2024-02-24T03:35:01.144+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff4f8b69-2e64-447a-b8fa-706e7e8c8d2d 2024-02-24T03:35:01.144829759Z [2024-02-24T03:35:01.144+0000] {scheduler_job.py:635} INFO - Setting external_id for to bea9d75f-9577-46ec-b321-cb867a6fcc9d 2024-02-24T03:35:01.145042787Z [2024-02-24T03:35:01.144+0000] {scheduler_job.py:635} INFO - Setting external_id for to fdcadf0f-79a3-4040-9aa2-288cab120ced 2024-02-24T03:35:03.544281912Z [2024-02-24T03:35:03.543+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:35:03.544922313Z [2024-02-24T03:35:03.544+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:34:00+00:00, run_id=scheduled__2024-02-24T03:34:00+00:00, run_start_date=2024-02-24 03:35:00.720899+00:00, run_end_date=2024-02-24 03:35:03.544508+00:00, run_duration=2.823609, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:34:00+00:00, data_interval_end=2024-02-24 03:35:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:35:03.558413957Z [2024-02-24T03:35:03.558+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:35:00+00:00, run_after=2024-02-24T03:36:00+00:00 2024-02-24T03:35:03.640235808Z [2024-02-24T03:35:03.639+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:35:03.640271290Z 2024-02-24T03:35:03.640438132Z [2024-02-24T03:35:03.640+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:35:03.641089805Z [2024-02-24T03:35:03.640+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:35:03.641100815Z 2024-02-24T03:35:03.647129967Z [2024-02-24T03:35:03.646+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T03:35:03.649076165Z [2024-02-24T03:35:03.648+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T03:35:03.753416458Z [2024-02-24T03:35:03.753+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T03:30:00+00:00 exited with status queued for try_number 1 2024-02-24T03:35:03.753465839Z [2024-02-24T03:35:03.753+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T03:30:00+00:00 exited with status success for try_number 1 2024-02-24T03:35:03.753740878Z [2024-02-24T03:35:03.753+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:34:00+00:00 exited with status success for try_number 1 2024-02-24T03:35:03.769540573Z [2024-02-24T03:35:03.769+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T03:30:00+00:00, map_index=-1, run_start_date=2024-02-24 03:35:03.089061+00:00, run_end_date=2024-02-24 03:35:03.476099+00:00, run_duration=0.387038, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1075, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:35:00.825532+00:00, queued_by_job_id=2, pid=15692 2024-02-24T03:35:03.769878941Z [2024-02-24T03:35:03.769+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9b1333be-341f-4676-8f80-26c4242c30bd 2024-02-24T03:35:03.770179262Z [2024-02-24T03:35:03.770+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:34:00+00:00, map_index=-1, run_start_date=2024-02-24 03:35:01.820506+00:00, run_end_date=2024-02-24 03:35:02.443650+00:00, run_duration=0.623144, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1074, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:35:00.825532+00:00, queued_by_job_id=2, pid=15671 2024-02-24T03:35:05.837749245Z [2024-02-24T03:35:05.833+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:35:05.837798573Z [2024-02-24T03:35:05.834+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:34:00+00:00, run_id=scheduled__2024-02-24T03:34:00+00:00, run_start_date=2024-02-24 03:35:00.722103+00:00, run_end_date=2024-02-24 03:35:05.834039+00:00, run_duration=5.111936, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:34:00+00:00, data_interval_end=2024-02-24 03:35:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:35:05.845171253Z [2024-02-24T03:35:05.844+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:35:00+00:00, run_after=2024-02-24T03:36:00+00:00 2024-02-24T03:35:05.857065316Z [2024-02-24T03:35:05.856+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:35:05.857422296Z [2024-02-24T03:35:05.857+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:34:00+00:00, run_id=scheduled__2024-02-24T03:34:00+00:00, run_start_date=2024-02-24 03:35:00.726266+00:00, run_end_date=2024-02-24 03:35:05.856960+00:00, run_duration=5.130694, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:34:00+00:00, data_interval_end=2024-02-24 03:35:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:35:05.867250750Z [2024-02-24T03:35:05.866+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:35:00+00:00, run_after=2024-02-24T03:36:00+00:00 2024-02-24T03:35:05.923938265Z [2024-02-24T03:35:05.923+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:35:05.923969872Z 2024-02-24T03:35:05.923981810Z [2024-02-24T03:35:05.923+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:35:05.924500434Z [2024-02-24T03:35:05.924+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:35:05.924515036Z 2024-02-24T03:35:05.927193020Z [2024-02-24T03:35:05.926+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T03:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T03:35:05.927319437Z [2024-02-24T03:35:05.927+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T03:35:05.979547480Z [2024-02-24T03:35:05.977+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T03:30:00+00:00 exited with status queued for try_number 1 2024-02-24T03:35:05.979591080Z [2024-02-24T03:35:05.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:34:00+00:00 exited with status success for try_number 1 2024-02-24T03:35:05.979598258Z [2024-02-24T03:35:05.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:34:00+00:00 exited with status success for try_number 1 2024-02-24T03:35:05.991488691Z [2024-02-24T03:35:05.989+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:34:00+00:00, map_index=-1, run_start_date=2024-02-24 03:35:03.261061+00:00, run_end_date=2024-02-24 03:35:05.067315+00:00, run_duration=1.806254, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1076, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:35:00.825532+00:00, queued_by_job_id=2, pid=15696 2024-02-24T03:35:05.991541963Z [2024-02-24T03:35:05.989+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:34:00+00:00, map_index=-1, run_start_date=2024-02-24 03:35:03.377378+00:00, run_end_date=2024-02-24 03:35:05.192704+00:00, run_duration=1.815326, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1077, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:35:00.825532+00:00, queued_by_job_id=2, pid=15702 2024-02-24T03:35:05.991550893Z [2024-02-24T03:35:05.989+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6cc042a9-23bb-49dd-8c96-a5cf7c3038fa 2024-02-24T03:35:06.088305380Z [2024-02-24T03:35:06.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T03:30:00+00:00 exited with status success for try_number 1 2024-02-24T03:35:06.097487098Z [2024-02-24T03:35:06.096+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T03:30:00+00:00, map_index=-1, run_start_date=2024-02-24 03:35:05.378520+00:00, run_end_date=2024-02-24 03:35:05.727718+00:00, run_duration=0.349198, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1078, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:35:03.644454+00:00, queued_by_job_id=2, pid=15720 2024-02-24T03:35:09.384551736Z [2024-02-24T03:35:09.384+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:35:09.384603342Z 2024-02-24T03:35:09.384612470Z [2024-02-24T03:35:09.384+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:35:09.385088585Z [2024-02-24T03:35:09.384+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:35:09.385112144Z 2024-02-24T03:35:09.388141065Z [2024-02-24T03:35:09.387+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:35:09.388199537Z [2024-02-24T03:35:09.388+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T03:35:09.468353160Z [2024-02-24T03:35:09.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T03:30:00+00:00 exited with status queued for try_number 1 2024-02-24T03:35:09.468477413Z [2024-02-24T03:35:09.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T03:30:00+00:00 exited with status success for try_number 1 2024-02-24T03:35:09.475964935Z [2024-02-24T03:35:09.475+0000] {scheduler_job.py:635} INFO - Setting external_id for to e77fb49a-bf37-4efe-a846-34d73862f0c2 2024-02-24T03:35:09.476254971Z [2024-02-24T03:35:09.476+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T03:30:00+00:00, map_index=0, run_start_date=2024-02-24 03:35:07.568014+00:00, run_end_date=2024-02-24 03:35:09.028312+00:00, run_duration=1.460298, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1079, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:35:05.924846+00:00, queued_by_job_id=2, pid=15728 2024-02-24T03:35:12.013548656Z [2024-02-24T03:35:12.013+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:35:12.013831510Z [2024-02-24T03:35:12.013+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:30:00+00:00, run_id=scheduled__2024-02-24T03:30:00+00:00, run_start_date=2024-02-24 03:35:00.719540+00:00, run_end_date=2024-02-24 03:35:12.013409+00:00, run_duration=11.293869, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:30:00+00:00, data_interval_end=2024-02-24 03:35:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T03:35:12.022694696Z [2024-02-24T03:35:12.022+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:35:00+00:00, run_after=2024-02-24T03:40:00+00:00 2024-02-24T03:35:12.073318274Z [2024-02-24T03:35:12.072+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T03:30:00+00:00 exited with status success for try_number 1 2024-02-24T03:35:12.080692472Z [2024-02-24T03:35:12.080+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T03:30:00+00:00, map_index=-1, run_start_date=2024-02-24 03:35:10.999348+00:00, run_end_date=2024-02-24 03:35:11.416122+00:00, run_duration=0.416774, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1080, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:35:09.385339+00:00, queued_by_job_id=2, pid=15741 2024-02-24T03:36:00.426799955Z [2024-02-24T03:36:00.426+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:36:00.459352596Z [2024-02-24T03:36:00.458+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:36:00+00:00, run_after=2024-02-24T03:37:00+00:00 2024-02-24T03:36:00.488684127Z [2024-02-24T03:36:00.487+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:36:00+00:00, run_after=2024-02-24T03:37:00+00:00 2024-02-24T03:36:00.503789829Z [2024-02-24T03:36:00.503+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:36:00.617160199Z [2024-02-24T03:36:00.616+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T03:36:00.617191373Z 2024-02-24T03:36:00.617197000Z 2024-02-24T03:36:00.617201553Z 2024-02-24T03:36:00.617205900Z 2024-02-24T03:36:00.617367391Z [2024-02-24T03:36:00.617+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T03:36:00.617698423Z [2024-02-24T03:36:00.617+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:36:00.617849727Z [2024-02-24T03:36:00.617+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:36:00.618126967Z [2024-02-24T03:36:00.617+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:36:00.619097624Z [2024-02-24T03:36:00.618+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:36:00.619115719Z 2024-02-24T03:36:00.619122407Z 2024-02-24T03:36:00.619128641Z 2024-02-24T03:36:00.619134191Z 2024-02-24T03:36:00.625017785Z [2024-02-24T03:36:00.624+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T03:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:36:00.625371818Z [2024-02-24T03:36:00.625+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T03:36:00.625882566Z [2024-02-24T03:36:00.625+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:36:00.626208016Z [2024-02-24T03:36:00.625+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:36:00.626678524Z [2024-02-24T03:36:00.626+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:36:00.626967296Z [2024-02-24T03:36:00.626+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:36:00.627413352Z [2024-02-24T03:36:00.627+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:36:00.627724132Z [2024-02-24T03:36:00.627+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:36:00.950265013Z [2024-02-24T03:36:00.949+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:34:00+00:00 exited with status queued for try_number 1 2024-02-24T03:36:00.953407330Z [2024-02-24T03:36:00.950+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:35:00+00:00 exited with status queued for try_number 1 2024-02-24T03:36:00.953661987Z [2024-02-24T03:36:00.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:35:00+00:00 exited with status queued for try_number 1 2024-02-24T03:36:00.953963316Z [2024-02-24T03:36:00.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:35:00+00:00 exited with status queued for try_number 1 2024-02-24T03:36:00.974522999Z [2024-02-24T03:36:00.974+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab6f8d75-da70-45a2-b3cf-3787db134e41 2024-02-24T03:36:00.974607300Z [2024-02-24T03:36:00.974+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05c091aa-5629-4c2b-a34e-d20925c3ba15 2024-02-24T03:36:00.975086864Z [2024-02-24T03:36:00.974+0000] {scheduler_job.py:635} INFO - Setting external_id for to d1f0986a-6df1-4868-bda5-0d619281057c 2024-02-24T03:36:00.980110928Z [2024-02-24T03:36:00.975+0000] {scheduler_job.py:635} INFO - Setting external_id for to b17b6156-f8fc-4c30-8212-d321492d0ede 2024-02-24T03:36:02.176680252Z [2024-02-24T03:36:02.176+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:36:02.178265396Z [2024-02-24T03:36:02.176+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 03:34:00+00:00, run_id=scheduled__2024-02-24T03:34:00+00:00, run_start_date=2024-02-24 03:36:00.525837+00:00, run_end_date=2024-02-24 03:36:02.176589+00:00, run_duration=1.650752, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:34:00+00:00, data_interval_end=2024-02-24 03:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T03:36:02.194991451Z [2024-02-24T03:36:02.194+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T03:36:00+00:00, run_after=2024-02-24T03:38:00+00:00 2024-02-24T03:36:02.267081309Z [2024-02-24T03:36:02.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:34:00+00:00 exited with status success for try_number 1 2024-02-24T03:36:02.274311624Z [2024-02-24T03:36:02.273+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T03:34:00+00:00, map_index=-1, run_start_date=2024-02-24 03:36:01.644122+00:00, run_end_date=2024-02-24 03:36:02.045846+00:00, run_duration=0.401724, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1081, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:36:00.620516+00:00, queued_by_job_id=2, pid=15764 2024-02-24T03:36:03.329952485Z [2024-02-24T03:36:03.329+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:36:03.330746393Z [2024-02-24T03:36:03.330+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:35:00+00:00, run_id=scheduled__2024-02-24T03:35:00+00:00, run_start_date=2024-02-24 03:36:00.527737+00:00, run_end_date=2024-02-24 03:36:03.329869+00:00, run_duration=2.802132, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:35:00+00:00, data_interval_end=2024-02-24 03:36:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:36:03.349163372Z [2024-02-24T03:36:03.348+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:36:00+00:00, run_after=2024-02-24T03:37:00+00:00 2024-02-24T03:36:03.405817558Z [2024-02-24T03:36:03.405+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:35:00+00:00 exited with status success for try_number 1 2024-02-24T03:36:03.411464622Z [2024-02-24T03:36:03.411+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:35:00+00:00, map_index=-1, run_start_date=2024-02-24 03:36:01.728854+00:00, run_end_date=2024-02-24 03:36:02.207745+00:00, run_duration=0.478891, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1082, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:36:00.620516+00:00, queued_by_job_id=2, pid=15765 2024-02-24T03:36:05.540069674Z [2024-02-24T03:36:05.539+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:36:05.540472777Z [2024-02-24T03:36:05.540+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:35:00+00:00, run_id=scheduled__2024-02-24T03:35:00+00:00, run_start_date=2024-02-24 03:36:00.529534+00:00, run_end_date=2024-02-24 03:36:05.539949+00:00, run_duration=5.010415, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:35:00+00:00, data_interval_end=2024-02-24 03:36:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:36:05.550980061Z [2024-02-24T03:36:05.550+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:36:00+00:00, run_after=2024-02-24T03:37:00+00:00 2024-02-24T03:36:05.595592596Z [2024-02-24T03:36:05.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:35:00+00:00 exited with status success for try_number 1 2024-02-24T03:36:05.602659544Z [2024-02-24T03:36:05.602+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:35:00+00:00, map_index=-1, run_start_date=2024-02-24 03:36:03.001631+00:00, run_end_date=2024-02-24 03:36:04.862177+00:00, run_duration=1.860546, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1084, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:36:00.620516+00:00, queued_by_job_id=2, pid=15789 2024-02-24T03:36:06.061339005Z [2024-02-24T03:36:06.060+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:36:06.061942944Z [2024-02-24T03:36:06.061+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:35:00+00:00, run_id=scheduled__2024-02-24T03:35:00+00:00, run_start_date=2024-02-24 03:36:00.531265+00:00, run_end_date=2024-02-24 03:36:06.061189+00:00, run_duration=5.529924, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:35:00+00:00, data_interval_end=2024-02-24 03:36:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:36:06.074367093Z [2024-02-24T03:36:06.073+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:36:00+00:00, run_after=2024-02-24T03:37:00+00:00 2024-02-24T03:36:06.121349281Z [2024-02-24T03:36:06.120+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:35:00+00:00 exited with status success for try_number 1 2024-02-24T03:36:06.134373219Z [2024-02-24T03:36:06.134+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:35:00+00:00, map_index=-1, run_start_date=2024-02-24 03:36:02.942558+00:00, run_end_date=2024-02-24 03:36:05.575244+00:00, run_duration=2.632686, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1083, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:36:00.620516+00:00, queued_by_job_id=2, pid=15788 2024-02-24T03:37:00.728771883Z [2024-02-24T03:37:00.728+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:37:00+00:00, run_after=2024-02-24T03:38:00+00:00 2024-02-24T03:37:00.755274236Z [2024-02-24T03:37:00.754+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:37:00+00:00, run_after=2024-02-24T03:38:00+00:00 2024-02-24T03:37:00.764247350Z [2024-02-24T03:37:00.763+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:37:00.856572636Z [2024-02-24T03:37:00.856+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T03:37:00.856600682Z 2024-02-24T03:37:00.856620476Z 2024-02-24T03:37:00.856623953Z 2024-02-24T03:37:00.856802768Z [2024-02-24T03:37:00.856+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:37:00.857064755Z [2024-02-24T03:37:00.856+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:37:00.857359065Z [2024-02-24T03:37:00.857+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:37:00.858370572Z [2024-02-24T03:37:00.858+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:37:00.858407570Z 2024-02-24T03:37:00.858418338Z 2024-02-24T03:37:00.858426360Z 2024-02-24T03:37:00.863858758Z [2024-02-24T03:37:00.863+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:37:00.864250307Z [2024-02-24T03:37:00.863+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:37:00.864889363Z [2024-02-24T03:37:00.864+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:37:00.865183663Z [2024-02-24T03:37:00.864+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:37:00.865722675Z [2024-02-24T03:37:00.865+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:37:00.866035990Z [2024-02-24T03:37:00.865+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:37:01.238820057Z [2024-02-24T03:37:01.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:36:00+00:00 exited with status queued for try_number 1 2024-02-24T03:37:01.238843977Z [2024-02-24T03:37:01.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:36:00+00:00 exited with status queued for try_number 1 2024-02-24T03:37:01.238847618Z [2024-02-24T03:37:01.237+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:36:00+00:00 exited with status queued for try_number 1 2024-02-24T03:37:01.268193769Z [2024-02-24T03:37:01.267+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a01dd09-6e9c-4ae4-8267-0333a43d999d 2024-02-24T03:37:01.269517299Z [2024-02-24T03:37:01.268+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7919cfda-89e2-4dc2-bfd7-ef70afdb67bd 2024-02-24T03:37:01.269530518Z [2024-02-24T03:37:01.268+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b6600c5-89f0-4103-9248-04c14457c0dc 2024-02-24T03:37:03.168378183Z [2024-02-24T03:37:03.167+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:37:03.168720931Z [2024-02-24T03:37:03.168+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:36:00+00:00, run_id=scheduled__2024-02-24T03:36:00+00:00, run_start_date=2024-02-24 03:37:00.779192+00:00, run_end_date=2024-02-24 03:37:03.168363+00:00, run_duration=2.389171, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:36:00+00:00, data_interval_end=2024-02-24 03:37:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:37:03.178604208Z [2024-02-24T03:37:03.178+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:37:00+00:00, run_after=2024-02-24T03:38:00+00:00 2024-02-24T03:37:03.250150447Z [2024-02-24T03:37:03.249+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:36:00+00:00 exited with status success for try_number 1 2024-02-24T03:37:03.255294815Z [2024-02-24T03:37:03.254+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:36:00+00:00, map_index=-1, run_start_date=2024-02-24 03:37:01.963783+00:00, run_end_date=2024-02-24 03:37:02.465294+00:00, run_duration=0.501511, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1085, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:37:00.859823+00:00, queued_by_job_id=2, pid=15822 2024-02-24T03:37:05.377165457Z [2024-02-24T03:37:05.376+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:37:05.377481745Z [2024-02-24T03:37:05.377+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:36:00+00:00, run_id=scheduled__2024-02-24T03:36:00+00:00, run_start_date=2024-02-24 03:37:00.780567+00:00, run_end_date=2024-02-24 03:37:05.377118+00:00, run_duration=4.596551, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:36:00+00:00, data_interval_end=2024-02-24 03:37:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:37:05.385892998Z [2024-02-24T03:37:05.385+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:37:00+00:00, run_after=2024-02-24T03:38:00+00:00 2024-02-24T03:37:05.422236858Z [2024-02-24T03:37:05.421+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:36:00+00:00 exited with status success for try_number 1 2024-02-24T03:37:05.429358141Z [2024-02-24T03:37:05.428+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:36:00+00:00, map_index=-1, run_start_date=2024-02-24 03:37:03.100260+00:00, run_end_date=2024-02-24 03:37:05.246674+00:00, run_duration=2.146414, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1087, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:37:00.859823+00:00, queued_by_job_id=2, pid=15841 2024-02-24T03:37:05.626013973Z [2024-02-24T03:37:05.625+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T03:37:06.667511893Z [2024-02-24T03:37:06.667+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:37:06.667841550Z [2024-02-24T03:37:06.667+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:36:00+00:00, run_id=scheduled__2024-02-24T03:36:00+00:00, run_start_date=2024-02-24 03:37:00.781859+00:00, run_end_date=2024-02-24 03:37:06.667299+00:00, run_duration=5.88544, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:36:00+00:00, data_interval_end=2024-02-24 03:37:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:37:06.682942781Z [2024-02-24T03:37:06.682+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:37:00+00:00, run_after=2024-02-24T03:38:00+00:00 2024-02-24T03:37:06.734017665Z [2024-02-24T03:37:06.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:36:00+00:00 exited with status success for try_number 1 2024-02-24T03:37:06.741637747Z [2024-02-24T03:37:06.741+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:36:00+00:00, map_index=-1, run_start_date=2024-02-24 03:37:03.041124+00:00, run_end_date=2024-02-24 03:37:05.651859+00:00, run_duration=2.610735, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1086, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:37:00.859823+00:00, queued_by_job_id=2, pid=15840 2024-02-24T03:38:00.986741265Z [2024-02-24T03:38:00.985+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:38:00+00:00, run_after=2024-02-24T03:39:00+00:00 2024-02-24T03:38:00.998320227Z [2024-02-24T03:38:00.997+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:38:01.012272358Z [2024-02-24T03:38:01.011+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:38:00+00:00, run_after=2024-02-24T03:39:00+00:00 2024-02-24T03:38:01.021234865Z [2024-02-24T03:38:01.020+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:38:01.102819227Z [2024-02-24T03:38:01.102+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T03:38:01.102850571Z 2024-02-24T03:38:01.102859119Z 2024-02-24T03:38:01.102863592Z 2024-02-24T03:38:01.102867773Z 2024-02-24T03:38:01.103066068Z [2024-02-24T03:38:01.102+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T03:38:01.103317228Z [2024-02-24T03:38:01.103+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:38:01.103543382Z [2024-02-24T03:38:01.103+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:38:01.103758213Z [2024-02-24T03:38:01.103+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:38:01.104672922Z [2024-02-24T03:38:01.104+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:38:01.104691076Z 2024-02-24T03:38:01.104696814Z 2024-02-24T03:38:01.104703475Z 2024-02-24T03:38:01.104732531Z 2024-02-24T03:38:01.110390011Z [2024-02-24T03:38:01.110+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T03:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:38:01.110627170Z [2024-02-24T03:38:01.110+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T03:38:01.110976456Z [2024-02-24T03:38:01.110+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:38:01.111180496Z [2024-02-24T03:38:01.110+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:38:01.111483326Z [2024-02-24T03:38:01.111+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:38:01.111658807Z [2024-02-24T03:38:01.111+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:38:01.111957361Z [2024-02-24T03:38:01.111+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:38:01.112127492Z [2024-02-24T03:38:01.111+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:38:01.798974767Z [2024-02-24T03:38:01.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:36:00+00:00 exited with status queued for try_number 1 2024-02-24T03:38:01.799063859Z [2024-02-24T03:38:01.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:37:00+00:00 exited with status queued for try_number 1 2024-02-24T03:38:01.799082237Z [2024-02-24T03:38:01.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:37:00+00:00 exited with status queued for try_number 1 2024-02-24T03:38:01.799143061Z [2024-02-24T03:38:01.799+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:37:00+00:00 exited with status queued for try_number 1 2024-02-24T03:38:01.816679710Z [2024-02-24T03:38:01.816+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99031330-8075-44c8-92e6-62cb3c57a4ee 2024-02-24T03:38:01.816787885Z [2024-02-24T03:38:01.816+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4dd5c0d1-85f6-458c-a290-68bccaaa78d5 2024-02-24T03:38:01.816794301Z [2024-02-24T03:38:01.816+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a8524fe-b5aa-4789-8116-094488714ee8 2024-02-24T03:38:01.816879558Z [2024-02-24T03:38:01.816+0000] {scheduler_job.py:635} INFO - Setting external_id for to 06535899-b890-42b0-ad12-3ee551f2b10e 2024-02-24T03:38:02.966412141Z [2024-02-24T03:38:02.965+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:38:02.966965213Z [2024-02-24T03:38:02.966+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:37:00+00:00, run_id=scheduled__2024-02-24T03:37:00+00:00, run_start_date=2024-02-24 03:38:01.035079+00:00, run_end_date=2024-02-24 03:38:02.966533+00:00, run_duration=1.931454, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:37:00+00:00, data_interval_end=2024-02-24 03:38:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:38:02.979676712Z [2024-02-24T03:38:02.979+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:38:00+00:00, run_after=2024-02-24T03:39:00+00:00 2024-02-24T03:38:02.993765934Z [2024-02-24T03:38:02.993+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:38:02.994274234Z [2024-02-24T03:38:02.994+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 03:36:00+00:00, run_id=scheduled__2024-02-24T03:36:00+00:00, run_start_date=2024-02-24 03:38:01.033871+00:00, run_end_date=2024-02-24 03:38:02.993667+00:00, run_duration=1.959796, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:36:00+00:00, data_interval_end=2024-02-24 03:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T03:38:03.006429785Z [2024-02-24T03:38:03.005+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T03:38:00+00:00, run_after=2024-02-24T03:40:00+00:00 2024-02-24T03:38:03.094804624Z [2024-02-24T03:38:03.094+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:36:00+00:00 exited with status success for try_number 1 2024-02-24T03:38:03.094910039Z [2024-02-24T03:38:03.094+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:37:00+00:00 exited with status success for try_number 1 2024-02-24T03:38:03.103973826Z [2024-02-24T03:38:03.103+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T03:36:00+00:00, map_index=-1, run_start_date=2024-02-24 03:38:02.111805+00:00, run_end_date=2024-02-24 03:38:02.471497+00:00, run_duration=0.359692, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1089, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:38:01.106030+00:00, queued_by_job_id=2, pid=15874 2024-02-24T03:38:03.104046173Z [2024-02-24T03:38:03.103+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:37:00+00:00, map_index=-1, run_start_date=2024-02-24 03:38:02.068210+00:00, run_end_date=2024-02-24 03:38:02.528886+00:00, run_duration=0.460676, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1088, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:38:01.106030+00:00, queued_by_job_id=2, pid=15873 2024-02-24T03:38:06.373022985Z [2024-02-24T03:38:06.372+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:38:06.373446046Z [2024-02-24T03:38:06.373+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:37:00+00:00, run_id=scheduled__2024-02-24T03:37:00+00:00, run_start_date=2024-02-24 03:38:01.037535+00:00, run_end_date=2024-02-24 03:38:06.373102+00:00, run_duration=5.335567, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:37:00+00:00, data_interval_end=2024-02-24 03:38:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:38:06.383001503Z [2024-02-24T03:38:06.382+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:38:00+00:00, run_after=2024-02-24T03:39:00+00:00 2024-02-24T03:38:06.391974651Z [2024-02-24T03:38:06.391+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:38:06.392301834Z [2024-02-24T03:38:06.392+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:37:00+00:00, run_id=scheduled__2024-02-24T03:37:00+00:00, run_start_date=2024-02-24 03:38:01.036233+00:00, run_end_date=2024-02-24 03:38:06.391879+00:00, run_duration=5.355646, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:37:00+00:00, data_interval_end=2024-02-24 03:38:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:38:06.403408341Z [2024-02-24T03:38:06.403+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:38:00+00:00, run_after=2024-02-24T03:39:00+00:00 2024-02-24T03:38:06.438098551Z [2024-02-24T03:38:06.437+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:37:00+00:00 exited with status success for try_number 1 2024-02-24T03:38:06.445938015Z [2024-02-24T03:38:06.443+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:37:00+00:00, map_index=-1, run_start_date=2024-02-24 03:38:03.212605+00:00, run_end_date=2024-02-24 03:38:05.514963+00:00, run_duration=2.302358, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1091, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:38:01.106030+00:00, queued_by_job_id=2, pid=15898 2024-02-24T03:38:07.508060393Z [2024-02-24T03:38:07.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:37:00+00:00 exited with status success for try_number 1 2024-02-24T03:38:07.516864339Z [2024-02-24T03:38:07.516+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:37:00+00:00, map_index=-1, run_start_date=2024-02-24 03:38:03.125986+00:00, run_end_date=2024-02-24 03:38:06.332071+00:00, run_duration=3.206085, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1090, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:38:01.106030+00:00, queued_by_job_id=2, pid=15897 2024-02-24T03:39:00.153074731Z [2024-02-24T03:39:00.152+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:39:00+00:00, run_after=2024-02-24T03:40:00+00:00 2024-02-24T03:39:00.159765022Z [2024-02-24T03:39:00.159+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:39:00.170117073Z [2024-02-24T03:39:00.169+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:39:00+00:00, run_after=2024-02-24T03:40:00+00:00 2024-02-24T03:39:00.222263048Z [2024-02-24T03:39:00.221+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T03:39:00.222287068Z 2024-02-24T03:39:00.222290624Z 2024-02-24T03:39:00.222293731Z 2024-02-24T03:39:00.223006836Z [2024-02-24T03:39:00.222+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:39:00.223264453Z [2024-02-24T03:39:00.223+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:39:00.223495499Z [2024-02-24T03:39:00.223+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:39:00.224389306Z [2024-02-24T03:39:00.224+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:39:00.224399642Z 2024-02-24T03:39:00.224415444Z 2024-02-24T03:39:00.224418659Z 2024-02-24T03:39:00.228198760Z [2024-02-24T03:39:00.227+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:39:00.228493893Z [2024-02-24T03:39:00.228+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:39:00.229245688Z [2024-02-24T03:39:00.228+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:39:00.229539837Z [2024-02-24T03:39:00.229+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:39:00.229919812Z [2024-02-24T03:39:00.229+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:39:00.230167598Z [2024-02-24T03:39:00.230+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:39:00.456419245Z [2024-02-24T03:39:00.455+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:38:00+00:00 exited with status queued for try_number 1 2024-02-24T03:39:00.458652583Z [2024-02-24T03:39:00.458+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:38:00+00:00 exited with status queued for try_number 1 2024-02-24T03:39:00.458911728Z [2024-02-24T03:39:00.458+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:38:00+00:00 exited with status queued for try_number 1 2024-02-24T03:39:00.468000913Z [2024-02-24T03:39:00.467+0000] {scheduler_job.py:635} INFO - Setting external_id for to c0b26d8e-03ca-4a0d-84f6-c9d790bd7d76 2024-02-24T03:39:00.468559487Z [2024-02-24T03:39:00.468+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8bd500bd-3d7d-430a-9e45-c9b83e5d7c18 2024-02-24T03:39:00.469007964Z [2024-02-24T03:39:00.468+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ee87221-e979-46cc-bd7b-c8a3b864ae85 2024-02-24T03:39:01.647637797Z [2024-02-24T03:39:01.647+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:39:01.648067436Z [2024-02-24T03:39:01.647+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:38:00+00:00, run_id=scheduled__2024-02-24T03:38:00+00:00, run_start_date=2024-02-24 03:39:00.180560+00:00, run_end_date=2024-02-24 03:39:01.647591+00:00, run_duration=1.467031, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:38:00+00:00, data_interval_end=2024-02-24 03:39:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:39:01.664339627Z [2024-02-24T03:39:01.663+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:39:00+00:00, run_after=2024-02-24T03:40:00+00:00 2024-02-24T03:39:02.834493812Z [2024-02-24T03:39:02.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:38:00+00:00 exited with status success for try_number 1 2024-02-24T03:39:02.840038669Z [2024-02-24T03:39:02.839+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:38:00+00:00, map_index=-1, run_start_date=2024-02-24 03:39:01.256127+00:00, run_end_date=2024-02-24 03:39:01.606910+00:00, run_duration=0.350783, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1092, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:39:00.225567+00:00, queued_by_job_id=2, pid=15931 2024-02-24T03:39:03.900872379Z [2024-02-24T03:39:03.900+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:39:03.900900991Z [2024-02-24T03:39:03.900+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:38:00+00:00, run_id=scheduled__2024-02-24T03:38:00+00:00, run_start_date=2024-02-24 03:39:00.181869+00:00, run_end_date=2024-02-24 03:39:03.900495+00:00, run_duration=3.718626, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:38:00+00:00, data_interval_end=2024-02-24 03:39:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:39:03.926639751Z [2024-02-24T03:39:03.926+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:39:00+00:00, run_after=2024-02-24T03:40:00+00:00 2024-02-24T03:39:03.988875037Z [2024-02-24T03:39:03.988+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:38:00+00:00 exited with status success for try_number 1 2024-02-24T03:39:04.001164780Z [2024-02-24T03:39:04.000+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:38:00+00:00, map_index=-1, run_start_date=2024-02-24 03:39:02.036687+00:00, run_end_date=2024-02-24 03:39:03.490979+00:00, run_duration=1.454292, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1093, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:39:00.225567+00:00, queued_by_job_id=2, pid=15949 2024-02-24T03:39:05.073223024Z [2024-02-24T03:39:05.072+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:39:05.074479926Z [2024-02-24T03:39:05.073+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:38:00+00:00, run_id=scheduled__2024-02-24T03:38:00+00:00, run_start_date=2024-02-24 03:39:00.182831+00:00, run_end_date=2024-02-24 03:39:05.073043+00:00, run_duration=4.890212, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:38:00+00:00, data_interval_end=2024-02-24 03:39:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:39:05.098626779Z [2024-02-24T03:39:05.098+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:39:00+00:00, run_after=2024-02-24T03:40:00+00:00 2024-02-24T03:39:05.140139944Z [2024-02-24T03:39:05.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:38:00+00:00 exited with status success for try_number 1 2024-02-24T03:39:05.146287920Z [2024-02-24T03:39:05.145+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:38:00+00:00, map_index=-1, run_start_date=2024-02-24 03:39:02.180079+00:00, run_end_date=2024-02-24 03:39:03.915277+00:00, run_duration=1.735198, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1094, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:39:00.225567+00:00, queued_by_job_id=2, pid=15950 2024-02-24T03:40:00.923581621Z [2024-02-24T03:40:00.923+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:40:00+00:00, run_after=2024-02-24T03:41:00+00:00 2024-02-24T03:40:00.937838652Z [2024-02-24T03:40:00.937+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:40:00+00:00, run_after=2024-02-24T03:41:00+00:00 2024-02-24T03:40:00.951337818Z [2024-02-24T03:40:00.950+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:40:00+00:00, run_after=2024-02-24T03:45:00+00:00 2024-02-24T03:40:00.958953671Z [2024-02-24T03:40:00.958+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:40:00.965503035Z [2024-02-24T03:40:00.965+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:40:01.096917958Z [2024-02-24T03:40:01.096+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-02-24T03:40:01.096977479Z 2024-02-24T03:40:01.096991874Z 2024-02-24T03:40:01.097005459Z 2024-02-24T03:40:01.097053672Z 2024-02-24T03:40:01.097114768Z 2024-02-24T03:40:01.097129640Z [2024-02-24T03:40:01.096+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:40:01.097248110Z [2024-02-24T03:40:01.096+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T03:40:01.097855997Z [2024-02-24T03:40:01.097+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:40:01.098061046Z [2024-02-24T03:40:01.097+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:40:01.098395688Z [2024-02-24T03:40:01.097+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:40:01.099510038Z [2024-02-24T03:40:01.099+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:40:01.099534616Z 2024-02-24T03:40:01.099544346Z 2024-02-24T03:40:01.099553729Z 2024-02-24T03:40:01.099562034Z 2024-02-24T03:40:01.099570559Z 2024-02-24T03:40:01.107617757Z [2024-02-24T03:40:01.107+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T03:40:01.107652312Z [2024-02-24T03:40:01.107+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T03:40:01.108038762Z [2024-02-24T03:40:01.107+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T03:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:40:01.108218160Z [2024-02-24T03:40:01.107+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T03:40:01.108447927Z [2024-02-24T03:40:01.108+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:40:01.108743194Z [2024-02-24T03:40:01.108+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:40:01.109160415Z [2024-02-24T03:40:01.108+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:40:01.109503739Z [2024-02-24T03:40:01.109+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:40:01.109918262Z [2024-02-24T03:40:01.109+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:40:01.110217814Z [2024-02-24T03:40:01.109+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:40:01.798837231Z [2024-02-24T03:40:01.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T03:35:00+00:00 exited with status queued for try_number 1 2024-02-24T03:40:01.799171985Z [2024-02-24T03:40:01.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:38:00+00:00 exited with status queued for try_number 1 2024-02-24T03:40:01.799421972Z [2024-02-24T03:40:01.799+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:39:00+00:00 exited with status queued for try_number 1 2024-02-24T03:40:01.799629925Z [2024-02-24T03:40:01.799+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:39:00+00:00 exited with status queued for try_number 1 2024-02-24T03:40:01.799908275Z [2024-02-24T03:40:01.799+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:39:00+00:00 exited with status queued for try_number 1 2024-02-24T03:40:01.820104999Z [2024-02-24T03:40:01.819+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c08e3f3-3e5b-4b51-8a7a-91909f748160 2024-02-24T03:40:01.820979364Z [2024-02-24T03:40:01.820+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60488bb0-8836-48b6-a02e-55114f78105b 2024-02-24T03:40:01.821345739Z [2024-02-24T03:40:01.821+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7cdb3173-a0b1-4f4a-aecb-ae798d445221 2024-02-24T03:40:01.821677790Z [2024-02-24T03:40:01.821+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99662b40-db61-4116-8092-a41ba720920a 2024-02-24T03:40:01.822015255Z [2024-02-24T03:40:01.821+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e66d481-3f83-4f1f-a985-939e54a4b6d4 2024-02-24T03:40:04.467636911Z [2024-02-24T03:40:04.467+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:40:04.467945294Z [2024-02-24T03:40:04.467+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 03:38:00+00:00, run_id=scheduled__2024-02-24T03:38:00+00:00, run_start_date=2024-02-24 03:40:00.977594+00:00, run_end_date=2024-02-24 03:40:04.467584+00:00, run_duration=3.48999, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:38:00+00:00, data_interval_end=2024-02-24 03:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T03:40:04.486134698Z [2024-02-24T03:40:04.485+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T03:40:00+00:00, run_after=2024-02-24T03:42:00+00:00 2024-02-24T03:40:04.520770667Z [2024-02-24T03:40:04.520+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:40:04.521068100Z [2024-02-24T03:40:04.520+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:39:00+00:00, run_id=scheduled__2024-02-24T03:39:00+00:00, run_start_date=2024-02-24 03:40:00.979009+00:00, run_end_date=2024-02-24 03:40:04.520675+00:00, run_duration=3.541666, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:39:00+00:00, data_interval_end=2024-02-24 03:40:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:40:04.532393329Z [2024-02-24T03:40:04.532+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:40:00+00:00, run_after=2024-02-24T03:41:00+00:00 2024-02-24T03:40:04.603756969Z [2024-02-24T03:40:04.603+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:38:00+00:00 exited with status success for try_number 1 2024-02-24T03:40:04.603791751Z [2024-02-24T03:40:04.603+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:39:00+00:00 exited with status success for try_number 1 2024-02-24T03:40:04.613462087Z [2024-02-24T03:40:04.613+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:39:00+00:00, map_index=-1, run_start_date=2024-02-24 03:40:02.452673+00:00, run_end_date=2024-02-24 03:40:03.333643+00:00, run_duration=0.88097, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1095, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:40:01.101731+00:00, queued_by_job_id=2, pid=15984 2024-02-24T03:40:04.613705182Z [2024-02-24T03:40:04.613+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T03:38:00+00:00, map_index=-1, run_start_date=2024-02-24 03:40:02.570995+00:00, run_end_date=2024-02-24 03:40:03.415635+00:00, run_duration=0.84464, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1096, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:40:01.101731+00:00, queued_by_job_id=2, pid=15985 2024-02-24T03:40:06.097960930Z [2024-02-24T03:40:06.097+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:40:06.097999125Z 2024-02-24T03:40:06.098338505Z [2024-02-24T03:40:06.098+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:40:06.099101198Z [2024-02-24T03:40:06.098+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:40:06.099119554Z 2024-02-24T03:40:06.102432599Z [2024-02-24T03:40:06.102+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T03:40:06.102764545Z [2024-02-24T03:40:06.102+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T03:40:06.155130709Z [2024-02-24T03:40:06.154+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T03:35:00+00:00 exited with status queued for try_number 1 2024-02-24T03:40:06.155553970Z [2024-02-24T03:40:06.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T03:35:00+00:00 exited with status success for try_number 1 2024-02-24T03:40:06.163158828Z [2024-02-24T03:40:06.162+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff8fb016-0aa0-44ba-9264-caa6e33ba70a 2024-02-24T03:40:06.164110066Z [2024-02-24T03:40:06.163+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T03:35:00+00:00, map_index=-1, run_start_date=2024-02-24 03:40:04.289665+00:00, run_end_date=2024-02-24 03:40:04.820323+00:00, run_duration=0.530658, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1097, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:40:01.101731+00:00, queued_by_job_id=2, pid=16009 2024-02-24T03:40:07.355900878Z [2024-02-24T03:40:07.355+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:40:07.356279800Z [2024-02-24T03:40:07.356+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:39:00+00:00, run_id=scheduled__2024-02-24T03:39:00+00:00, run_start_date=2024-02-24 03:40:00.980279+00:00, run_end_date=2024-02-24 03:40:07.355951+00:00, run_duration=6.375672, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:39:00+00:00, data_interval_end=2024-02-24 03:40:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:40:07.367339010Z [2024-02-24T03:40:07.366+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:40:00+00:00, run_after=2024-02-24T03:41:00+00:00 2024-02-24T03:40:07.374931396Z [2024-02-24T03:40:07.374+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:40:07.375398425Z [2024-02-24T03:40:07.375+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:39:00+00:00, run_id=scheduled__2024-02-24T03:39:00+00:00, run_start_date=2024-02-24 03:40:00.982204+00:00, run_end_date=2024-02-24 03:40:07.374823+00:00, run_duration=6.392619, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:39:00+00:00, data_interval_end=2024-02-24 03:40:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:40:07.387433530Z [2024-02-24T03:40:07.387+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:40:00+00:00, run_after=2024-02-24T03:41:00+00:00 2024-02-24T03:40:07.461996941Z [2024-02-24T03:40:07.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:39:00+00:00 exited with status success for try_number 1 2024-02-24T03:40:07.477899309Z [2024-02-24T03:40:07.477+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:39:00+00:00, map_index=-1, run_start_date=2024-02-24 03:40:04.432610+00:00, run_end_date=2024-02-24 03:40:06.559340+00:00, run_duration=2.12673, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1098, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:40:01.101731+00:00, queued_by_job_id=2, pid=16010 2024-02-24T03:40:08.578759827Z [2024-02-24T03:40:08.578+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:40:08.578795822Z 2024-02-24T03:40:08.578959453Z [2024-02-24T03:40:08.578+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:40:08.579822761Z [2024-02-24T03:40:08.579+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:40:08.579834087Z 2024-02-24T03:40:08.583189746Z [2024-02-24T03:40:08.582+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T03:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T03:40:08.583492025Z [2024-02-24T03:40:08.583+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T03:40:08.654149382Z [2024-02-24T03:40:08.653+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T03:35:00+00:00 exited with status queued for try_number 1 2024-02-24T03:40:08.654652651Z [2024-02-24T03:40:08.654+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:39:00+00:00 exited with status success for try_number 1 2024-02-24T03:40:08.655262302Z [2024-02-24T03:40:08.654+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T03:35:00+00:00 exited with status success for try_number 1 2024-02-24T03:40:08.668857548Z [2024-02-24T03:40:08.668+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T03:35:00+00:00, map_index=-1, run_start_date=2024-02-24 03:40:07.885502+00:00, run_end_date=2024-02-24 03:40:08.277036+00:00, run_duration=0.391534, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1100, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:40:06.099724+00:00, queued_by_job_id=2, pid=16039 2024-02-24T03:40:08.669074304Z [2024-02-24T03:40:08.668+0000] {scheduler_job.py:635} INFO - Setting external_id for to b5000034-a4bc-4327-9ca5-a9bff6d7f47c 2024-02-24T03:40:08.669343643Z [2024-02-24T03:40:08.669+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:39:00+00:00, map_index=-1, run_start_date=2024-02-24 03:40:05.149213+00:00, run_end_date=2024-02-24 03:40:07.274680+00:00, run_duration=2.125467, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1099, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:40:01.101731+00:00, queued_by_job_id=2, pid=16026 2024-02-24T03:40:12.386027648Z [2024-02-24T03:40:12.380+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:40:12.386058137Z 2024-02-24T03:40:12.386065147Z [2024-02-24T03:40:12.380+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:40:12.386070595Z [2024-02-24T03:40:12.381+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:40:12.386075373Z 2024-02-24T03:40:12.386081181Z [2024-02-24T03:40:12.384+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:40:12.386086610Z [2024-02-24T03:40:12.384+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T03:40:12.446125421Z [2024-02-24T03:40:12.445+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T03:35:00+00:00 exited with status queued for try_number 1 2024-02-24T03:40:12.446283070Z [2024-02-24T03:40:12.445+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T03:35:00+00:00 exited with status success for try_number 1 2024-02-24T03:40:12.456131636Z [2024-02-24T03:40:12.455+0000] {scheduler_job.py:635} INFO - Setting external_id for to 091fc724-54c6-4015-ac48-cc4de4d41a05 2024-02-24T03:40:12.456259976Z [2024-02-24T03:40:12.456+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T03:35:00+00:00, map_index=0, run_start_date=2024-02-24 03:40:10.110194+00:00, run_end_date=2024-02-24 03:40:11.413897+00:00, run_duration=1.303703, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1101, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:40:08.580328+00:00, queued_by_job_id=2, pid=16047 2024-02-24T03:40:15.214842322Z [2024-02-24T03:40:15.214+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:40:15.215060809Z [2024-02-24T03:40:15.214+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:35:00+00:00, run_id=scheduled__2024-02-24T03:35:00+00:00, run_start_date=2024-02-24 03:40:00.975600+00:00, run_end_date=2024-02-24 03:40:15.214548+00:00, run_duration=14.238948, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:35:00+00:00, data_interval_end=2024-02-24 03:40:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T03:40:15.225677855Z [2024-02-24T03:40:15.225+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:40:00+00:00, run_after=2024-02-24T03:45:00+00:00 2024-02-24T03:40:15.271217360Z [2024-02-24T03:40:15.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T03:35:00+00:00 exited with status success for try_number 1 2024-02-24T03:40:15.280235331Z [2024-02-24T03:40:15.279+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T03:35:00+00:00, map_index=-1, run_start_date=2024-02-24 03:40:14.128299+00:00, run_end_date=2024-02-24 03:40:14.494310+00:00, run_duration=0.366011, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1102, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:40:12.381838+00:00, queued_by_job_id=2, pid=16060 2024-02-24T03:41:00.647794032Z [2024-02-24T03:41:00.647+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:41:00.666961521Z [2024-02-24T03:41:00.666+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:41:00+00:00, run_after=2024-02-24T03:42:00+00:00 2024-02-24T03:41:00.683987006Z [2024-02-24T03:41:00.683+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:41:00+00:00, run_after=2024-02-24T03:42:00+00:00 2024-02-24T03:41:00.768308228Z [2024-02-24T03:41:00.767+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T03:41:00.768368803Z 2024-02-24T03:41:00.768373042Z 2024-02-24T03:41:00.768384492Z 2024-02-24T03:41:00.768570368Z [2024-02-24T03:41:00.768+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:41:00.768758068Z [2024-02-24T03:41:00.768+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:41:00.768925072Z [2024-02-24T03:41:00.768+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:41:00.769617396Z [2024-02-24T03:41:00.769+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:41:00.769632418Z 2024-02-24T03:41:00.769637856Z 2024-02-24T03:41:00.769664338Z 2024-02-24T03:41:00.773224162Z [2024-02-24T03:41:00.772+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:41:00.773507622Z [2024-02-24T03:41:00.773+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:41:00.773848264Z [2024-02-24T03:41:00.773+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:41:00.774101437Z [2024-02-24T03:41:00.773+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:41:00.774437712Z [2024-02-24T03:41:00.774+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:41:00.774668051Z [2024-02-24T03:41:00.774+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:41:01.021951219Z [2024-02-24T03:41:01.021+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:40:00+00:00 exited with status queued for try_number 1 2024-02-24T03:41:01.022445646Z [2024-02-24T03:41:01.022+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:40:00+00:00 exited with status queued for try_number 1 2024-02-24T03:41:01.022748869Z [2024-02-24T03:41:01.022+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:40:00+00:00 exited with status queued for try_number 1 2024-02-24T03:41:01.035116348Z [2024-02-24T03:41:01.034+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4126eb30-0fb4-45fd-af0b-c0df3777ddb9 2024-02-24T03:41:01.035191057Z [2024-02-24T03:41:01.035+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1683dbb0-8020-4c60-b099-4f3c1862a5d1 2024-02-24T03:41:01.035327017Z [2024-02-24T03:41:01.035+0000] {scheduler_job.py:635} INFO - Setting external_id for to b864a77a-2b3f-4173-965c-e3ca5c1cd8be 2024-02-24T03:41:02.254579530Z [2024-02-24T03:41:02.253+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:41:02.255076800Z [2024-02-24T03:41:02.254+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:40:00+00:00, run_id=scheduled__2024-02-24T03:40:00+00:00, run_start_date=2024-02-24 03:41:00.697866+00:00, run_end_date=2024-02-24 03:41:02.254517+00:00, run_duration=1.556651, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:40:00+00:00, data_interval_end=2024-02-24 03:41:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:41:02.272442823Z [2024-02-24T03:41:02.272+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:41:00+00:00, run_after=2024-02-24T03:42:00+00:00 2024-02-24T03:41:02.393142574Z [2024-02-24T03:41:02.392+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:40:00+00:00 exited with status success for try_number 1 2024-02-24T03:41:02.401976403Z [2024-02-24T03:41:02.400+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:40:00+00:00, map_index=-1, run_start_date=2024-02-24 03:41:01.673133+00:00, run_end_date=2024-02-24 03:41:02.081910+00:00, run_duration=0.408777, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1103, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:41:00.770431+00:00, queued_by_job_id=2, pid=16082 2024-02-24T03:41:04.592196701Z [2024-02-24T03:41:04.591+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:41:04.592654075Z [2024-02-24T03:41:04.592+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:40:00+00:00, run_id=scheduled__2024-02-24T03:40:00+00:00, run_start_date=2024-02-24 03:41:00.699307+00:00, run_end_date=2024-02-24 03:41:04.592157+00:00, run_duration=3.89285, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:40:00+00:00, data_interval_end=2024-02-24 03:41:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:41:04.605694726Z [2024-02-24T03:41:04.605+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:41:00+00:00, run_after=2024-02-24T03:42:00+00:00 2024-02-24T03:41:04.666633878Z [2024-02-24T03:41:04.666+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:40:00+00:00 exited with status success for try_number 1 2024-02-24T03:41:04.673466548Z [2024-02-24T03:41:04.672+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:40:00+00:00, map_index=-1, run_start_date=2024-02-24 03:41:02.685112+00:00, run_end_date=2024-02-24 03:41:04.078342+00:00, run_duration=1.39323, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1105, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:41:00.770431+00:00, queued_by_job_id=2, pid=16101 2024-02-24T03:41:05.711624211Z [2024-02-24T03:41:05.711+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:41:05.711837398Z [2024-02-24T03:41:05.711+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:40:00+00:00, run_id=scheduled__2024-02-24T03:40:00+00:00, run_start_date=2024-02-24 03:41:00.700470+00:00, run_end_date=2024-02-24 03:41:05.711487+00:00, run_duration=5.011017, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:40:00+00:00, data_interval_end=2024-02-24 03:41:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:41:05.724475132Z [2024-02-24T03:41:05.724+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:41:00+00:00, run_after=2024-02-24T03:42:00+00:00 2024-02-24T03:41:05.762711447Z [2024-02-24T03:41:05.762+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:40:00+00:00 exited with status success for try_number 1 2024-02-24T03:41:05.769338524Z [2024-02-24T03:41:05.768+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:40:00+00:00, map_index=-1, run_start_date=2024-02-24 03:41:02.598547+00:00, run_end_date=2024-02-24 03:41:04.680788+00:00, run_duration=2.082241, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1104, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:41:00.770431+00:00, queued_by_job_id=2, pid=16100 2024-02-24T03:42:01.064859492Z [2024-02-24T03:42:01.064+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:42:00+00:00, run_after=2024-02-24T03:43:00+00:00 2024-02-24T03:42:01.076802128Z [2024-02-24T03:42:01.076+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:42:01.088315453Z [2024-02-24T03:42:01.087+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:42:01.116073116Z [2024-02-24T03:42:01.115+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:42:00+00:00, run_after=2024-02-24T03:43:00+00:00 2024-02-24T03:42:01.247259527Z [2024-02-24T03:42:01.245+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T03:42:01.247284693Z 2024-02-24T03:42:01.247289790Z 2024-02-24T03:42:01.247293220Z 2024-02-24T03:42:01.247296727Z 2024-02-24T03:42:01.247301910Z [2024-02-24T03:42:01.246+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T03:42:01.247305257Z [2024-02-24T03:42:01.246+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:42:01.247308347Z [2024-02-24T03:42:01.246+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:42:01.247311424Z [2024-02-24T03:42:01.246+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:42:01.247578821Z [2024-02-24T03:42:01.247+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:42:01.247583111Z 2024-02-24T03:42:01.247586306Z 2024-02-24T03:42:01.247589475Z 2024-02-24T03:42:01.247592549Z 2024-02-24T03:42:01.252586738Z [2024-02-24T03:42:01.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:42:01.252603430Z [2024-02-24T03:42:01.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T03:42:01.252611138Z [2024-02-24T03:42:01.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:42:01.252626138Z [2024-02-24T03:42:01.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:42:01.252629785Z [2024-02-24T03:42:01.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:42:01.252632826Z [2024-02-24T03:42:01.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:42:01.252635826Z [2024-02-24T03:42:01.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:42:01.252639222Z [2024-02-24T03:42:01.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:42:01.600324463Z [2024-02-24T03:42:01.599+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:40:00+00:00 exited with status queued for try_number 1 2024-02-24T03:42:01.600690734Z [2024-02-24T03:42:01.600+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:41:00+00:00 exited with status queued for try_number 1 2024-02-24T03:42:01.600995368Z [2024-02-24T03:42:01.600+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:41:00+00:00 exited with status queued for try_number 1 2024-02-24T03:42:01.601284541Z [2024-02-24T03:42:01.601+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:41:00+00:00 exited with status queued for try_number 1 2024-02-24T03:42:01.619506399Z [2024-02-24T03:42:01.619+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58a78d4e-7b56-4f97-aa40-a065320efbce 2024-02-24T03:42:01.619825695Z [2024-02-24T03:42:01.619+0000] {scheduler_job.py:635} INFO - Setting external_id for to 683aaa9b-91fd-4ce4-a9c0-864b7689a437 2024-02-24T03:42:01.620038294Z [2024-02-24T03:42:01.619+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a5b1411-df6f-4fc0-8d5c-ec5fccb8b7a8 2024-02-24T03:42:01.620234463Z [2024-02-24T03:42:01.620+0000] {scheduler_job.py:635} INFO - Setting external_id for to f28102bb-9c60-4f5c-91e7-795935e199e3 2024-02-24T03:42:03.287514519Z [2024-02-24T03:42:03.287+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:42:03.287809815Z [2024-02-24T03:42:03.287+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 03:40:00+00:00, run_id=scheduled__2024-02-24T03:40:00+00:00, run_start_date=2024-02-24 03:42:01.139751+00:00, run_end_date=2024-02-24 03:42:03.287457+00:00, run_duration=2.147706, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:40:00+00:00, data_interval_end=2024-02-24 03:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T03:42:03.297300403Z [2024-02-24T03:42:03.296+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T03:42:00+00:00, run_after=2024-02-24T03:44:00+00:00 2024-02-24T03:42:03.308514007Z [2024-02-24T03:42:03.308+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:42:03.309349705Z [2024-02-24T03:42:03.309+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:41:00+00:00, run_id=scheduled__2024-02-24T03:41:00+00:00, run_start_date=2024-02-24 03:42:01.141497+00:00, run_end_date=2024-02-24 03:42:03.308808+00:00, run_duration=2.167311, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:41:00+00:00, data_interval_end=2024-02-24 03:42:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:42:03.322230910Z [2024-02-24T03:42:03.320+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:42:00+00:00, run_after=2024-02-24T03:43:00+00:00 2024-02-24T03:42:03.377484164Z [2024-02-24T03:42:03.377+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:40:00+00:00 exited with status success for try_number 1 2024-02-24T03:42:03.378486701Z [2024-02-24T03:42:03.378+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:41:00+00:00 exited with status success for try_number 1 2024-02-24T03:42:03.387046927Z [2024-02-24T03:42:03.386+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:41:00+00:00, map_index=-1, run_start_date=2024-02-24 03:42:02.116174+00:00, run_end_date=2024-02-24 03:42:02.727211+00:00, run_duration=0.611037, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1106, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:42:01.248477+00:00, queued_by_job_id=2, pid=16135 2024-02-24T03:42:03.387507083Z [2024-02-24T03:42:03.387+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T03:40:00+00:00, map_index=-1, run_start_date=2024-02-24 03:42:02.193183+00:00, run_end_date=2024-02-24 03:42:02.606165+00:00, run_duration=0.412982, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1107, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:42:01.248477+00:00, queued_by_job_id=2, pid=16136 2024-02-24T03:42:05.539974362Z [2024-02-24T03:42:05.539+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:42:05.540063574Z [2024-02-24T03:42:05.539+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:41:00+00:00, run_id=scheduled__2024-02-24T03:41:00+00:00, run_start_date=2024-02-24 03:42:01.143179+00:00, run_end_date=2024-02-24 03:42:05.539840+00:00, run_duration=4.396661, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:41:00+00:00, data_interval_end=2024-02-24 03:42:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:42:05.548343018Z [2024-02-24T03:42:05.548+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:42:00+00:00, run_after=2024-02-24T03:43:00+00:00 2024-02-24T03:42:05.674216097Z [2024-02-24T03:42:05.673+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:42:05.674698834Z [2024-02-24T03:42:05.674+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:41:00+00:00, run_id=scheduled__2024-02-24T03:41:00+00:00, run_start_date=2024-02-24 03:42:01.144775+00:00, run_end_date=2024-02-24 03:42:05.674066+00:00, run_duration=4.529291, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:41:00+00:00, data_interval_end=2024-02-24 03:42:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:42:05.685164970Z [2024-02-24T03:42:05.684+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:42:00+00:00, run_after=2024-02-24T03:43:00+00:00 2024-02-24T03:42:05.722701340Z [2024-02-24T03:42:05.722+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:41:00+00:00 exited with status success for try_number 1 2024-02-24T03:42:05.722739234Z [2024-02-24T03:42:05.722+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:41:00+00:00 exited with status success for try_number 1 2024-02-24T03:42:05.730455638Z [2024-02-24T03:42:05.729+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:41:00+00:00, map_index=-1, run_start_date=2024-02-24 03:42:03.488569+00:00, run_end_date=2024-02-24 03:42:05.466039+00:00, run_duration=1.97747, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1108, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:42:01.248477+00:00, queued_by_job_id=2, pid=16159 2024-02-24T03:42:05.730700319Z [2024-02-24T03:42:05.730+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:41:00+00:00, map_index=-1, run_start_date=2024-02-24 03:42:03.579583+00:00, run_end_date=2024-02-24 03:42:05.491922+00:00, run_duration=1.912339, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1109, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:42:01.248477+00:00, queued_by_job_id=2, pid=16160 2024-02-24T03:42:05.742743953Z [2024-02-24T03:42:05.742+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T03:43:00.134227213Z [2024-02-24T03:43:00.133+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:43:00.152642411Z [2024-02-24T03:43:00.152+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:43:00+00:00, run_after=2024-02-24T03:44:00+00:00 2024-02-24T03:43:00.165727149Z [2024-02-24T03:43:00.165+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:43:00+00:00, run_after=2024-02-24T03:44:00+00:00 2024-02-24T03:43:00.255810852Z [2024-02-24T03:43:00.255+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T03:43:00.255864316Z 2024-02-24T03:43:00.255875114Z 2024-02-24T03:43:00.255884237Z 2024-02-24T03:43:00.255893501Z [2024-02-24T03:43:00.255+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:43:00.256091995Z [2024-02-24T03:43:00.255+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:43:00.256434155Z [2024-02-24T03:43:00.256+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:43:00.257677051Z [2024-02-24T03:43:00.257+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:43:00.257697447Z 2024-02-24T03:43:00.257706295Z 2024-02-24T03:43:00.257714399Z 2024-02-24T03:43:00.263540486Z [2024-02-24T03:43:00.263+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:43:00.263724152Z [2024-02-24T03:43:00.263+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:43:00.264436782Z [2024-02-24T03:43:00.264+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:43:00.264849440Z [2024-02-24T03:43:00.264+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:43:00.265522177Z [2024-02-24T03:43:00.265+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:43:00.265998906Z [2024-02-24T03:43:00.265+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:43:00.447180829Z [2024-02-24T03:43:00.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:42:00+00:00 exited with status queued for try_number 1 2024-02-24T03:43:00.447534328Z [2024-02-24T03:43:00.447+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:42:00+00:00 exited with status queued for try_number 1 2024-02-24T03:43:00.447668844Z [2024-02-24T03:43:00.447+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:42:00+00:00 exited with status queued for try_number 1 2024-02-24T03:43:00.471080986Z [2024-02-24T03:43:00.459+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6a93b156-47fd-49a1-9feb-e5d5b2224c27 2024-02-24T03:43:00.471103576Z [2024-02-24T03:43:00.469+0000] {scheduler_job.py:635} INFO - Setting external_id for to 49714ba0-bca0-4086-ab95-ef701066efd6 2024-02-24T03:43:00.471107439Z [2024-02-24T03:43:00.469+0000] {scheduler_job.py:635} INFO - Setting external_id for to 036b498c-d6ba-41a5-a7d9-060d550cf51c 2024-02-24T03:43:01.624709396Z [2024-02-24T03:43:01.623+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:43:01.624738891Z [2024-02-24T03:43:01.624+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:42:00+00:00, run_id=scheduled__2024-02-24T03:42:00+00:00, run_start_date=2024-02-24 03:43:00.184520+00:00, run_end_date=2024-02-24 03:43:01.624109+00:00, run_duration=1.439589, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:42:00+00:00, data_interval_end=2024-02-24 03:43:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:43:01.636025528Z [2024-02-24T03:43:01.635+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:43:00+00:00, run_after=2024-02-24T03:44:00+00:00 2024-02-24T03:43:01.693337793Z [2024-02-24T03:43:01.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:42:00+00:00 exited with status success for try_number 1 2024-02-24T03:43:01.705190606Z [2024-02-24T03:43:01.704+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:42:00+00:00, map_index=-1, run_start_date=2024-02-24 03:43:00.991460+00:00, run_end_date=2024-02-24 03:43:01.445725+00:00, run_duration=0.454265, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1110, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:43:00.259198+00:00, queued_by_job_id=2, pid=16192 2024-02-24T03:43:04.292920898Z [2024-02-24T03:43:04.292+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:43:04.293047060Z [2024-02-24T03:43:04.292+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:42:00+00:00, run_id=scheduled__2024-02-24T03:42:00+00:00, run_start_date=2024-02-24 03:43:00.186064+00:00, run_end_date=2024-02-24 03:43:04.292508+00:00, run_duration=4.106444, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:42:00+00:00, data_interval_end=2024-02-24 03:43:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:43:04.308130203Z [2024-02-24T03:43:04.307+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:43:00+00:00, run_after=2024-02-24T03:44:00+00:00 2024-02-24T03:43:04.317922921Z [2024-02-24T03:43:04.317+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:43:04.318243056Z [2024-02-24T03:43:04.317+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:42:00+00:00, run_id=scheduled__2024-02-24T03:42:00+00:00, run_start_date=2024-02-24 03:43:00.187435+00:00, run_end_date=2024-02-24 03:43:04.317749+00:00, run_duration=4.130314, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:42:00+00:00, data_interval_end=2024-02-24 03:43:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:43:04.340379401Z [2024-02-24T03:43:04.339+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:43:00+00:00, run_after=2024-02-24T03:44:00+00:00 2024-02-24T03:43:04.401922665Z [2024-02-24T03:43:04.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:42:00+00:00 exited with status success for try_number 1 2024-02-24T03:43:04.402135532Z [2024-02-24T03:43:04.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:42:00+00:00 exited with status success for try_number 1 2024-02-24T03:43:04.414456916Z [2024-02-24T03:43:04.413+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:42:00+00:00, map_index=-1, run_start_date=2024-02-24 03:43:02.133734+00:00, run_end_date=2024-02-24 03:43:03.963336+00:00, run_duration=1.829602, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1112, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:43:00.259198+00:00, queued_by_job_id=2, pid=16211 2024-02-24T03:43:04.414781179Z [2024-02-24T03:43:04.414+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:42:00+00:00, map_index=-1, run_start_date=2024-02-24 03:43:01.979033+00:00, run_end_date=2024-02-24 03:43:03.342002+00:00, run_duration=1.362969, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1111, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:43:00.259198+00:00, queued_by_job_id=2, pid=16210 2024-02-24T03:44:00.165482496Z [2024-02-24T03:44:00.164+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:44:00+00:00, run_after=2024-02-24T03:45:00+00:00 2024-02-24T03:44:00.182922057Z [2024-02-24T03:44:00.182+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:44:00.206917227Z [2024-02-24T03:44:00.206+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:44:00+00:00, run_after=2024-02-24T03:45:00+00:00 2024-02-24T03:44:00.219939021Z [2024-02-24T03:44:00.219+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:44:00.364186188Z [2024-02-24T03:44:00.363+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T03:44:00.364219733Z 2024-02-24T03:44:00.364231275Z 2024-02-24T03:44:00.364235190Z 2024-02-24T03:44:00.364238835Z 2024-02-24T03:44:00.364695862Z [2024-02-24T03:44:00.364+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T03:44:00.365210152Z [2024-02-24T03:44:00.364+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:44:00.365584387Z [2024-02-24T03:44:00.365+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:44:00.365970729Z [2024-02-24T03:44:00.365+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:44:00.367252221Z [2024-02-24T03:44:00.366+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:44:00.367264532Z 2024-02-24T03:44:00.367272102Z 2024-02-24T03:44:00.367280773Z 2024-02-24T03:44:00.367288121Z 2024-02-24T03:44:00.374306044Z [2024-02-24T03:44:00.373+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T03:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:44:00.374790649Z [2024-02-24T03:44:00.374+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T03:44:00.375326432Z [2024-02-24T03:44:00.375+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:44:00.375577965Z [2024-02-24T03:44:00.375+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:44:00.376043970Z [2024-02-24T03:44:00.375+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:44:00.376326463Z [2024-02-24T03:44:00.376+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:44:00.376742382Z [2024-02-24T03:44:00.376+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:44:00.377059119Z [2024-02-24T03:44:00.376+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:44:00.902228053Z [2024-02-24T03:44:00.899+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:42:00+00:00 exited with status queued for try_number 1 2024-02-24T03:44:00.902326211Z [2024-02-24T03:44:00.902+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:43:00+00:00 exited with status queued for try_number 1 2024-02-24T03:44:00.902407917Z [2024-02-24T03:44:00.902+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:43:00+00:00 exited with status queued for try_number 1 2024-02-24T03:44:00.902471609Z [2024-02-24T03:44:00.902+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:43:00+00:00 exited with status queued for try_number 1 2024-02-24T03:44:00.926714014Z [2024-02-24T03:44:00.926+0000] {scheduler_job.py:635} INFO - Setting external_id for to 895dd860-318f-4b81-8a83-0363d52a16ff 2024-02-24T03:44:00.926773715Z [2024-02-24T03:44:00.926+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23610d01-b41f-446f-ac19-3878ae8c31fb 2024-02-24T03:44:00.926883199Z [2024-02-24T03:44:00.926+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20f9a3db-1ba2-4a29-89fa-9283be4eca2d 2024-02-24T03:44:00.926985193Z [2024-02-24T03:44:00.926+0000] {scheduler_job.py:635} INFO - Setting external_id for to 872bdafd-4444-4f1f-80cf-3e6f4ae13017 2024-02-24T03:44:02.281956073Z [2024-02-24T03:44:02.281+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:44:02.282512505Z [2024-02-24T03:44:02.282+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 03:42:00+00:00, run_id=scheduled__2024-02-24T03:42:00+00:00, run_start_date=2024-02-24 03:44:00.234662+00:00, run_end_date=2024-02-24 03:44:02.281885+00:00, run_duration=2.047223, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:42:00+00:00, data_interval_end=2024-02-24 03:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T03:44:02.291741410Z [2024-02-24T03:44:02.291+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T03:44:00+00:00, run_after=2024-02-24T03:46:00+00:00 2024-02-24T03:44:02.299004535Z [2024-02-24T03:44:02.298+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:44:02.299187099Z [2024-02-24T03:44:02.299+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:43:00+00:00, run_id=scheduled__2024-02-24T03:43:00+00:00, run_start_date=2024-02-24 03:44:00.236252+00:00, run_end_date=2024-02-24 03:44:02.298917+00:00, run_duration=2.062665, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:43:00+00:00, data_interval_end=2024-02-24 03:44:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:44:02.310763200Z [2024-02-24T03:44:02.310+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:44:00+00:00, run_after=2024-02-24T03:45:00+00:00 2024-02-24T03:44:02.387499387Z [2024-02-24T03:44:02.385+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:42:00+00:00 exited with status success for try_number 1 2024-02-24T03:44:02.387529062Z [2024-02-24T03:44:02.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:43:00+00:00 exited with status success for try_number 1 2024-02-24T03:44:02.407553140Z [2024-02-24T03:44:02.407+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T03:42:00+00:00, map_index=-1, run_start_date=2024-02-24 03:44:01.119725+00:00, run_end_date=2024-02-24 03:44:01.628408+00:00, run_duration=0.508683, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1113, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:44:00.369192+00:00, queued_by_job_id=2, pid=16244 2024-02-24T03:44:02.407622840Z [2024-02-24T03:44:02.407+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:43:00+00:00, map_index=-1, run_start_date=2024-02-24 03:44:01.490000+00:00, run_end_date=2024-02-24 03:44:01.965176+00:00, run_duration=0.475176, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1114, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:44:00.369192+00:00, queued_by_job_id=2, pid=16246 2024-02-24T03:44:04.156469195Z [2024-02-24T03:44:04.155+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:44:04.157568242Z [2024-02-24T03:44:04.157+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:43:00+00:00, run_id=scheduled__2024-02-24T03:43:00+00:00, run_start_date=2024-02-24 03:44:00.237664+00:00, run_end_date=2024-02-24 03:44:04.156924+00:00, run_duration=3.91926, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:43:00+00:00, data_interval_end=2024-02-24 03:44:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:44:04.172467212Z [2024-02-24T03:44:04.172+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:44:00+00:00, run_after=2024-02-24T03:45:00+00:00 2024-02-24T03:44:04.241752346Z [2024-02-24T03:44:04.241+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:43:00+00:00 exited with status success for try_number 1 2024-02-24T03:44:04.252978498Z [2024-02-24T03:44:04.252+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:43:00+00:00, map_index=-1, run_start_date=2024-02-24 03:44:02.284423+00:00, run_end_date=2024-02-24 03:44:04.056874+00:00, run_duration=1.772451, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1115, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:44:00.369192+00:00, queued_by_job_id=2, pid=16268 2024-02-24T03:44:06.442535102Z [2024-02-24T03:44:06.441+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:44:06.442857116Z [2024-02-24T03:44:06.442+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:43:00+00:00, run_id=scheduled__2024-02-24T03:43:00+00:00, run_start_date=2024-02-24 03:44:00.238851+00:00, run_end_date=2024-02-24 03:44:06.442262+00:00, run_duration=6.203411, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:43:00+00:00, data_interval_end=2024-02-24 03:44:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:44:06.451414620Z [2024-02-24T03:44:06.451+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:44:00+00:00, run_after=2024-02-24T03:45:00+00:00 2024-02-24T03:44:06.485019128Z [2024-02-24T03:44:06.484+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:43:00+00:00 exited with status success for try_number 1 2024-02-24T03:44:06.492015765Z [2024-02-24T03:44:06.491+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:43:00+00:00, map_index=-1, run_start_date=2024-02-24 03:44:02.548752+00:00, run_end_date=2024-02-24 03:44:05.354981+00:00, run_duration=2.806229, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1116, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:44:00.369192+00:00, queued_by_job_id=2, pid=16269 2024-02-24T03:45:00.104468596Z [2024-02-24T03:45:00.103+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:45:00+00:00, run_after=2024-02-24T03:50:00+00:00 2024-02-24T03:45:00.117482488Z [2024-02-24T03:45:00.117+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:45:00.135562454Z [2024-02-24T03:45:00.135+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:45:00+00:00, run_after=2024-02-24T03:46:00+00:00 2024-02-24T03:45:00.148133236Z [2024-02-24T03:45:00.147+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:45:00+00:00, run_after=2024-02-24T03:46:00+00:00 2024-02-24T03:45:00.261454687Z [2024-02-24T03:45:00.260+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T03:45:00.261483222Z 2024-02-24T03:45:00.261493316Z 2024-02-24T03:45:00.261497684Z 2024-02-24T03:45:00.261501970Z 2024-02-24T03:45:00.261514614Z [2024-02-24T03:45:00.261+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:45:00.261827004Z [2024-02-24T03:45:00.261+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:45:00.262037570Z [2024-02-24T03:45:00.261+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:45:00.262965561Z [2024-02-24T03:45:00.262+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:45:00.263793570Z [2024-02-24T03:45:00.263+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:45:00.263808034Z 2024-02-24T03:45:00.263813015Z 2024-02-24T03:45:00.263817171Z 2024-02-24T03:45:00.263821570Z 2024-02-24T03:45:00.268062207Z [2024-02-24T03:45:00.267+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T03:45:00.268238098Z [2024-02-24T03:45:00.267+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T03:45:00.268606399Z [2024-02-24T03:45:00.268+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:45:00.268954668Z [2024-02-24T03:45:00.268+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:45:00.269331456Z [2024-02-24T03:45:00.269+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:45:00.269587645Z [2024-02-24T03:45:00.269+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:45:00.270294997Z [2024-02-24T03:45:00.269+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:45:00.270309864Z [2024-02-24T03:45:00.269+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:45:00.538569077Z [2024-02-24T03:45:00.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T03:40:00+00:00 exited with status queued for try_number 1 2024-02-24T03:45:00.538830547Z [2024-02-24T03:45:00.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:44:00+00:00 exited with status queued for try_number 1 2024-02-24T03:45:00.538939827Z [2024-02-24T03:45:00.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:44:00+00:00 exited with status queued for try_number 1 2024-02-24T03:45:00.539162665Z [2024-02-24T03:45:00.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:44:00+00:00 exited with status queued for try_number 1 2024-02-24T03:45:00.559169605Z [2024-02-24T03:45:00.558+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad2f4879-1838-4578-9375-51add94815d8 2024-02-24T03:45:00.559340994Z [2024-02-24T03:45:00.559+0000] {scheduler_job.py:635} INFO - Setting external_id for to 872fdd5f-fe2f-428e-9a9f-150626dfc284 2024-02-24T03:45:00.559485281Z [2024-02-24T03:45:00.559+0000] {scheduler_job.py:635} INFO - Setting external_id for to f79454cd-5b03-4c38-bda1-16052fc3b4d8 2024-02-24T03:45:00.559626660Z [2024-02-24T03:45:00.559+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f2ef7fb-a1c5-440e-83e0-e1473874adbd 2024-02-24T03:45:02.565019797Z [2024-02-24T03:45:02.564+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:45:02.565355193Z [2024-02-24T03:45:02.565+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:44:00+00:00, run_id=scheduled__2024-02-24T03:44:00+00:00, run_start_date=2024-02-24 03:45:00.158916+00:00, run_end_date=2024-02-24 03:45:02.564866+00:00, run_duration=2.40595, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:44:00+00:00, data_interval_end=2024-02-24 03:45:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:45:02.574818934Z [2024-02-24T03:45:02.574+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:45:00+00:00, run_after=2024-02-24T03:46:00+00:00 2024-02-24T03:45:02.676783442Z [2024-02-24T03:45:02.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:44:00+00:00 exited with status success for try_number 1 2024-02-24T03:45:02.695884057Z [2024-02-24T03:45:02.695+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:44:00+00:00, map_index=-1, run_start_date=2024-02-24 03:45:01.175906+00:00, run_end_date=2024-02-24 03:45:01.731521+00:00, run_duration=0.555615, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1117, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:45:00.264905+00:00, queued_by_job_id=2, pid=16302 2024-02-24T03:45:03.808737107Z [2024-02-24T03:45:03.808+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:45:03.808757105Z 2024-02-24T03:45:03.809047724Z [2024-02-24T03:45:03.808+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:45:03.809836540Z [2024-02-24T03:45:03.809+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:45:03.809849061Z 2024-02-24T03:45:03.812592493Z [2024-02-24T03:45:03.812+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T03:45:03.812832327Z [2024-02-24T03:45:03.812+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T03:45:03.870697074Z [2024-02-24T03:45:03.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T03:40:00+00:00 exited with status queued for try_number 1 2024-02-24T03:45:03.870956376Z [2024-02-24T03:45:03.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T03:40:00+00:00 exited with status success for try_number 1 2024-02-24T03:45:03.891583171Z [2024-02-24T03:45:03.891+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb0f55cd-5fd8-4fd8-bd90-ea08ac50180d 2024-02-24T03:45:03.892155808Z [2024-02-24T03:45:03.891+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T03:40:00+00:00, map_index=-1, run_start_date=2024-02-24 03:45:02.764677+00:00, run_end_date=2024-02-24 03:45:03.269804+00:00, run_duration=0.505127, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1119, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:45:00.264905+00:00, queued_by_job_id=2, pid=16329 2024-02-24T03:45:03.944368291Z [2024-02-24T03:45:03.943+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:45:03.944508316Z [2024-02-24T03:45:03.944+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:44:00+00:00, run_id=scheduled__2024-02-24T03:44:00+00:00, run_start_date=2024-02-24 03:45:00.159892+00:00, run_end_date=2024-02-24 03:45:03.944241+00:00, run_duration=3.784349, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:44:00+00:00, data_interval_end=2024-02-24 03:45:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:45:03.953689637Z [2024-02-24T03:45:03.953+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:45:00+00:00, run_after=2024-02-24T03:46:00+00:00 2024-02-24T03:45:04.012966619Z [2024-02-24T03:45:04.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:44:00+00:00 exited with status success for try_number 1 2024-02-24T03:45:04.018550982Z [2024-02-24T03:45:04.018+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:44:00+00:00, map_index=-1, run_start_date=2024-02-24 03:45:02.368553+00:00, run_end_date=2024-02-24 03:45:03.820117+00:00, run_duration=1.451564, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1118, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:45:00.264905+00:00, queued_by_job_id=2, pid=16316 2024-02-24T03:45:05.084936024Z [2024-02-24T03:45:05.084+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:45:05.085237499Z [2024-02-24T03:45:05.085+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:44:00+00:00, run_id=scheduled__2024-02-24T03:44:00+00:00, run_start_date=2024-02-24 03:45:00.160793+00:00, run_end_date=2024-02-24 03:45:05.084826+00:00, run_duration=4.924033, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:44:00+00:00, data_interval_end=2024-02-24 03:45:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:45:05.094469878Z [2024-02-24T03:45:05.094+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:45:00+00:00, run_after=2024-02-24T03:46:00+00:00 2024-02-24T03:45:05.143063174Z [2024-02-24T03:45:05.141+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:44:00+00:00 exited with status success for try_number 1 2024-02-24T03:45:05.150701298Z [2024-02-24T03:45:05.150+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:44:00+00:00, map_index=-1, run_start_date=2024-02-24 03:45:03.004658+00:00, run_end_date=2024-02-24 03:45:04.606705+00:00, run_duration=1.602047, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1120, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:45:00.264905+00:00, queued_by_job_id=2, pid=16333 2024-02-24T03:45:06.805909429Z [2024-02-24T03:45:06.805+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:45:06.805939380Z 2024-02-24T03:45:06.806173179Z [2024-02-24T03:45:06.805+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:45:06.806823420Z [2024-02-24T03:45:06.806+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:45:06.806834880Z 2024-02-24T03:45:06.809588125Z [2024-02-24T03:45:06.809+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T03:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T03:45:06.809958686Z [2024-02-24T03:45:06.809+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T03:45:06.856014055Z [2024-02-24T03:45:06.855+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T03:40:00+00:00 exited with status queued for try_number 1 2024-02-24T03:45:06.856074334Z [2024-02-24T03:45:06.855+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T03:40:00+00:00 exited with status success for try_number 1 2024-02-24T03:45:06.864084704Z [2024-02-24T03:45:06.863+0000] {scheduler_job.py:635} INFO - Setting external_id for to de9a91dc-3036-4dfa-bfa0-31b8f1d1e387 2024-02-24T03:45:06.864416011Z [2024-02-24T03:45:06.864+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T03:40:00+00:00, map_index=-1, run_start_date=2024-02-24 03:45:05.539305+00:00, run_end_date=2024-02-24 03:45:05.875546+00:00, run_duration=0.336241, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1121, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:45:03.810327+00:00, queued_by_job_id=2, pid=16351 2024-02-24T03:45:10.200292993Z [2024-02-24T03:45:10.199+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:45:10.200347286Z 2024-02-24T03:45:10.200417486Z [2024-02-24T03:45:10.200+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:45:10.201672147Z [2024-02-24T03:45:10.201+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:45:10.201688483Z 2024-02-24T03:45:10.206471188Z [2024-02-24T03:45:10.206+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:45:10.206897803Z [2024-02-24T03:45:10.206+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T03:45:10.288330086Z [2024-02-24T03:45:10.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T03:40:00+00:00 exited with status queued for try_number 1 2024-02-24T03:45:10.288607107Z [2024-02-24T03:45:10.288+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T03:40:00+00:00 exited with status success for try_number 1 2024-02-24T03:45:10.298922251Z [2024-02-24T03:45:10.298+0000] {scheduler_job.py:635} INFO - Setting external_id for to 94f84f53-6fb3-4d8d-a66f-ab27afe48198 2024-02-24T03:45:10.299065499Z [2024-02-24T03:45:10.298+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T03:40:00+00:00, map_index=0, run_start_date=2024-02-24 03:45:08.403257+00:00, run_end_date=2024-02-24 03:45:09.636725+00:00, run_duration=1.233468, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1122, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:45:06.807219+00:00, queued_by_job_id=2, pid=16359 2024-02-24T03:45:12.662341819Z [2024-02-24T03:45:12.661+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:45:12.662871827Z [2024-02-24T03:45:12.662+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:40:00+00:00, run_id=scheduled__2024-02-24T03:40:00+00:00, run_start_date=2024-02-24 03:45:00.157856+00:00, run_end_date=2024-02-24 03:45:12.662156+00:00, run_duration=12.5043, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:40:00+00:00, data_interval_end=2024-02-24 03:45:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T03:45:12.670350228Z [2024-02-24T03:45:12.669+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:45:00+00:00, run_after=2024-02-24T03:50:00+00:00 2024-02-24T03:45:12.704589459Z [2024-02-24T03:45:12.704+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T03:40:00+00:00 exited with status success for try_number 1 2024-02-24T03:45:12.711693656Z [2024-02-24T03:45:12.710+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T03:40:00+00:00, map_index=-1, run_start_date=2024-02-24 03:45:11.913217+00:00, run_end_date=2024-02-24 03:45:12.271901+00:00, run_duration=0.358684, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1123, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:45:10.202530+00:00, queued_by_job_id=2, pid=16372 2024-02-24T03:46:00.559610514Z [2024-02-24T03:46:00.559+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:46:00.581983212Z [2024-02-24T03:46:00.581+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:46:00+00:00, run_after=2024-02-24T03:47:00+00:00 2024-02-24T03:46:00.594247193Z [2024-02-24T03:46:00.593+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:46:00.611134412Z [2024-02-24T03:46:00.610+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:46:00+00:00, run_after=2024-02-24T03:47:00+00:00 2024-02-24T03:46:00.725824598Z [2024-02-24T03:46:00.725+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T03:46:00.725854500Z 2024-02-24T03:46:00.725860969Z 2024-02-24T03:46:00.725865893Z 2024-02-24T03:46:00.725870825Z 2024-02-24T03:46:00.725923689Z [2024-02-24T03:46:00.725+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T03:46:00.725955310Z [2024-02-24T03:46:00.725+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:46:00.726200757Z [2024-02-24T03:46:00.726+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:46:00.726285366Z [2024-02-24T03:46:00.726+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:46:00.726918416Z [2024-02-24T03:46:00.726+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:46:00.726942337Z 2024-02-24T03:46:00.726948130Z 2024-02-24T03:46:00.726952785Z 2024-02-24T03:46:00.726957601Z 2024-02-24T03:46:00.730910753Z [2024-02-24T03:46:00.730+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T03:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:46:00.731119893Z [2024-02-24T03:46:00.730+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T03:46:00.731530706Z [2024-02-24T03:46:00.731+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:46:00.731713328Z [2024-02-24T03:46:00.731+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:46:00.732016459Z [2024-02-24T03:46:00.731+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:46:00.732185799Z [2024-02-24T03:46:00.732+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:46:00.732549363Z [2024-02-24T03:46:00.732+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:46:00.732574476Z [2024-02-24T03:46:00.732+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:46:01.369351652Z [2024-02-24T03:46:01.368+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:44:00+00:00 exited with status queued for try_number 1 2024-02-24T03:46:01.369591136Z [2024-02-24T03:46:01.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:45:00+00:00 exited with status queued for try_number 1 2024-02-24T03:46:01.369891682Z [2024-02-24T03:46:01.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:45:00+00:00 exited with status queued for try_number 1 2024-02-24T03:46:01.370048168Z [2024-02-24T03:46:01.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:45:00+00:00 exited with status queued for try_number 1 2024-02-24T03:46:01.385505088Z [2024-02-24T03:46:01.385+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2e7e1dc7-9158-474f-b33b-e90ca715ad5b 2024-02-24T03:46:01.385740917Z [2024-02-24T03:46:01.385+0000] {scheduler_job.py:635} INFO - Setting external_id for to bedfd341-e6fa-4f9a-bb9b-b66381c517f9 2024-02-24T03:46:01.385965912Z [2024-02-24T03:46:01.385+0000] {scheduler_job.py:635} INFO - Setting external_id for to 305e75e7-fb5f-4b8a-bf2e-d659c443c647 2024-02-24T03:46:01.386145635Z [2024-02-24T03:46:01.386+0000] {scheduler_job.py:635} INFO - Setting external_id for to e77996ef-9530-4993-92ba-8f55348243cb 2024-02-24T03:46:03.032206276Z [2024-02-24T03:46:03.031+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:46:03.032680438Z [2024-02-24T03:46:03.032+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:45:00+00:00, run_id=scheduled__2024-02-24T03:45:00+00:00, run_start_date=2024-02-24 03:46:00.627859+00:00, run_end_date=2024-02-24 03:46:03.032302+00:00, run_duration=2.404443, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:45:00+00:00, data_interval_end=2024-02-24 03:46:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:46:03.044027532Z [2024-02-24T03:46:03.043+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:46:00+00:00, run_after=2024-02-24T03:47:00+00:00 2024-02-24T03:46:03.052891084Z [2024-02-24T03:46:03.052+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:46:03.053390303Z [2024-02-24T03:46:03.053+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 03:44:00+00:00, run_id=scheduled__2024-02-24T03:44:00+00:00, run_start_date=2024-02-24 03:46:00.626181+00:00, run_end_date=2024-02-24 03:46:03.053028+00:00, run_duration=2.426847, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:44:00+00:00, data_interval_end=2024-02-24 03:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T03:46:03.063113617Z [2024-02-24T03:46:03.062+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T03:46:00+00:00, run_after=2024-02-24T03:48:00+00:00 2024-02-24T03:46:03.147707764Z [2024-02-24T03:46:03.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:44:00+00:00 exited with status success for try_number 1 2024-02-24T03:46:03.147764480Z [2024-02-24T03:46:03.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:45:00+00:00 exited with status success for try_number 1 2024-02-24T03:46:03.158565096Z [2024-02-24T03:46:03.158+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:45:00+00:00, map_index=-1, run_start_date=2024-02-24 03:46:01.899447+00:00, run_end_date=2024-02-24 03:46:02.339710+00:00, run_duration=0.440263, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1124, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:46:00.727836+00:00, queued_by_job_id=2, pid=16396 2024-02-24T03:46:03.158894452Z [2024-02-24T03:46:03.158+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T03:44:00+00:00, map_index=-1, run_start_date=2024-02-24 03:46:02.195476+00:00, run_end_date=2024-02-24 03:46:02.741546+00:00, run_duration=0.54607, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1125, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:46:00.727836+00:00, queued_by_job_id=2, pid=16397 2024-02-24T03:46:05.301706744Z [2024-02-24T03:46:05.301+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:46:05.302031969Z [2024-02-24T03:46:05.301+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:45:00+00:00, run_id=scheduled__2024-02-24T03:45:00+00:00, run_start_date=2024-02-24 03:46:00.629632+00:00, run_end_date=2024-02-24 03:46:05.301673+00:00, run_duration=4.672041, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:45:00+00:00, data_interval_end=2024-02-24 03:46:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:46:05.310828194Z [2024-02-24T03:46:05.310+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:46:00+00:00, run_after=2024-02-24T03:47:00+00:00 2024-02-24T03:46:05.357921364Z [2024-02-24T03:46:05.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:45:00+00:00 exited with status success for try_number 1 2024-02-24T03:46:05.365650823Z [2024-02-24T03:46:05.365+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:45:00+00:00, map_index=-1, run_start_date=2024-02-24 03:46:03.412399+00:00, run_end_date=2024-02-24 03:46:05.002764+00:00, run_duration=1.590365, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1126, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:46:00.727836+00:00, queued_by_job_id=2, pid=16420 2024-02-24T03:46:06.410967829Z [2024-02-24T03:46:06.410+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:46:06.411160725Z [2024-02-24T03:46:06.410+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:45:00+00:00, run_id=scheduled__2024-02-24T03:45:00+00:00, run_start_date=2024-02-24 03:46:00.631184+00:00, run_end_date=2024-02-24 03:46:06.410826+00:00, run_duration=5.779642, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:45:00+00:00, data_interval_end=2024-02-24 03:46:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:46:06.420472354Z [2024-02-24T03:46:06.419+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:46:00+00:00, run_after=2024-02-24T03:47:00+00:00 2024-02-24T03:46:06.450915208Z [2024-02-24T03:46:06.450+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:45:00+00:00 exited with status success for try_number 1 2024-02-24T03:46:06.458125141Z [2024-02-24T03:46:06.457+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:45:00+00:00, map_index=-1, run_start_date=2024-02-24 03:46:03.607788+00:00, run_end_date=2024-02-24 03:46:05.943660+00:00, run_duration=2.335872, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1127, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:46:00.727836+00:00, queued_by_job_id=2, pid=16421 2024-02-24T03:47:00.251978018Z [2024-02-24T03:47:00.251+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:47:00+00:00, run_after=2024-02-24T03:48:00+00:00 2024-02-24T03:47:00.267687644Z [2024-02-24T03:47:00.267+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:47:00+00:00, run_after=2024-02-24T03:48:00+00:00 2024-02-24T03:47:00.273738536Z [2024-02-24T03:47:00.273+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:47:00.329073390Z [2024-02-24T03:47:00.328+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T03:47:00.329103736Z 2024-02-24T03:47:00.329107852Z 2024-02-24T03:47:00.329111456Z 2024-02-24T03:47:00.329168502Z [2024-02-24T03:47:00.329+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:47:00.329366445Z [2024-02-24T03:47:00.329+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:47:00.329526940Z [2024-02-24T03:47:00.329+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:47:00.330238827Z [2024-02-24T03:47:00.330+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:47:00.330250008Z 2024-02-24T03:47:00.330253662Z 2024-02-24T03:47:00.330256937Z 2024-02-24T03:47:00.333456427Z [2024-02-24T03:47:00.333+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:47:00.333635168Z [2024-02-24T03:47:00.333+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:47:00.334226030Z [2024-02-24T03:47:00.334+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:47:00.334434918Z [2024-02-24T03:47:00.334+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:47:00.334632220Z [2024-02-24T03:47:00.334+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:47:00.334786936Z [2024-02-24T03:47:00.334+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:47:00.513018138Z [2024-02-24T03:47:00.512+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:46:00+00:00 exited with status queued for try_number 1 2024-02-24T03:47:00.513137845Z [2024-02-24T03:47:00.512+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:46:00+00:00 exited with status queued for try_number 1 2024-02-24T03:47:00.513291130Z [2024-02-24T03:47:00.513+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:46:00+00:00 exited with status queued for try_number 1 2024-02-24T03:47:00.522738936Z [2024-02-24T03:47:00.522+0000] {scheduler_job.py:635} INFO - Setting external_id for to 257e0682-2ed8-4e21-a9b8-f30b02a89f42 2024-02-24T03:47:00.522917920Z [2024-02-24T03:47:00.522+0000] {scheduler_job.py:635} INFO - Setting external_id for to def38017-28d8-4a3d-9437-17efeb24298d 2024-02-24T03:47:00.523066001Z [2024-02-24T03:47:00.522+0000] {scheduler_job.py:635} INFO - Setting external_id for to b992cca1-b8dd-4e8f-8b84-f2812d9b5aac 2024-02-24T03:47:01.656595948Z [2024-02-24T03:47:01.656+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:47:01.657126801Z [2024-02-24T03:47:01.656+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:46:00+00:00, run_id=scheduled__2024-02-24T03:46:00+00:00, run_start_date=2024-02-24 03:47:00.283021+00:00, run_end_date=2024-02-24 03:47:01.656704+00:00, run_duration=1.373683, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:46:00+00:00, data_interval_end=2024-02-24 03:47:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:47:01.668756518Z [2024-02-24T03:47:01.668+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:47:00+00:00, run_after=2024-02-24T03:48:00+00:00 2024-02-24T03:47:02.209357068Z [2024-02-24T03:47:02.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:46:00+00:00 exited with status success for try_number 1 2024-02-24T03:47:02.233665419Z [2024-02-24T03:47:02.233+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:46:00+00:00, map_index=-1, run_start_date=2024-02-24 03:47:01.110181+00:00, run_end_date=2024-02-24 03:47:01.574965+00:00, run_duration=0.464784, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1128, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:47:00.330840+00:00, queued_by_job_id=2, pid=16453 2024-02-24T03:47:04.413562737Z [2024-02-24T03:47:04.412+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:47:04.414446432Z [2024-02-24T03:47:04.414+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:46:00+00:00, run_id=scheduled__2024-02-24T03:46:00+00:00, run_start_date=2024-02-24 03:47:00.285069+00:00, run_end_date=2024-02-24 03:47:04.413852+00:00, run_duration=4.128783, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:46:00+00:00, data_interval_end=2024-02-24 03:47:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:47:04.430860828Z [2024-02-24T03:47:04.430+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:47:00+00:00, run_after=2024-02-24T03:48:00+00:00 2024-02-24T03:47:04.443867667Z [2024-02-24T03:47:04.443+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:47:04.444593235Z [2024-02-24T03:47:04.444+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:46:00+00:00, run_id=scheduled__2024-02-24T03:46:00+00:00, run_start_date=2024-02-24 03:47:00.284113+00:00, run_end_date=2024-02-24 03:47:04.443660+00:00, run_duration=4.159547, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:46:00+00:00, data_interval_end=2024-02-24 03:47:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:47:04.462530302Z [2024-02-24T03:47:04.461+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:47:00+00:00, run_after=2024-02-24T03:48:00+00:00 2024-02-24T03:47:04.510021010Z [2024-02-24T03:47:04.508+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:46:00+00:00 exited with status success for try_number 1 2024-02-24T03:47:04.510072008Z [2024-02-24T03:47:04.509+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:46:00+00:00 exited with status success for try_number 1 2024-02-24T03:47:04.519154500Z [2024-02-24T03:47:04.518+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:46:00+00:00, map_index=-1, run_start_date=2024-02-24 03:47:02.134607+00:00, run_end_date=2024-02-24 03:47:03.509320+00:00, run_duration=1.374713, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1129, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:47:00.330840+00:00, queued_by_job_id=2, pid=16471 2024-02-24T03:47:04.519709929Z [2024-02-24T03:47:04.519+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:46:00+00:00, map_index=-1, run_start_date=2024-02-24 03:47:02.180403+00:00, run_end_date=2024-02-24 03:47:04.287242+00:00, run_duration=2.106839, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1130, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:47:00.330840+00:00, queued_by_job_id=2, pid=16472 2024-02-24T03:47:05.818072199Z [2024-02-24T03:47:05.817+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T03:48:00.085303569Z [2024-02-24T03:48:00.084+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:48:00+00:00, run_after=2024-02-24T03:49:00+00:00 2024-02-24T03:48:00.092829660Z [2024-02-24T03:48:00.092+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:48:00.102010403Z [2024-02-24T03:48:00.101+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:48:00.116393518Z [2024-02-24T03:48:00.116+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:48:00+00:00, run_after=2024-02-24T03:49:00+00:00 2024-02-24T03:48:00.225473459Z [2024-02-24T03:48:00.225+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T03:48:00.225492312Z 2024-02-24T03:48:00.225508180Z 2024-02-24T03:48:00.225524953Z 2024-02-24T03:48:00.225528273Z 2024-02-24T03:48:00.226190372Z [2024-02-24T03:48:00.225+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T03:48:00.226768512Z [2024-02-24T03:48:00.226+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:48:00.227140232Z [2024-02-24T03:48:00.226+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:48:00.227432573Z [2024-02-24T03:48:00.227+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:48:00.228648095Z [2024-02-24T03:48:00.228+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:48:00.228658347Z 2024-02-24T03:48:00.228661863Z 2024-02-24T03:48:00.228665106Z 2024-02-24T03:48:00.228668082Z 2024-02-24T03:48:00.234390236Z [2024-02-24T03:48:00.234+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T03:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:48:00.234612618Z [2024-02-24T03:48:00.234+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T03:48:00.235008884Z [2024-02-24T03:48:00.234+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:48:00.235213978Z [2024-02-24T03:48:00.235+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:48:00.235615639Z [2024-02-24T03:48:00.235+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:48:00.235861549Z [2024-02-24T03:48:00.235+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:48:00.236143253Z [2024-02-24T03:48:00.235+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:48:00.236297612Z [2024-02-24T03:48:00.236+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:48:00.614978407Z [2024-02-24T03:48:00.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:46:00+00:00 exited with status queued for try_number 1 2024-02-24T03:48:00.615128433Z [2024-02-24T03:48:00.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:47:00+00:00 exited with status queued for try_number 1 2024-02-24T03:48:00.615248245Z [2024-02-24T03:48:00.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:47:00+00:00 exited with status queued for try_number 1 2024-02-24T03:48:00.615382008Z [2024-02-24T03:48:00.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:47:00+00:00 exited with status queued for try_number 1 2024-02-24T03:48:00.643202813Z [2024-02-24T03:48:00.642+0000] {scheduler_job.py:635} INFO - Setting external_id for to ebb2b735-487a-474f-bb9d-aa10c61be097 2024-02-24T03:48:00.647795778Z [2024-02-24T03:48:00.647+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1435dea5-6e69-41ca-843d-e09caaa729f0 2024-02-24T03:48:00.648074178Z [2024-02-24T03:48:00.647+0000] {scheduler_job.py:635} INFO - Setting external_id for to d95af5f8-ab31-42b0-9a57-882abd1c1480 2024-02-24T03:48:00.648239505Z [2024-02-24T03:48:00.648+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e1d6af4-81f9-45df-9bd4-1161a959a34f 2024-02-24T03:48:02.033316017Z [2024-02-24T03:48:02.032+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:48:02.033535639Z [2024-02-24T03:48:02.033+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:47:00+00:00, run_id=scheduled__2024-02-24T03:47:00+00:00, run_start_date=2024-02-24 03:48:00.135084+00:00, run_end_date=2024-02-24 03:48:02.033186+00:00, run_duration=1.898102, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:47:00+00:00, data_interval_end=2024-02-24 03:48:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:48:02.079503647Z [2024-02-24T03:48:02.079+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:48:00+00:00, run_after=2024-02-24T03:49:00+00:00 2024-02-24T03:48:02.206922407Z [2024-02-24T03:48:02.206+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:47:00+00:00 exited with status success for try_number 1 2024-02-24T03:48:02.215160213Z [2024-02-24T03:48:02.214+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:47:00+00:00, map_index=-1, run_start_date=2024-02-24 03:48:01.229152+00:00, run_end_date=2024-02-24 03:48:01.795892+00:00, run_duration=0.56674, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1131, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:48:00.230474+00:00, queued_by_job_id=2, pid=16505 2024-02-24T03:48:02.515741808Z [2024-02-24T03:48:02.515+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:48:02.516145521Z [2024-02-24T03:48:02.515+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 03:46:00+00:00, run_id=scheduled__2024-02-24T03:46:00+00:00, run_start_date=2024-02-24 03:48:00.133705+00:00, run_end_date=2024-02-24 03:48:02.515748+00:00, run_duration=2.382043, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:46:00+00:00, data_interval_end=2024-02-24 03:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T03:48:02.527849398Z [2024-02-24T03:48:02.527+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T03:48:00+00:00, run_after=2024-02-24T03:50:00+00:00 2024-02-24T03:48:03.132189009Z [2024-02-24T03:48:03.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:46:00+00:00 exited with status success for try_number 1 2024-02-24T03:48:03.144915489Z [2024-02-24T03:48:03.144+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T03:46:00+00:00, map_index=-1, run_start_date=2024-02-24 03:48:01.953461+00:00, run_end_date=2024-02-24 03:48:02.455753+00:00, run_duration=0.502292, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1132, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:48:00.230474+00:00, queued_by_job_id=2, pid=16512 2024-02-24T03:48:05.299905035Z [2024-02-24T03:48:05.299+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:48:05.300246393Z [2024-02-24T03:48:05.299+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:47:00+00:00, run_id=scheduled__2024-02-24T03:47:00+00:00, run_start_date=2024-02-24 03:48:00.137525+00:00, run_end_date=2024-02-24 03:48:05.299723+00:00, run_duration=5.162198, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:47:00+00:00, data_interval_end=2024-02-24 03:48:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:48:05.313357859Z [2024-02-24T03:48:05.312+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:48:00+00:00, run_after=2024-02-24T03:49:00+00:00 2024-02-24T03:48:05.374418436Z [2024-02-24T03:48:05.373+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:47:00+00:00 exited with status success for try_number 1 2024-02-24T03:48:05.382105489Z [2024-02-24T03:48:05.381+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:47:00+00:00, map_index=-1, run_start_date=2024-02-24 03:48:03.193334+00:00, run_end_date=2024-02-24 03:48:05.101304+00:00, run_duration=1.90797, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1133, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:48:00.230474+00:00, queued_by_job_id=2, pid=16524 2024-02-24T03:48:06.426847663Z [2024-02-24T03:48:06.426+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:48:06.428470332Z [2024-02-24T03:48:06.427+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:47:00+00:00, run_id=scheduled__2024-02-24T03:47:00+00:00, run_start_date=2024-02-24 03:48:00.136260+00:00, run_end_date=2024-02-24 03:48:06.427789+00:00, run_duration=6.291529, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:47:00+00:00, data_interval_end=2024-02-24 03:48:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:48:06.441302827Z [2024-02-24T03:48:06.440+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:48:00+00:00, run_after=2024-02-24T03:49:00+00:00 2024-02-24T03:48:06.477232553Z [2024-02-24T03:48:06.476+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:47:00+00:00 exited with status success for try_number 1 2024-02-24T03:48:06.482984106Z [2024-02-24T03:48:06.482+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:47:00+00:00, map_index=-1, run_start_date=2024-02-24 03:48:03.701754+00:00, run_end_date=2024-02-24 03:48:05.417282+00:00, run_duration=1.715528, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1134, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:48:00.230474+00:00, queued_by_job_id=2, pid=16535 2024-02-24T03:49:00.046128569Z [2024-02-24T03:49:00.045+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:49:00.064310802Z [2024-02-24T03:49:00.063+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:49:00+00:00, run_after=2024-02-24T03:50:00+00:00 2024-02-24T03:49:00.076974741Z [2024-02-24T03:49:00.076+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:49:00+00:00, run_after=2024-02-24T03:50:00+00:00 2024-02-24T03:49:00.159219399Z [2024-02-24T03:49:00.158+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T03:49:00.159269635Z 2024-02-24T03:49:00.159275722Z 2024-02-24T03:49:00.159298603Z 2024-02-24T03:49:00.159579072Z [2024-02-24T03:49:00.159+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:49:00.159854032Z [2024-02-24T03:49:00.159+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:49:00.160216697Z [2024-02-24T03:49:00.159+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:49:00.161015098Z [2024-02-24T03:49:00.160+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:49:00.161037825Z 2024-02-24T03:49:00.161046953Z 2024-02-24T03:49:00.161055400Z 2024-02-24T03:49:00.165991828Z [2024-02-24T03:49:00.165+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:49:00.166199511Z [2024-02-24T03:49:00.165+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:49:00.166646399Z [2024-02-24T03:49:00.166+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:49:00.166906341Z [2024-02-24T03:49:00.166+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:49:00.167310743Z [2024-02-24T03:49:00.167+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:49:00.167595024Z [2024-02-24T03:49:00.167+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:49:00.449202879Z [2024-02-24T03:49:00.448+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:48:00+00:00 exited with status queued for try_number 1 2024-02-24T03:49:00.449417865Z [2024-02-24T03:49:00.449+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:48:00+00:00 exited with status queued for try_number 1 2024-02-24T03:49:00.449619023Z [2024-02-24T03:49:00.449+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:48:00+00:00 exited with status queued for try_number 1 2024-02-24T03:49:00.457106142Z [2024-02-24T03:49:00.456+0000] {scheduler_job.py:635} INFO - Setting external_id for to 649d8d4f-8a94-46f1-b9c5-869ebd293867 2024-02-24T03:49:00.457326677Z [2024-02-24T03:49:00.457+0000] {scheduler_job.py:635} INFO - Setting external_id for to f3737c51-7546-47e4-89a8-14cf44593f11 2024-02-24T03:49:00.457525373Z [2024-02-24T03:49:00.457+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff6853b7-ea09-4356-9fa4-e4ec937d4dc1 2024-02-24T03:49:01.601895555Z [2024-02-24T03:49:01.601+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:49:01.602504447Z [2024-02-24T03:49:01.602+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:48:00+00:00, run_id=scheduled__2024-02-24T03:48:00+00:00, run_start_date=2024-02-24 03:49:00.086602+00:00, run_end_date=2024-02-24 03:49:01.602098+00:00, run_duration=1.515496, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:48:00+00:00, data_interval_end=2024-02-24 03:49:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:49:01.613605787Z [2024-02-24T03:49:01.613+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:49:00+00:00, run_after=2024-02-24T03:50:00+00:00 2024-02-24T03:49:01.674601386Z [2024-02-24T03:49:01.674+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:48:00+00:00 exited with status success for try_number 1 2024-02-24T03:49:01.686943773Z [2024-02-24T03:49:01.686+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:48:00+00:00, map_index=-1, run_start_date=2024-02-24 03:49:00.975125+00:00, run_end_date=2024-02-24 03:49:01.432033+00:00, run_duration=0.456908, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1135, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:49:00.162081+00:00, queued_by_job_id=2, pid=16563 2024-02-24T03:49:04.056918790Z [2024-02-24T03:49:04.056+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:49:04.057388639Z [2024-02-24T03:49:04.056+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:48:00+00:00, run_id=scheduled__2024-02-24T03:48:00+00:00, run_start_date=2024-02-24 03:49:00.087671+00:00, run_end_date=2024-02-24 03:49:04.056662+00:00, run_duration=3.968991, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:48:00+00:00, data_interval_end=2024-02-24 03:49:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:49:04.066248556Z [2024-02-24T03:49:04.065+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:49:00+00:00, run_after=2024-02-24T03:50:00+00:00 2024-02-24T03:49:04.073754608Z [2024-02-24T03:49:04.073+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:49:04.074075278Z [2024-02-24T03:49:04.073+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:48:00+00:00, run_id=scheduled__2024-02-24T03:48:00+00:00, run_start_date=2024-02-24 03:49:00.088644+00:00, run_end_date=2024-02-24 03:49:04.073567+00:00, run_duration=3.984923, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:48:00+00:00, data_interval_end=2024-02-24 03:49:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:49:04.085117930Z [2024-02-24T03:49:04.084+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:49:00+00:00, run_after=2024-02-24T03:50:00+00:00 2024-02-24T03:49:04.123947453Z [2024-02-24T03:49:04.123+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:48:00+00:00 exited with status success for try_number 1 2024-02-24T03:49:04.124447607Z [2024-02-24T03:49:04.124+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:48:00+00:00 exited with status success for try_number 1 2024-02-24T03:49:04.134032652Z [2024-02-24T03:49:04.133+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:48:00+00:00, map_index=-1, run_start_date=2024-02-24 03:49:01.998796+00:00, run_end_date=2024-02-24 03:49:03.293606+00:00, run_duration=1.29481, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1137, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:49:00.162081+00:00, queued_by_job_id=2, pid=16582 2024-02-24T03:49:04.134654251Z [2024-02-24T03:49:04.134+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:48:00+00:00, map_index=-1, run_start_date=2024-02-24 03:49:01.942774+00:00, run_end_date=2024-02-24 03:49:03.688975+00:00, run_duration=1.746201, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1136, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:49:00.162081+00:00, queued_by_job_id=2, pid=16581 2024-02-24T03:50:01.024590308Z [2024-02-24T03:50:01.024+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:50:00+00:00, run_after=2024-02-24T03:51:00+00:00 2024-02-24T03:50:01.048293542Z [2024-02-24T03:50:01.047+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:50:00+00:00, run_after=2024-02-24T03:55:00+00:00 2024-02-24T03:50:01.060666488Z [2024-02-24T03:50:01.060+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:50:01.072925062Z [2024-02-24T03:50:01.072+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:50:01.093073210Z [2024-02-24T03:50:01.092+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:50:00+00:00, run_after=2024-02-24T03:51:00+00:00 2024-02-24T03:50:01.253913248Z [2024-02-24T03:50:01.252+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-02-24T03:50:01.253945844Z 2024-02-24T03:50:01.253976336Z 2024-02-24T03:50:01.254002913Z 2024-02-24T03:50:01.254009491Z 2024-02-24T03:50:01.254015414Z 2024-02-24T03:50:01.254021701Z [2024-02-24T03:50:01.253+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:50:01.254028474Z [2024-02-24T03:50:01.253+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T03:50:01.254034890Z [2024-02-24T03:50:01.253+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:50:01.254041155Z [2024-02-24T03:50:01.253+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:50:01.254667063Z [2024-02-24T03:50:01.253+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:50:01.254905429Z [2024-02-24T03:50:01.254+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:50:01.254913624Z 2024-02-24T03:50:01.254917679Z 2024-02-24T03:50:01.254920971Z 2024-02-24T03:50:01.254924200Z 2024-02-24T03:50:01.254927327Z 2024-02-24T03:50:01.266256206Z [2024-02-24T03:50:01.260+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T03:50:01.266278899Z [2024-02-24T03:50:01.260+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T03:50:01.266295882Z [2024-02-24T03:50:01.261+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T03:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:50:01.266304868Z [2024-02-24T03:50:01.261+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T03:50:01.266309337Z [2024-02-24T03:50:01.261+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:50:01.266313429Z [2024-02-24T03:50:01.261+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:50:01.266317395Z [2024-02-24T03:50:01.261+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:50:01.266321647Z [2024-02-24T03:50:01.261+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:50:01.266325630Z [2024-02-24T03:50:01.262+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:50:01.266330032Z [2024-02-24T03:50:01.262+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:50:01.733481549Z [2024-02-24T03:50:01.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T03:45:00+00:00 exited with status queued for try_number 1 2024-02-24T03:50:01.733583121Z [2024-02-24T03:50:01.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:48:00+00:00 exited with status queued for try_number 1 2024-02-24T03:50:01.733766015Z [2024-02-24T03:50:01.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:49:00+00:00 exited with status queued for try_number 1 2024-02-24T03:50:01.733949278Z [2024-02-24T03:50:01.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:49:00+00:00 exited with status queued for try_number 1 2024-02-24T03:50:01.734247727Z [2024-02-24T03:50:01.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:49:00+00:00 exited with status queued for try_number 1 2024-02-24T03:50:01.758021177Z [2024-02-24T03:50:01.757+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2a51a5ef-0b99-4dcb-948e-efb792027fb5 2024-02-24T03:50:01.758233155Z [2024-02-24T03:50:01.758+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9ae09a9e-6a7c-40db-a5b5-b9e057b7b235 2024-02-24T03:50:01.758412320Z [2024-02-24T03:50:01.758+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5618471a-27a5-414e-8a72-1dba4ff7696a 2024-02-24T03:50:01.758585656Z [2024-02-24T03:50:01.758+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a9097fa-b148-4494-b553-4ac3c32422bb 2024-02-24T03:50:01.758770938Z [2024-02-24T03:50:01.758+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ffc5f60-a234-4a52-9fd9-2f6655bf68a8 2024-02-24T03:50:03.059968074Z [2024-02-24T03:50:03.059+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:50:03.060482630Z [2024-02-24T03:50:03.060+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:49:00+00:00, run_id=scheduled__2024-02-24T03:49:00+00:00, run_start_date=2024-02-24 03:50:01.122172+00:00, run_end_date=2024-02-24 03:50:03.060113+00:00, run_duration=1.937941, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:49:00+00:00, data_interval_end=2024-02-24 03:50:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:50:03.070884808Z [2024-02-24T03:50:03.070+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:50:00+00:00, run_after=2024-02-24T03:51:00+00:00 2024-02-24T03:50:03.160947550Z [2024-02-24T03:50:03.160+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:49:00+00:00 exited with status success for try_number 1 2024-02-24T03:50:03.175249675Z [2024-02-24T03:50:03.174+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:49:00+00:00, map_index=-1, run_start_date=2024-02-24 03:50:02.139169+00:00, run_end_date=2024-02-24 03:50:02.667009+00:00, run_duration=0.52784, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1138, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:50:01.255961+00:00, queued_by_job_id=2, pid=16616 2024-02-24T03:50:03.474295414Z [2024-02-24T03:50:03.473+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:50:03.474646209Z [2024-02-24T03:50:03.474+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 03:48:00+00:00, run_id=scheduled__2024-02-24T03:48:00+00:00, run_start_date=2024-02-24 03:50:01.119728+00:00, run_end_date=2024-02-24 03:50:03.474269+00:00, run_duration=2.354541, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:48:00+00:00, data_interval_end=2024-02-24 03:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T03:50:03.482690389Z [2024-02-24T03:50:03.482+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T03:50:00+00:00, run_after=2024-02-24T03:52:00+00:00 2024-02-24T03:50:03.558368457Z [2024-02-24T03:50:03.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:48:00+00:00 exited with status success for try_number 1 2024-02-24T03:50:03.569190211Z [2024-02-24T03:50:03.567+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T03:48:00+00:00, map_index=-1, run_start_date=2024-02-24 03:50:02.413087+00:00, run_end_date=2024-02-24 03:50:03.041170+00:00, run_duration=0.628083, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1139, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:50:01.255961+00:00, queued_by_job_id=2, pid=16617 2024-02-24T03:50:04.700764401Z [2024-02-24T03:50:04.700+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:50:04.700792489Z 2024-02-24T03:50:04.701104563Z [2024-02-24T03:50:04.700+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:50:04.701992646Z [2024-02-24T03:50:04.701+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:50:04.702009999Z 2024-02-24T03:50:04.705191721Z [2024-02-24T03:50:04.704+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T03:50:04.705470467Z [2024-02-24T03:50:04.705+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T03:50:04.766635659Z [2024-02-24T03:50:04.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T03:45:00+00:00 exited with status queued for try_number 1 2024-02-24T03:50:04.766747244Z [2024-02-24T03:50:04.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T03:45:00+00:00 exited with status success for try_number 1 2024-02-24T03:50:04.774346596Z [2024-02-24T03:50:04.773+0000] {scheduler_job.py:635} INFO - Setting external_id for to fcf8b356-d9da-416d-97e3-2577fe83beef 2024-02-24T03:50:04.774517532Z [2024-02-24T03:50:04.774+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T03:45:00+00:00, map_index=-1, run_start_date=2024-02-24 03:50:03.769411+00:00, run_end_date=2024-02-24 03:50:04.234706+00:00, run_duration=0.465295, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1141, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:50:01.255961+00:00, queued_by_job_id=2, pid=16646 2024-02-24T03:50:06.389300330Z [2024-02-24T03:50:06.388+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:50:06.389733803Z [2024-02-24T03:50:06.389+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:49:00+00:00, run_id=scheduled__2024-02-24T03:49:00+00:00, run_start_date=2024-02-24 03:50:01.124568+00:00, run_end_date=2024-02-24 03:50:06.389412+00:00, run_duration=5.264844, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:49:00+00:00, data_interval_end=2024-02-24 03:50:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:50:06.400034281Z [2024-02-24T03:50:06.399+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:50:00+00:00, run_after=2024-02-24T03:51:00+00:00 2024-02-24T03:50:06.408275231Z [2024-02-24T03:50:06.407+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:50:06.408687391Z [2024-02-24T03:50:06.408+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:49:00+00:00, run_id=scheduled__2024-02-24T03:49:00+00:00, run_start_date=2024-02-24 03:50:01.127302+00:00, run_end_date=2024-02-24 03:50:06.408366+00:00, run_duration=5.281064, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:49:00+00:00, data_interval_end=2024-02-24 03:50:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:50:06.417843445Z [2024-02-24T03:50:06.417+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:50:00+00:00, run_after=2024-02-24T03:51:00+00:00 2024-02-24T03:50:06.462724464Z [2024-02-24T03:50:06.462+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:49:00+00:00 exited with status success for try_number 1 2024-02-24T03:50:06.463064407Z [2024-02-24T03:50:06.462+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:49:00+00:00 exited with status success for try_number 1 2024-02-24T03:50:06.470341842Z [2024-02-24T03:50:06.470+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:49:00+00:00, map_index=-1, run_start_date=2024-02-24 03:50:03.775823+00:00, run_end_date=2024-02-24 03:50:05.416537+00:00, run_duration=1.640714, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1140, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:50:01.255961+00:00, queued_by_job_id=2, pid=16647 2024-02-24T03:50:06.470708903Z [2024-02-24T03:50:06.470+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:49:00+00:00, map_index=-1, run_start_date=2024-02-24 03:50:03.795004+00:00, run_end_date=2024-02-24 03:50:05.586692+00:00, run_duration=1.791688, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1142, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:50:01.255961+00:00, queued_by_job_id=2, pid=16648 2024-02-24T03:50:07.549340078Z [2024-02-24T03:50:07.548+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:50:07.549403215Z 2024-02-24T03:50:07.549431774Z [2024-02-24T03:50:07.549+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:50:07.550231442Z [2024-02-24T03:50:07.549+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:50:07.550245152Z 2024-02-24T03:50:07.553549170Z [2024-02-24T03:50:07.553+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T03:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T03:50:07.553572037Z [2024-02-24T03:50:07.553+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T03:50:07.616299784Z [2024-02-24T03:50:07.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T03:45:00+00:00 exited with status queued for try_number 1 2024-02-24T03:50:07.616619889Z [2024-02-24T03:50:07.616+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T03:45:00+00:00 exited with status success for try_number 1 2024-02-24T03:50:07.625952007Z [2024-02-24T03:50:07.625+0000] {scheduler_job.py:635} INFO - Setting external_id for to 342dd8ee-5bb1-4c39-b014-bdeda9c1a580 2024-02-24T03:50:07.626125069Z [2024-02-24T03:50:07.625+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T03:45:00+00:00, map_index=-1, run_start_date=2024-02-24 03:50:06.312270+00:00, run_end_date=2024-02-24 03:50:06.682299+00:00, run_duration=0.370029, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1143, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:50:04.702639+00:00, queued_by_job_id=2, pid=16671 2024-02-24T03:50:11.323101066Z [2024-02-24T03:50:11.322+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:50:11.323162755Z 2024-02-24T03:50:11.323309717Z [2024-02-24T03:50:11.322+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:50:11.324223497Z [2024-02-24T03:50:11.324+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:50:11.324237567Z 2024-02-24T03:50:11.326644017Z [2024-02-24T03:50:11.326+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:50:11.326959428Z [2024-02-24T03:50:11.326+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T03:50:11.388250113Z [2024-02-24T03:50:11.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T03:45:00+00:00 exited with status queued for try_number 1 2024-02-24T03:50:11.388667181Z [2024-02-24T03:50:11.388+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T03:45:00+00:00 exited with status success for try_number 1 2024-02-24T03:50:11.397899987Z [2024-02-24T03:50:11.397+0000] {scheduler_job.py:635} INFO - Setting external_id for to 89bf9568-a390-4b20-a25c-d53af23fec09 2024-02-24T03:50:11.398310708Z [2024-02-24T03:50:11.398+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T03:45:00+00:00, map_index=0, run_start_date=2024-02-24 03:50:09.151160+00:00, run_end_date=2024-02-24 03:50:10.430115+00:00, run_duration=1.278955, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1144, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:50:07.550834+00:00, queued_by_job_id=2, pid=16679 2024-02-24T03:50:13.614882841Z [2024-02-24T03:50:13.614+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:50:13.615140904Z [2024-02-24T03:50:13.614+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:45:00+00:00, run_id=scheduled__2024-02-24T03:45:00+00:00, run_start_date=2024-02-24 03:50:01.116591+00:00, run_end_date=2024-02-24 03:50:13.614742+00:00, run_duration=12.498151, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:45:00+00:00, data_interval_end=2024-02-24 03:50:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T03:50:13.620977047Z [2024-02-24T03:50:13.620+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:50:00+00:00, run_after=2024-02-24T03:55:00+00:00 2024-02-24T03:50:13.654433243Z [2024-02-24T03:50:13.654+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T03:45:00+00:00 exited with status success for try_number 1 2024-02-24T03:50:13.661953099Z [2024-02-24T03:50:13.661+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T03:45:00+00:00, map_index=-1, run_start_date=2024-02-24 03:50:12.994904+00:00, run_end_date=2024-02-24 03:50:13.390791+00:00, run_duration=0.395887, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1145, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:50:11.324582+00:00, queued_by_job_id=2, pid=16692 2024-02-24T03:51:00.315243581Z [2024-02-24T03:51:00.314+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:51:00+00:00, run_after=2024-02-24T03:52:00+00:00 2024-02-24T03:51:00.323695102Z [2024-02-24T03:51:00.323+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:51:00.340698620Z [2024-02-24T03:51:00.340+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:51:00+00:00, run_after=2024-02-24T03:52:00+00:00 2024-02-24T03:51:00.402674552Z [2024-02-24T03:51:00.402+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T03:51:00.402704651Z 2024-02-24T03:51:00.402710864Z 2024-02-24T03:51:00.402721654Z 2024-02-24T03:51:00.402873048Z [2024-02-24T03:51:00.402+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:51:00.403103229Z [2024-02-24T03:51:00.402+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:51:00.403331049Z [2024-02-24T03:51:00.403+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:51:00.403971969Z [2024-02-24T03:51:00.403+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:51:00.403986218Z 2024-02-24T03:51:00.403991738Z 2024-02-24T03:51:00.404016974Z 2024-02-24T03:51:00.407375418Z [2024-02-24T03:51:00.407+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:51:00.407623469Z [2024-02-24T03:51:00.407+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:51:00.408095482Z [2024-02-24T03:51:00.407+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:51:00.408355620Z [2024-02-24T03:51:00.408+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:51:00.408792981Z [2024-02-24T03:51:00.408+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:51:00.409036098Z [2024-02-24T03:51:00.408+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:51:00.687494597Z [2024-02-24T03:51:00.686+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:50:00+00:00 exited with status queued for try_number 1 2024-02-24T03:51:00.687821620Z [2024-02-24T03:51:00.687+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:50:00+00:00 exited with status queued for try_number 1 2024-02-24T03:51:00.688072203Z [2024-02-24T03:51:00.687+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:50:00+00:00 exited with status queued for try_number 1 2024-02-24T03:51:00.698399686Z [2024-02-24T03:51:00.698+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15e2a8d8-c392-46a7-a9c1-653eb3676a09 2024-02-24T03:51:00.698603023Z [2024-02-24T03:51:00.698+0000] {scheduler_job.py:635} INFO - Setting external_id for to be2c0fcd-067b-490d-8402-154a54a65224 2024-02-24T03:51:00.698790075Z [2024-02-24T03:51:00.698+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1874a01a-37a2-42dd-a556-2ac2e0d10ac6 2024-02-24T03:51:02.292963423Z [2024-02-24T03:51:02.292+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:51:02.293909951Z [2024-02-24T03:51:02.293+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:50:00+00:00, run_id=scheduled__2024-02-24T03:50:00+00:00, run_start_date=2024-02-24 03:51:00.350489+00:00, run_end_date=2024-02-24 03:51:02.292875+00:00, run_duration=1.942386, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:50:00+00:00, data_interval_end=2024-02-24 03:51:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:51:02.311180730Z [2024-02-24T03:51:02.309+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:51:00+00:00, run_after=2024-02-24T03:52:00+00:00 2024-02-24T03:51:02.391501930Z [2024-02-24T03:51:02.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:50:00+00:00 exited with status success for try_number 1 2024-02-24T03:51:02.393581198Z [2024-02-24T03:51:02.393+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:50:00+00:00, map_index=-1, run_start_date=2024-02-24 03:51:01.287607+00:00, run_end_date=2024-02-24 03:51:01.722545+00:00, run_duration=0.434938, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1146, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:51:00.404695+00:00, queued_by_job_id=2, pid=16715 2024-02-24T03:51:04.019914905Z [2024-02-24T03:51:04.019+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:51:04.020318959Z [2024-02-24T03:51:04.019+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:50:00+00:00, run_id=scheduled__2024-02-24T03:50:00+00:00, run_start_date=2024-02-24 03:51:00.351596+00:00, run_end_date=2024-02-24 03:51:04.019767+00:00, run_duration=3.668171, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:50:00+00:00, data_interval_end=2024-02-24 03:51:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:51:04.052118588Z [2024-02-24T03:51:04.051+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:51:00+00:00, run_after=2024-02-24T03:52:00+00:00 2024-02-24T03:51:04.113174369Z [2024-02-24T03:51:04.109+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:50:00+00:00 exited with status success for try_number 1 2024-02-24T03:51:04.122680065Z [2024-02-24T03:51:04.122+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:50:00+00:00, map_index=-1, run_start_date=2024-02-24 03:51:02.482674+00:00, run_end_date=2024-02-24 03:51:03.848928+00:00, run_duration=1.366254, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1147, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:51:00.404695+00:00, queued_by_job_id=2, pid=16733 2024-02-24T03:51:05.197437788Z [2024-02-24T03:51:05.196+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:51:05.198081732Z [2024-02-24T03:51:05.197+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:50:00+00:00, run_id=scheduled__2024-02-24T03:50:00+00:00, run_start_date=2024-02-24 03:51:00.352630+00:00, run_end_date=2024-02-24 03:51:05.197502+00:00, run_duration=4.844872, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:50:00+00:00, data_interval_end=2024-02-24 03:51:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:51:05.211740633Z [2024-02-24T03:51:05.211+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:51:00+00:00, run_after=2024-02-24T03:52:00+00:00 2024-02-24T03:51:05.248803109Z [2024-02-24T03:51:05.248+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:50:00+00:00 exited with status success for try_number 1 2024-02-24T03:51:05.259043280Z [2024-02-24T03:51:05.258+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:50:00+00:00, map_index=-1, run_start_date=2024-02-24 03:51:02.494908+00:00, run_end_date=2024-02-24 03:51:04.645437+00:00, run_duration=2.150529, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1148, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:51:00.404695+00:00, queued_by_job_id=2, pid=16734 2024-02-24T03:51:58.193997653Z [2024-02-24T03:51:58.193+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:51:58.194049099Z 2024-02-24T03:51:58.194684552Z [2024-02-24T03:51:58.193+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-02-24T03:51:58.195725110Z [2024-02-24T03:51:58.195+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:51:58.195751940Z 2024-02-24T03:51:58.199349289Z [2024-02-24T03:51:58.198+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240224035156_391051', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:51:58.199522895Z [2024-02-24T03:51:58.199+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240224035156_391051', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-02-24T03:51:58.260412321Z [2024-02-24T03:51:58.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240224035156_391051 exited with status queued for try_number 1 2024-02-24T03:51:58.269801341Z [2024-02-24T03:51:58.269+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77181044-6bfa-4590-9242-33bee5796090 2024-02-24T03:51:59.421926847Z [2024-02-24T03:51:59.421+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:51:59.422229350Z [2024-02-24T03:51:59.422+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-02-24 03:51:57.143982+00:00, run_id=scaleout_vdu_20240224035156_391051, run_start_date=2024-02-24 03:51:58.147407+00:00, run_end_date=2024-02-24 03:51:59.421863+00:00, run_duration=1.274456, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-02-24 03:51:57.143982+00:00, data_interval_end=2024-02-24 03:51:57.143982+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-02-24T03:51:59.424788548Z [2024-02-24T03:51:59.424+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-02-24T03:51:59.453243558Z [2024-02-24T03:51:59.452+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240224035156_391051 exited with status success for try_number 1 2024-02-24T03:51:59.458980062Z [2024-02-24T03:51:59.458+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240224035156_391051, map_index=-1, run_start_date=2024-02-24 03:51:58.872538+00:00, run_end_date=2024-02-24 03:51:59.290887+00:00, run_duration=0.418349, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1149, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:51:58.196121+00:00, queued_by_job_id=2, pid=16759 2024-02-24T03:52:00.490966164Z [2024-02-24T03:52:00.490+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:52:00.505510804Z [2024-02-24T03:52:00.505+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:52:00+00:00, run_after=2024-02-24T03:53:00+00:00 2024-02-24T03:52:00.513488619Z [2024-02-24T03:52:00.513+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:52:00.526828008Z [2024-02-24T03:52:00.526+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:52:00+00:00, run_after=2024-02-24T03:53:00+00:00 2024-02-24T03:52:00.619558396Z [2024-02-24T03:52:00.619+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T03:52:00.619586112Z 2024-02-24T03:52:00.619591852Z 2024-02-24T03:52:00.619596648Z 2024-02-24T03:52:00.619601264Z 2024-02-24T03:52:00.619920252Z [2024-02-24T03:52:00.619+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T03:52:00.620205245Z [2024-02-24T03:52:00.620+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:52:00.620475208Z [2024-02-24T03:52:00.620+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:52:00.620792792Z [2024-02-24T03:52:00.620+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:52:00.621733219Z [2024-02-24T03:52:00.621+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:52:00.621749605Z 2024-02-24T03:52:00.621761659Z 2024-02-24T03:52:00.621766352Z 2024-02-24T03:52:00.621794602Z 2024-02-24T03:52:00.627242556Z [2024-02-24T03:52:00.626+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:52:00.627535254Z [2024-02-24T03:52:00.627+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T03:52:00.627853069Z [2024-02-24T03:52:00.627+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:52:00.628097983Z [2024-02-24T03:52:00.627+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:52:00.628369977Z [2024-02-24T03:52:00.628+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:52:00.628577160Z [2024-02-24T03:52:00.628+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:52:00.628919921Z [2024-02-24T03:52:00.628+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:52:00.629180526Z [2024-02-24T03:52:00.628+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:52:00.879252987Z [2024-02-24T03:52:00.878+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:50:00+00:00 exited with status queued for try_number 1 2024-02-24T03:52:00.881262022Z [2024-02-24T03:52:00.879+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:51:00+00:00 exited with status queued for try_number 1 2024-02-24T03:52:00.881411875Z [2024-02-24T03:52:00.881+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:51:00+00:00 exited with status queued for try_number 1 2024-02-24T03:52:00.881545548Z [2024-02-24T03:52:00.881+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:51:00+00:00 exited with status queued for try_number 1 2024-02-24T03:52:00.898265705Z [2024-02-24T03:52:00.897+0000] {scheduler_job.py:635} INFO - Setting external_id for to 048a9ef0-68ef-4fa6-9254-85bf3f73ac76 2024-02-24T03:52:00.898438404Z [2024-02-24T03:52:00.898+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99a8d524-c350-44bf-b1c1-7a254831e5de 2024-02-24T03:52:00.898613092Z [2024-02-24T03:52:00.898+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac037af4-f201-439a-9d5d-82144e632f44 2024-02-24T03:52:00.898749613Z [2024-02-24T03:52:00.898+0000] {scheduler_job.py:635} INFO - Setting external_id for to d79a2b65-66bd-4f6e-804c-bab77f337768 2024-02-24T03:52:02.117222219Z [2024-02-24T03:52:02.116+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:52:02.117594204Z [2024-02-24T03:52:02.117+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 03:50:00+00:00, run_id=scheduled__2024-02-24T03:50:00+00:00, run_start_date=2024-02-24 03:52:00.540123+00:00, run_end_date=2024-02-24 03:52:02.117131+00:00, run_duration=1.577008, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:50:00+00:00, data_interval_end=2024-02-24 03:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T03:52:02.126410559Z [2024-02-24T03:52:02.126+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T03:52:00+00:00, run_after=2024-02-24T03:54:00+00:00 2024-02-24T03:52:02.133558205Z [2024-02-24T03:52:02.133+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:52:02.133741832Z [2024-02-24T03:52:02.133+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:51:00+00:00, run_id=scheduled__2024-02-24T03:51:00+00:00, run_start_date=2024-02-24 03:52:00.541359+00:00, run_end_date=2024-02-24 03:52:02.133460+00:00, run_duration=1.592101, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:51:00+00:00, data_interval_end=2024-02-24 03:52:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:52:02.144033465Z [2024-02-24T03:52:02.143+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:52:00+00:00, run_after=2024-02-24T03:53:00+00:00 2024-02-24T03:52:02.201665661Z [2024-02-24T03:52:02.201+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:50:00+00:00 exited with status success for try_number 1 2024-02-24T03:52:02.202123741Z [2024-02-24T03:52:02.201+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:51:00+00:00 exited with status success for try_number 1 2024-02-24T03:52:02.213869478Z [2024-02-24T03:52:02.213+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T03:50:00+00:00, map_index=-1, run_start_date=2024-02-24 03:52:01.427408+00:00, run_end_date=2024-02-24 03:52:01.933269+00:00, run_duration=0.505861, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1150, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:52:00.623046+00:00, queued_by_job_id=2, pid=16775 2024-02-24T03:52:02.214193719Z [2024-02-24T03:52:02.213+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:51:00+00:00, map_index=-1, run_start_date=2024-02-24 03:52:01.581673+00:00, run_end_date=2024-02-24 03:52:01.974900+00:00, run_duration=0.393227, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1151, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:52:00.623046+00:00, queued_by_job_id=2, pid=16776 2024-02-24T03:52:04.504738923Z [2024-02-24T03:52:04.504+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:52:04.505002702Z [2024-02-24T03:52:04.504+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:51:00+00:00, run_id=scheduled__2024-02-24T03:51:00+00:00, run_start_date=2024-02-24 03:52:00.542530+00:00, run_end_date=2024-02-24 03:52:04.504653+00:00, run_duration=3.962123, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:51:00+00:00, data_interval_end=2024-02-24 03:52:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:52:04.513710665Z [2024-02-24T03:52:04.513+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:52:00+00:00, run_after=2024-02-24T03:53:00+00:00 2024-02-24T03:52:05.653709875Z [2024-02-24T03:52:05.653+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:52:05.654080010Z [2024-02-24T03:52:05.653+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:51:00+00:00, run_id=scheduled__2024-02-24T03:51:00+00:00, run_start_date=2024-02-24 03:52:00.544144+00:00, run_end_date=2024-02-24 03:52:05.653624+00:00, run_duration=5.10948, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:51:00+00:00, data_interval_end=2024-02-24 03:52:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:52:05.670034685Z [2024-02-24T03:52:05.669+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:52:00+00:00, run_after=2024-02-24T03:53:00+00:00 2024-02-24T03:52:05.711708215Z [2024-02-24T03:52:05.711+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:51:00+00:00 exited with status success for try_number 1 2024-02-24T03:52:05.711935469Z [2024-02-24T03:52:05.711+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:51:00+00:00 exited with status success for try_number 1 2024-02-24T03:52:05.720738405Z [2024-02-24T03:52:05.720+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:51:00+00:00, map_index=-1, run_start_date=2024-02-24 03:52:02.791546+00:00, run_end_date=2024-02-24 03:52:04.429159+00:00, run_duration=1.637613, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1153, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:52:00.623046+00:00, queued_by_job_id=2, pid=16800 2024-02-24T03:52:05.722060587Z [2024-02-24T03:52:05.721+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:51:00+00:00, map_index=-1, run_start_date=2024-02-24 03:52:02.599247+00:00, run_end_date=2024-02-24 03:52:04.594628+00:00, run_duration=1.995381, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1152, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:52:00.623046+00:00, queued_by_job_id=2, pid=16799 2024-02-24T03:52:05.869997961Z [2024-02-24T03:52:05.869+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T03:53:00.245173684Z [2024-02-24T03:53:00.244+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:53:00+00:00, run_after=2024-02-24T03:54:00+00:00 2024-02-24T03:53:00.260789723Z [2024-02-24T03:53:00.260+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:53:00+00:00, run_after=2024-02-24T03:54:00+00:00 2024-02-24T03:53:00.273331671Z [2024-02-24T03:53:00.273+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:53:00.344489678Z [2024-02-24T03:53:00.344+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T03:53:00.344529535Z 2024-02-24T03:53:00.344536519Z 2024-02-24T03:53:00.344542554Z 2024-02-24T03:53:00.344927194Z [2024-02-24T03:53:00.344+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:53:00.345303258Z [2024-02-24T03:53:00.345+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:53:00.345643613Z [2024-02-24T03:53:00.345+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:53:00.346804676Z [2024-02-24T03:53:00.346+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:53:00.346824924Z 2024-02-24T03:53:00.346831036Z 2024-02-24T03:53:00.346836759Z 2024-02-24T03:53:00.351832916Z [2024-02-24T03:53:00.351+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:53:00.352284871Z [2024-02-24T03:53:00.351+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:53:00.352902675Z [2024-02-24T03:53:00.352+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:53:00.353254792Z [2024-02-24T03:53:00.353+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:53:00.353847332Z [2024-02-24T03:53:00.353+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:53:00.354122573Z [2024-02-24T03:53:00.353+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:53:00.568462770Z [2024-02-24T03:53:00.567+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:52:00+00:00 exited with status queued for try_number 1 2024-02-24T03:53:00.568517401Z [2024-02-24T03:53:00.568+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:52:00+00:00 exited with status queued for try_number 1 2024-02-24T03:53:00.568676214Z [2024-02-24T03:53:00.568+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:52:00+00:00 exited with status queued for try_number 1 2024-02-24T03:53:00.576391580Z [2024-02-24T03:53:00.576+0000] {scheduler_job.py:635} INFO - Setting external_id for to 04eb47b0-91a6-40f7-bafa-c266e5f92516 2024-02-24T03:53:00.576548567Z [2024-02-24T03:53:00.576+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2109a490-caa1-44c0-a4fd-d521a33799b3 2024-02-24T03:53:00.576720794Z [2024-02-24T03:53:00.576+0000] {scheduler_job.py:635} INFO - Setting external_id for to b11be9e8-c5ef-494c-a50d-5826a2b4473d 2024-02-24T03:53:01.721289161Z [2024-02-24T03:53:01.720+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:53:01.722107892Z [2024-02-24T03:53:01.721+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:52:00+00:00, run_id=scheduled__2024-02-24T03:52:00+00:00, run_start_date=2024-02-24 03:53:00.283611+00:00, run_end_date=2024-02-24 03:53:01.721536+00:00, run_duration=1.437925, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:52:00+00:00, data_interval_end=2024-02-24 03:53:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:53:01.740203498Z [2024-02-24T03:53:01.739+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:53:00+00:00, run_after=2024-02-24T03:54:00+00:00 2024-02-24T03:53:01.807490194Z [2024-02-24T03:53:01.807+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:52:00+00:00 exited with status success for try_number 1 2024-02-24T03:53:01.815566948Z [2024-02-24T03:53:01.814+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:52:00+00:00, map_index=-1, run_start_date=2024-02-24 03:53:01.140526+00:00, run_end_date=2024-02-24 03:53:01.594860+00:00, run_duration=0.454334, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1154, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:53:00.347981+00:00, queued_by_job_id=2, pid=16833 2024-02-24T03:53:04.029903648Z [2024-02-24T03:53:04.028+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:53:04.029951558Z [2024-02-24T03:53:04.028+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:52:00+00:00, run_id=scheduled__2024-02-24T03:52:00+00:00, run_start_date=2024-02-24 03:53:00.284679+00:00, run_end_date=2024-02-24 03:53:04.028838+00:00, run_duration=3.744159, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:52:00+00:00, data_interval_end=2024-02-24 03:53:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:53:04.045238498Z [2024-02-24T03:53:04.043+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:53:00+00:00, run_after=2024-02-24T03:54:00+00:00 2024-02-24T03:53:04.083240325Z [2024-02-24T03:53:04.082+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:52:00+00:00 exited with status success for try_number 1 2024-02-24T03:53:04.083470601Z [2024-02-24T03:53:04.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:52:00+00:00 exited with status success for try_number 1 2024-02-24T03:53:04.091727344Z [2024-02-24T03:53:04.091+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:52:00+00:00, map_index=-1, run_start_date=2024-02-24 03:53:02.172008+00:00, run_end_date=2024-02-24 03:53:03.920902+00:00, run_duration=1.748894, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1155, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:53:00.347981+00:00, queued_by_job_id=2, pid=16851 2024-02-24T03:53:04.092186736Z [2024-02-24T03:53:04.091+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:52:00+00:00, map_index=-1, run_start_date=2024-02-24 03:53:02.180522+00:00, run_end_date=2024-02-24 03:53:03.554379+00:00, run_duration=1.373857, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1156, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:53:00.347981+00:00, queued_by_job_id=2, pid=16852 2024-02-24T03:53:05.013103757Z [2024-02-24T03:53:05.012+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:53:05.013846759Z [2024-02-24T03:53:05.013+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:52:00+00:00, run_id=scheduled__2024-02-24T03:52:00+00:00, run_start_date=2024-02-24 03:53:00.285607+00:00, run_end_date=2024-02-24 03:53:05.013093+00:00, run_duration=4.727486, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:52:00+00:00, data_interval_end=2024-02-24 03:53:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:53:05.034217480Z [2024-02-24T03:53:05.033+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:53:00+00:00, run_after=2024-02-24T03:54:00+00:00 2024-02-24T03:54:00.219639096Z [2024-02-24T03:54:00.219+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:54:00.247900781Z [2024-02-24T03:54:00.247+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:54:00+00:00, run_after=2024-02-24T03:55:00+00:00 2024-02-24T03:54:00.258604629Z [2024-02-24T03:54:00.258+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:54:00.283394641Z [2024-02-24T03:54:00.282+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:54:00+00:00, run_after=2024-02-24T03:55:00+00:00 2024-02-24T03:54:00.409727473Z [2024-02-24T03:54:00.409+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T03:54:00.409819574Z 2024-02-24T03:54:00.409838913Z 2024-02-24T03:54:00.409851412Z 2024-02-24T03:54:00.409863838Z 2024-02-24T03:54:00.410209657Z [2024-02-24T03:54:00.409+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T03:54:00.410655379Z [2024-02-24T03:54:00.410+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:54:00.411008008Z [2024-02-24T03:54:00.410+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:54:00.411322734Z [2024-02-24T03:54:00.411+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:54:00.412739640Z [2024-02-24T03:54:00.412+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:54:00.412760221Z 2024-02-24T03:54:00.412798814Z 2024-02-24T03:54:00.412807762Z 2024-02-24T03:54:00.412816477Z 2024-02-24T03:54:00.418116250Z [2024-02-24T03:54:00.417+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T03:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:54:00.418386406Z [2024-02-24T03:54:00.418+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T03:54:00.418876587Z [2024-02-24T03:54:00.418+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:54:00.419203770Z [2024-02-24T03:54:00.418+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:54:00.419591188Z [2024-02-24T03:54:00.419+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:54:00.419829381Z [2024-02-24T03:54:00.419+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:54:00.420297403Z [2024-02-24T03:54:00.420+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:54:00.420562065Z [2024-02-24T03:54:00.420+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:54:00.752679968Z [2024-02-24T03:54:00.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:52:00+00:00 exited with status queued for try_number 1 2024-02-24T03:54:00.753194223Z [2024-02-24T03:54:00.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:53:00+00:00 exited with status queued for try_number 1 2024-02-24T03:54:00.753396422Z [2024-02-24T03:54:00.753+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:53:00+00:00 exited with status queued for try_number 1 2024-02-24T03:54:00.753594647Z [2024-02-24T03:54:00.753+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:53:00+00:00 exited with status queued for try_number 1 2024-02-24T03:54:00.762470613Z [2024-02-24T03:54:00.762+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4206303a-a509-4bae-87b5-99e0af646587 2024-02-24T03:54:00.762624456Z [2024-02-24T03:54:00.762+0000] {scheduler_job.py:635} INFO - Setting external_id for to d9d524ca-111f-4479-89c4-bda9af907638 2024-02-24T03:54:00.762813198Z [2024-02-24T03:54:00.762+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ce03a23-3765-4f06-950d-f3b3724f96a9 2024-02-24T03:54:00.763003609Z [2024-02-24T03:54:00.762+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8fbb139f-ff85-4f3b-9b20-dd8a61c7861c 2024-02-24T03:54:01.907096732Z [2024-02-24T03:54:01.906+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:54:01.907634707Z [2024-02-24T03:54:01.907+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 03:52:00+00:00, run_id=scheduled__2024-02-24T03:52:00+00:00, run_start_date=2024-02-24 03:54:00.297747+00:00, run_end_date=2024-02-24 03:54:01.907192+00:00, run_duration=1.609445, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:52:00+00:00, data_interval_end=2024-02-24 03:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T03:54:01.916514743Z [2024-02-24T03:54:01.916+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T03:54:00+00:00, run_after=2024-02-24T03:56:00+00:00 2024-02-24T03:54:01.977038161Z [2024-02-24T03:54:01.976+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:52:00+00:00 exited with status success for try_number 1 2024-02-24T03:54:01.977470301Z [2024-02-24T03:54:01.977+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:53:00+00:00 exited with status success for try_number 1 2024-02-24T03:54:01.988843687Z [2024-02-24T03:54:01.988+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:53:00+00:00, map_index=-1, run_start_date=2024-02-24 03:54:01.412409+00:00, run_end_date=2024-02-24 03:54:01.819072+00:00, run_duration=0.406663, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1158, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:54:00.414294+00:00, queued_by_job_id=2, pid=16886 2024-02-24T03:54:01.989299903Z [2024-02-24T03:54:01.989+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T03:52:00+00:00, map_index=-1, run_start_date=2024-02-24 03:54:01.239313+00:00, run_end_date=2024-02-24 03:54:01.582862+00:00, run_duration=0.343549, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1157, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:54:00.414294+00:00, queued_by_job_id=2, pid=16885 2024-02-24T03:54:03.038653233Z [2024-02-24T03:54:03.038+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:54:03.038753658Z [2024-02-24T03:54:03.038+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:53:00+00:00, run_id=scheduled__2024-02-24T03:53:00+00:00, run_start_date=2024-02-24 03:54:00.301634+00:00, run_end_date=2024-02-24 03:54:03.038474+00:00, run_duration=2.73684, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:53:00+00:00, data_interval_end=2024-02-24 03:54:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:54:03.048715713Z [2024-02-24T03:54:03.048+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:54:00+00:00, run_after=2024-02-24T03:55:00+00:00 2024-02-24T03:54:04.149767876Z [2024-02-24T03:54:04.149+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:54:04.149931350Z [2024-02-24T03:54:04.149+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:53:00+00:00, run_id=scheduled__2024-02-24T03:53:00+00:00, run_start_date=2024-02-24 03:54:00.303291+00:00, run_end_date=2024-02-24 03:54:04.149534+00:00, run_duration=3.846243, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:53:00+00:00, data_interval_end=2024-02-24 03:54:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:54:04.159706573Z [2024-02-24T03:54:04.159+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:54:00+00:00, run_after=2024-02-24T03:55:00+00:00 2024-02-24T03:54:04.168886278Z [2024-02-24T03:54:04.168+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:54:04.169265097Z [2024-02-24T03:54:04.168+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:53:00+00:00, run_id=scheduled__2024-02-24T03:53:00+00:00, run_start_date=2024-02-24 03:54:00.304610+00:00, run_end_date=2024-02-24 03:54:04.168715+00:00, run_duration=3.864105, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:53:00+00:00, data_interval_end=2024-02-24 03:54:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:54:04.181283272Z [2024-02-24T03:54:04.180+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:54:00+00:00, run_after=2024-02-24T03:55:00+00:00 2024-02-24T03:54:04.221743024Z [2024-02-24T03:54:04.221+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:53:00+00:00 exited with status success for try_number 1 2024-02-24T03:54:04.229664891Z [2024-02-24T03:54:04.229+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:53:00+00:00, map_index=-1, run_start_date=2024-02-24 03:54:02.464867+00:00, run_end_date=2024-02-24 03:54:03.770992+00:00, run_duration=1.306125, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1160, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:54:00.414294+00:00, queued_by_job_id=2, pid=16910 2024-02-24T03:54:04.379128738Z [2024-02-24T03:54:04.378+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:53:00+00:00 exited with status success for try_number 1 2024-02-24T03:54:04.385659287Z [2024-02-24T03:54:04.385+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:53:00+00:00, map_index=-1, run_start_date=2024-02-24 03:54:02.322308+00:00, run_end_date=2024-02-24 03:54:04.076216+00:00, run_duration=1.753908, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1159, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:54:00.414294+00:00, queued_by_job_id=2, pid=16909 2024-02-24T03:55:00.110157607Z [2024-02-24T03:55:00.109+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:55:00.122599420Z [2024-02-24T03:55:00.122+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:55:00+00:00, run_after=2024-02-24T03:56:00+00:00 2024-02-24T03:55:00.137479245Z [2024-02-24T03:55:00.137+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:55:00+00:00, run_after=2024-02-24T04:00:00+00:00 2024-02-24T03:55:00.148870145Z [2024-02-24T03:55:00.148+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:55:00+00:00, run_after=2024-02-24T03:56:00+00:00 2024-02-24T03:55:00.215579591Z [2024-02-24T03:55:00.215+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T03:55:00.215607861Z 2024-02-24T03:55:00.215613318Z 2024-02-24T03:55:00.215617066Z 2024-02-24T03:55:00.215620387Z 2024-02-24T03:55:00.215733454Z [2024-02-24T03:55:00.215+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:55:00.215859441Z [2024-02-24T03:55:00.215+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:55:00.216036086Z [2024-02-24T03:55:00.215+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:55:00.216193058Z [2024-02-24T03:55:00.216+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:55:00.216903390Z [2024-02-24T03:55:00.216+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:55:00.216921996Z 2024-02-24T03:55:00.216925047Z 2024-02-24T03:55:00.216928248Z 2024-02-24T03:55:00.216931113Z 2024-02-24T03:55:00.220699931Z [2024-02-24T03:55:00.220+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T03:55:00.221119118Z [2024-02-24T03:55:00.220+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T03:55:00.221523742Z [2024-02-24T03:55:00.221+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:55:00.221690054Z [2024-02-24T03:55:00.221+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:55:00.222042320Z [2024-02-24T03:55:00.221+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:55:00.222212463Z [2024-02-24T03:55:00.222+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:55:00.222499114Z [2024-02-24T03:55:00.222+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:55:00.222643545Z [2024-02-24T03:55:00.222+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:55:00.514902484Z [2024-02-24T03:55:00.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T03:50:00+00:00 exited with status queued for try_number 1 2024-02-24T03:55:00.515027588Z [2024-02-24T03:55:00.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:54:00+00:00 exited with status queued for try_number 1 2024-02-24T03:55:00.515190200Z [2024-02-24T03:55:00.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:54:00+00:00 exited with status queued for try_number 1 2024-02-24T03:55:00.515329236Z [2024-02-24T03:55:00.515+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:54:00+00:00 exited with status queued for try_number 1 2024-02-24T03:55:00.524882822Z [2024-02-24T03:55:00.524+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8066a001-8032-4a77-9d20-a872ee767597 2024-02-24T03:55:00.526036552Z [2024-02-24T03:55:00.524+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac1b1838-7b32-4b03-95b4-24bab31b2147 2024-02-24T03:55:00.526251846Z [2024-02-24T03:55:00.526+0000] {scheduler_job.py:635} INFO - Setting external_id for to 70895133-a4fc-485c-9622-fa068c178168 2024-02-24T03:55:00.526422133Z [2024-02-24T03:55:00.526+0000] {scheduler_job.py:635} INFO - Setting external_id for to 27bb5194-205b-40ed-8118-220f6ff8a62d 2024-02-24T03:55:01.776102013Z [2024-02-24T03:55:01.775+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:55:01.776384301Z [2024-02-24T03:55:01.776+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:54:00+00:00, run_id=scheduled__2024-02-24T03:54:00+00:00, run_start_date=2024-02-24 03:55:00.161672+00:00, run_end_date=2024-02-24 03:55:01.776007+00:00, run_duration=1.614335, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:54:00+00:00, data_interval_end=2024-02-24 03:55:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:55:01.795653048Z [2024-02-24T03:55:01.795+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:55:00+00:00, run_after=2024-02-24T03:56:00+00:00 2024-02-24T03:55:02.984849381Z [2024-02-24T03:55:02.984+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:55:02.984877520Z 2024-02-24T03:55:02.985175185Z [2024-02-24T03:55:02.984+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:55:02.985966831Z [2024-02-24T03:55:02.985+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:55:02.985981760Z 2024-02-24T03:55:02.989163710Z [2024-02-24T03:55:02.988+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T03:55:02.989352659Z [2024-02-24T03:55:02.989+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T03:55:03.074124720Z [2024-02-24T03:55:03.073+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T03:50:00+00:00 exited with status queued for try_number 1 2024-02-24T03:55:03.075251464Z [2024-02-24T03:55:03.074+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:54:00+00:00 exited with status success for try_number 1 2024-02-24T03:55:03.086988769Z [2024-02-24T03:55:03.086+0000] {scheduler_job.py:635} INFO - Setting external_id for to efdfd8df-9cc0-4328-8845-22b1c640c7cf 2024-02-24T03:55:03.087395136Z [2024-02-24T03:55:03.087+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:54:00+00:00, map_index=-1, run_start_date=2024-02-24 03:55:01.171980+00:00, run_end_date=2024-02-24 03:55:01.725689+00:00, run_duration=0.553709, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1161, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:55:00.217902+00:00, queued_by_job_id=2, pid=16944 2024-02-24T03:55:03.206221866Z [2024-02-24T03:55:03.205+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T03:50:00+00:00 exited with status success for try_number 1 2024-02-24T03:55:03.213652086Z [2024-02-24T03:55:03.213+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T03:50:00+00:00, map_index=-1, run_start_date=2024-02-24 03:55:02.137681+00:00, run_end_date=2024-02-24 03:55:02.834244+00:00, run_duration=0.696563, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1163, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:55:00.217902+00:00, queued_by_job_id=2, pid=16968 2024-02-24T03:55:04.270566426Z [2024-02-24T03:55:04.269+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:55:04.271205649Z [2024-02-24T03:55:04.270+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:54:00+00:00, run_id=scheduled__2024-02-24T03:54:00+00:00, run_start_date=2024-02-24 03:55:00.162688+00:00, run_end_date=2024-02-24 03:55:04.270394+00:00, run_duration=4.107706, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:54:00+00:00, data_interval_end=2024-02-24 03:55:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:55:04.289747665Z [2024-02-24T03:55:04.287+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:55:00+00:00, run_after=2024-02-24T03:56:00+00:00 2024-02-24T03:55:04.359739328Z [2024-02-24T03:55:04.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:54:00+00:00 exited with status success for try_number 1 2024-02-24T03:55:04.379729482Z [2024-02-24T03:55:04.379+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:54:00+00:00, map_index=-1, run_start_date=2024-02-24 03:55:02.035333+00:00, run_end_date=2024-02-24 03:55:03.668498+00:00, run_duration=1.633165, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1162, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:55:00.217902+00:00, queued_by_job_id=2, pid=16962 2024-02-24T03:55:04.724779659Z [2024-02-24T03:55:04.724+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:55:04.725048294Z [2024-02-24T03:55:04.724+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:54:00+00:00, run_id=scheduled__2024-02-24T03:54:00+00:00, run_start_date=2024-02-24 03:55:00.163604+00:00, run_end_date=2024-02-24 03:55:04.724672+00:00, run_duration=4.561068, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:54:00+00:00, data_interval_end=2024-02-24 03:55:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:55:04.738961711Z [2024-02-24T03:55:04.738+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:55:00+00:00, run_after=2024-02-24T03:56:00+00:00 2024-02-24T03:55:04.813121025Z [2024-02-24T03:55:04.812+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:54:00+00:00 exited with status success for try_number 1 2024-02-24T03:55:04.823165178Z [2024-02-24T03:55:04.822+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:54:00+00:00, map_index=-1, run_start_date=2024-02-24 03:55:02.319922+00:00, run_end_date=2024-02-24 03:55:04.364087+00:00, run_duration=2.044165, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1164, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:55:00.217902+00:00, queued_by_job_id=2, pid=16969 2024-02-24T03:55:05.673236174Z [2024-02-24T03:55:05.672+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:55:05.673292700Z 2024-02-24T03:55:05.673516735Z [2024-02-24T03:55:05.673+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:55:05.674461035Z [2024-02-24T03:55:05.674+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:55:05.674476760Z 2024-02-24T03:55:05.678459248Z [2024-02-24T03:55:05.678+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T03:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T03:55:05.678735490Z [2024-02-24T03:55:05.678+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T03:55:05.744383141Z [2024-02-24T03:55:05.743+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T03:50:00+00:00 exited with status queued for try_number 1 2024-02-24T03:55:05.750941399Z [2024-02-24T03:55:05.750+0000] {scheduler_job.py:635} INFO - Setting external_id for to 802a397a-ab5e-47ea-8b9c-bb0384b89afc 2024-02-24T03:55:05.855465835Z [2024-02-24T03:55:05.854+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T03:50:00+00:00 exited with status success for try_number 1 2024-02-24T03:55:05.862437923Z [2024-02-24T03:55:05.862+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T03:50:00+00:00, map_index=-1, run_start_date=2024-02-24 03:55:05.145425+00:00, run_end_date=2024-02-24 03:55:05.563198+00:00, run_duration=0.417773, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1165, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:55:02.986597+00:00, queued_by_job_id=2, pid=16992 2024-02-24T03:55:10.258384362Z [2024-02-24T03:55:10.257+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:55:10.258417621Z 2024-02-24T03:55:10.258513542Z [2024-02-24T03:55:10.258+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:55:10.259189560Z [2024-02-24T03:55:10.258+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:55:10.259211584Z 2024-02-24T03:55:10.262706267Z [2024-02-24T03:55:10.262+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:55:10.262891481Z [2024-02-24T03:55:10.262+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T03:55:10.336897427Z [2024-02-24T03:55:10.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T03:50:00+00:00 exited with status queued for try_number 1 2024-02-24T03:55:10.337263221Z [2024-02-24T03:55:10.337+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T03:50:00+00:00 exited with status success for try_number 1 2024-02-24T03:55:10.349510187Z [2024-02-24T03:55:10.348+0000] {scheduler_job.py:635} INFO - Setting external_id for to af4d4c80-6ac3-4291-8d60-d998ef989e2c 2024-02-24T03:55:10.350177033Z [2024-02-24T03:55:10.349+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T03:50:00+00:00, map_index=0, run_start_date=2024-02-24 03:55:07.530647+00:00, run_end_date=2024-02-24 03:55:09.156580+00:00, run_duration=1.625933, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1166, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:55:05.675179+00:00, queued_by_job_id=2, pid=17000 2024-02-24T03:55:13.018383904Z [2024-02-24T03:55:13.017+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:55:13.018681923Z [2024-02-24T03:55:13.018+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:50:00+00:00, run_id=scheduled__2024-02-24T03:50:00+00:00, run_start_date=2024-02-24 03:55:00.160643+00:00, run_end_date=2024-02-24 03:55:13.018232+00:00, run_duration=12.857589, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:50:00+00:00, data_interval_end=2024-02-24 03:55:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T03:55:13.025264058Z [2024-02-24T03:55:13.024+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:55:00+00:00, run_after=2024-02-24T04:00:00+00:00 2024-02-24T03:55:13.064280672Z [2024-02-24T03:55:13.063+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T03:50:00+00:00 exited with status success for try_number 1 2024-02-24T03:55:13.071369762Z [2024-02-24T03:55:13.070+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T03:50:00+00:00, map_index=-1, run_start_date=2024-02-24 03:55:11.891524+00:00, run_end_date=2024-02-24 03:55:12.278861+00:00, run_duration=0.387337, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1167, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:55:10.259802+00:00, queued_by_job_id=2, pid=17013 2024-02-24T03:55:57.553090316Z [2024-02-24T03:55:57.551+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T03:55:57.553109858Z 2024-02-24T03:55:57.553355900Z [2024-02-24T03:55:57.552+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-02-24T03:55:57.554304520Z [2024-02-24T03:55:57.554+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:55:57.554316537Z 2024-02-24T03:55:57.558469663Z [2024-02-24T03:55:57.558+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240224035556_380417', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:55:57.558974501Z [2024-02-24T03:55:57.558+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240224035556_380417', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-02-24T03:55:57.609046704Z [2024-02-24T03:55:57.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240224035556_380417 exited with status queued for try_number 1 2024-02-24T03:55:57.623058608Z [2024-02-24T03:55:57.622+0000] {scheduler_job.py:635} INFO - Setting external_id for to f02ef422-c146-4168-9cd0-1e3ca5bfd3d3 2024-02-24T03:55:58.783285362Z [2024-02-24T03:55:58.782+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:55:58.784487917Z [2024-02-24T03:55:58.783+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-02-24 03:55:57.298220+00:00, run_id=scaleout_vdu_20240224035556_380417, run_start_date=2024-02-24 03:55:57.515886+00:00, run_end_date=2024-02-24 03:55:58.783103+00:00, run_duration=1.267217, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-02-24 03:55:57.298220+00:00, data_interval_end=2024-02-24 03:55:57.298220+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-02-24T03:55:58.789570595Z [2024-02-24T03:55:58.789+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-02-24T03:55:58.846793372Z [2024-02-24T03:55:58.846+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240224035556_380417 exited with status success for try_number 1 2024-02-24T03:55:58.851888336Z [2024-02-24T03:55:58.851+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240224035556_380417, map_index=-1, run_start_date=2024-02-24 03:55:58.250175+00:00, run_end_date=2024-02-24 03:55:58.662120+00:00, run_duration=0.411945, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1168, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:55:57.556424+00:00, queued_by_job_id=2, pid=17029 2024-02-24T03:56:00.968266221Z [2024-02-24T03:56:00.967+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:56:00.998999959Z [2024-02-24T03:56:00.998+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:56:00+00:00, run_after=2024-02-24T03:57:00+00:00 2024-02-24T03:56:01.020647134Z [2024-02-24T03:56:01.020+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:56:00+00:00, run_after=2024-02-24T03:57:00+00:00 2024-02-24T03:56:01.032240291Z [2024-02-24T03:56:01.031+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:56:01.150711716Z [2024-02-24T03:56:01.150+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T03:56:01.150748681Z 2024-02-24T03:56:01.150757151Z 2024-02-24T03:56:01.150764071Z 2024-02-24T03:56:01.150770611Z 2024-02-24T03:56:01.150777989Z [2024-02-24T03:56:01.150+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T03:56:01.150924945Z [2024-02-24T03:56:01.150+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:56:01.151075885Z [2024-02-24T03:56:01.150+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:56:01.151227024Z [2024-02-24T03:56:01.151+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:56:01.151891443Z [2024-02-24T03:56:01.151+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:56:01.151907685Z 2024-02-24T03:56:01.151915524Z 2024-02-24T03:56:01.151922208Z 2024-02-24T03:56:01.151929677Z 2024-02-24T03:56:01.155955931Z [2024-02-24T03:56:01.155+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T03:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:56:01.156010766Z [2024-02-24T03:56:01.155+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T03:56:01.156500798Z [2024-02-24T03:56:01.156+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:56:01.156855741Z [2024-02-24T03:56:01.156+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:56:01.157316549Z [2024-02-24T03:56:01.157+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:56:01.157615543Z [2024-02-24T03:56:01.157+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:56:01.158225741Z [2024-02-24T03:56:01.157+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:56:01.158571548Z [2024-02-24T03:56:01.158+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:56:01.640340616Z [2024-02-24T03:56:01.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:54:00+00:00 exited with status queued for try_number 1 2024-02-24T03:56:01.644762032Z [2024-02-24T03:56:01.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:55:00+00:00 exited with status queued for try_number 1 2024-02-24T03:56:01.644931369Z [2024-02-24T03:56:01.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:55:00+00:00 exited with status queued for try_number 1 2024-02-24T03:56:01.645192959Z [2024-02-24T03:56:01.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:55:00+00:00 exited with status queued for try_number 1 2024-02-24T03:56:01.657186851Z [2024-02-24T03:56:01.656+0000] {scheduler_job.py:635} INFO - Setting external_id for to 16bb72d9-63e1-4dbc-9133-7c83ac13d1d2 2024-02-24T03:56:01.657380237Z [2024-02-24T03:56:01.657+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3baa2cb6-0dae-4721-a80e-5b6cd4d13064 2024-02-24T03:56:01.657653124Z [2024-02-24T03:56:01.657+0000] {scheduler_job.py:635} INFO - Setting external_id for to dee01c2b-f66a-4dda-a9d1-66d97da83d52 2024-02-24T03:56:01.657890522Z [2024-02-24T03:56:01.657+0000] {scheduler_job.py:635} INFO - Setting external_id for to 92eb3246-f87c-428e-ae44-25682c66fcc7 2024-02-24T03:56:02.829628151Z [2024-02-24T03:56:02.829+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:56:02.830283054Z [2024-02-24T03:56:02.829+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 03:54:00+00:00, run_id=scheduled__2024-02-24T03:54:00+00:00, run_start_date=2024-02-24 03:56:01.053275+00:00, run_end_date=2024-02-24 03:56:02.829736+00:00, run_duration=1.776461, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:54:00+00:00, data_interval_end=2024-02-24 03:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T03:56:02.840688796Z [2024-02-24T03:56:02.840+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T03:56:00+00:00, run_after=2024-02-24T03:58:00+00:00 2024-02-24T03:56:02.849304832Z [2024-02-24T03:56:02.848+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:56:02.849897300Z [2024-02-24T03:56:02.849+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:55:00+00:00, run_id=scheduled__2024-02-24T03:55:00+00:00, run_start_date=2024-02-24 03:56:01.055154+00:00, run_end_date=2024-02-24 03:56:02.849196+00:00, run_duration=1.794042, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:55:00+00:00, data_interval_end=2024-02-24 03:56:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:56:02.862524200Z [2024-02-24T03:56:02.861+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:56:00+00:00, run_after=2024-02-24T03:57:00+00:00 2024-02-24T03:56:02.906955428Z [2024-02-24T03:56:02.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:54:00+00:00 exited with status success for try_number 1 2024-02-24T03:56:02.909088345Z [2024-02-24T03:56:02.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:55:00+00:00 exited with status success for try_number 1 2024-02-24T03:56:02.915748417Z [2024-02-24T03:56:02.915+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T03:54:00+00:00, map_index=-1, run_start_date=2024-02-24 03:56:02.001398+00:00, run_end_date=2024-02-24 03:56:02.322384+00:00, run_duration=0.320986, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1169, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:56:01.152754+00:00, queued_by_job_id=2, pid=17044 2024-02-24T03:56:02.916017865Z [2024-02-24T03:56:02.915+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:55:00+00:00, map_index=-1, run_start_date=2024-02-24 03:56:02.096511+00:00, run_end_date=2024-02-24 03:56:02.607194+00:00, run_duration=0.510683, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1170, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:56:01.152754+00:00, queued_by_job_id=2, pid=17045 2024-02-24T03:56:06.175666390Z [2024-02-24T03:56:06.174+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:56:06.176260938Z [2024-02-24T03:56:06.175+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:55:00+00:00, run_id=scheduled__2024-02-24T03:55:00+00:00, run_start_date=2024-02-24 03:56:01.056752+00:00, run_end_date=2024-02-24 03:56:06.175839+00:00, run_duration=5.119087, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:55:00+00:00, data_interval_end=2024-02-24 03:56:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:56:06.190806576Z [2024-02-24T03:56:06.190+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:56:00+00:00, run_after=2024-02-24T03:57:00+00:00 2024-02-24T03:56:06.200560309Z [2024-02-24T03:56:06.200+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:56:06.201052445Z [2024-02-24T03:56:06.200+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:55:00+00:00, run_id=scheduled__2024-02-24T03:55:00+00:00, run_start_date=2024-02-24 03:56:01.058383+00:00, run_end_date=2024-02-24 03:56:06.200670+00:00, run_duration=5.142287, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:55:00+00:00, data_interval_end=2024-02-24 03:56:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:56:06.213902818Z [2024-02-24T03:56:06.213+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:56:00+00:00, run_after=2024-02-24T03:57:00+00:00 2024-02-24T03:56:06.275943537Z [2024-02-24T03:56:06.275+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:55:00+00:00 exited with status success for try_number 1 2024-02-24T03:56:06.276234849Z [2024-02-24T03:56:06.276+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:55:00+00:00 exited with status success for try_number 1 2024-02-24T03:56:06.282007546Z [2024-02-24T03:56:06.281+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:55:00+00:00, map_index=-1, run_start_date=2024-02-24 03:56:03.349533+00:00, run_end_date=2024-02-24 03:56:05.588463+00:00, run_duration=2.23893, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1172, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:56:01.152754+00:00, queued_by_job_id=2, pid=17069 2024-02-24T03:56:06.282337173Z [2024-02-24T03:56:06.282+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:55:00+00:00, map_index=-1, run_start_date=2024-02-24 03:56:03.333634+00:00, run_end_date=2024-02-24 03:56:05.929236+00:00, run_duration=2.595602, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1171, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:56:01.152754+00:00, queued_by_job_id=2, pid=17068 2024-02-24T03:57:00.649813239Z [2024-02-24T03:57:00.649+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:57:00.669122332Z [2024-02-24T03:57:00.668+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:57:00+00:00, run_after=2024-02-24T03:58:00+00:00 2024-02-24T03:57:00.680823606Z [2024-02-24T03:57:00.680+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:57:00+00:00, run_after=2024-02-24T03:58:00+00:00 2024-02-24T03:57:00.768394200Z [2024-02-24T03:57:00.768+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T03:57:00.768417975Z 2024-02-24T03:57:00.768421884Z 2024-02-24T03:57:00.768425019Z 2024-02-24T03:57:00.768644095Z [2024-02-24T03:57:00.768+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:57:00.768863516Z [2024-02-24T03:57:00.768+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:57:00.769097880Z [2024-02-24T03:57:00.768+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:57:00.769714301Z [2024-02-24T03:57:00.769+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:57:00.769741668Z 2024-02-24T03:57:00.769745118Z 2024-02-24T03:57:00.769748323Z 2024-02-24T03:57:00.772653160Z [2024-02-24T03:57:00.772+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:57:00.772854013Z [2024-02-24T03:57:00.772+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:57:00.773163016Z [2024-02-24T03:57:00.773+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:57:00.773344134Z [2024-02-24T03:57:00.773+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:57:00.773613670Z [2024-02-24T03:57:00.773+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:57:00.773810577Z [2024-02-24T03:57:00.773+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:57:01.002306787Z [2024-02-24T03:57:01.001+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:56:00+00:00 exited with status queued for try_number 1 2024-02-24T03:57:01.002366427Z [2024-02-24T03:57:01.002+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:56:00+00:00 exited with status queued for try_number 1 2024-02-24T03:57:01.002452642Z [2024-02-24T03:57:01.002+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:56:00+00:00 exited with status queued for try_number 1 2024-02-24T03:57:01.012962269Z [2024-02-24T03:57:01.012+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f9c7323-349b-4a85-b082-d98ff33b2e6b 2024-02-24T03:57:01.013088990Z [2024-02-24T03:57:01.012+0000] {scheduler_job.py:635} INFO - Setting external_id for to da8fa6a3-40b7-4716-8d13-8349cf45ac88 2024-02-24T03:57:01.013192409Z [2024-02-24T03:57:01.013+0000] {scheduler_job.py:635} INFO - Setting external_id for to 32351c1f-7f9a-4ad2-9eca-6f1dee795d6e 2024-02-24T03:57:02.197610610Z [2024-02-24T03:57:02.197+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:57:02.198177913Z [2024-02-24T03:57:02.197+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:56:00+00:00, run_id=scheduled__2024-02-24T03:56:00+00:00, run_start_date=2024-02-24 03:57:00.691090+00:00, run_end_date=2024-02-24 03:57:02.197515+00:00, run_duration=1.506425, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:56:00+00:00, data_interval_end=2024-02-24 03:57:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:57:02.208233949Z [2024-02-24T03:57:02.207+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:57:00+00:00, run_after=2024-02-24T03:58:00+00:00 2024-02-24T03:57:02.269055524Z [2024-02-24T03:57:02.268+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:56:00+00:00 exited with status success for try_number 1 2024-02-24T03:57:02.275072328Z [2024-02-24T03:57:02.274+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:56:00+00:00, map_index=-1, run_start_date=2024-02-24 03:57:01.547168+00:00, run_end_date=2024-02-24 03:57:01.923169+00:00, run_duration=0.376001, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1173, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:57:00.770510+00:00, queued_by_job_id=2, pid=17102 2024-02-24T03:57:05.396403694Z [2024-02-24T03:57:05.395+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:57:05.396625420Z [2024-02-24T03:57:05.396+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:56:00+00:00, run_id=scheduled__2024-02-24T03:56:00+00:00, run_start_date=2024-02-24 03:57:00.692178+00:00, run_end_date=2024-02-24 03:57:05.396282+00:00, run_duration=4.704104, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:56:00+00:00, data_interval_end=2024-02-24 03:57:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:57:05.410724303Z [2024-02-24T03:57:05.410+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:57:00+00:00, run_after=2024-02-24T03:58:00+00:00 2024-02-24T03:57:05.417571020Z [2024-02-24T03:57:05.417+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:57:05.417860406Z [2024-02-24T03:57:05.417+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:56:00+00:00, run_id=scheduled__2024-02-24T03:56:00+00:00, run_start_date=2024-02-24 03:57:00.693256+00:00, run_end_date=2024-02-24 03:57:05.417466+00:00, run_duration=4.72421, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:56:00+00:00, data_interval_end=2024-02-24 03:57:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:57:05.426872305Z [2024-02-24T03:57:05.426+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:57:00+00:00, run_after=2024-02-24T03:58:00+00:00 2024-02-24T03:57:05.458416220Z [2024-02-24T03:57:05.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:56:00+00:00 exited with status success for try_number 1 2024-02-24T03:57:05.458646039Z [2024-02-24T03:57:05.458+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:56:00+00:00 exited with status success for try_number 1 2024-02-24T03:57:05.466696209Z [2024-02-24T03:57:05.466+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:56:00+00:00, map_index=-1, run_start_date=2024-02-24 03:57:02.791162+00:00, run_end_date=2024-02-24 03:57:05.221133+00:00, run_duration=2.429971, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1174, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:57:00.770510+00:00, queued_by_job_id=2, pid=17120 2024-02-24T03:57:05.467017110Z [2024-02-24T03:57:05.466+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:56:00+00:00, map_index=-1, run_start_date=2024-02-24 03:57:02.961852+00:00, run_end_date=2024-02-24 03:57:04.836697+00:00, run_duration=1.874845, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1175, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:57:00.770510+00:00, queued_by_job_id=2, pid=17121 2024-02-24T03:57:05.924590874Z [2024-02-24T03:57:05.924+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T03:58:00.572005220Z [2024-02-24T03:58:00.571+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:58:00.585077720Z [2024-02-24T03:58:00.584+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:58:00+00:00, run_after=2024-02-24T03:59:00+00:00 2024-02-24T03:58:00.592852039Z [2024-02-24T03:58:00.592+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:58:00.606242345Z [2024-02-24T03:58:00.605+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:58:00+00:00, run_after=2024-02-24T03:59:00+00:00 2024-02-24T03:58:00.688186978Z [2024-02-24T03:58:00.687+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T03:58:00.688242039Z 2024-02-24T03:58:00.688247824Z 2024-02-24T03:58:00.688252169Z 2024-02-24T03:58:00.688256192Z 2024-02-24T03:58:00.688270817Z [2024-02-24T03:58:00.688+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T03:58:00.688316491Z [2024-02-24T03:58:00.688+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:58:00.688447569Z [2024-02-24T03:58:00.688+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:58:00.688551451Z [2024-02-24T03:58:00.688+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:58:00.689342608Z [2024-02-24T03:58:00.689+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:58:00.689353182Z 2024-02-24T03:58:00.689358404Z 2024-02-24T03:58:00.689363098Z 2024-02-24T03:58:00.689367313Z 2024-02-24T03:58:00.694098291Z [2024-02-24T03:58:00.693+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T03:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:58:00.694210872Z [2024-02-24T03:58:00.693+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T03:58:00.694383071Z [2024-02-24T03:58:00.694+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:58:00.694445293Z [2024-02-24T03:58:00.694+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:58:00.694685974Z [2024-02-24T03:58:00.694+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:58:00.694797750Z [2024-02-24T03:58:00.694+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:58:00.695056015Z [2024-02-24T03:58:00.694+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:58:00.695361630Z [2024-02-24T03:58:00.695+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:58:01.147606624Z [2024-02-24T03:58:01.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:56:00+00:00 exited with status queued for try_number 1 2024-02-24T03:58:01.147655762Z [2024-02-24T03:58:01.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:57:00+00:00 exited with status queued for try_number 1 2024-02-24T03:58:01.147679427Z [2024-02-24T03:58:01.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:57:00+00:00 exited with status queued for try_number 1 2024-02-24T03:58:01.147792971Z [2024-02-24T03:58:01.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:57:00+00:00 exited with status queued for try_number 1 2024-02-24T03:58:01.169552484Z [2024-02-24T03:58:01.169+0000] {scheduler_job.py:635} INFO - Setting external_id for to f769e66e-6807-4d58-b965-64b99a29dd83 2024-02-24T03:58:01.170439942Z [2024-02-24T03:58:01.170+0000] {scheduler_job.py:635} INFO - Setting external_id for to c979162f-eafe-4193-ba9d-eb2ae4243bf2 2024-02-24T03:58:01.170667623Z [2024-02-24T03:58:01.170+0000] {scheduler_job.py:635} INFO - Setting external_id for to 24e203f8-998d-4a57-992b-cf705416e1e9 2024-02-24T03:58:01.170951488Z [2024-02-24T03:58:01.170+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4361d535-4099-475a-83d1-833649113fec 2024-02-24T03:58:02.523217610Z [2024-02-24T03:58:02.522+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:58:02.523608068Z [2024-02-24T03:58:02.523+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 03:56:00+00:00, run_id=scheduled__2024-02-24T03:56:00+00:00, run_start_date=2024-02-24 03:58:00.616788+00:00, run_end_date=2024-02-24 03:58:02.523152+00:00, run_duration=1.906364, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:56:00+00:00, data_interval_end=2024-02-24 03:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T03:58:02.537017912Z [2024-02-24T03:58:02.536+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T03:58:00+00:00, run_after=2024-02-24T04:00:00+00:00 2024-02-24T03:58:02.551615668Z [2024-02-24T03:58:02.551+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:58:02.551929955Z [2024-02-24T03:58:02.551+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:57:00+00:00, run_id=scheduled__2024-02-24T03:57:00+00:00, run_start_date=2024-02-24 03:58:00.617980+00:00, run_end_date=2024-02-24 03:58:02.551498+00:00, run_duration=1.933518, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:57:00+00:00, data_interval_end=2024-02-24 03:58:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:58:02.578825949Z [2024-02-24T03:58:02.578+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:58:00+00:00, run_after=2024-02-24T03:59:00+00:00 2024-02-24T03:58:02.677788735Z [2024-02-24T03:58:02.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:56:00+00:00 exited with status success for try_number 1 2024-02-24T03:58:02.677818675Z [2024-02-24T03:58:02.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:57:00+00:00 exited with status success for try_number 1 2024-02-24T03:58:02.701170181Z [2024-02-24T03:58:02.700+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T03:56:00+00:00, map_index=-1, run_start_date=2024-02-24 03:58:01.873641+00:00, run_end_date=2024-02-24 03:58:02.214369+00:00, run_duration=0.340728, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1177, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:58:00.690584+00:00, queued_by_job_id=2, pid=17155 2024-02-24T03:58:02.701324048Z [2024-02-24T03:58:02.700+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:57:00+00:00, map_index=-1, run_start_date=2024-02-24 03:58:01.654665+00:00, run_end_date=2024-02-24 03:58:02.055800+00:00, run_duration=0.401135, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1176, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:58:00.690584+00:00, queued_by_job_id=2, pid=17154 2024-02-24T03:58:05.745907860Z [2024-02-24T03:58:05.745+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:58:05.746280644Z [2024-02-24T03:58:05.746+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:57:00+00:00, run_id=scheduled__2024-02-24T03:57:00+00:00, run_start_date=2024-02-24 03:58:00.618993+00:00, run_end_date=2024-02-24 03:58:05.745761+00:00, run_duration=5.126768, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:57:00+00:00, data_interval_end=2024-02-24 03:58:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:58:05.771001749Z [2024-02-24T03:58:05.770+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:58:00+00:00, run_after=2024-02-24T03:59:00+00:00 2024-02-24T03:58:05.825285724Z [2024-02-24T03:58:05.824+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:57:00+00:00 exited with status success for try_number 1 2024-02-24T03:58:05.831113784Z [2024-02-24T03:58:05.830+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:57:00+00:00, map_index=-1, run_start_date=2024-02-24 03:58:02.978827+00:00, run_end_date=2024-02-24 03:58:05.263099+00:00, run_duration=2.284272, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1179, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:58:00.690584+00:00, queued_by_job_id=2, pid=17178 2024-02-24T03:58:06.885513955Z [2024-02-24T03:58:06.885+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:58:06.885729091Z [2024-02-24T03:58:06.885+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:57:00+00:00, run_id=scheduled__2024-02-24T03:57:00+00:00, run_start_date=2024-02-24 03:58:00.619985+00:00, run_end_date=2024-02-24 03:58:06.885376+00:00, run_duration=6.265391, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:57:00+00:00, data_interval_end=2024-02-24 03:58:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:58:06.896024840Z [2024-02-24T03:58:06.895+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:58:00+00:00, run_after=2024-02-24T03:59:00+00:00 2024-02-24T03:58:06.929526154Z [2024-02-24T03:58:06.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:57:00+00:00 exited with status success for try_number 1 2024-02-24T03:58:06.934352283Z [2024-02-24T03:58:06.934+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:57:00+00:00, map_index=-1, run_start_date=2024-02-24 03:58:02.979705+00:00, run_end_date=2024-02-24 03:58:05.739595+00:00, run_duration=2.75989, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1178, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:58:00.690584+00:00, queued_by_job_id=2, pid=17179 2024-02-24T03:59:00.489897775Z [2024-02-24T03:59:00.489+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:59:00+00:00, run_after=2024-02-24T04:00:00+00:00 2024-02-24T03:59:00.509810800Z [2024-02-24T03:59:00.509+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:59:00+00:00, run_after=2024-02-24T04:00:00+00:00 2024-02-24T03:59:00.518805031Z [2024-02-24T03:59:00.518+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T03:59:00.580299124Z [2024-02-24T03:59:00.579+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T03:59:00.580322246Z 2024-02-24T03:59:00.580355777Z 2024-02-24T03:59:00.580359231Z 2024-02-24T03:59:00.580362460Z [2024-02-24T03:59:00.580+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:59:00.580372825Z [2024-02-24T03:59:00.580+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T03:59:00.580467236Z [2024-02-24T03:59:00.580+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T03:59:00.581112209Z [2024-02-24T03:59:00.580+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T03:59:00.581165694Z 2024-02-24T03:59:00.581176991Z 2024-02-24T03:59:00.581186013Z 2024-02-24T03:59:00.584356695Z [2024-02-24T03:59:00.584+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:59:00.584395199Z [2024-02-24T03:59:00.584+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T03:59:00.584618143Z [2024-02-24T03:59:00.584+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:59:00.584669996Z [2024-02-24T03:59:00.584+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T03:59:00.584828445Z [2024-02-24T03:59:00.584+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T03:59:00.584892152Z [2024-02-24T03:59:00.584+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T03:59:00.886991595Z [2024-02-24T03:59:00.885+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:58:00+00:00 exited with status queued for try_number 1 2024-02-24T03:59:00.887059832Z [2024-02-24T03:59:00.885+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:58:00+00:00 exited with status queued for try_number 1 2024-02-24T03:59:00.887063748Z [2024-02-24T03:59:00.885+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:58:00+00:00 exited with status queued for try_number 1 2024-02-24T03:59:00.907098495Z [2024-02-24T03:59:00.906+0000] {scheduler_job.py:635} INFO - Setting external_id for to f8e825cf-b6a9-4831-a719-0b35110c2303 2024-02-24T03:59:00.907295067Z [2024-02-24T03:59:00.907+0000] {scheduler_job.py:635} INFO - Setting external_id for to fdbc12a4-43d2-412e-8b5d-df37b6fbdab6 2024-02-24T03:59:00.907487787Z [2024-02-24T03:59:00.907+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9fd33e4a-f373-4d72-9313-2f3309b075a9 2024-02-24T03:59:02.114195781Z [2024-02-24T03:59:02.113+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:59:02.115023206Z [2024-02-24T03:59:02.114+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:58:00+00:00, run_id=scheduled__2024-02-24T03:58:00+00:00, run_start_date=2024-02-24 03:59:00.531607+00:00, run_end_date=2024-02-24 03:59:02.114327+00:00, run_duration=1.58272, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:58:00+00:00, data_interval_end=2024-02-24 03:59:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T03:59:02.146640406Z [2024-02-24T03:59:02.146+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T03:59:00+00:00, run_after=2024-02-24T04:00:00+00:00 2024-02-24T03:59:03.367723091Z [2024-02-24T03:59:03.367+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:58:00+00:00 exited with status success for try_number 1 2024-02-24T03:59:03.373028967Z [2024-02-24T03:59:03.372+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:58:00+00:00, map_index=-1, run_start_date=2024-02-24 03:59:01.634986+00:00, run_end_date=2024-02-24 03:59:02.092366+00:00, run_duration=0.45738, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1180, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:59:00.581662+00:00, queued_by_job_id=2, pid=17211 2024-02-24T03:59:05.546991425Z [2024-02-24T03:59:05.546+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:59:05.547364112Z [2024-02-24T03:59:05.547+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:58:00+00:00, run_id=scheduled__2024-02-24T03:58:00+00:00, run_start_date=2024-02-24 03:59:00.532885+00:00, run_end_date=2024-02-24 03:59:05.547056+00:00, run_duration=5.014171, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:58:00+00:00, data_interval_end=2024-02-24 03:59:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T03:59:05.556608740Z [2024-02-24T03:59:05.556+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:59:00+00:00, run_after=2024-02-24T04:00:00+00:00 2024-02-24T03:59:05.563798571Z [2024-02-24T03:59:05.563+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T03:59:05.563970294Z [2024-02-24T03:59:05.563+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:58:00+00:00, run_id=scheduled__2024-02-24T03:58:00+00:00, run_start_date=2024-02-24 03:59:00.533993+00:00, run_end_date=2024-02-24 03:59:05.563707+00:00, run_duration=5.029714, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:58:00+00:00, data_interval_end=2024-02-24 03:59:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T03:59:05.574205184Z [2024-02-24T03:59:05.573+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T03:59:00+00:00, run_after=2024-02-24T04:00:00+00:00 2024-02-24T03:59:05.609333744Z [2024-02-24T03:59:05.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:58:00+00:00 exited with status success for try_number 1 2024-02-24T03:59:05.609505113Z [2024-02-24T03:59:05.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:58:00+00:00 exited with status success for try_number 1 2024-02-24T03:59:05.617039456Z [2024-02-24T03:59:05.616+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:58:00+00:00, map_index=-1, run_start_date=2024-02-24 03:59:02.642073+00:00, run_end_date=2024-02-24 03:59:04.860852+00:00, run_duration=2.218779, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1182, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:59:00.581662+00:00, queued_by_job_id=2, pid=17230 2024-02-24T03:59:05.617324704Z [2024-02-24T03:59:05.617+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:58:00+00:00, map_index=-1, run_start_date=2024-02-24 03:59:02.584346+00:00, run_end_date=2024-02-24 03:59:04.856907+00:00, run_duration=2.272561, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1181, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 03:59:00.581662+00:00, queued_by_job_id=2, pid=17229 2024-02-24T04:00:00.364049293Z [2024-02-24T04:00:00.363+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:00:00.377952151Z [2024-02-24T04:00:00.377+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:00:00+00:00, run_after=2024-02-24T04:01:00+00:00 2024-02-24T04:00:00.393156169Z [2024-02-24T04:00:00.392+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:00:00+00:00, run_after=2024-02-24T04:05:00+00:00 2024-02-24T04:00:00.401294736Z [2024-02-24T04:00:00.400+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:00:00.413742919Z [2024-02-24T04:00:00.413+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:00:00+00:00, run_after=2024-02-24T04:01:00+00:00 2024-02-24T04:00:00.512866857Z [2024-02-24T04:00:00.512+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-02-24T04:00:00.512913070Z 2024-02-24T04:00:00.512923076Z 2024-02-24T04:00:00.512932862Z 2024-02-24T04:00:00.512941248Z 2024-02-24T04:00:00.512949673Z 2024-02-24T04:00:00.513001045Z [2024-02-24T04:00:00.512+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:00:00.513028833Z [2024-02-24T04:00:00.512+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T04:00:00.513142882Z [2024-02-24T04:00:00.513+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:00:00.513272044Z [2024-02-24T04:00:00.513+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:00:00.513291601Z [2024-02-24T04:00:00.513+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:00:00.514199761Z [2024-02-24T04:00:00.513+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:00:00.514222028Z 2024-02-24T04:00:00.514301389Z 2024-02-24T04:00:00.514316217Z 2024-02-24T04:00:00.514329519Z 2024-02-24T04:00:00.514342546Z 2024-02-24T04:00:00.519748253Z [2024-02-24T04:00:00.519+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T03:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T04:00:00.519832702Z [2024-02-24T04:00:00.519+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T04:00:00.519871272Z [2024-02-24T04:00:00.519+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T03:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:00:00.519887933Z [2024-02-24T04:00:00.519+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T04:00:00.520061597Z [2024-02-24T04:00:00.519+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:00:00.520085499Z [2024-02-24T04:00:00.519+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:00:00.520301437Z [2024-02-24T04:00:00.520+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:00:00.520321866Z [2024-02-24T04:00:00.520+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:00:00.520510061Z [2024-02-24T04:00:00.520+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T03:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:00:00.520529879Z [2024-02-24T04:00:00.520+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:00:01.097277921Z [2024-02-24T04:00:01.096+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T03:55:00+00:00 exited with status queued for try_number 1 2024-02-24T04:00:01.098831633Z [2024-02-24T04:00:01.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:58:00+00:00 exited with status queued for try_number 1 2024-02-24T04:00:01.098897825Z [2024-02-24T04:00:01.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:59:00+00:00 exited with status queued for try_number 1 2024-02-24T04:00:01.098901412Z [2024-02-24T04:00:01.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:59:00+00:00 exited with status queued for try_number 1 2024-02-24T04:00:01.098916156Z [2024-02-24T04:00:01.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:59:00+00:00 exited with status queued for try_number 1 2024-02-24T04:00:01.119226473Z [2024-02-24T04:00:01.118+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5457ed0-2163-473c-97ca-cd398b189e35 2024-02-24T04:00:01.119415556Z [2024-02-24T04:00:01.119+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc83a934-6364-4785-b14c-a35a683d641f 2024-02-24T04:00:01.119506658Z [2024-02-24T04:00:01.119+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e01c7fc-6dfb-42f3-9d68-af083f56414c 2024-02-24T04:00:01.119630075Z [2024-02-24T04:00:01.119+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77a522e0-71d4-4949-a118-f3b7d8870393 2024-02-24T04:00:01.119752069Z [2024-02-24T04:00:01.119+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1dba4a59-ae17-459f-8eda-b1857bfa09dc 2024-02-24T04:00:02.563360422Z [2024-02-24T04:00:02.562+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:00:02.563762122Z [2024-02-24T04:00:02.563+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 03:58:00+00:00, run_id=scheduled__2024-02-24T03:58:00+00:00, run_start_date=2024-02-24 04:00:00.428566+00:00, run_end_date=2024-02-24 04:00:02.563303+00:00, run_duration=2.134737, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:58:00+00:00, data_interval_end=2024-02-24 04:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T04:00:02.572684989Z [2024-02-24T04:00:02.572+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T04:00:00+00:00, run_after=2024-02-24T04:02:00+00:00 2024-02-24T04:00:02.693853706Z [2024-02-24T04:00:02.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T03:58:00+00:00 exited with status success for try_number 1 2024-02-24T04:00:02.739060236Z [2024-02-24T04:00:02.738+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T03:58:00+00:00, map_index=-1, run_start_date=2024-02-24 04:00:01.462466+00:00, run_end_date=2024-02-24 04:00:01.987958+00:00, run_duration=0.525492, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1183, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:00:00.515954+00:00, queued_by_job_id=2, pid=17259 2024-02-24T04:00:03.827334384Z [2024-02-24T04:00:03.826+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:00:03.827564247Z [2024-02-24T04:00:03.827+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 03:59:00+00:00, run_id=scheduled__2024-02-24T03:59:00+00:00, run_start_date=2024-02-24 04:00:00.429656+00:00, run_end_date=2024-02-24 04:00:03.827278+00:00, run_duration=3.397622, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:59:00+00:00, data_interval_end=2024-02-24 04:00:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:00:03.838208638Z [2024-02-24T04:00:03.837+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:00:00+00:00, run_after=2024-02-24T04:01:00+00:00 2024-02-24T04:00:03.913910006Z [2024-02-24T04:00:03.912+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:59:00+00:00 exited with status success for try_number 1 2024-02-24T04:00:03.918545585Z [2024-02-24T04:00:03.918+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:59:00+00:00, map_index=-1, run_start_date=2024-02-24 04:00:01.947313+00:00, run_end_date=2024-02-24 04:00:02.723631+00:00, run_duration=0.776318, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1184, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:00:00.515954+00:00, queued_by_job_id=2, pid=17270 2024-02-24T04:00:05.016283185Z [2024-02-24T04:00:05.015+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:00:05.016308609Z 2024-02-24T04:00:05.016366996Z [2024-02-24T04:00:05.016+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:00:05.017023192Z [2024-02-24T04:00:05.016+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:00:05.017036259Z 2024-02-24T04:00:05.021108757Z [2024-02-24T04:00:05.020+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T03:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T04:00:05.021250412Z [2024-02-24T04:00:05.021+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T04:00:05.070772831Z [2024-02-24T04:00:05.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T03:55:00+00:00 exited with status queued for try_number 1 2024-02-24T04:00:05.071205463Z [2024-02-24T04:00:05.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T03:55:00+00:00 exited with status success for try_number 1 2024-02-24T04:00:05.078189329Z [2024-02-24T04:00:05.077+0000] {scheduler_job.py:635} INFO - Setting external_id for to a8f0fb81-ad72-4410-b03e-84957c09ded1 2024-02-24T04:00:05.078533159Z [2024-02-24T04:00:05.078+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T03:55:00+00:00, map_index=-1, run_start_date=2024-02-24 04:00:03.441653+00:00, run_end_date=2024-02-24 04:00:03.857195+00:00, run_duration=0.415542, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1187, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:00:00.515954+00:00, queued_by_job_id=2, pid=17296 2024-02-24T04:00:06.198545524Z [2024-02-24T04:00:06.198+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:00:06.198824012Z [2024-02-24T04:00:06.198+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:59:00+00:00, run_id=scheduled__2024-02-24T03:59:00+00:00, run_start_date=2024-02-24 04:00:00.430798+00:00, run_end_date=2024-02-24 04:00:06.198408+00:00, run_duration=5.76761, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:59:00+00:00, data_interval_end=2024-02-24 04:00:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:00:06.207539351Z [2024-02-24T04:00:06.207+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:00:00+00:00, run_after=2024-02-24T04:01:00+00:00 2024-02-24T04:00:06.215491192Z [2024-02-24T04:00:06.215+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:00:06.215951455Z [2024-02-24T04:00:06.215+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:59:00+00:00, run_id=scheduled__2024-02-24T03:59:00+00:00, run_start_date=2024-02-24 04:00:00.431886+00:00, run_end_date=2024-02-24 04:00:06.215376+00:00, run_duration=5.78349, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:59:00+00:00, data_interval_end=2024-02-24 04:00:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:00:06.225640673Z [2024-02-24T04:00:06.225+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:00:00+00:00, run_after=2024-02-24T04:01:00+00:00 2024-02-24T04:00:06.282251154Z [2024-02-24T04:00:06.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:59:00+00:00 exited with status success for try_number 1 2024-02-24T04:00:06.282326680Z [2024-02-24T04:00:06.282+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T03:59:00+00:00 exited with status success for try_number 1 2024-02-24T04:00:06.288399835Z [2024-02-24T04:00:06.287+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:59:00+00:00, map_index=-1, run_start_date=2024-02-24 04:00:03.370987+00:00, run_end_date=2024-02-24 04:00:05.220492+00:00, run_duration=1.849505, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1185, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:00:00.515954+00:00, queued_by_job_id=2, pid=17294 2024-02-24T04:00:06.288605941Z [2024-02-24T04:00:06.288+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T03:59:00+00:00, map_index=-1, run_start_date=2024-02-24 04:00:03.409970+00:00, run_end_date=2024-02-24 04:00:05.474198+00:00, run_duration=2.064228, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1186, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:00:00.515954+00:00, queued_by_job_id=2, pid=17295 2024-02-24T04:00:07.365123122Z [2024-02-24T04:00:07.364+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:00:07.365162479Z 2024-02-24T04:00:07.365579047Z [2024-02-24T04:00:07.365+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:00:07.366771101Z [2024-02-24T04:00:07.366+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:00:07.366785685Z 2024-02-24T04:00:07.369738638Z [2024-02-24T04:00:07.369+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T03:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T04:00:07.370046308Z [2024-02-24T04:00:07.369+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T04:00:07.420309903Z [2024-02-24T04:00:07.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T03:55:00+00:00 exited with status queued for try_number 1 2024-02-24T04:00:07.420536436Z [2024-02-24T04:00:07.420+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T03:55:00+00:00 exited with status success for try_number 1 2024-02-24T04:00:07.425952656Z [2024-02-24T04:00:07.425+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62be5ead-5237-43e5-8453-1b125e59e168 2024-02-24T04:00:07.426291882Z [2024-02-24T04:00:07.426+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T03:55:00+00:00, map_index=-1, run_start_date=2024-02-24 04:00:06.680237+00:00, run_end_date=2024-02-24 04:00:06.989301+00:00, run_duration=0.309064, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1188, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:00:05.017398+00:00, queued_by_job_id=2, pid=17319 2024-02-24T04:00:11.234412412Z [2024-02-24T04:00:11.232+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:00:11.234438997Z 2024-02-24T04:00:11.234446964Z [2024-02-24T04:00:11.232+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:00:11.243725015Z [2024-02-24T04:00:11.234+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:00:11.243771156Z 2024-02-24T04:00:11.243775883Z [2024-02-24T04:00:11.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T03:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:00:11.243779765Z [2024-02-24T04:00:11.238+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T04:00:11.357058745Z [2024-02-24T04:00:11.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T03:55:00+00:00 exited with status queued for try_number 1 2024-02-24T04:00:11.357083023Z [2024-02-24T04:00:11.354+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T03:55:00+00:00 exited with status success for try_number 1 2024-02-24T04:00:11.371362193Z [2024-02-24T04:00:11.368+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2553b31b-8009-4a0d-859b-beaa4e53ccde 2024-02-24T04:00:11.371387702Z [2024-02-24T04:00:11.369+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T03:55:00+00:00, map_index=0, run_start_date=2024-02-24 04:00:09.019505+00:00, run_end_date=2024-02-24 04:00:10.087288+00:00, run_duration=1.067783, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1189, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:00:07.367349+00:00, queued_by_job_id=2, pid=17327 2024-02-24T04:00:13.621440943Z [2024-02-24T04:00:13.620+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:00:13.622113618Z [2024-02-24T04:00:13.621+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 03:55:00+00:00, run_id=scheduled__2024-02-24T03:55:00+00:00, run_start_date=2024-02-24 04:00:00.427458+00:00, run_end_date=2024-02-24 04:00:13.621388+00:00, run_duration=13.19393, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 03:55:00+00:00, data_interval_end=2024-02-24 04:00:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T04:00:13.634393352Z [2024-02-24T04:00:13.633+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:00:00+00:00, run_after=2024-02-24T04:05:00+00:00 2024-02-24T04:00:13.672217181Z [2024-02-24T04:00:13.671+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T03:55:00+00:00 exited with status success for try_number 1 2024-02-24T04:00:13.678089643Z [2024-02-24T04:00:13.677+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T03:55:00+00:00, map_index=-1, run_start_date=2024-02-24 04:00:12.925243+00:00, run_end_date=2024-02-24 04:00:13.294034+00:00, run_duration=0.368791, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1190, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:00:11.235095+00:00, queued_by_job_id=2, pid=17340 2024-02-24T04:01:00.340150353Z [2024-02-24T04:01:00.339+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:01:00+00:00, run_after=2024-02-24T04:02:00+00:00 2024-02-24T04:01:00.362243200Z [2024-02-24T04:01:00.361+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:01:00+00:00, run_after=2024-02-24T04:02:00+00:00 2024-02-24T04:01:00.374779235Z [2024-02-24T04:01:00.374+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:01:00.460630282Z [2024-02-24T04:01:00.460+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T04:01:00.460687594Z 2024-02-24T04:01:00.460693355Z 2024-02-24T04:01:00.460698290Z 2024-02-24T04:01:00.460971408Z [2024-02-24T04:01:00.460+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:01:00.461272675Z [2024-02-24T04:01:00.460+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:01:00.461523374Z [2024-02-24T04:01:00.461+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:01:00.462500981Z [2024-02-24T04:01:00.462+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:01:00.462520866Z 2024-02-24T04:01:00.462528916Z 2024-02-24T04:01:00.462536832Z 2024-02-24T04:01:00.467107525Z [2024-02-24T04:01:00.466+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:01:00.467483504Z [2024-02-24T04:01:00.467+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:01:00.467804065Z [2024-02-24T04:01:00.467+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:01:00.467939747Z [2024-02-24T04:01:00.467+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:01:00.468420894Z [2024-02-24T04:01:00.468+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:01:00.468551107Z [2024-02-24T04:01:00.468+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:01:00.682236584Z [2024-02-24T04:01:00.681+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:00:00+00:00 exited with status queued for try_number 1 2024-02-24T04:01:00.682321090Z [2024-02-24T04:01:00.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:00:00+00:00 exited with status queued for try_number 1 2024-02-24T04:01:00.682452226Z [2024-02-24T04:01:00.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:00:00+00:00 exited with status queued for try_number 1 2024-02-24T04:01:00.690737736Z [2024-02-24T04:01:00.690+0000] {scheduler_job.py:635} INFO - Setting external_id for to a55dfb6f-3c35-4ce9-aeda-3b0c6362e1d7 2024-02-24T04:01:00.690901245Z [2024-02-24T04:01:00.690+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d42b580-bd42-4c71-a95a-d39daece8b4e 2024-02-24T04:01:00.691045288Z [2024-02-24T04:01:00.690+0000] {scheduler_job.py:635} INFO - Setting external_id for to c622d793-5f2f-4346-a8f6-8adf3607e64c 2024-02-24T04:01:01.862118720Z [2024-02-24T04:01:01.861+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:01:01.862744809Z [2024-02-24T04:01:01.862+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:00:00+00:00, run_id=scheduled__2024-02-24T04:00:00+00:00, run_start_date=2024-02-24 04:01:00.385237+00:00, run_end_date=2024-02-24 04:01:01.862380+00:00, run_duration=1.477143, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:00:00+00:00, data_interval_end=2024-02-24 04:01:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:01:01.873308753Z [2024-02-24T04:01:01.872+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:01:00+00:00, run_after=2024-02-24T04:02:00+00:00 2024-02-24T04:01:01.916396215Z [2024-02-24T04:01:01.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:00:00+00:00 exited with status success for try_number 1 2024-02-24T04:01:01.922307408Z [2024-02-24T04:01:01.921+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:00:00+00:00, map_index=-1, run_start_date=2024-02-24 04:01:01.227019+00:00, run_end_date=2024-02-24 04:01:01.685988+00:00, run_duration=0.458969, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1191, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:01:00.463513+00:00, queued_by_job_id=2, pid=17362 2024-02-24T04:01:04.290529464Z [2024-02-24T04:01:04.290+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:01:04.290897519Z [2024-02-24T04:01:04.290+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:00:00+00:00, run_id=scheduled__2024-02-24T04:00:00+00:00, run_start_date=2024-02-24 04:01:00.386555+00:00, run_end_date=2024-02-24 04:01:04.290477+00:00, run_duration=3.903922, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:00:00+00:00, data_interval_end=2024-02-24 04:01:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:01:04.309422431Z [2024-02-24T04:01:04.309+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:01:00+00:00, run_after=2024-02-24T04:02:00+00:00 2024-02-24T04:01:05.396743271Z [2024-02-24T04:01:05.396+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:01:05.397324471Z [2024-02-24T04:01:05.397+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:00:00+00:00, run_id=scheduled__2024-02-24T04:00:00+00:00, run_start_date=2024-02-24 04:01:00.387992+00:00, run_end_date=2024-02-24 04:01:05.396934+00:00, run_duration=5.008942, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:00:00+00:00, data_interval_end=2024-02-24 04:01:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:01:05.412989167Z [2024-02-24T04:01:05.412+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:01:00+00:00, run_after=2024-02-24T04:02:00+00:00 2024-02-24T04:01:05.448213133Z [2024-02-24T04:01:05.447+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:00:00+00:00 exited with status success for try_number 1 2024-02-24T04:01:05.448731738Z [2024-02-24T04:01:05.448+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:00:00+00:00 exited with status success for try_number 1 2024-02-24T04:01:05.459200251Z [2024-02-24T04:01:05.458+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:00:00+00:00, map_index=-1, run_start_date=2024-02-24 04:01:02.520107+00:00, run_end_date=2024-02-24 04:01:04.248682+00:00, run_duration=1.728575, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1193, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:01:00.463513+00:00, queued_by_job_id=2, pid=17381 2024-02-24T04:01:05.459831562Z [2024-02-24T04:01:05.459+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:00:00+00:00, map_index=-1, run_start_date=2024-02-24 04:01:02.467104+00:00, run_end_date=2024-02-24 04:01:04.615625+00:00, run_duration=2.148521, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1192, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:01:00.463513+00:00, queued_by_job_id=2, pid=17380 2024-02-24T04:02:00.740959344Z [2024-02-24T04:02:00.740+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:02:00+00:00, run_after=2024-02-24T04:03:00+00:00 2024-02-24T04:02:00.762991344Z [2024-02-24T04:02:00.762+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:02:00+00:00, run_after=2024-02-24T04:03:00+00:00 2024-02-24T04:02:00.770374961Z [2024-02-24T04:02:00.769+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:02:00.776945818Z [2024-02-24T04:02:00.776+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:02:00.853602818Z [2024-02-24T04:02:00.853+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T04:02:00.853653721Z 2024-02-24T04:02:00.853665799Z 2024-02-24T04:02:00.853675443Z 2024-02-24T04:02:00.853684373Z 2024-02-24T04:02:00.853764371Z [2024-02-24T04:02:00.853+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T04:02:00.853849650Z [2024-02-24T04:02:00.853+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:02:00.853862101Z [2024-02-24T04:02:00.853+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:02:00.853871666Z [2024-02-24T04:02:00.853+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:02:00.854631610Z [2024-02-24T04:02:00.854+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:02:00.854718461Z 2024-02-24T04:02:00.854725653Z 2024-02-24T04:02:00.854750057Z 2024-02-24T04:02:00.854755165Z 2024-02-24T04:02:00.858779005Z [2024-02-24T04:02:00.858+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T04:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:02:00.858979231Z [2024-02-24T04:02:00.858+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T04:02:00.859522368Z [2024-02-24T04:02:00.859+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:02:00.859730566Z [2024-02-24T04:02:00.859+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:02:00.859953049Z [2024-02-24T04:02:00.859+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:02:00.860010622Z [2024-02-24T04:02:00.859+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:02:00.860222068Z [2024-02-24T04:02:00.860+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:02:00.860250644Z [2024-02-24T04:02:00.860+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:02:01.282480269Z [2024-02-24T04:02:01.278+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:00:00+00:00 exited with status queued for try_number 1 2024-02-24T04:02:01.282506193Z [2024-02-24T04:02:01.279+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:01:00+00:00 exited with status queued for try_number 1 2024-02-24T04:02:01.282510144Z [2024-02-24T04:02:01.279+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:01:00+00:00 exited with status queued for try_number 1 2024-02-24T04:02:01.282513497Z [2024-02-24T04:02:01.279+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:01:00+00:00 exited with status queued for try_number 1 2024-02-24T04:02:01.305977743Z [2024-02-24T04:02:01.304+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f82167e-22e3-4bc0-aa4e-4e4acc30257b 2024-02-24T04:02:01.306002691Z [2024-02-24T04:02:01.304+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1567ff3b-30c5-48f4-bcb4-b11ac5c73242 2024-02-24T04:02:01.306006964Z [2024-02-24T04:02:01.304+0000] {scheduler_job.py:635} INFO - Setting external_id for to fbc861a8-ad3b-429b-8fe7-ec33e879d6ac 2024-02-24T04:02:01.306010631Z [2024-02-24T04:02:01.304+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0cb637db-f25d-4c4f-8e48-34c47fc6923f 2024-02-24T04:02:02.496606941Z [2024-02-24T04:02:02.495+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:02:02.497534923Z [2024-02-24T04:02:02.497+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:01:00+00:00, run_id=scheduled__2024-02-24T04:01:00+00:00, run_start_date=2024-02-24 04:02:00.788341+00:00, run_end_date=2024-02-24 04:02:02.496429+00:00, run_duration=1.708088, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:01:00+00:00, data_interval_end=2024-02-24 04:02:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:02:02.511259511Z [2024-02-24T04:02:02.510+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:02:00+00:00, run_after=2024-02-24T04:03:00+00:00 2024-02-24T04:02:02.572717423Z [2024-02-24T04:02:02.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:01:00+00:00 exited with status success for try_number 1 2024-02-24T04:02:02.584275752Z [2024-02-24T04:02:02.583+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:01:00+00:00, map_index=-1, run_start_date=2024-02-24 04:02:01.817067+00:00, run_end_date=2024-02-24 04:02:02.302776+00:00, run_duration=0.485709, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1194, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:02:00.855447+00:00, queued_by_job_id=2, pid=17414 2024-02-24T04:02:03.073158703Z [2024-02-24T04:02:03.072+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:02:03.073853187Z [2024-02-24T04:02:03.073+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 04:00:00+00:00, run_id=scheduled__2024-02-24T04:00:00+00:00, run_start_date=2024-02-24 04:02:00.787205+00:00, run_end_date=2024-02-24 04:02:03.073327+00:00, run_duration=2.286122, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:00:00+00:00, data_interval_end=2024-02-24 04:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T04:02:03.086242391Z [2024-02-24T04:02:03.085+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T04:02:00+00:00, run_after=2024-02-24T04:04:00+00:00 2024-02-24T04:02:03.177486880Z [2024-02-24T04:02:03.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:00:00+00:00 exited with status success for try_number 1 2024-02-24T04:02:03.187337575Z [2024-02-24T04:02:03.186+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T04:00:00+00:00, map_index=-1, run_start_date=2024-02-24 04:02:01.996685+00:00, run_end_date=2024-02-24 04:02:02.498763+00:00, run_duration=0.502078, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1195, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:02:00.855447+00:00, queued_by_job_id=2, pid=17416 2024-02-24T04:02:05.347511757Z [2024-02-24T04:02:05.347+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:02:05.347598159Z [2024-02-24T04:02:05.347+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:01:00+00:00, run_id=scheduled__2024-02-24T04:01:00+00:00, run_start_date=2024-02-24 04:02:00.789390+00:00, run_end_date=2024-02-24 04:02:05.347318+00:00, run_duration=4.557928, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:01:00+00:00, data_interval_end=2024-02-24 04:02:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:02:05.357496091Z [2024-02-24T04:02:05.357+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:02:00+00:00, run_after=2024-02-24T04:03:00+00:00 2024-02-24T04:02:05.397585673Z [2024-02-24T04:02:05.397+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:01:00+00:00 exited with status success for try_number 1 2024-02-24T04:02:05.406280972Z [2024-02-24T04:02:05.405+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:01:00+00:00, map_index=-1, run_start_date=2024-02-24 04:02:03.198058+00:00, run_end_date=2024-02-24 04:02:04.899115+00:00, run_duration=1.701057, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1196, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:02:00.855447+00:00, queued_by_job_id=2, pid=17438 2024-02-24T04:02:05.965071163Z [2024-02-24T04:02:05.964+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:02:05.965210060Z [2024-02-24T04:02:05.964+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:01:00+00:00, run_id=scheduled__2024-02-24T04:01:00+00:00, run_start_date=2024-02-24 04:02:00.790469+00:00, run_end_date=2024-02-24 04:02:05.964887+00:00, run_duration=5.174418, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:01:00+00:00, data_interval_end=2024-02-24 04:02:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:02:05.974695808Z [2024-02-24T04:02:05.974+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:02:00+00:00, run_after=2024-02-24T04:03:00+00:00 2024-02-24T04:02:06.030091575Z [2024-02-24T04:02:06.029+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T04:02:06.769156091Z [2024-02-24T04:02:06.768+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:01:00+00:00 exited with status success for try_number 1 2024-02-24T04:02:06.775352025Z [2024-02-24T04:02:06.774+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:01:00+00:00, map_index=-1, run_start_date=2024-02-24 04:02:03.236919+00:00, run_end_date=2024-02-24 04:02:05.884786+00:00, run_duration=2.647867, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1197, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:02:00.855447+00:00, queued_by_job_id=2, pid=17439 2024-02-24T04:03:01.030227281Z [2024-02-24T04:03:01.029+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:03:00+00:00, run_after=2024-02-24T04:04:00+00:00 2024-02-24T04:03:01.038261977Z [2024-02-24T04:03:01.037+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:03:01.050831917Z [2024-02-24T04:03:01.050+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:03:00+00:00, run_after=2024-02-24T04:04:00+00:00 2024-02-24T04:03:01.139616437Z [2024-02-24T04:03:01.139+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T04:03:01.139645289Z 2024-02-24T04:03:01.139650388Z 2024-02-24T04:03:01.139654826Z 2024-02-24T04:03:01.139858083Z [2024-02-24T04:03:01.139+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:03:01.140080397Z [2024-02-24T04:03:01.139+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:03:01.140245670Z [2024-02-24T04:03:01.140+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:03:01.140956064Z [2024-02-24T04:03:01.140+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:03:01.140973985Z 2024-02-24T04:03:01.140979357Z 2024-02-24T04:03:01.140983947Z 2024-02-24T04:03:01.145069191Z [2024-02-24T04:03:01.144+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:03:01.145181242Z [2024-02-24T04:03:01.144+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:03:01.145504199Z [2024-02-24T04:03:01.145+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:03:01.145651721Z [2024-02-24T04:03:01.145+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:03:01.146199857Z [2024-02-24T04:03:01.145+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:03:01.146426556Z [2024-02-24T04:03:01.146+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:03:01.416066351Z [2024-02-24T04:03:01.415+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:02:00+00:00 exited with status queued for try_number 1 2024-02-24T04:03:01.416137372Z [2024-02-24T04:03:01.415+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:02:00+00:00 exited with status queued for try_number 1 2024-02-24T04:03:01.416142401Z [2024-02-24T04:03:01.416+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:02:00+00:00 exited with status queued for try_number 1 2024-02-24T04:03:01.424253228Z [2024-02-24T04:03:01.423+0000] {scheduler_job.py:635} INFO - Setting external_id for to d76ca3c4-02ad-45c2-b6d1-269eecb59312 2024-02-24T04:03:01.424338957Z [2024-02-24T04:03:01.424+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8cf391c6-8e1b-4b8e-9619-a441e7af08f6 2024-02-24T04:03:01.424388950Z [2024-02-24T04:03:01.424+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84aa2b1d-c67c-42a8-864a-76a57476dc09 2024-02-24T04:03:02.570517742Z [2024-02-24T04:03:02.569+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:03:02.571402314Z [2024-02-24T04:03:02.570+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:02:00+00:00, run_id=scheduled__2024-02-24T04:02:00+00:00, run_start_date=2024-02-24 04:03:01.071388+00:00, run_end_date=2024-02-24 04:03:02.570553+00:00, run_duration=1.499165, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:02:00+00:00, data_interval_end=2024-02-24 04:03:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:03:02.587589972Z [2024-02-24T04:03:02.587+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:03:00+00:00, run_after=2024-02-24T04:04:00+00:00 2024-02-24T04:03:02.682336787Z [2024-02-24T04:03:02.680+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:02:00+00:00 exited with status success for try_number 1 2024-02-24T04:03:02.709668475Z [2024-02-24T04:03:02.697+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:02:00+00:00, map_index=-1, run_start_date=2024-02-24 04:03:01.899367+00:00, run_end_date=2024-02-24 04:03:02.274442+00:00, run_duration=0.375075, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1198, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:03:01.141872+00:00, queued_by_job_id=2, pid=17472 2024-02-24T04:03:06.180928437Z [2024-02-24T04:03:06.180+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:03:06.181287999Z [2024-02-24T04:03:06.181+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:02:00+00:00, run_id=scheduled__2024-02-24T04:02:00+00:00, run_start_date=2024-02-24 04:03:01.074238+00:00, run_end_date=2024-02-24 04:03:06.180819+00:00, run_duration=5.106581, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:02:00+00:00, data_interval_end=2024-02-24 04:03:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:03:06.190899158Z [2024-02-24T04:03:06.190+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:03:00+00:00, run_after=2024-02-24T04:04:00+00:00 2024-02-24T04:03:06.198161650Z [2024-02-24T04:03:06.197+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:03:06.198506471Z [2024-02-24T04:03:06.198+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:02:00+00:00, run_id=scheduled__2024-02-24T04:02:00+00:00, run_start_date=2024-02-24 04:03:01.076395+00:00, run_end_date=2024-02-24 04:03:06.198067+00:00, run_duration=5.121672, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:02:00+00:00, data_interval_end=2024-02-24 04:03:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:03:06.208070389Z [2024-02-24T04:03:06.207+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:03:00+00:00, run_after=2024-02-24T04:04:00+00:00 2024-02-24T04:03:06.238239411Z [2024-02-24T04:03:06.237+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:02:00+00:00 exited with status success for try_number 1 2024-02-24T04:03:06.238274998Z [2024-02-24T04:03:06.238+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:02:00+00:00 exited with status success for try_number 1 2024-02-24T04:03:06.244159034Z [2024-02-24T04:03:06.243+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:02:00+00:00, map_index=-1, run_start_date=2024-02-24 04:03:03.026897+00:00, run_end_date=2024-02-24 04:03:05.451780+00:00, run_duration=2.424883, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1199, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:03:01.141872+00:00, queued_by_job_id=2, pid=17490 2024-02-24T04:03:06.244374087Z [2024-02-24T04:03:06.244+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:02:00+00:00, map_index=-1, run_start_date=2024-02-24 04:03:03.233094+00:00, run_end_date=2024-02-24 04:03:05.625697+00:00, run_duration=2.392603, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1200, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:03:01.141872+00:00, queued_by_job_id=2, pid=17491 2024-02-24T04:04:01.014376150Z [2024-02-24T04:04:01.013+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:04:01.025291271Z [2024-02-24T04:04:01.024+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:04:01.041828413Z [2024-02-24T04:04:01.041+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:04:00+00:00, run_after=2024-02-24T04:05:00+00:00 2024-02-24T04:04:01.055219879Z [2024-02-24T04:04:01.054+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:04:00+00:00, run_after=2024-02-24T04:05:00+00:00 2024-02-24T04:04:01.150631900Z [2024-02-24T04:04:01.150+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T04:04:01.150668848Z 2024-02-24T04:04:01.150677735Z 2024-02-24T04:04:01.150685161Z 2024-02-24T04:04:01.150692156Z 2024-02-24T04:04:01.150711725Z [2024-02-24T04:04:01.150+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T04:04:01.150919374Z [2024-02-24T04:04:01.150+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:04:01.151013045Z [2024-02-24T04:04:01.150+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:04:01.151205510Z [2024-02-24T04:04:01.151+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:04:01.152088060Z [2024-02-24T04:04:01.151+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:04:01.152098951Z 2024-02-24T04:04:01.152105788Z 2024-02-24T04:04:01.152112199Z 2024-02-24T04:04:01.152118968Z 2024-02-24T04:04:01.158662637Z [2024-02-24T04:04:01.158+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T04:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:04:01.158741072Z [2024-02-24T04:04:01.158+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T04:04:01.160012048Z [2024-02-24T04:04:01.159+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:04:01.160043856Z [2024-02-24T04:04:01.159+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:04:01.160326185Z [2024-02-24T04:04:01.160+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:04:01.160354952Z [2024-02-24T04:04:01.160+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:04:01.160529535Z [2024-02-24T04:04:01.160+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:04:01.160561082Z [2024-02-24T04:04:01.160+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:04:01.634204665Z [2024-02-24T04:04:01.633+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:02:00+00:00 exited with status queued for try_number 1 2024-02-24T04:04:01.636383562Z [2024-02-24T04:04:01.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:03:00+00:00 exited with status queued for try_number 1 2024-02-24T04:04:01.636460249Z [2024-02-24T04:04:01.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:03:00+00:00 exited with status queued for try_number 1 2024-02-24T04:04:01.636576637Z [2024-02-24T04:04:01.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:03:00+00:00 exited with status queued for try_number 1 2024-02-24T04:04:01.655189112Z [2024-02-24T04:04:01.654+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6d3d9c6f-7320-449f-b012-5263129f3329 2024-02-24T04:04:01.655313807Z [2024-02-24T04:04:01.655+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8993ac78-11b1-4ead-b32f-8e40ed42eb5c 2024-02-24T04:04:01.655478438Z [2024-02-24T04:04:01.655+0000] {scheduler_job.py:635} INFO - Setting external_id for to 89e6a948-a152-4956-90cf-8243e6abaaf7 2024-02-24T04:04:01.655621547Z [2024-02-24T04:04:01.655+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee662ab7-efbd-4afd-b64e-dfde8f820ca5 2024-02-24T04:04:02.897465200Z [2024-02-24T04:04:02.897+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:04:02.898168282Z [2024-02-24T04:04:02.897+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 04:02:00+00:00, run_id=scheduled__2024-02-24T04:02:00+00:00, run_start_date=2024-02-24 04:04:01.066268+00:00, run_end_date=2024-02-24 04:04:02.897536+00:00, run_duration=1.831268, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:02:00+00:00, data_interval_end=2024-02-24 04:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T04:04:02.909849585Z [2024-02-24T04:04:02.909+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T04:04:00+00:00, run_after=2024-02-24T04:06:00+00:00 2024-02-24T04:04:03.037209840Z [2024-02-24T04:04:03.036+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:02:00+00:00 exited with status success for try_number 1 2024-02-24T04:04:03.046148416Z [2024-02-24T04:04:03.045+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T04:02:00+00:00, map_index=-1, run_start_date=2024-02-24 04:04:02.007175+00:00, run_end_date=2024-02-24 04:04:02.421714+00:00, run_duration=0.414539, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1201, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:04:01.154330+00:00, queued_by_job_id=2, pid=17520 2024-02-24T04:04:04.094174687Z [2024-02-24T04:04:04.093+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:04:04.094602448Z [2024-02-24T04:04:04.094+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:03:00+00:00, run_id=scheduled__2024-02-24T04:03:00+00:00, run_start_date=2024-02-24 04:04:01.068588+00:00, run_end_date=2024-02-24 04:04:04.094110+00:00, run_duration=3.025522, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:03:00+00:00, data_interval_end=2024-02-24 04:04:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:04:04.104251617Z [2024-02-24T04:04:04.103+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:04:00+00:00, run_after=2024-02-24T04:05:00+00:00 2024-02-24T04:04:04.168490005Z [2024-02-24T04:04:04.167+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:03:00+00:00 exited with status success for try_number 1 2024-02-24T04:04:04.174942291Z [2024-02-24T04:04:04.174+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:03:00+00:00, map_index=-1, run_start_date=2024-02-24 04:04:02.506723+00:00, run_end_date=2024-02-24 04:04:03.128119+00:00, run_duration=0.621396, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1202, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:04:01.154330+00:00, queued_by_job_id=2, pid=17532 2024-02-24T04:04:06.158504885Z [2024-02-24T04:04:06.157+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:04:06.159162285Z [2024-02-24T04:04:06.158+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:03:00+00:00, run_id=scheduled__2024-02-24T04:03:00+00:00, run_start_date=2024-02-24 04:04:01.071090+00:00, run_end_date=2024-02-24 04:04:06.158667+00:00, run_duration=5.087577, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:03:00+00:00, data_interval_end=2024-02-24 04:04:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:04:06.171701520Z [2024-02-24T04:04:06.171+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:04:00+00:00, run_after=2024-02-24T04:05:00+00:00 2024-02-24T04:04:06.180496127Z [2024-02-24T04:04:06.180+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:04:06.180950299Z [2024-02-24T04:04:06.180+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:03:00+00:00, run_id=scheduled__2024-02-24T04:03:00+00:00, run_start_date=2024-02-24 04:04:01.073340+00:00, run_end_date=2024-02-24 04:04:06.180583+00:00, run_duration=5.107243, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:03:00+00:00, data_interval_end=2024-02-24 04:04:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:04:06.189963901Z [2024-02-24T04:04:06.189+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:04:00+00:00, run_after=2024-02-24T04:05:00+00:00 2024-02-24T04:04:06.215585692Z [2024-02-24T04:04:06.215+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:03:00+00:00 exited with status success for try_number 1 2024-02-24T04:04:06.215890919Z [2024-02-24T04:04:06.215+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:03:00+00:00 exited with status success for try_number 1 2024-02-24T04:04:06.221991661Z [2024-02-24T04:04:06.221+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:03:00+00:00, map_index=-1, run_start_date=2024-02-24 04:04:03.560840+00:00, run_end_date=2024-02-24 04:04:05.736134+00:00, run_duration=2.175294, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1204, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:04:01.154330+00:00, queued_by_job_id=2, pid=17550 2024-02-24T04:04:06.222345248Z [2024-02-24T04:04:06.222+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:03:00+00:00, map_index=-1, run_start_date=2024-02-24 04:04:03.380123+00:00, run_end_date=2024-02-24 04:04:05.819640+00:00, run_duration=2.439517, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1203, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:04:01.154330+00:00, queued_by_job_id=2, pid=17549 2024-02-24T04:05:00.782124314Z [2024-02-24T04:05:00.781+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:05:00+00:00, run_after=2024-02-24T04:06:00+00:00 2024-02-24T04:05:00.807197472Z [2024-02-24T04:05:00.806+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:05:00+00:00, run_after=2024-02-24T04:06:00+00:00 2024-02-24T04:05:00.818635622Z [2024-02-24T04:05:00.818+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:05:00.843364579Z [2024-02-24T04:05:00.842+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:05:00+00:00, run_after=2024-02-24T04:10:00+00:00 2024-02-24T04:05:00.931532384Z [2024-02-24T04:05:00.931+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T04:05:00.931628643Z 2024-02-24T04:05:00.931636318Z 2024-02-24T04:05:00.931659574Z 2024-02-24T04:05:00.931665614Z 2024-02-24T04:05:00.931702198Z [2024-02-24T04:05:00.931+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:05:00.931731804Z [2024-02-24T04:05:00.931+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:05:00.931930846Z [2024-02-24T04:05:00.931+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:05:00.932069709Z [2024-02-24T04:05:00.931+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:05:00.932619790Z [2024-02-24T04:05:00.932+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:05:00.932666371Z 2024-02-24T04:05:00.932672482Z 2024-02-24T04:05:00.932676812Z 2024-02-24T04:05:00.932681127Z 2024-02-24T04:05:00.936570328Z [2024-02-24T04:05:00.936+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T04:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T04:05:00.936720875Z [2024-02-24T04:05:00.936+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T04:05:00.937014242Z [2024-02-24T04:05:00.936+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:05:00.937143224Z [2024-02-24T04:05:00.937+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:05:00.937557647Z [2024-02-24T04:05:00.937+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:05:00.937809261Z [2024-02-24T04:05:00.937+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:05:00.939835042Z [2024-02-24T04:05:00.939+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:05:00.939968693Z [2024-02-24T04:05:00.939+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:05:01.366870831Z [2024-02-24T04:05:01.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T04:00:00+00:00 exited with status queued for try_number 1 2024-02-24T04:05:01.367013342Z [2024-02-24T04:05:01.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:04:00+00:00 exited with status queued for try_number 1 2024-02-24T04:05:01.367164340Z [2024-02-24T04:05:01.367+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:04:00+00:00 exited with status queued for try_number 1 2024-02-24T04:05:01.367286043Z [2024-02-24T04:05:01.367+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:04:00+00:00 exited with status queued for try_number 1 2024-02-24T04:05:01.386663051Z [2024-02-24T04:05:01.386+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f71084d-b419-49e9-b122-a45ddc055c83 2024-02-24T04:05:01.386842679Z [2024-02-24T04:05:01.386+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3550bf0c-4cd9-48b1-8551-2bfea755f076 2024-02-24T04:05:01.387019362Z [2024-02-24T04:05:01.386+0000] {scheduler_job.py:635} INFO - Setting external_id for to fd52b39f-109c-45b7-8027-6b1e6fd531e6 2024-02-24T04:05:01.387169406Z [2024-02-24T04:05:01.387+0000] {scheduler_job.py:635} INFO - Setting external_id for to bef92311-f02c-4297-94dd-a642e5fe0103 2024-02-24T04:05:02.666229669Z [2024-02-24T04:05:02.655+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:04:00+00:00 exited with status success for try_number 1 2024-02-24T04:05:02.697865603Z [2024-02-24T04:05:02.694+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:04:00+00:00, map_index=-1, run_start_date=2024-02-24 04:05:02.016172+00:00, run_end_date=2024-02-24 04:05:02.479974+00:00, run_duration=0.463802, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1205, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:05:00.933442+00:00, queued_by_job_id=2, pid=17583 2024-02-24T04:05:03.754907262Z [2024-02-24T04:05:03.754+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:05:03.755771872Z [2024-02-24T04:05:03.755+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:04:00+00:00, run_id=scheduled__2024-02-24T04:04:00+00:00, run_start_date=2024-02-24 04:05:00.859477+00:00, run_end_date=2024-02-24 04:05:03.755293+00:00, run_duration=2.895816, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:04:00+00:00, data_interval_end=2024-02-24 04:05:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:05:03.768295998Z [2024-02-24T04:05:03.767+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:05:00+00:00, run_after=2024-02-24T04:06:00+00:00 2024-02-24T04:05:03.827765713Z [2024-02-24T04:05:03.827+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:05:03.827803602Z 2024-02-24T04:05:03.827823108Z [2024-02-24T04:05:03.827+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:05:03.828348747Z [2024-02-24T04:05:03.828+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:05:03.828359643Z 2024-02-24T04:05:03.831012215Z [2024-02-24T04:05:03.830+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T04:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T04:05:03.831044340Z [2024-02-24T04:05:03.830+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T04:05:03.887691437Z [2024-02-24T04:05:03.876+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T04:00:00+00:00 exited with status queued for try_number 1 2024-02-24T04:05:03.887720082Z [2024-02-24T04:05:03.877+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T04:00:00+00:00 exited with status success for try_number 1 2024-02-24T04:05:03.887723984Z [2024-02-24T04:05:03.882+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84895396-b25c-40d7-a83e-4052342a1128 2024-02-24T04:05:03.887729328Z [2024-02-24T04:05:03.882+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T04:00:00+00:00, map_index=-1, run_start_date=2024-02-24 04:05:03.010295+00:00, run_end_date=2024-02-24 04:05:03.404804+00:00, run_duration=0.394509, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1206, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:05:00.933442+00:00, queued_by_job_id=2, pid=17602 2024-02-24T04:05:05.041228717Z [2024-02-24T04:05:05.040+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:05:05.041940680Z [2024-02-24T04:05:05.041+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:04:00+00:00, run_id=scheduled__2024-02-24T04:04:00+00:00, run_start_date=2024-02-24 04:05:00.860717+00:00, run_end_date=2024-02-24 04:05:05.041086+00:00, run_duration=4.180369, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:04:00+00:00, data_interval_end=2024-02-24 04:05:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:05:05.057579725Z [2024-02-24T04:05:05.057+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:05:00+00:00, run_after=2024-02-24T04:06:00+00:00 2024-02-24T04:05:05.149758419Z [2024-02-24T04:05:05.149+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:04:00+00:00 exited with status success for try_number 1 2024-02-24T04:05:05.157216998Z [2024-02-24T04:05:05.156+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:04:00+00:00, map_index=-1, run_start_date=2024-02-24 04:05:03.257574+00:00, run_end_date=2024-02-24 04:05:04.626022+00:00, run_duration=1.368448, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1208, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:05:00.933442+00:00, queued_by_job_id=2, pid=17609 2024-02-24T04:05:06.210118860Z [2024-02-24T04:05:06.209+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:05:06.210764059Z [2024-02-24T04:05:06.210+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:04:00+00:00, run_id=scheduled__2024-02-24T04:04:00+00:00, run_start_date=2024-02-24 04:05:00.862055+00:00, run_end_date=2024-02-24 04:05:06.210197+00:00, run_duration=5.348142, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:04:00+00:00, data_interval_end=2024-02-24 04:05:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:05:06.231833434Z [2024-02-24T04:05:06.225+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:05:00+00:00, run_after=2024-02-24T04:06:00+00:00 2024-02-24T04:05:06.285519259Z [2024-02-24T04:05:06.284+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:05:06.285606809Z 2024-02-24T04:05:06.286336852Z [2024-02-24T04:05:06.286+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:05:06.287489055Z [2024-02-24T04:05:06.287+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:05:06.287504295Z 2024-02-24T04:05:06.290725200Z [2024-02-24T04:05:06.290+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T04:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T04:05:06.291069541Z [2024-02-24T04:05:06.290+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T04:05:06.346660269Z [2024-02-24T04:05:06.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T04:00:00+00:00 exited with status queued for try_number 1 2024-02-24T04:05:06.346705941Z [2024-02-24T04:05:06.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:04:00+00:00 exited with status success for try_number 1 2024-02-24T04:05:06.346871148Z [2024-02-24T04:05:06.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T04:00:00+00:00 exited with status success for try_number 1 2024-02-24T04:05:06.355381925Z [2024-02-24T04:05:06.354+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T04:00:00+00:00, map_index=-1, run_start_date=2024-02-24 04:05:05.462996+00:00, run_end_date=2024-02-24 04:05:05.848885+00:00, run_duration=0.385889, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1209, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:05:03.828638+00:00, queued_by_job_id=2, pid=17632 2024-02-24T04:05:06.355568258Z [2024-02-24T04:05:06.355+0000] {scheduler_job.py:635} INFO - Setting external_id for to f8fc60dc-2723-4f13-a741-7c886d727e88 2024-02-24T04:05:06.355824534Z [2024-02-24T04:05:06.355+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:04:00+00:00, map_index=-1, run_start_date=2024-02-24 04:05:03.187406+00:00, run_end_date=2024-02-24 04:05:05.585648+00:00, run_duration=2.398242, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1207, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:05:00.933442+00:00, queued_by_job_id=2, pid=17608 2024-02-24T04:05:09.735589823Z [2024-02-24T04:05:09.735+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:05:09.735614989Z 2024-02-24T04:05:09.735821275Z [2024-02-24T04:05:09.735+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:05:09.736436638Z [2024-02-24T04:05:09.736+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:05:09.736451861Z 2024-02-24T04:05:09.738674436Z [2024-02-24T04:05:09.738+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T04:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:05:09.738934367Z [2024-02-24T04:05:09.738+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T04:05:09.800972356Z [2024-02-24T04:05:09.800+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T04:00:00+00:00 exited with status queued for try_number 1 2024-02-24T04:05:09.801066811Z [2024-02-24T04:05:09.800+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T04:00:00+00:00 exited with status success for try_number 1 2024-02-24T04:05:09.806164412Z [2024-02-24T04:05:09.805+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8feefeb0-95e4-4087-93f7-b8dfb041a77e 2024-02-24T04:05:09.806492965Z [2024-02-24T04:05:09.806+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T04:00:00+00:00, map_index=0, run_start_date=2024-02-24 04:05:07.905320+00:00, run_end_date=2024-02-24 04:05:09.175639+00:00, run_duration=1.270319, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1210, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:05:06.288057+00:00, queued_by_job_id=2, pid=17640 2024-02-24T04:05:12.625072218Z [2024-02-24T04:05:12.624+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:05:12.625503041Z [2024-02-24T04:05:12.625+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:00:00+00:00, run_id=scheduled__2024-02-24T04:00:00+00:00, run_start_date=2024-02-24 04:05:00.857963+00:00, run_end_date=2024-02-24 04:05:12.625071+00:00, run_duration=11.767108, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:00:00+00:00, data_interval_end=2024-02-24 04:05:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T04:05:12.636036032Z [2024-02-24T04:05:12.634+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:05:00+00:00, run_after=2024-02-24T04:10:00+00:00 2024-02-24T04:05:12.707334797Z [2024-02-24T04:05:12.707+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T04:00:00+00:00 exited with status success for try_number 1 2024-02-24T04:05:12.719160487Z [2024-02-24T04:05:12.718+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T04:00:00+00:00, map_index=-1, run_start_date=2024-02-24 04:05:11.386457+00:00, run_end_date=2024-02-24 04:05:11.757289+00:00, run_duration=0.370832, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1211, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:05:09.736848+00:00, queued_by_job_id=2, pid=17653 2024-02-24T04:06:00.138683919Z [2024-02-24T04:06:00.138+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:06:00+00:00, run_after=2024-02-24T04:07:00+00:00 2024-02-24T04:06:00.155659885Z [2024-02-24T04:06:00.155+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:06:00+00:00, run_after=2024-02-24T04:07:00+00:00 2024-02-24T04:06:00.163835909Z [2024-02-24T04:06:00.163+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:06:00.170151770Z [2024-02-24T04:06:00.169+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:06:00.264129744Z [2024-02-24T04:06:00.263+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T04:06:00.264152340Z 2024-02-24T04:06:00.264161230Z 2024-02-24T04:06:00.264164638Z 2024-02-24T04:06:00.264167923Z 2024-02-24T04:06:00.264293037Z [2024-02-24T04:06:00.264+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T04:06:00.264446440Z [2024-02-24T04:06:00.264+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:06:00.264575533Z [2024-02-24T04:06:00.264+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:06:00.264700257Z [2024-02-24T04:06:00.264+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:06:00.265240956Z [2024-02-24T04:06:00.265+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:06:00.265250422Z 2024-02-24T04:06:00.265253766Z 2024-02-24T04:06:00.265256938Z 2024-02-24T04:06:00.265260117Z 2024-02-24T04:06:00.268806017Z [2024-02-24T04:06:00.268+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T04:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:06:00.268960668Z [2024-02-24T04:06:00.268+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T04:06:00.269232809Z [2024-02-24T04:06:00.269+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:06:00.269390334Z [2024-02-24T04:06:00.269+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:06:00.269634921Z [2024-02-24T04:06:00.269+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:06:00.269860327Z [2024-02-24T04:06:00.269+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:06:00.270076997Z [2024-02-24T04:06:00.269+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:06:00.270258598Z [2024-02-24T04:06:00.270+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:06:00.851046291Z [2024-02-24T04:06:00.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:04:00+00:00 exited with status queued for try_number 1 2024-02-24T04:06:00.851245425Z [2024-02-24T04:06:00.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:05:00+00:00 exited with status queued for try_number 1 2024-02-24T04:06:00.851468024Z [2024-02-24T04:06:00.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:05:00+00:00 exited with status queued for try_number 1 2024-02-24T04:06:00.851646744Z [2024-02-24T04:06:00.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:05:00+00:00 exited with status queued for try_number 1 2024-02-24T04:06:00.871104114Z [2024-02-24T04:06:00.870+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d5a9eaf-f6f3-4922-a453-74193adae411 2024-02-24T04:06:00.872050892Z [2024-02-24T04:06:00.871+0000] {scheduler_job.py:635} INFO - Setting external_id for to b4430b9a-e36c-4f20-979f-60b8c416edef 2024-02-24T04:06:00.873321124Z [2024-02-24T04:06:00.873+0000] {scheduler_job.py:635} INFO - Setting external_id for to 035b0f31-af66-4ad1-a54a-3b47f29763c4 2024-02-24T04:06:00.873586418Z [2024-02-24T04:06:00.873+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39c08fe1-4c95-4b97-a1f1-d1e4df9f1425 2024-02-24T04:06:02.169619840Z [2024-02-24T04:06:02.169+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:06:02.169979193Z [2024-02-24T04:06:02.169+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 04:04:00+00:00, run_id=scheduled__2024-02-24T04:04:00+00:00, run_start_date=2024-02-24 04:06:00.180716+00:00, run_end_date=2024-02-24 04:06:02.169583+00:00, run_duration=1.988867, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:04:00+00:00, data_interval_end=2024-02-24 04:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T04:06:02.179017612Z [2024-02-24T04:06:02.178+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T04:06:00+00:00, run_after=2024-02-24T04:08:00+00:00 2024-02-24T04:06:02.186757621Z [2024-02-24T04:06:02.186+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:06:02.187011283Z [2024-02-24T04:06:02.186+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:05:00+00:00, run_id=scheduled__2024-02-24T04:05:00+00:00, run_start_date=2024-02-24 04:06:00.182212+00:00, run_end_date=2024-02-24 04:06:02.186721+00:00, run_duration=2.004509, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:05:00+00:00, data_interval_end=2024-02-24 04:06:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:06:02.197590956Z [2024-02-24T04:06:02.197+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:06:00+00:00, run_after=2024-02-24T04:07:00+00:00 2024-02-24T04:06:02.271204302Z [2024-02-24T04:06:02.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:04:00+00:00 exited with status success for try_number 1 2024-02-24T04:06:02.271399814Z [2024-02-24T04:06:02.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:05:00+00:00 exited with status success for try_number 1 2024-02-24T04:06:02.286548711Z [2024-02-24T04:06:02.286+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T04:04:00+00:00, map_index=-1, run_start_date=2024-02-24 04:06:01.269318+00:00, run_end_date=2024-02-24 04:06:01.750462+00:00, run_duration=0.481144, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1212, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:06:00.266037+00:00, queued_by_job_id=2, pid=17677 2024-02-24T04:06:02.286853493Z [2024-02-24T04:06:02.286+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:05:00+00:00, map_index=-1, run_start_date=2024-02-24 04:06:01.441817+00:00, run_end_date=2024-02-24 04:06:01.866968+00:00, run_duration=0.425151, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1213, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:06:00.266037+00:00, queued_by_job_id=2, pid=17679 2024-02-24T04:06:04.451923815Z [2024-02-24T04:06:04.451+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:06:04.452197179Z [2024-02-24T04:06:04.451+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:05:00+00:00, run_id=scheduled__2024-02-24T04:05:00+00:00, run_start_date=2024-02-24 04:06:00.183510+00:00, run_end_date=2024-02-24 04:06:04.451883+00:00, run_duration=4.268373, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:05:00+00:00, data_interval_end=2024-02-24 04:06:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:06:04.460754397Z [2024-02-24T04:06:04.460+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:06:00+00:00, run_after=2024-02-24T04:07:00+00:00 2024-02-24T04:06:04.503605807Z [2024-02-24T04:06:04.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:05:00+00:00 exited with status success for try_number 1 2024-02-24T04:06:04.513098486Z [2024-02-24T04:06:04.512+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:05:00+00:00, map_index=-1, run_start_date=2024-02-24 04:06:02.274535+00:00, run_end_date=2024-02-24 04:06:03.601651+00:00, run_duration=1.327116, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1214, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:06:00.266037+00:00, queued_by_job_id=2, pid=17696 2024-02-24T04:06:05.551727727Z [2024-02-24T04:06:05.551+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:06:05.552033022Z [2024-02-24T04:06:05.551+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:05:00+00:00, run_id=scheduled__2024-02-24T04:05:00+00:00, run_start_date=2024-02-24 04:06:00.184845+00:00, run_end_date=2024-02-24 04:06:05.551676+00:00, run_duration=5.366831, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:05:00+00:00, data_interval_end=2024-02-24 04:06:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:06:05.561214211Z [2024-02-24T04:06:05.560+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:06:00+00:00, run_after=2024-02-24T04:07:00+00:00 2024-02-24T04:06:05.589576761Z [2024-02-24T04:06:05.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:05:00+00:00 exited with status success for try_number 1 2024-02-24T04:06:05.595428872Z [2024-02-24T04:06:05.594+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:05:00+00:00, map_index=-1, run_start_date=2024-02-24 04:06:02.570522+00:00, run_end_date=2024-02-24 04:06:04.748349+00:00, run_duration=2.177827, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1215, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:06:00.266037+00:00, queued_by_job_id=2, pid=17707 2024-02-24T04:06:25.051569591Z [2024-02-24T04:06:25.050+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:06:25.051600475Z 2024-02-24T04:06:25.051853723Z [2024-02-24T04:06:25.051+0000] {scheduler_job.py:425} INFO - DAG vdu_alarm has 0/16 running and queued tasks 2024-02-24T04:06:25.053312628Z [2024-02-24T04:06:25.052+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:06:25.053339488Z 2024-02-24T04:06:25.057944977Z [2024-02-24T04:06:25.057+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_alarm', task_id='main_task', run_id='vdu_alarm_20240224040624_635783', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:06:25.058093671Z [2024-02-24T04:06:25.057+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240224040624_635783', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-02-24T04:06:25.107752869Z [2024-02-24T04:06:25.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240224040624_635783 exited with status queued for try_number 1 2024-02-24T04:06:25.115739279Z [2024-02-24T04:06:25.115+0000] {scheduler_job.py:635} INFO - Setting external_id for to eda58de0-91a1-4bcd-ae97-ea7700cc9c84 2024-02-24T04:06:26.255583798Z [2024-02-24T04:06:26.255+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:06:26.255991811Z [2024-02-24T04:06:26.255+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_alarm, execution_date=2024-02-24 04:06:24.292043+00:00, run_id=vdu_alarm_20240224040624_635783, run_start_date=2024-02-24 04:06:25.021286+00:00, run_end_date=2024-02-24 04:06:26.255686+00:00, run_duration=1.2344, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-02-24 04:06:24.292043+00:00, data_interval_end=2024-02-24 04:06:24.292043+00:00, dag_hash=4c7a7f623757a362f63c388cf0edb231 2024-02-24T04:06:26.260311664Z [2024-02-24T04:06:26.260+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_alarm to None, run_after=None 2024-02-24T04:06:26.313101037Z [2024-02-24T04:06:26.312+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240224040624_635783 exited with status success for try_number 1 2024-02-24T04:06:26.324773344Z [2024-02-24T04:06:26.324+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_alarm, task_id=main_task, run_id=vdu_alarm_20240224040624_635783, map_index=-1, run_start_date=2024-02-24 04:06:25.713943+00:00, run_end_date=2024-02-24 04:06:26.129434+00:00, run_duration=0.415491, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1216, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:06:25.054607+00:00, queued_by_job_id=2, pid=17714 2024-02-24T04:07:00.198105930Z [2024-02-24T04:07:00.197+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:07:00+00:00, run_after=2024-02-24T04:08:00+00:00 2024-02-24T04:07:00.213032074Z [2024-02-24T04:07:00.212+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:07:00+00:00, run_after=2024-02-24T04:08:00+00:00 2024-02-24T04:07:00.229039007Z [2024-02-24T04:07:00.228+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:07:00.309848946Z [2024-02-24T04:07:00.309+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T04:07:00.309910004Z 2024-02-24T04:07:00.309920251Z 2024-02-24T04:07:00.309951681Z 2024-02-24T04:07:00.310150442Z [2024-02-24T04:07:00.309+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:07:00.310539697Z [2024-02-24T04:07:00.310+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:07:00.310873270Z [2024-02-24T04:07:00.310+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:07:00.312210394Z [2024-02-24T04:07:00.311+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:07:00.312217245Z 2024-02-24T04:07:00.312220948Z 2024-02-24T04:07:00.312224231Z 2024-02-24T04:07:00.318201359Z [2024-02-24T04:07:00.317+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:07:00.318454410Z [2024-02-24T04:07:00.318+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:07:00.318875006Z [2024-02-24T04:07:00.318+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:07:00.319138702Z [2024-02-24T04:07:00.318+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:07:00.319497115Z [2024-02-24T04:07:00.319+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:07:00.319735854Z [2024-02-24T04:07:00.319+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:07:00.541533474Z [2024-02-24T04:07:00.540+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:06:00+00:00 exited with status queued for try_number 1 2024-02-24T04:07:00.541806089Z [2024-02-24T04:07:00.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:06:00+00:00 exited with status queued for try_number 1 2024-02-24T04:07:00.541987912Z [2024-02-24T04:07:00.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:06:00+00:00 exited with status queued for try_number 1 2024-02-24T04:07:00.551305572Z [2024-02-24T04:07:00.550+0000] {scheduler_job.py:635} INFO - Setting external_id for to cc9bd06e-6554-4592-9dea-0441d13b7729 2024-02-24T04:07:00.551524342Z [2024-02-24T04:07:00.551+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6fd08228-b631-4580-b776-b99e61e79c91 2024-02-24T04:07:00.551764062Z [2024-02-24T04:07:00.551+0000] {scheduler_job.py:635} INFO - Setting external_id for to 844170a3-4825-4f2e-bc17-5a224a7bb095 2024-02-24T04:07:02.491479597Z [2024-02-24T04:07:02.491+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:07:02.491786880Z [2024-02-24T04:07:02.491+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:06:00+00:00, run_id=scheduled__2024-02-24T04:06:00+00:00, run_start_date=2024-02-24 04:07:00.248292+00:00, run_end_date=2024-02-24 04:07:02.491423+00:00, run_duration=2.243131, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:06:00+00:00, data_interval_end=2024-02-24 04:07:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:07:02.502306302Z [2024-02-24T04:07:02.501+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:07:00+00:00, run_after=2024-02-24T04:08:00+00:00 2024-02-24T04:07:02.565550055Z [2024-02-24T04:07:02.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:06:00+00:00 exited with status success for try_number 1 2024-02-24T04:07:02.573489117Z [2024-02-24T04:07:02.573+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:06:00+00:00, map_index=-1, run_start_date=2024-02-24 04:07:01.122609+00:00, run_end_date=2024-02-24 04:07:01.624861+00:00, run_duration=0.502252, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1217, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:07:00.313887+00:00, queued_by_job_id=2, pid=17741 2024-02-24T04:07:04.262437675Z [2024-02-24T04:07:04.262+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:07:04.262549115Z [2024-02-24T04:07:04.262+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:06:00+00:00, run_id=scheduled__2024-02-24T04:06:00+00:00, run_start_date=2024-02-24 04:07:00.250436+00:00, run_end_date=2024-02-24 04:07:04.262326+00:00, run_duration=4.01189, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:06:00+00:00, data_interval_end=2024-02-24 04:07:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:07:04.271915116Z [2024-02-24T04:07:04.271+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:07:00+00:00, run_after=2024-02-24T04:08:00+00:00 2024-02-24T04:07:04.280097938Z [2024-02-24T04:07:04.279+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:07:04.280227072Z [2024-02-24T04:07:04.280+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:06:00+00:00, run_id=scheduled__2024-02-24T04:06:00+00:00, run_start_date=2024-02-24 04:07:00.252302+00:00, run_end_date=2024-02-24 04:07:04.279960+00:00, run_duration=4.027658, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:06:00+00:00, data_interval_end=2024-02-24 04:07:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:07:04.291432265Z [2024-02-24T04:07:04.291+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:07:00+00:00, run_after=2024-02-24T04:08:00+00:00 2024-02-24T04:07:04.323428715Z [2024-02-24T04:07:04.323+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:06:00+00:00 exited with status success for try_number 1 2024-02-24T04:07:04.323457810Z [2024-02-24T04:07:04.323+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:06:00+00:00 exited with status success for try_number 1 2024-02-24T04:07:04.332226832Z [2024-02-24T04:07:04.331+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:06:00+00:00, map_index=-1, run_start_date=2024-02-24 04:07:02.098417+00:00, run_end_date=2024-02-24 04:07:03.420168+00:00, run_duration=1.321751, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1219, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:07:00.313887+00:00, queued_by_job_id=2, pid=17760 2024-02-24T04:07:04.332547405Z [2024-02-24T04:07:04.332+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:06:00+00:00, map_index=-1, run_start_date=2024-02-24 04:07:02.079359+00:00, run_end_date=2024-02-24 04:07:03.954379+00:00, run_duration=1.87502, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1218, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:07:00.313887+00:00, queued_by_job_id=2, pid=17759 2024-02-24T04:07:06.090672723Z [2024-02-24T04:07:06.090+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T04:08:00.109245098Z [2024-02-24T04:08:00.108+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:08:00+00:00, run_after=2024-02-24T04:09:00+00:00 2024-02-24T04:08:00.116990360Z [2024-02-24T04:08:00.116+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:08:00.124396503Z [2024-02-24T04:08:00.124+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:08:00.138027511Z [2024-02-24T04:08:00.137+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:08:00+00:00, run_after=2024-02-24T04:09:00+00:00 2024-02-24T04:08:00.213162554Z [2024-02-24T04:08:00.212+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T04:08:00.213193556Z 2024-02-24T04:08:00.213201064Z 2024-02-24T04:08:00.213207187Z 2024-02-24T04:08:00.213212939Z 2024-02-24T04:08:00.213709071Z [2024-02-24T04:08:00.213+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T04:08:00.214062627Z [2024-02-24T04:08:00.213+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:08:00.214305230Z [2024-02-24T04:08:00.214+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:08:00.214428834Z [2024-02-24T04:08:00.214+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:08:00.215092763Z [2024-02-24T04:08:00.214+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:08:00.215104183Z 2024-02-24T04:08:00.215107648Z 2024-02-24T04:08:00.215126287Z 2024-02-24T04:08:00.215130331Z 2024-02-24T04:08:00.221623028Z [2024-02-24T04:08:00.221+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T04:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:08:00.221842024Z [2024-02-24T04:08:00.221+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T04:08:00.222055519Z [2024-02-24T04:08:00.221+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:08:00.222143529Z [2024-02-24T04:08:00.222+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:08:00.222359973Z [2024-02-24T04:08:00.222+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:08:00.222509217Z [2024-02-24T04:08:00.222+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:08:00.222846358Z [2024-02-24T04:08:00.222+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:08:00.222992601Z [2024-02-24T04:08:00.222+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:08:00.603258685Z [2024-02-24T04:08:00.602+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:06:00+00:00 exited with status queued for try_number 1 2024-02-24T04:08:00.606158445Z [2024-02-24T04:08:00.603+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:07:00+00:00 exited with status queued for try_number 1 2024-02-24T04:08:00.606399462Z [2024-02-24T04:08:00.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:07:00+00:00 exited with status queued for try_number 1 2024-02-24T04:08:00.606544287Z [2024-02-24T04:08:00.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:07:00+00:00 exited with status queued for try_number 1 2024-02-24T04:08:00.628682695Z [2024-02-24T04:08:00.628+0000] {scheduler_job.py:635} INFO - Setting external_id for to 44e606fb-4003-4d51-a750-2f24501ae398 2024-02-24T04:08:00.630137206Z [2024-02-24T04:08:00.628+0000] {scheduler_job.py:635} INFO - Setting external_id for to 845511aa-3bd3-4e8d-8d00-7c4bb33c4bee 2024-02-24T04:08:00.630357225Z [2024-02-24T04:08:00.630+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a50dfd6-1f53-4a77-8370-7a74925d7200 2024-02-24T04:08:00.630537367Z [2024-02-24T04:08:00.630+0000] {scheduler_job.py:635} INFO - Setting external_id for to 01eb2a94-10f4-411c-8ef7-83dfaaa34fb5 2024-02-24T04:08:01.815569015Z [2024-02-24T04:08:01.815+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:08:01.815951838Z [2024-02-24T04:08:01.815+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 04:06:00+00:00, run_id=scheduled__2024-02-24T04:06:00+00:00, run_start_date=2024-02-24 04:08:00.147307+00:00, run_end_date=2024-02-24 04:08:01.815497+00:00, run_duration=1.66819, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:06:00+00:00, data_interval_end=2024-02-24 04:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T04:08:01.825491403Z [2024-02-24T04:08:01.825+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T04:08:00+00:00, run_after=2024-02-24T04:10:00+00:00 2024-02-24T04:08:01.884226234Z [2024-02-24T04:08:01.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:06:00+00:00 exited with status success for try_number 1 2024-02-24T04:08:01.890658784Z [2024-02-24T04:08:01.890+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T04:06:00+00:00, map_index=-1, run_start_date=2024-02-24 04:08:01.018798+00:00, run_end_date=2024-02-24 04:08:01.447830+00:00, run_duration=0.429032, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1220, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:08:00.216248+00:00, queued_by_job_id=2, pid=17788 2024-02-24T04:08:02.950212955Z [2024-02-24T04:08:02.949+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:08:02.950660122Z [2024-02-24T04:08:02.950+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:07:00+00:00, run_id=scheduled__2024-02-24T04:07:00+00:00, run_start_date=2024-02-24 04:08:00.148677+00:00, run_end_date=2024-02-24 04:08:02.950106+00:00, run_duration=2.801429, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:07:00+00:00, data_interval_end=2024-02-24 04:08:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:08:02.961397358Z [2024-02-24T04:08:02.961+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:08:00+00:00, run_after=2024-02-24T04:09:00+00:00 2024-02-24T04:08:03.036160509Z [2024-02-24T04:08:03.035+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:07:00+00:00 exited with status success for try_number 1 2024-02-24T04:08:03.044209727Z [2024-02-24T04:08:03.043+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:07:00+00:00, map_index=-1, run_start_date=2024-02-24 04:08:01.528987+00:00, run_end_date=2024-02-24 04:08:01.896818+00:00, run_duration=0.367831, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1221, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:08:00.216248+00:00, queued_by_job_id=2, pid=17799 2024-02-24T04:08:05.239293927Z [2024-02-24T04:08:05.238+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:08:05.239812563Z [2024-02-24T04:08:05.239+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:07:00+00:00, run_id=scheduled__2024-02-24T04:07:00+00:00, run_start_date=2024-02-24 04:08:00.149929+00:00, run_end_date=2024-02-24 04:08:05.239145+00:00, run_duration=5.089216, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:07:00+00:00, data_interval_end=2024-02-24 04:08:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:08:05.254565591Z [2024-02-24T04:08:05.254+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:08:00+00:00, run_after=2024-02-24T04:09:00+00:00 2024-02-24T04:08:05.266752985Z [2024-02-24T04:08:05.266+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:08:05.267357092Z [2024-02-24T04:08:05.266+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:07:00+00:00, run_id=scheduled__2024-02-24T04:07:00+00:00, run_start_date=2024-02-24 04:08:00.151122+00:00, run_end_date=2024-02-24 04:08:05.266619+00:00, run_duration=5.115497, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:07:00+00:00, data_interval_end=2024-02-24 04:08:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:08:05.283361728Z [2024-02-24T04:08:05.282+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:08:00+00:00, run_after=2024-02-24T04:09:00+00:00 2024-02-24T04:08:05.331070980Z [2024-02-24T04:08:05.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:07:00+00:00 exited with status success for try_number 1 2024-02-24T04:08:05.331326877Z [2024-02-24T04:08:05.330+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:07:00+00:00 exited with status success for try_number 1 2024-02-24T04:08:05.343174626Z [2024-02-24T04:08:05.342+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:07:00+00:00, map_index=-1, run_start_date=2024-02-24 04:08:02.443393+00:00, run_end_date=2024-02-24 04:08:04.482593+00:00, run_duration=2.0392, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1222, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:08:00.216248+00:00, queued_by_job_id=2, pid=17817 2024-02-24T04:08:05.343535902Z [2024-02-24T04:08:05.343+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:07:00+00:00, map_index=-1, run_start_date=2024-02-24 04:08:02.586552+00:00, run_end_date=2024-02-24 04:08:04.780829+00:00, run_duration=2.194277, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1223, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:08:00.216248+00:00, queued_by_job_id=2, pid=17818 2024-02-24T04:09:01.085037564Z [2024-02-24T04:09:01.084+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:09:01.101853698Z [2024-02-24T04:09:01.101+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:09:00+00:00, run_after=2024-02-24T04:10:00+00:00 2024-02-24T04:09:01.120962664Z [2024-02-24T04:09:01.120+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:09:00+00:00, run_after=2024-02-24T04:10:00+00:00 2024-02-24T04:09:01.226020687Z [2024-02-24T04:09:01.222+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T04:09:01.226057707Z 2024-02-24T04:09:01.226063081Z 2024-02-24T04:09:01.226067947Z 2024-02-24T04:09:01.226072568Z [2024-02-24T04:09:01.222+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:09:01.226077413Z [2024-02-24T04:09:01.223+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:09:01.226081952Z [2024-02-24T04:09:01.223+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:09:01.226087120Z [2024-02-24T04:09:01.224+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:09:01.226091771Z 2024-02-24T04:09:01.226096316Z 2024-02-24T04:09:01.226100758Z 2024-02-24T04:09:01.230041275Z [2024-02-24T04:09:01.228+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:09:01.230091627Z [2024-02-24T04:09:01.228+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:09:01.230101221Z [2024-02-24T04:09:01.229+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:09:01.230109547Z [2024-02-24T04:09:01.229+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:09:01.230117966Z [2024-02-24T04:09:01.229+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:09:01.230179677Z [2024-02-24T04:09:01.229+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:09:01.711201200Z [2024-02-24T04:09:01.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:08:00+00:00 exited with status queued for try_number 1 2024-02-24T04:09:01.711325477Z [2024-02-24T04:09:01.711+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:08:00+00:00 exited with status queued for try_number 1 2024-02-24T04:09:01.711530081Z [2024-02-24T04:09:01.711+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:08:00+00:00 exited with status queued for try_number 1 2024-02-24T04:09:01.727975216Z [2024-02-24T04:09:01.727+0000] {scheduler_job.py:635} INFO - Setting external_id for to 91b4f3c1-e646-4fbd-b7ae-21d055936748 2024-02-24T04:09:01.728379934Z [2024-02-24T04:09:01.727+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c0cf931-b343-4ca1-bccd-84fdca8e2a04 2024-02-24T04:09:01.728675728Z [2024-02-24T04:09:01.728+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d723ac6-6a7d-4969-b4d0-5f74c672c710 2024-02-24T04:09:03.433092649Z [2024-02-24T04:09:03.432+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:09:03.433549914Z [2024-02-24T04:09:03.433+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:08:00+00:00, run_id=scheduled__2024-02-24T04:08:00+00:00, run_start_date=2024-02-24 04:09:01.146902+00:00, run_end_date=2024-02-24 04:09:03.433009+00:00, run_duration=2.286107, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:08:00+00:00, data_interval_end=2024-02-24 04:09:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:09:03.447006733Z [2024-02-24T04:09:03.446+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:09:00+00:00, run_after=2024-02-24T04:10:00+00:00 2024-02-24T04:09:03.535601234Z [2024-02-24T04:09:03.535+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:08:00+00:00 exited with status success for try_number 1 2024-02-24T04:09:03.542379262Z [2024-02-24T04:09:03.542+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:08:00+00:00, map_index=-1, run_start_date=2024-02-24 04:09:02.345186+00:00, run_end_date=2024-02-24 04:09:02.926323+00:00, run_duration=0.581137, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1224, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:09:01.225393+00:00, queued_by_job_id=2, pid=17851 2024-02-24T04:09:07.319461783Z [2024-02-24T04:09:07.318+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:09:07.320180596Z [2024-02-24T04:09:07.319+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:08:00+00:00, run_id=scheduled__2024-02-24T04:08:00+00:00, run_start_date=2024-02-24 04:09:01.148551+00:00, run_end_date=2024-02-24 04:09:07.319537+00:00, run_duration=6.170986, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:08:00+00:00, data_interval_end=2024-02-24 04:09:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:09:07.333366856Z [2024-02-24T04:09:07.332+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:09:00+00:00, run_after=2024-02-24T04:10:00+00:00 2024-02-24T04:09:07.341478896Z [2024-02-24T04:09:07.340+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:09:07.341688315Z [2024-02-24T04:09:07.341+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:08:00+00:00, run_id=scheduled__2024-02-24T04:08:00+00:00, run_start_date=2024-02-24 04:09:01.150139+00:00, run_end_date=2024-02-24 04:09:07.341257+00:00, run_duration=6.191118, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:08:00+00:00, data_interval_end=2024-02-24 04:09:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:09:07.352295077Z [2024-02-24T04:09:07.352+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:09:00+00:00, run_after=2024-02-24T04:10:00+00:00 2024-02-24T04:09:07.395793032Z [2024-02-24T04:09:07.395+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:08:00+00:00 exited with status success for try_number 1 2024-02-24T04:09:07.396275538Z [2024-02-24T04:09:07.395+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:08:00+00:00 exited with status success for try_number 1 2024-02-24T04:09:07.407900424Z [2024-02-24T04:09:07.407+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:08:00+00:00, map_index=-1, run_start_date=2024-02-24 04:09:03.307559+00:00, run_end_date=2024-02-24 04:09:06.751944+00:00, run_duration=3.444385, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1225, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:09:01.225393+00:00, queued_by_job_id=2, pid=17868 2024-02-24T04:09:07.408367109Z [2024-02-24T04:09:07.408+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:08:00+00:00, map_index=-1, run_start_date=2024-02-24 04:09:03.354302+00:00, run_end_date=2024-02-24 04:09:06.793914+00:00, run_duration=3.439612, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1226, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:09:01.225393+00:00, queued_by_job_id=2, pid=17869 2024-02-24T04:10:00.163914225Z [2024-02-24T04:10:00.163+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:10:00.182758224Z [2024-02-24T04:10:00.182+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:10:00+00:00, run_after=2024-02-24T04:11:00+00:00 2024-02-24T04:10:00.194938075Z [2024-02-24T04:10:00.194+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:10:00.214007066Z [2024-02-24T04:10:00.213+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:10:00+00:00, run_after=2024-02-24T04:11:00+00:00 2024-02-24T04:10:00.228091579Z [2024-02-24T04:10:00.226+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:10:00+00:00, run_after=2024-02-24T04:15:00+00:00 2024-02-24T04:10:00.344729268Z [2024-02-24T04:10:00.344+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-02-24T04:10:00.344840356Z 2024-02-24T04:10:00.344852862Z 2024-02-24T04:10:00.344863040Z 2024-02-24T04:10:00.344871889Z 2024-02-24T04:10:00.344880585Z 2024-02-24T04:10:00.345648588Z [2024-02-24T04:10:00.344+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:10:00.346221835Z [2024-02-24T04:10:00.345+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T04:10:00.346669192Z [2024-02-24T04:10:00.346+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:10:00.347069439Z [2024-02-24T04:10:00.346+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:10:00.347525126Z [2024-02-24T04:10:00.347+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:10:00.349026167Z [2024-02-24T04:10:00.348+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:10:00.349052461Z 2024-02-24T04:10:00.349068932Z 2024-02-24T04:10:00.349078169Z 2024-02-24T04:10:00.349086796Z 2024-02-24T04:10:00.349125358Z 2024-02-24T04:10:00.356054923Z [2024-02-24T04:10:00.355+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T04:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T04:10:00.356360348Z [2024-02-24T04:10:00.355+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T04:10:00.356885406Z [2024-02-24T04:10:00.356+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T04:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:10:00.357158313Z [2024-02-24T04:10:00.356+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T04:10:00.357738301Z [2024-02-24T04:10:00.357+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:10:00.358088236Z [2024-02-24T04:10:00.357+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:10:00.358553215Z [2024-02-24T04:10:00.358+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:10:00.359008829Z [2024-02-24T04:10:00.358+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:10:00.359299971Z [2024-02-24T04:10:00.359+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:10:00.359489404Z [2024-02-24T04:10:00.359+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:10:00.864165746Z [2024-02-24T04:10:00.863+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T04:05:00+00:00 exited with status queued for try_number 1 2024-02-24T04:10:00.864585422Z [2024-02-24T04:10:00.864+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:08:00+00:00 exited with status queued for try_number 1 2024-02-24T04:10:00.864817999Z [2024-02-24T04:10:00.864+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:09:00+00:00 exited with status queued for try_number 1 2024-02-24T04:10:00.865061827Z [2024-02-24T04:10:00.864+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:09:00+00:00 exited with status queued for try_number 1 2024-02-24T04:10:00.865196970Z [2024-02-24T04:10:00.865+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:09:00+00:00 exited with status queued for try_number 1 2024-02-24T04:10:00.879191413Z [2024-02-24T04:10:00.878+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6ecd505-da83-49e1-8453-62df42de0b77 2024-02-24T04:10:00.879613801Z [2024-02-24T04:10:00.879+0000] {scheduler_job.py:635} INFO - Setting external_id for to 42335116-0470-480d-a242-dcfba39a487a 2024-02-24T04:10:00.879819599Z [2024-02-24T04:10:00.879+0000] {scheduler_job.py:635} INFO - Setting external_id for to e92cc626-dc7e-4986-9b14-684a482202c8 2024-02-24T04:10:00.879986915Z [2024-02-24T04:10:00.879+0000] {scheduler_job.py:635} INFO - Setting external_id for to a06fa683-1a0c-4d8f-8658-794b9994d9b3 2024-02-24T04:10:00.880164431Z [2024-02-24T04:10:00.880+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22b868ee-9a08-4d22-a3f9-b748c3cb7bbd 2024-02-24T04:10:02.311498641Z [2024-02-24T04:10:02.310+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:10:02.311819868Z [2024-02-24T04:10:02.311+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 04:08:00+00:00, run_id=scheduled__2024-02-24T04:08:00+00:00, run_start_date=2024-02-24 04:10:00.238287+00:00, run_end_date=2024-02-24 04:10:02.311457+00:00, run_duration=2.07317, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:08:00+00:00, data_interval_end=2024-02-24 04:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T04:10:02.323711453Z [2024-02-24T04:10:02.323+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T04:10:00+00:00, run_after=2024-02-24T04:12:00+00:00 2024-02-24T04:10:02.332386490Z [2024-02-24T04:10:02.331+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:10:02.332683027Z [2024-02-24T04:10:02.332+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:09:00+00:00, run_id=scheduled__2024-02-24T04:09:00+00:00, run_start_date=2024-02-24 04:10:00.239462+00:00, run_end_date=2024-02-24 04:10:02.332372+00:00, run_duration=2.09291, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:09:00+00:00, data_interval_end=2024-02-24 04:10:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:10:02.343544795Z [2024-02-24T04:10:02.343+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:10:00+00:00, run_after=2024-02-24T04:11:00+00:00 2024-02-24T04:10:02.435631990Z [2024-02-24T04:10:02.435+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:09:00+00:00 exited with status success for try_number 1 2024-02-24T04:10:02.443367194Z [2024-02-24T04:10:02.442+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:09:00+00:00, map_index=-1, run_start_date=2024-02-24 04:10:01.569794+00:00, run_end_date=2024-02-24 04:10:02.127403+00:00, run_duration=0.557609, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1227, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:10:00.351234+00:00, queued_by_job_id=2, pid=17902 2024-02-24T04:10:02.854767403Z [2024-02-24T04:10:02.854+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:08:00+00:00 exited with status success for try_number 1 2024-02-24T04:10:02.870507000Z [2024-02-24T04:10:02.870+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T04:08:00+00:00, map_index=-1, run_start_date=2024-02-24 04:10:01.623004+00:00, run_end_date=2024-02-24 04:10:02.217320+00:00, run_duration=0.594316, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1228, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:10:00.351234+00:00, queued_by_job_id=2, pid=17903 2024-02-24T04:10:03.974814779Z [2024-02-24T04:10:03.974+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:10:03.974844105Z 2024-02-24T04:10:03.977028258Z [2024-02-24T04:10:03.975+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:10:03.977051435Z [2024-02-24T04:10:03.975+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:10:03.977059235Z 2024-02-24T04:10:03.979836330Z [2024-02-24T04:10:03.979+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T04:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T04:10:03.980434939Z [2024-02-24T04:10:03.980+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T04:10:04.070235851Z [2024-02-24T04:10:04.069+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T04:05:00+00:00 exited with status queued for try_number 1 2024-02-24T04:10:04.071602367Z [2024-02-24T04:10:04.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T04:05:00+00:00 exited with status success for try_number 1 2024-02-24T04:10:04.086167152Z [2024-02-24T04:10:04.078+0000] {scheduler_job.py:635} INFO - Setting external_id for to 126adc02-4976-4f1a-a9ce-65793e7e73cb 2024-02-24T04:10:04.086217912Z [2024-02-24T04:10:04.078+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T04:05:00+00:00, map_index=-1, run_start_date=2024-02-24 04:10:02.808067+00:00, run_end_date=2024-02-24 04:10:03.197294+00:00, run_duration=0.389227, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1229, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:10:00.351234+00:00, queued_by_job_id=2, pid=17927 2024-02-24T04:10:05.232964733Z [2024-02-24T04:10:05.232+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:10:05.233341982Z [2024-02-24T04:10:05.233+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:09:00+00:00, run_id=scheduled__2024-02-24T04:09:00+00:00, run_start_date=2024-02-24 04:10:00.240461+00:00, run_end_date=2024-02-24 04:10:05.232973+00:00, run_duration=4.992512, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:09:00+00:00, data_interval_end=2024-02-24 04:10:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:10:05.242861895Z [2024-02-24T04:10:05.242+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:10:00+00:00, run_after=2024-02-24T04:11:00+00:00 2024-02-24T04:10:05.250946250Z [2024-02-24T04:10:05.250+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:10:05.251410540Z [2024-02-24T04:10:05.251+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:09:00+00:00, run_id=scheduled__2024-02-24T04:09:00+00:00, run_start_date=2024-02-24 04:10:00.241485+00:00, run_end_date=2024-02-24 04:10:05.251040+00:00, run_duration=5.009555, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:09:00+00:00, data_interval_end=2024-02-24 04:10:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:10:05.261750289Z [2024-02-24T04:10:05.261+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:10:00+00:00, run_after=2024-02-24T04:11:00+00:00 2024-02-24T04:10:05.313333951Z [2024-02-24T04:10:05.312+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:09:00+00:00 exited with status success for try_number 1 2024-02-24T04:10:05.313712958Z [2024-02-24T04:10:05.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:09:00+00:00 exited with status success for try_number 1 2024-02-24T04:10:05.322918921Z [2024-02-24T04:10:05.322+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:09:00+00:00, map_index=-1, run_start_date=2024-02-24 04:10:03.024315+00:00, run_end_date=2024-02-24 04:10:04.714134+00:00, run_duration=1.689819, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1230, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:10:00.351234+00:00, queued_by_job_id=2, pid=17933 2024-02-24T04:10:05.323375351Z [2024-02-24T04:10:05.323+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:09:00+00:00, map_index=-1, run_start_date=2024-02-24 04:10:03.279927+00:00, run_end_date=2024-02-24 04:10:04.688553+00:00, run_duration=1.408626, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1231, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:10:00.351234+00:00, queued_by_job_id=2, pid=17939 2024-02-24T04:10:07.409098862Z [2024-02-24T04:10:07.408+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:10:07.409294404Z 2024-02-24T04:10:07.409314003Z [2024-02-24T04:10:07.408+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:10:07.409515363Z [2024-02-24T04:10:07.409+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:10:07.409541641Z 2024-02-24T04:10:07.411862052Z [2024-02-24T04:10:07.411+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T04:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T04:10:07.412029485Z [2024-02-24T04:10:07.411+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T04:10:07.486430166Z [2024-02-24T04:10:07.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T04:05:00+00:00 exited with status queued for try_number 1 2024-02-24T04:10:07.486745968Z [2024-02-24T04:10:07.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T04:05:00+00:00 exited with status success for try_number 1 2024-02-24T04:10:07.495917763Z [2024-02-24T04:10:07.495+0000] {scheduler_job.py:635} INFO - Setting external_id for to ffdefb23-ccaa-4141-b020-d670268ed73a 2024-02-24T04:10:07.496449839Z [2024-02-24T04:10:07.496+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T04:05:00+00:00, map_index=-1, run_start_date=2024-02-24 04:10:05.925418+00:00, run_end_date=2024-02-24 04:10:06.302640+00:00, run_duration=0.377222, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1232, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:10:03.976094+00:00, queued_by_job_id=2, pid=17957 2024-02-24T04:10:09.961767670Z [2024-02-24T04:10:09.961+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:10:09.961869422Z 2024-02-24T04:10:09.961909110Z [2024-02-24T04:10:09.961+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:10:09.962828334Z [2024-02-24T04:10:09.962+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:10:09.962872977Z 2024-02-24T04:10:09.966761830Z [2024-02-24T04:10:09.966+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T04:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:10:09.967159828Z [2024-02-24T04:10:09.966+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T04:10:10.048206299Z [2024-02-24T04:10:10.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T04:05:00+00:00 exited with status queued for try_number 1 2024-02-24T04:10:10.048272021Z [2024-02-24T04:10:10.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T04:05:00+00:00 exited with status success for try_number 1 2024-02-24T04:10:10.057277874Z [2024-02-24T04:10:10.056+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0454c5ef-4963-417f-b98a-823c88a9c523 2024-02-24T04:10:10.057563477Z [2024-02-24T04:10:10.057+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T04:05:00+00:00, map_index=0, run_start_date=2024-02-24 04:10:09.039251+00:00, run_end_date=2024-02-24 04:10:09.385370+00:00, run_duration=0.346119, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1233, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:10:07.409926+00:00, queued_by_job_id=2, pid=17965 2024-02-24T04:10:12.395291160Z [2024-02-24T04:10:12.394+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:10:12.395630161Z [2024-02-24T04:10:12.395+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:05:00+00:00, run_id=scheduled__2024-02-24T04:05:00+00:00, run_start_date=2024-02-24 04:10:00.236962+00:00, run_end_date=2024-02-24 04:10:12.395353+00:00, run_duration=12.158391, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:05:00+00:00, data_interval_end=2024-02-24 04:10:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T04:10:12.402676039Z [2024-02-24T04:10:12.402+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:10:00+00:00, run_after=2024-02-24T04:15:00+00:00 2024-02-24T04:10:12.441113465Z [2024-02-24T04:10:12.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T04:05:00+00:00 exited with status success for try_number 1 2024-02-24T04:10:12.450072578Z [2024-02-24T04:10:12.449+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T04:05:00+00:00, map_index=-1, run_start_date=2024-02-24 04:10:11.738600+00:00, run_end_date=2024-02-24 04:10:12.116453+00:00, run_duration=0.377853, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1234, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:10:09.963200+00:00, queued_by_job_id=2, pid=17973 2024-02-24T04:10:25.025521432Z [2024-02-24T04:10:25.025+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:10:25.025551433Z 2024-02-24T04:10:25.025564889Z [2024-02-24T04:10:25.025+0000] {scheduler_job.py:425} INFO - DAG vdu_alarm has 0/16 running and queued tasks 2024-02-24T04:10:25.026459360Z [2024-02-24T04:10:25.026+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:10:25.026471378Z 2024-02-24T04:10:25.034523567Z [2024-02-24T04:10:25.034+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_alarm', task_id='main_task', run_id='vdu_alarm_20240224041024_824503', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:10:25.034790316Z [2024-02-24T04:10:25.034+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240224041024_824503', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-02-24T04:10:25.101861931Z [2024-02-24T04:10:25.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240224041024_824503 exited with status queued for try_number 1 2024-02-24T04:10:25.109077896Z [2024-02-24T04:10:25.108+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e0286cd-9ff5-480f-84d3-8d890673efee 2024-02-24T04:10:26.274750395Z [2024-02-24T04:10:26.274+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:10:26.275300400Z [2024-02-24T04:10:26.274+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_alarm, execution_date=2024-02-24 04:10:24.342954+00:00, run_id=vdu_alarm_20240224041024_824503, run_start_date=2024-02-24 04:10:24.972313+00:00, run_end_date=2024-02-24 04:10:26.274568+00:00, run_duration=1.302255, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-02-24 04:10:24.342954+00:00, data_interval_end=2024-02-24 04:10:24.342954+00:00, dag_hash=4c7a7f623757a362f63c388cf0edb231 2024-02-24T04:10:26.280157142Z [2024-02-24T04:10:26.279+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_alarm to None, run_after=None 2024-02-24T04:10:26.327076307Z [2024-02-24T04:10:26.326+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240224041024_824503 exited with status success for try_number 1 2024-02-24T04:10:26.336455500Z [2024-02-24T04:10:26.335+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_alarm, task_id=main_task, run_id=vdu_alarm_20240224041024_824503, map_index=-1, run_start_date=2024-02-24 04:10:25.722370+00:00, run_end_date=2024-02-24 04:10:26.097912+00:00, run_duration=0.375542, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1235, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:10:25.030317+00:00, queued_by_job_id=2, pid=17975 2024-02-24T04:11:00.343665234Z [2024-02-24T04:11:00.343+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:11:00+00:00, run_after=2024-02-24T04:12:00+00:00 2024-02-24T04:11:00.360320231Z [2024-02-24T04:11:00.359+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:11:00+00:00, run_after=2024-02-24T04:12:00+00:00 2024-02-24T04:11:00.371373739Z [2024-02-24T04:11:00.371+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:11:00.451777613Z [2024-02-24T04:11:00.451+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T04:11:00.451821184Z 2024-02-24T04:11:00.451830715Z 2024-02-24T04:11:00.451839868Z 2024-02-24T04:11:00.451862172Z [2024-02-24T04:11:00.451+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:11:00.451961715Z [2024-02-24T04:11:00.451+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:11:00.452153705Z [2024-02-24T04:11:00.451+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:11:00.452941437Z [2024-02-24T04:11:00.452+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:11:00.452960923Z 2024-02-24T04:11:00.452970107Z 2024-02-24T04:11:00.452978870Z 2024-02-24T04:11:00.457738356Z [2024-02-24T04:11:00.457+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:11:00.457803384Z [2024-02-24T04:11:00.457+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:11:00.458205485Z [2024-02-24T04:11:00.457+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:11:00.458297371Z [2024-02-24T04:11:00.458+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:11:00.458615666Z [2024-02-24T04:11:00.458+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:11:00.458649873Z [2024-02-24T04:11:00.458+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:11:00.675592809Z [2024-02-24T04:11:00.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:10:00+00:00 exited with status queued for try_number 1 2024-02-24T04:11:00.675804708Z [2024-02-24T04:11:00.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:10:00+00:00 exited with status queued for try_number 1 2024-02-24T04:11:00.675965228Z [2024-02-24T04:11:00.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:10:00+00:00 exited with status queued for try_number 1 2024-02-24T04:11:00.684470358Z [2024-02-24T04:11:00.683+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31eba1ca-57ed-42e4-a1ed-ee03f4c5bb51 2024-02-24T04:11:00.684718017Z [2024-02-24T04:11:00.684+0000] {scheduler_job.py:635} INFO - Setting external_id for to e2d542eb-b784-4c02-90c5-b6139a9e5716 2024-02-24T04:11:00.684928137Z [2024-02-24T04:11:00.684+0000] {scheduler_job.py:635} INFO - Setting external_id for to 124aad3e-be85-4894-8bd9-9f1cf5b1a156 2024-02-24T04:11:01.821593044Z [2024-02-24T04:11:01.821+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:11:01.822408637Z [2024-02-24T04:11:01.822+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:10:00+00:00, run_id=scheduled__2024-02-24T04:10:00+00:00, run_start_date=2024-02-24 04:11:00.383696+00:00, run_end_date=2024-02-24 04:11:01.821470+00:00, run_duration=1.437774, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:10:00+00:00, data_interval_end=2024-02-24 04:11:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:11:01.832056632Z [2024-02-24T04:11:01.831+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:11:00+00:00, run_after=2024-02-24T04:12:00+00:00 2024-02-24T04:11:02.318588222Z [2024-02-24T04:11:02.318+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:10:00+00:00 exited with status success for try_number 1 2024-02-24T04:11:02.326889851Z [2024-02-24T04:11:02.326+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:10:00+00:00, map_index=-1, run_start_date=2024-02-24 04:11:01.289754+00:00, run_end_date=2024-02-24 04:11:01.726909+00:00, run_duration=0.437155, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1236, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:11:00.453941+00:00, queued_by_job_id=2, pid=18002 2024-02-24T04:11:05.520528486Z [2024-02-24T04:11:05.520+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:11:05.520936776Z [2024-02-24T04:11:05.520+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:10:00+00:00, run_id=scheduled__2024-02-24T04:10:00+00:00, run_start_date=2024-02-24 04:11:00.385309+00:00, run_end_date=2024-02-24 04:11:05.520360+00:00, run_duration=5.135051, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:10:00+00:00, data_interval_end=2024-02-24 04:11:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:11:05.530156565Z [2024-02-24T04:11:05.529+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:11:00+00:00, run_after=2024-02-24T04:12:00+00:00 2024-02-24T04:11:05.537212518Z [2024-02-24T04:11:05.536+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:11:05.537562873Z [2024-02-24T04:11:05.537+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:10:00+00:00, run_id=scheduled__2024-02-24T04:10:00+00:00, run_start_date=2024-02-24 04:11:00.386662+00:00, run_end_date=2024-02-24 04:11:05.537058+00:00, run_duration=5.150396, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:10:00+00:00, data_interval_end=2024-02-24 04:11:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:11:05.546304378Z [2024-02-24T04:11:05.546+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:11:00+00:00, run_after=2024-02-24T04:12:00+00:00 2024-02-24T04:11:05.573366690Z [2024-02-24T04:11:05.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:10:00+00:00 exited with status success for try_number 1 2024-02-24T04:11:05.573756055Z [2024-02-24T04:11:05.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:10:00+00:00 exited with status success for try_number 1 2024-02-24T04:11:05.580936203Z [2024-02-24T04:11:05.580+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:10:00+00:00, map_index=-1, run_start_date=2024-02-24 04:11:02.312332+00:00, run_end_date=2024-02-24 04:11:04.454253+00:00, run_duration=2.141921, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1237, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:11:00.453941+00:00, queued_by_job_id=2, pid=18020 2024-02-24T04:11:05.581197049Z [2024-02-24T04:11:05.580+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:10:00+00:00, map_index=-1, run_start_date=2024-02-24 04:11:02.354859+00:00, run_end_date=2024-02-24 04:11:04.848471+00:00, run_duration=2.493612, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1238, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:11:00.453941+00:00, queued_by_job_id=2, pid=18021 2024-02-24T04:12:00.295516991Z [2024-02-24T04:12:00.294+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:12:00+00:00, run_after=2024-02-24T04:13:00+00:00 2024-02-24T04:12:00.306760092Z [2024-02-24T04:12:00.306+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:12:00.319918928Z [2024-02-24T04:12:00.317+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:12:00.338408698Z [2024-02-24T04:12:00.338+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:12:00+00:00, run_after=2024-02-24T04:13:00+00:00 2024-02-24T04:12:00.451381597Z [2024-02-24T04:12:00.450+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T04:12:00.451451620Z 2024-02-24T04:12:00.451461045Z 2024-02-24T04:12:00.451497540Z 2024-02-24T04:12:00.451506283Z 2024-02-24T04:12:00.451530114Z [2024-02-24T04:12:00.451+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T04:12:00.451628377Z [2024-02-24T04:12:00.451+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:12:00.451778584Z [2024-02-24T04:12:00.451+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:12:00.451938534Z [2024-02-24T04:12:00.451+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:12:00.452681484Z [2024-02-24T04:12:00.452+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:12:00.452693787Z 2024-02-24T04:12:00.452700123Z 2024-02-24T04:12:00.452727367Z 2024-02-24T04:12:00.452733428Z 2024-02-24T04:12:00.457339274Z [2024-02-24T04:12:00.456+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T04:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:12:00.457437398Z [2024-02-24T04:12:00.457+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T04:12:00.457945540Z [2024-02-24T04:12:00.457+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:12:00.458054961Z [2024-02-24T04:12:00.457+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:12:00.458473194Z [2024-02-24T04:12:00.458+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:12:00.458549297Z [2024-02-24T04:12:00.458+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:12:00.458779849Z [2024-02-24T04:12:00.458+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:12:00.458931991Z [2024-02-24T04:12:00.458+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:12:00.958359593Z [2024-02-24T04:12:00.957+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:10:00+00:00 exited with status queued for try_number 1 2024-02-24T04:12:00.958632301Z [2024-02-24T04:12:00.958+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:11:00+00:00 exited with status queued for try_number 1 2024-02-24T04:12:00.958891899Z [2024-02-24T04:12:00.958+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:11:00+00:00 exited with status queued for try_number 1 2024-02-24T04:12:00.959098276Z [2024-02-24T04:12:00.958+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:11:00+00:00 exited with status queued for try_number 1 2024-02-24T04:12:00.974025600Z [2024-02-24T04:12:00.973+0000] {scheduler_job.py:635} INFO - Setting external_id for to d7ac3981-98f6-4415-9a62-5a87704b12db 2024-02-24T04:12:00.977686624Z [2024-02-24T04:12:00.977+0000] {scheduler_job.py:635} INFO - Setting external_id for to 24f65d75-298d-42c0-8dfb-e1e7b81e649c 2024-02-24T04:12:00.977903738Z [2024-02-24T04:12:00.977+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc88d6ab-8b6a-4bad-9e12-272879d73785 2024-02-24T04:12:00.978180844Z [2024-02-24T04:12:00.977+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4559d10d-a0a4-4f1d-bc3c-02de95e93384 2024-02-24T04:12:02.239606284Z [2024-02-24T04:12:02.238+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:12:02.240773026Z [2024-02-24T04:12:02.240+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 04:10:00+00:00, run_id=scheduled__2024-02-24T04:10:00+00:00, run_start_date=2024-02-24 04:12:00.353784+00:00, run_end_date=2024-02-24 04:12:02.239986+00:00, run_duration=1.886202, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:10:00+00:00, data_interval_end=2024-02-24 04:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T04:12:02.256719745Z [2024-02-24T04:12:02.256+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T04:12:00+00:00, run_after=2024-02-24T04:14:00+00:00 2024-02-24T04:12:02.266105955Z [2024-02-24T04:12:02.265+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:12:02.266285798Z [2024-02-24T04:12:02.266+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:11:00+00:00, run_id=scheduled__2024-02-24T04:11:00+00:00, run_start_date=2024-02-24 04:12:00.355169+00:00, run_end_date=2024-02-24 04:12:02.266017+00:00, run_duration=1.910848, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:11:00+00:00, data_interval_end=2024-02-24 04:12:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:12:02.277357919Z [2024-02-24T04:12:02.277+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:12:00+00:00, run_after=2024-02-24T04:13:00+00:00 2024-02-24T04:12:02.340253022Z [2024-02-24T04:12:02.339+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:10:00+00:00 exited with status success for try_number 1 2024-02-24T04:12:02.340636383Z [2024-02-24T04:12:02.340+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:11:00+00:00 exited with status success for try_number 1 2024-02-24T04:12:02.355466571Z [2024-02-24T04:12:02.355+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T04:10:00+00:00, map_index=-1, run_start_date=2024-02-24 04:12:01.334424+00:00, run_end_date=2024-02-24 04:12:01.746422+00:00, run_duration=0.411998, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1239, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:12:00.453707+00:00, queued_by_job_id=2, pid=18055 2024-02-24T04:12:02.355628817Z [2024-02-24T04:12:02.355+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:11:00+00:00, map_index=-1, run_start_date=2024-02-24 04:12:01.418664+00:00, run_end_date=2024-02-24 04:12:01.859111+00:00, run_duration=0.440447, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1240, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:12:00.453707+00:00, queued_by_job_id=2, pid=18056 2024-02-24T04:12:04.929160324Z [2024-02-24T04:12:04.928+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:12:04.929451373Z [2024-02-24T04:12:04.929+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:11:00+00:00, run_id=scheduled__2024-02-24T04:11:00+00:00, run_start_date=2024-02-24 04:12:00.358044+00:00, run_end_date=2024-02-24 04:12:04.929105+00:00, run_duration=4.571061, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:11:00+00:00, data_interval_end=2024-02-24 04:12:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:12:04.941010450Z [2024-02-24T04:12:04.940+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:12:00+00:00, run_after=2024-02-24T04:13:00+00:00 2024-02-24T04:12:04.957149210Z [2024-02-24T04:12:04.956+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:12:04.957422607Z [2024-02-24T04:12:04.957+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:11:00+00:00, run_id=scheduled__2024-02-24T04:11:00+00:00, run_start_date=2024-02-24 04:12:00.356764+00:00, run_end_date=2024-02-24 04:12:04.956933+00:00, run_duration=4.600169, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:11:00+00:00, data_interval_end=2024-02-24 04:12:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:12:04.975678268Z [2024-02-24T04:12:04.975+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:12:00+00:00, run_after=2024-02-24T04:13:00+00:00 2024-02-24T04:12:05.014201063Z [2024-02-24T04:12:05.013+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:11:00+00:00 exited with status success for try_number 1 2024-02-24T04:12:05.014646166Z [2024-02-24T04:12:05.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:11:00+00:00 exited with status success for try_number 1 2024-02-24T04:12:05.023534261Z [2024-02-24T04:12:05.023+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:11:00+00:00, map_index=-1, run_start_date=2024-02-24 04:12:02.353285+00:00, run_end_date=2024-02-24 04:12:04.032287+00:00, run_duration=1.679002, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1241, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:12:00.453707+00:00, queued_by_job_id=2, pid=18074 2024-02-24T04:12:05.023897937Z [2024-02-24T04:12:05.023+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:11:00+00:00, map_index=-1, run_start_date=2024-02-24 04:12:02.697539+00:00, run_end_date=2024-02-24 04:12:04.067621+00:00, run_duration=1.370082, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1242, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:12:00.453707+00:00, queued_by_job_id=2, pid=18080 2024-02-24T04:12:06.150384909Z [2024-02-24T04:12:06.150+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T04:13:00.289417158Z [2024-02-24T04:13:00.288+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:13:00+00:00, run_after=2024-02-24T04:14:00+00:00 2024-02-24T04:13:00.301445584Z [2024-02-24T04:13:00.301+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:13:00+00:00, run_after=2024-02-24T04:14:00+00:00 2024-02-24T04:13:00.308852834Z [2024-02-24T04:13:00.308+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:13:00.392473750Z [2024-02-24T04:13:00.392+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T04:13:00.392510013Z 2024-02-24T04:13:00.392517296Z 2024-02-24T04:13:00.392529059Z 2024-02-24T04:13:00.392765346Z [2024-02-24T04:13:00.392+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:13:00.393115899Z [2024-02-24T04:13:00.392+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:13:00.393478045Z [2024-02-24T04:13:00.393+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:13:00.394842338Z [2024-02-24T04:13:00.394+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:13:00.394894817Z 2024-02-24T04:13:00.394904353Z 2024-02-24T04:13:00.394911200Z 2024-02-24T04:13:00.401440135Z [2024-02-24T04:13:00.401+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:13:00.401873152Z [2024-02-24T04:13:00.401+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:13:00.402193811Z [2024-02-24T04:13:00.402+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:13:00.402368157Z [2024-02-24T04:13:00.402+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:13:00.402561098Z [2024-02-24T04:13:00.402+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:13:00.402683666Z [2024-02-24T04:13:00.402+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:13:00.654735642Z [2024-02-24T04:13:00.654+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:12:00+00:00 exited with status queued for try_number 1 2024-02-24T04:13:00.656827157Z [2024-02-24T04:13:00.654+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:12:00+00:00 exited with status queued for try_number 1 2024-02-24T04:13:00.657046834Z [2024-02-24T04:13:00.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:12:00+00:00 exited with status queued for try_number 1 2024-02-24T04:13:00.664435018Z [2024-02-24T04:13:00.664+0000] {scheduler_job.py:635} INFO - Setting external_id for to 08a540ec-cc11-44c9-a461-73e68613a16f 2024-02-24T04:13:00.664649349Z [2024-02-24T04:13:00.664+0000] {scheduler_job.py:635} INFO - Setting external_id for to db2e97cf-869a-412e-9432-31ff46fdad74 2024-02-24T04:13:00.664827475Z [2024-02-24T04:13:00.664+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8f350dd-eaa7-419d-be6e-fde006692ee2 2024-02-24T04:13:01.884105585Z [2024-02-24T04:13:01.883+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:13:01.884423016Z [2024-02-24T04:13:01.884+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:12:00+00:00, run_id=scheduled__2024-02-24T04:12:00+00:00, run_start_date=2024-02-24 04:13:00.319839+00:00, run_end_date=2024-02-24 04:13:01.884045+00:00, run_duration=1.564206, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:12:00+00:00, data_interval_end=2024-02-24 04:13:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:13:01.899274397Z [2024-02-24T04:13:01.898+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:13:00+00:00, run_after=2024-02-24T04:14:00+00:00 2024-02-24T04:13:01.943907604Z [2024-02-24T04:13:01.943+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:12:00+00:00 exited with status success for try_number 1 2024-02-24T04:13:01.948957724Z [2024-02-24T04:13:01.948+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:12:00+00:00, map_index=-1, run_start_date=2024-02-24 04:13:01.340563+00:00, run_end_date=2024-02-24 04:13:01.733193+00:00, run_duration=0.39263, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1243, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:13:00.396984+00:00, queued_by_job_id=2, pid=18112 2024-02-24T04:13:05.427026328Z [2024-02-24T04:13:05.426+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:13:05.427264754Z [2024-02-24T04:13:05.426+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:12:00+00:00, run_id=scheduled__2024-02-24T04:12:00+00:00, run_start_date=2024-02-24 04:13:00.321084+00:00, run_end_date=2024-02-24 04:13:05.426744+00:00, run_duration=5.10566, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:12:00+00:00, data_interval_end=2024-02-24 04:13:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:13:05.436847849Z [2024-02-24T04:13:05.436+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:13:00+00:00, run_after=2024-02-24T04:14:00+00:00 2024-02-24T04:13:05.445153060Z [2024-02-24T04:13:05.444+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:13:05.445375343Z [2024-02-24T04:13:05.445+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:12:00+00:00, run_id=scheduled__2024-02-24T04:12:00+00:00, run_start_date=2024-02-24 04:13:00.322108+00:00, run_end_date=2024-02-24 04:13:05.444991+00:00, run_duration=5.122883, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:12:00+00:00, data_interval_end=2024-02-24 04:13:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:13:05.454944564Z [2024-02-24T04:13:05.454+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:13:00+00:00, run_after=2024-02-24T04:14:00+00:00 2024-02-24T04:13:05.506329622Z [2024-02-24T04:13:05.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:12:00+00:00 exited with status success for try_number 1 2024-02-24T04:13:05.506515647Z [2024-02-24T04:13:05.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:12:00+00:00 exited with status success for try_number 1 2024-02-24T04:13:05.517301153Z [2024-02-24T04:13:05.516+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:12:00+00:00, map_index=-1, run_start_date=2024-02-24 04:13:02.482689+00:00, run_end_date=2024-02-24 04:13:04.308972+00:00, run_duration=1.826283, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1245, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:13:00.396984+00:00, queued_by_job_id=2, pid=18131 2024-02-24T04:13:05.517401659Z [2024-02-24T04:13:05.517+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:12:00+00:00, map_index=-1, run_start_date=2024-02-24 04:13:02.436183+00:00, run_end_date=2024-02-24 04:13:04.667417+00:00, run_duration=2.231234, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1244, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:13:00.396984+00:00, queued_by_job_id=2, pid=18130 2024-02-24T04:14:00.239522566Z [2024-02-24T04:14:00.238+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:14:00.256755923Z [2024-02-24T04:14:00.256+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:14:00.271844722Z [2024-02-24T04:14:00.271+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:14:00+00:00, run_after=2024-02-24T04:15:00+00:00 2024-02-24T04:14:00.284839987Z [2024-02-24T04:14:00.284+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:14:00+00:00, run_after=2024-02-24T04:15:00+00:00 2024-02-24T04:14:00.379642689Z [2024-02-24T04:14:00.379+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T04:14:00.379730985Z 2024-02-24T04:14:00.379742521Z 2024-02-24T04:14:00.379751363Z 2024-02-24T04:14:00.379791470Z 2024-02-24T04:14:00.379848652Z [2024-02-24T04:14:00.379+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T04:14:00.379868404Z [2024-02-24T04:14:00.379+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:14:00.380026276Z [2024-02-24T04:14:00.379+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:14:00.380236803Z [2024-02-24T04:14:00.380+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:14:00.380916464Z [2024-02-24T04:14:00.380+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:14:00.380961960Z 2024-02-24T04:14:00.380970773Z 2024-02-24T04:14:00.380978350Z 2024-02-24T04:14:00.380985937Z 2024-02-24T04:14:00.385821144Z [2024-02-24T04:14:00.385+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T04:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:14:00.385944613Z [2024-02-24T04:14:00.385+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T04:14:00.386309157Z [2024-02-24T04:14:00.386+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:14:00.386482981Z [2024-02-24T04:14:00.386+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:14:00.386789695Z [2024-02-24T04:14:00.386+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:14:00.386937367Z [2024-02-24T04:14:00.386+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:14:00.387281435Z [2024-02-24T04:14:00.387+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:14:00.388484320Z [2024-02-24T04:14:00.387+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:14:00.848748264Z [2024-02-24T04:14:00.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:12:00+00:00 exited with status queued for try_number 1 2024-02-24T04:14:00.851153857Z [2024-02-24T04:14:00.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:13:00+00:00 exited with status queued for try_number 1 2024-02-24T04:14:00.851541881Z [2024-02-24T04:14:00.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:13:00+00:00 exited with status queued for try_number 1 2024-02-24T04:14:00.851868401Z [2024-02-24T04:14:00.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:13:00+00:00 exited with status queued for try_number 1 2024-02-24T04:14:00.859998480Z [2024-02-24T04:14:00.859+0000] {scheduler_job.py:635} INFO - Setting external_id for to f18da770-a404-4c31-92d1-9c9461c1f000 2024-02-24T04:14:00.860272759Z [2024-02-24T04:14:00.860+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5febdffb-52f0-4ead-a3a5-0043944cf120 2024-02-24T04:14:00.860484806Z [2024-02-24T04:14:00.860+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d0ad2fd-b4dd-4c14-883d-b3002ff0e83d 2024-02-24T04:14:00.860695403Z [2024-02-24T04:14:00.860+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc60da37-3bb6-4d11-920a-b9507f674daf 2024-02-24T04:14:02.193150710Z [2024-02-24T04:14:02.192+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:14:02.193385306Z [2024-02-24T04:14:02.193+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 04:12:00+00:00, run_id=scheduled__2024-02-24T04:12:00+00:00, run_start_date=2024-02-24 04:14:00.298282+00:00, run_end_date=2024-02-24 04:14:02.193065+00:00, run_duration=1.894783, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:12:00+00:00, data_interval_end=2024-02-24 04:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T04:14:02.201549350Z [2024-02-24T04:14:02.201+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T04:14:00+00:00, run_after=2024-02-24T04:16:00+00:00 2024-02-24T04:14:02.210905352Z [2024-02-24T04:14:02.210+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:14:02.211122971Z [2024-02-24T04:14:02.210+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:13:00+00:00, run_id=scheduled__2024-02-24T04:13:00+00:00, run_start_date=2024-02-24 04:14:00.301141+00:00, run_end_date=2024-02-24 04:14:02.210876+00:00, run_duration=1.909735, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:13:00+00:00, data_interval_end=2024-02-24 04:14:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:14:02.224379729Z [2024-02-24T04:14:02.224+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:14:00+00:00, run_after=2024-02-24T04:15:00+00:00 2024-02-24T04:14:02.296394916Z [2024-02-24T04:14:02.295+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:12:00+00:00 exited with status success for try_number 1 2024-02-24T04:14:02.296438877Z [2024-02-24T04:14:02.296+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:13:00+00:00 exited with status success for try_number 1 2024-02-24T04:14:02.304447760Z [2024-02-24T04:14:02.303+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T04:12:00+00:00, map_index=-1, run_start_date=2024-02-24 04:14:01.358050+00:00, run_end_date=2024-02-24 04:14:01.770792+00:00, run_duration=0.412742, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1246, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:14:00.381879+00:00, queued_by_job_id=2, pid=18164 2024-02-24T04:14:02.304552630Z [2024-02-24T04:14:02.304+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:13:00+00:00, map_index=-1, run_start_date=2024-02-24 04:14:01.517682+00:00, run_end_date=2024-02-24 04:14:01.939399+00:00, run_duration=0.421717, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1247, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:14:00.381879+00:00, queued_by_job_id=2, pid=18166 2024-02-24T04:14:04.489899044Z [2024-02-24T04:14:04.489+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:14:04.490211121Z [2024-02-24T04:14:04.489+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:13:00+00:00, run_id=scheduled__2024-02-24T04:13:00+00:00, run_start_date=2024-02-24 04:14:00.319399+00:00, run_end_date=2024-02-24 04:14:04.489687+00:00, run_duration=4.170288, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:13:00+00:00, data_interval_end=2024-02-24 04:14:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:14:04.499561017Z [2024-02-24T04:14:04.498+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:14:00+00:00, run_after=2024-02-24T04:15:00+00:00 2024-02-24T04:14:04.507156336Z [2024-02-24T04:14:04.506+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:14:04.507593249Z [2024-02-24T04:14:04.507+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:13:00+00:00, run_id=scheduled__2024-02-24T04:13:00+00:00, run_start_date=2024-02-24 04:14:00.317945+00:00, run_end_date=2024-02-24 04:14:04.507009+00:00, run_duration=4.189064, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:13:00+00:00, data_interval_end=2024-02-24 04:14:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:14:04.516988647Z [2024-02-24T04:14:04.516+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:14:00+00:00, run_after=2024-02-24T04:15:00+00:00 2024-02-24T04:14:04.550923852Z [2024-02-24T04:14:04.550+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:13:00+00:00 exited with status success for try_number 1 2024-02-24T04:14:04.551049217Z [2024-02-24T04:14:04.550+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:13:00+00:00 exited with status success for try_number 1 2024-02-24T04:14:04.564090687Z [2024-02-24T04:14:04.563+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:13:00+00:00, map_index=-1, run_start_date=2024-02-24 04:14:02.545120+00:00, run_end_date=2024-02-24 04:14:03.857001+00:00, run_duration=1.311881, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1249, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:14:00.381879+00:00, queued_by_job_id=2, pid=18189 2024-02-24T04:14:04.564413974Z [2024-02-24T04:14:04.564+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:13:00+00:00, map_index=-1, run_start_date=2024-02-24 04:14:02.392488+00:00, run_end_date=2024-02-24 04:14:04.226012+00:00, run_duration=1.833524, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1248, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:14:00.381879+00:00, queued_by_job_id=2, pid=18188 2024-02-24T04:15:00.903667797Z [2024-02-24T04:15:00.903+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:15:00+00:00, run_after=2024-02-24T04:20:00+00:00 2024-02-24T04:15:00.924719216Z [2024-02-24T04:15:00.924+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:15:00+00:00, run_after=2024-02-24T04:16:00+00:00 2024-02-24T04:15:00.942499326Z [2024-02-24T04:15:00.942+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:15:00+00:00, run_after=2024-02-24T04:16:00+00:00 2024-02-24T04:15:00.955618320Z [2024-02-24T04:15:00.955+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:15:01.102427108Z [2024-02-24T04:15:01.101+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T04:15:01.102547811Z 2024-02-24T04:15:01.102556708Z 2024-02-24T04:15:01.102587331Z 2024-02-24T04:15:01.102658526Z 2024-02-24T04:15:01.102666213Z [2024-02-24T04:15:01.102+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:15:01.102743148Z [2024-02-24T04:15:01.102+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:15:01.102765259Z [2024-02-24T04:15:01.102+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:15:01.102771892Z [2024-02-24T04:15:01.102+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:15:01.103520429Z [2024-02-24T04:15:01.103+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:15:01.103545051Z 2024-02-24T04:15:01.103549190Z 2024-02-24T04:15:01.103552720Z 2024-02-24T04:15:01.103555879Z 2024-02-24T04:15:01.108478201Z [2024-02-24T04:15:01.108+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T04:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T04:15:01.108711674Z [2024-02-24T04:15:01.108+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T04:15:01.109122567Z [2024-02-24T04:15:01.108+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:15:01.109332503Z [2024-02-24T04:15:01.109+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:15:01.109727401Z [2024-02-24T04:15:01.109+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:15:01.109991415Z [2024-02-24T04:15:01.109+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:15:01.110365374Z [2024-02-24T04:15:01.110+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:15:01.110658293Z [2024-02-24T04:15:01.110+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:15:01.628119216Z [2024-02-24T04:15:01.627+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T04:10:00+00:00 exited with status queued for try_number 1 2024-02-24T04:15:01.628337523Z [2024-02-24T04:15:01.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:14:00+00:00 exited with status queued for try_number 1 2024-02-24T04:15:01.628606680Z [2024-02-24T04:15:01.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:14:00+00:00 exited with status queued for try_number 1 2024-02-24T04:15:01.628784664Z [2024-02-24T04:15:01.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:14:00+00:00 exited with status queued for try_number 1 2024-02-24T04:15:01.648014537Z [2024-02-24T04:15:01.647+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ac62395-d3a5-4ce1-b2ee-9b47c5998f6f 2024-02-24T04:15:01.648378082Z [2024-02-24T04:15:01.648+0000] {scheduler_job.py:635} INFO - Setting external_id for to f1d572dc-2314-43b5-9b67-32f014ad5945 2024-02-24T04:15:01.648692613Z [2024-02-24T04:15:01.648+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6063f1dc-0d02-41d4-b7d5-31ef340990ba 2024-02-24T04:15:01.649011035Z [2024-02-24T04:15:01.648+0000] {scheduler_job.py:635} INFO - Setting external_id for to 147a2705-2449-4680-a52b-70d58a0daa66 2024-02-24T04:15:02.942608742Z [2024-02-24T04:15:02.942+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:15:02.942968619Z [2024-02-24T04:15:02.942+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:14:00+00:00, run_id=scheduled__2024-02-24T04:14:00+00:00, run_start_date=2024-02-24 04:15:00.971794+00:00, run_end_date=2024-02-24 04:15:02.942614+00:00, run_duration=1.97082, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:14:00+00:00, data_interval_end=2024-02-24 04:15:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:15:02.953606216Z [2024-02-24T04:15:02.952+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:15:00+00:00, run_after=2024-02-24T04:16:00+00:00 2024-02-24T04:15:03.004285980Z [2024-02-24T04:15:03.003+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:14:00+00:00 exited with status success for try_number 1 2024-02-24T04:15:03.012345657Z [2024-02-24T04:15:03.011+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:14:00+00:00, map_index=-1, run_start_date=2024-02-24 04:15:02.140535+00:00, run_end_date=2024-02-24 04:15:02.538407+00:00, run_duration=0.397872, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1250, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:15:01.104556+00:00, queued_by_job_id=2, pid=18222 2024-02-24T04:15:04.152199749Z [2024-02-24T04:15:04.151+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:15:04.152245629Z 2024-02-24T04:15:04.152576861Z [2024-02-24T04:15:04.152+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:15:04.153662106Z [2024-02-24T04:15:04.153+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:15:04.153679496Z 2024-02-24T04:15:04.157635657Z [2024-02-24T04:15:04.157+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T04:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T04:15:04.157896429Z [2024-02-24T04:15:04.157+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T04:15:04.226491623Z [2024-02-24T04:15:04.225+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T04:10:00+00:00 exited with status queued for try_number 1 2024-02-24T04:15:04.226531262Z [2024-02-24T04:15:04.226+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T04:10:00+00:00 exited with status success for try_number 1 2024-02-24T04:15:04.232442548Z [2024-02-24T04:15:04.232+0000] {scheduler_job.py:635} INFO - Setting external_id for to b91edb73-50a3-4317-b754-1419a7877f46 2024-02-24T04:15:04.232630734Z [2024-02-24T04:15:04.232+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T04:10:00+00:00, map_index=-1, run_start_date=2024-02-24 04:15:03.428848+00:00, run_end_date=2024-02-24 04:15:03.816000+00:00, run_duration=0.387152, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1252, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:15:01.104556+00:00, queued_by_job_id=2, pid=18247 2024-02-24T04:15:06.071765484Z [2024-02-24T04:15:06.071+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:15:06.072162077Z [2024-02-24T04:15:06.071+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:14:00+00:00, run_id=scheduled__2024-02-24T04:14:00+00:00, run_start_date=2024-02-24 04:15:00.972946+00:00, run_end_date=2024-02-24 04:15:06.071686+00:00, run_duration=5.09874, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:14:00+00:00, data_interval_end=2024-02-24 04:15:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:15:06.082159225Z [2024-02-24T04:15:06.081+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:15:00+00:00, run_after=2024-02-24T04:16:00+00:00 2024-02-24T04:15:06.089954738Z [2024-02-24T04:15:06.089+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:15:06.090293085Z [2024-02-24T04:15:06.090+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:14:00+00:00, run_id=scheduled__2024-02-24T04:14:00+00:00, run_start_date=2024-02-24 04:15:00.974116+00:00, run_end_date=2024-02-24 04:15:06.089845+00:00, run_duration=5.115729, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:14:00+00:00, data_interval_end=2024-02-24 04:15:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:15:06.101145490Z [2024-02-24T04:15:06.100+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:15:00+00:00, run_after=2024-02-24T04:16:00+00:00 2024-02-24T04:15:06.142394716Z [2024-02-24T04:15:06.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:14:00+00:00 exited with status success for try_number 1 2024-02-24T04:15:06.142648049Z [2024-02-24T04:15:06.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:14:00+00:00 exited with status success for try_number 1 2024-02-24T04:15:06.149035913Z [2024-02-24T04:15:06.148+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:14:00+00:00, map_index=-1, run_start_date=2024-02-24 04:15:03.384588+00:00, run_end_date=2024-02-24 04:15:05.615957+00:00, run_duration=2.231369, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1251, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:15:01.104556+00:00, queued_by_job_id=2, pid=18246 2024-02-24T04:15:06.149374368Z [2024-02-24T04:15:06.148+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:14:00+00:00, map_index=-1, run_start_date=2024-02-24 04:15:03.456598+00:00, run_end_date=2024-02-24 04:15:05.395229+00:00, run_duration=1.938631, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1253, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:15:01.104556+00:00, queued_by_job_id=2, pid=18248 2024-02-24T04:15:06.975164990Z [2024-02-24T04:15:06.974+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:15:06.975209618Z 2024-02-24T04:15:06.975376187Z [2024-02-24T04:15:06.974+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:15:06.976133696Z [2024-02-24T04:15:06.975+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:15:06.976146473Z 2024-02-24T04:15:06.979739447Z [2024-02-24T04:15:06.979+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T04:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T04:15:06.980070127Z [2024-02-24T04:15:06.979+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T04:15:07.046396528Z [2024-02-24T04:15:07.046+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T04:10:00+00:00 exited with status queued for try_number 1 2024-02-24T04:15:07.046425516Z [2024-02-24T04:15:07.046+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T04:10:00+00:00 exited with status success for try_number 1 2024-02-24T04:15:07.052784700Z [2024-02-24T04:15:07.052+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8065b741-f9df-4f78-8983-948561992c35 2024-02-24T04:15:07.052883616Z [2024-02-24T04:15:07.052+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T04:10:00+00:00, map_index=-1, run_start_date=2024-02-24 04:15:05.779091+00:00, run_end_date=2024-02-24 04:15:06.108955+00:00, run_duration=0.329864, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1254, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:15:04.154329+00:00, queued_by_job_id=2, pid=18271 2024-02-24T04:15:09.301562204Z [2024-02-24T04:15:09.301+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:15:09.301591350Z 2024-02-24T04:15:09.301729366Z [2024-02-24T04:15:09.301+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:15:09.302730970Z [2024-02-24T04:15:09.302+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:15:09.302744282Z 2024-02-24T04:15:09.306675592Z [2024-02-24T04:15:09.306+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T04:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:15:09.307182726Z [2024-02-24T04:15:09.306+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T04:15:09.362544832Z [2024-02-24T04:15:09.362+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T04:10:00+00:00 exited with status queued for try_number 1 2024-02-24T04:15:09.362836973Z [2024-02-24T04:15:09.362+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T04:10:00+00:00 exited with status success for try_number 1 2024-02-24T04:15:09.369513592Z [2024-02-24T04:15:09.369+0000] {scheduler_job.py:635} INFO - Setting external_id for to f889b291-3fca-4049-980a-c133e23769dc 2024-02-24T04:15:09.370056967Z [2024-02-24T04:15:09.369+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T04:10:00+00:00, map_index=0, run_start_date=2024-02-24 04:15:08.649946+00:00, run_end_date=2024-02-24 04:15:09.052113+00:00, run_duration=0.402167, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1255, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:15:06.976727+00:00, queued_by_job_id=2, pid=18279 2024-02-24T04:15:12.119100217Z [2024-02-24T04:15:12.118+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:15:12.119309214Z [2024-02-24T04:15:12.119+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:10:00+00:00, run_id=scheduled__2024-02-24T04:10:00+00:00, run_start_date=2024-02-24 04:15:00.970413+00:00, run_end_date=2024-02-24 04:15:12.119033+00:00, run_duration=11.14862, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:10:00+00:00, data_interval_end=2024-02-24 04:15:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T04:15:12.130235396Z [2024-02-24T04:15:12.129+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:15:00+00:00, run_after=2024-02-24T04:20:00+00:00 2024-02-24T04:15:12.167950350Z [2024-02-24T04:15:12.167+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T04:10:00+00:00 exited with status success for try_number 1 2024-02-24T04:15:12.177076254Z [2024-02-24T04:15:12.176+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T04:10:00+00:00, map_index=-1, run_start_date=2024-02-24 04:15:10.959823+00:00, run_end_date=2024-02-24 04:15:11.349476+00:00, run_duration=0.389653, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1256, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:15:09.303290+00:00, queued_by_job_id=2, pid=18287 2024-02-24T04:16:00.896852636Z [2024-02-24T04:16:00.896+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:16:00.918716777Z [2024-02-24T04:16:00.918+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:16:00+00:00, run_after=2024-02-24T04:17:00+00:00 2024-02-24T04:16:00.936828025Z [2024-02-24T04:16:00.936+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:16:00+00:00, run_after=2024-02-24T04:17:00+00:00 2024-02-24T04:16:00.951632918Z [2024-02-24T04:16:00.951+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:16:01.055901922Z [2024-02-24T04:16:01.055+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T04:16:01.055936089Z 2024-02-24T04:16:01.055943975Z 2024-02-24T04:16:01.055949900Z 2024-02-24T04:16:01.055955619Z 2024-02-24T04:16:01.056027340Z [2024-02-24T04:16:01.055+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T04:16:01.056180138Z [2024-02-24T04:16:01.055+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:16:01.056211228Z [2024-02-24T04:16:01.056+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:16:01.056439578Z [2024-02-24T04:16:01.056+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:16:01.057074438Z [2024-02-24T04:16:01.056+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:16:01.057090225Z 2024-02-24T04:16:01.057095250Z 2024-02-24T04:16:01.057100172Z 2024-02-24T04:16:01.057104751Z 2024-02-24T04:16:01.061761968Z [2024-02-24T04:16:01.061+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T04:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:16:01.062003427Z [2024-02-24T04:16:01.061+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T04:16:01.062295442Z [2024-02-24T04:16:01.062+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:16:01.062447236Z [2024-02-24T04:16:01.062+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:16:01.062691855Z [2024-02-24T04:16:01.062+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:16:01.062893786Z [2024-02-24T04:16:01.062+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:16:01.063080370Z [2024-02-24T04:16:01.062+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:16:01.063237736Z [2024-02-24T04:16:01.063+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:16:01.826967799Z [2024-02-24T04:16:01.826+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:14:00+00:00 exited with status queued for try_number 1 2024-02-24T04:16:01.827186385Z [2024-02-24T04:16:01.826+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:15:00+00:00 exited with status queued for try_number 1 2024-02-24T04:16:01.827333249Z [2024-02-24T04:16:01.827+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:15:00+00:00 exited with status queued for try_number 1 2024-02-24T04:16:01.827516515Z [2024-02-24T04:16:01.827+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:15:00+00:00 exited with status queued for try_number 1 2024-02-24T04:16:01.846452023Z [2024-02-24T04:16:01.846+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5f048e01-18a1-4bd0-a435-e75316923255 2024-02-24T04:16:01.846673670Z [2024-02-24T04:16:01.846+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22d03ef7-393c-40ef-9988-d1fa8a0030c3 2024-02-24T04:16:01.846888156Z [2024-02-24T04:16:01.846+0000] {scheduler_job.py:635} INFO - Setting external_id for to c528e3ad-637c-498b-9439-a46da0bbe7be 2024-02-24T04:16:01.847064813Z [2024-02-24T04:16:01.846+0000] {scheduler_job.py:635} INFO - Setting external_id for to 02e6614e-5947-4c9a-910d-6c39449e8606 2024-02-24T04:16:04.041198114Z [2024-02-24T04:16:04.039+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:16:04.041231053Z [2024-02-24T04:16:04.039+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:15:00+00:00, run_id=scheduled__2024-02-24T04:15:00+00:00, run_start_date=2024-02-24 04:16:00.966283+00:00, run_end_date=2024-02-24 04:16:04.039794+00:00, run_duration=3.073511, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:15:00+00:00, data_interval_end=2024-02-24 04:16:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:16:04.081884523Z [2024-02-24T04:16:04.081+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:16:00+00:00, run_after=2024-02-24T04:17:00+00:00 2024-02-24T04:16:04.097314954Z [2024-02-24T04:16:04.095+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:16:04.097340897Z [2024-02-24T04:16:04.096+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 04:14:00+00:00, run_id=scheduled__2024-02-24T04:14:00+00:00, run_start_date=2024-02-24 04:16:00.964759+00:00, run_end_date=2024-02-24 04:16:04.096254+00:00, run_duration=3.131495, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:14:00+00:00, data_interval_end=2024-02-24 04:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T04:16:04.107151361Z [2024-02-24T04:16:04.106+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T04:16:00+00:00, run_after=2024-02-24T04:18:00+00:00 2024-02-24T04:16:04.168653956Z [2024-02-24T04:16:04.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:14:00+00:00 exited with status success for try_number 1 2024-02-24T04:16:04.168797628Z [2024-02-24T04:16:04.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:15:00+00:00 exited with status success for try_number 1 2024-02-24T04:16:04.180819958Z [2024-02-24T04:16:04.177+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:15:00+00:00, map_index=-1, run_start_date=2024-02-24 04:16:02.273925+00:00, run_end_date=2024-02-24 04:16:03.211492+00:00, run_duration=0.937567, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1257, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:16:01.058140+00:00, queued_by_job_id=2, pid=18310 2024-02-24T04:16:04.180837241Z [2024-02-24T04:16:04.178+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T04:14:00+00:00, map_index=-1, run_start_date=2024-02-24 04:16:02.374302+00:00, run_end_date=2024-02-24 04:16:03.071317+00:00, run_duration=0.697015, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1258, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:16:01.058140+00:00, queued_by_job_id=2, pid=18311 2024-02-24T04:16:06.462637926Z [2024-02-24T04:16:06.462+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:16:06.463047731Z [2024-02-24T04:16:06.462+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:15:00+00:00, run_id=scheduled__2024-02-24T04:15:00+00:00, run_start_date=2024-02-24 04:16:00.967799+00:00, run_end_date=2024-02-24 04:16:06.462524+00:00, run_duration=5.494725, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:15:00+00:00, data_interval_end=2024-02-24 04:16:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:16:06.472845981Z [2024-02-24T04:16:06.472+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:16:00+00:00, run_after=2024-02-24T04:17:00+00:00 2024-02-24T04:16:06.479639086Z [2024-02-24T04:16:06.479+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:16:06.479970666Z [2024-02-24T04:16:06.479+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:15:00+00:00, run_id=scheduled__2024-02-24T04:15:00+00:00, run_start_date=2024-02-24 04:16:00.969049+00:00, run_end_date=2024-02-24 04:16:06.479480+00:00, run_duration=5.510431, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:15:00+00:00, data_interval_end=2024-02-24 04:16:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:16:06.490717287Z [2024-02-24T04:16:06.490+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:16:00+00:00, run_after=2024-02-24T04:17:00+00:00 2024-02-24T04:16:06.524471205Z [2024-02-24T04:16:06.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:15:00+00:00 exited with status success for try_number 1 2024-02-24T04:16:06.524810840Z [2024-02-24T04:16:06.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:15:00+00:00 exited with status success for try_number 1 2024-02-24T04:16:06.531407839Z [2024-02-24T04:16:06.531+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:15:00+00:00, map_index=-1, run_start_date=2024-02-24 04:16:04.496029+00:00, run_end_date=2024-02-24 04:16:06.295976+00:00, run_duration=1.799947, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1260, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:16:01.058140+00:00, queued_by_job_id=2, pid=18340 2024-02-24T04:16:06.531498481Z [2024-02-24T04:16:06.531+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:15:00+00:00, map_index=-1, run_start_date=2024-02-24 04:16:04.053227+00:00, run_end_date=2024-02-24 04:16:06.099151+00:00, run_duration=2.045924, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1259, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:16:01.058140+00:00, queued_by_job_id=2, pid=18329 2024-02-24T04:17:00.781274193Z [2024-02-24T04:17:00.780+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:17:00+00:00, run_after=2024-02-24T04:18:00+00:00 2024-02-24T04:17:00.793792831Z [2024-02-24T04:17:00.793+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:17:00+00:00, run_after=2024-02-24T04:18:00+00:00 2024-02-24T04:17:00.801343397Z [2024-02-24T04:17:00.800+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:17:00.873026475Z [2024-02-24T04:17:00.872+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T04:17:00.873053141Z 2024-02-24T04:17:00.873056607Z 2024-02-24T04:17:00.873060123Z 2024-02-24T04:17:00.873070148Z [2024-02-24T04:17:00.872+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:17:00.873621683Z [2024-02-24T04:17:00.873+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:17:00.873815079Z [2024-02-24T04:17:00.873+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:17:00.874491282Z [2024-02-24T04:17:00.874+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:17:00.874499638Z 2024-02-24T04:17:00.874503011Z 2024-02-24T04:17:00.874506367Z 2024-02-24T04:17:00.878502259Z [2024-02-24T04:17:00.878+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:17:00.878654637Z [2024-02-24T04:17:00.878+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:17:00.878937503Z [2024-02-24T04:17:00.878+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:17:00.879081282Z [2024-02-24T04:17:00.878+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:17:00.879297765Z [2024-02-24T04:17:00.879+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:17:00.879433202Z [2024-02-24T04:17:00.879+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:17:01.215311406Z [2024-02-24T04:17:01.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:16:00+00:00 exited with status queued for try_number 1 2024-02-24T04:17:01.215444818Z [2024-02-24T04:17:01.215+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:16:00+00:00 exited with status queued for try_number 1 2024-02-24T04:17:01.215562176Z [2024-02-24T04:17:01.215+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:16:00+00:00 exited with status queued for try_number 1 2024-02-24T04:17:01.242098322Z [2024-02-24T04:17:01.241+0000] {scheduler_job.py:635} INFO - Setting external_id for to b818b115-f3bb-4ec3-9a7a-338397668a87 2024-02-24T04:17:01.242119686Z [2024-02-24T04:17:01.241+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0c065559-64d4-4564-b889-2615976b7e59 2024-02-24T04:17:01.242454674Z [2024-02-24T04:17:01.242+0000] {scheduler_job.py:635} INFO - Setting external_id for to f26e949c-466a-4c58-a633-6222e5265bed 2024-02-24T04:17:02.406950716Z [2024-02-24T04:17:02.406+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:17:02.407154064Z [2024-02-24T04:17:02.406+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:16:00+00:00, run_id=scheduled__2024-02-24T04:16:00+00:00, run_start_date=2024-02-24 04:17:00.813987+00:00, run_end_date=2024-02-24 04:17:02.406834+00:00, run_duration=1.592847, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:16:00+00:00, data_interval_end=2024-02-24 04:17:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:17:02.417166205Z [2024-02-24T04:17:02.416+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:17:00+00:00, run_after=2024-02-24T04:18:00+00:00 2024-02-24T04:17:02.465884530Z [2024-02-24T04:17:02.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:16:00+00:00 exited with status success for try_number 1 2024-02-24T04:17:02.471470396Z [2024-02-24T04:17:02.471+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:16:00+00:00, map_index=-1, run_start_date=2024-02-24 04:17:01.813571+00:00, run_end_date=2024-02-24 04:17:02.167799+00:00, run_duration=0.354228, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1261, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:17:00.875279+00:00, queued_by_job_id=2, pid=18367 2024-02-24T04:17:04.839991418Z [2024-02-24T04:17:04.839+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:17:04.840504824Z [2024-02-24T04:17:04.840+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:16:00+00:00, run_id=scheduled__2024-02-24T04:16:00+00:00, run_start_date=2024-02-24 04:17:00.815347+00:00, run_end_date=2024-02-24 04:17:04.840080+00:00, run_duration=4.024733, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:16:00+00:00, data_interval_end=2024-02-24 04:17:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:17:04.858550339Z [2024-02-24T04:17:04.858+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:17:00+00:00, run_after=2024-02-24T04:18:00+00:00 2024-02-24T04:17:04.867698205Z [2024-02-24T04:17:04.867+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:17:04.868190914Z [2024-02-24T04:17:04.867+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:16:00+00:00, run_id=scheduled__2024-02-24T04:16:00+00:00, run_start_date=2024-02-24 04:17:00.816515+00:00, run_end_date=2024-02-24 04:17:04.867797+00:00, run_duration=4.051282, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:16:00+00:00, data_interval_end=2024-02-24 04:17:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:17:04.878670925Z [2024-02-24T04:17:04.878+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:17:00+00:00, run_after=2024-02-24T04:18:00+00:00 2024-02-24T04:17:04.905524866Z [2024-02-24T04:17:04.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:16:00+00:00 exited with status success for try_number 1 2024-02-24T04:17:04.905819681Z [2024-02-24T04:17:04.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:16:00+00:00 exited with status success for try_number 1 2024-02-24T04:17:04.912544573Z [2024-02-24T04:17:04.912+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:16:00+00:00, map_index=-1, run_start_date=2024-02-24 04:17:03.104569+00:00, run_end_date=2024-02-24 04:17:04.375553+00:00, run_duration=1.270984, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1263, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:17:00.875279+00:00, queued_by_job_id=2, pid=18391 2024-02-24T04:17:04.913036621Z [2024-02-24T04:17:04.912+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:16:00+00:00, map_index=-1, run_start_date=2024-02-24 04:17:02.785233+00:00, run_end_date=2024-02-24 04:17:04.503354+00:00, run_duration=1.718121, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1262, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:17:00.875279+00:00, queued_by_job_id=2, pid=18380 2024-02-24T04:17:06.203193867Z [2024-02-24T04:17:06.202+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T04:17:39.138426716Z [2024-02-24T04:17:39.137+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:17:39.138470979Z 2024-02-24T04:17:39.138778997Z [2024-02-24T04:17:39.138+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-02-24T04:17:39.139463257Z [2024-02-24T04:17:39.139+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:17:39.139480783Z 2024-02-24T04:17:39.142418531Z [2024-02-24T04:17:39.142+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240224041737_088906', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:17:39.142539955Z [2024-02-24T04:17:39.142+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240224041737_088906', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-02-24T04:17:39.201591626Z [2024-02-24T04:17:39.201+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240224041737_088906 exited with status queued for try_number 1 2024-02-24T04:17:39.206487788Z [2024-02-24T04:17:39.206+0000] {scheduler_job.py:635} INFO - Setting external_id for to c99a04e4-ccff-4f96-bed1-c5549b55b1bd 2024-02-24T04:17:40.324962993Z [2024-02-24T04:17:40.324+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:17:40.325385097Z [2024-02-24T04:17:40.325+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-02-24 04:17:37.993075+00:00, run_id=vdu_down_20240224041737_088906, run_start_date=2024-02-24 04:17:39.102789+00:00, run_end_date=2024-02-24 04:17:40.324799+00:00, run_duration=1.22201, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-02-24 04:17:37.993075+00:00, data_interval_end=2024-02-24 04:17:37.993075+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-02-24T04:17:40.328912248Z [2024-02-24T04:17:40.328+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-02-24T04:17:40.382938956Z [2024-02-24T04:17:40.382+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240224041737_088906 exited with status success for try_number 1 2024-02-24T04:17:40.389647145Z [2024-02-24T04:17:40.389+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240224041737_088906, map_index=-1, run_start_date=2024-02-24 04:17:39.836357+00:00, run_end_date=2024-02-24 04:17:40.215249+00:00, run_duration=0.378892, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1264, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:17:39.139938+00:00, queued_by_job_id=2, pid=18398 2024-02-24T04:18:00.514639138Z [2024-02-24T04:18:00.514+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:18:00+00:00, run_after=2024-02-24T04:19:00+00:00 2024-02-24T04:18:00.521084360Z [2024-02-24T04:18:00.520+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:18:00.528693029Z [2024-02-24T04:18:00.528+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:18:00.555828360Z [2024-02-24T04:18:00.555+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:18:00+00:00, run_after=2024-02-24T04:19:00+00:00 2024-02-24T04:18:00.653603588Z [2024-02-24T04:18:00.653+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T04:18:00.653641101Z 2024-02-24T04:18:00.653649547Z 2024-02-24T04:18:00.653660866Z 2024-02-24T04:18:00.653667349Z 2024-02-24T04:18:00.653920369Z [2024-02-24T04:18:00.653+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T04:18:00.654155026Z [2024-02-24T04:18:00.653+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:18:00.654281656Z [2024-02-24T04:18:00.654+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:18:00.654466104Z [2024-02-24T04:18:00.654+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:18:00.655429865Z [2024-02-24T04:18:00.655+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:18:00.655440700Z 2024-02-24T04:18:00.655444493Z 2024-02-24T04:18:00.655470285Z 2024-02-24T04:18:00.655474503Z 2024-02-24T04:18:00.660333908Z [2024-02-24T04:18:00.660+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T04:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:18:00.660552055Z [2024-02-24T04:18:00.660+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T04:18:00.660973230Z [2024-02-24T04:18:00.660+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:18:00.661212205Z [2024-02-24T04:18:00.660+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:18:00.661582923Z [2024-02-24T04:18:00.661+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:18:00.661829461Z [2024-02-24T04:18:00.661+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:18:00.662173536Z [2024-02-24T04:18:00.661+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:18:00.662400920Z [2024-02-24T04:18:00.662+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:18:01.244326679Z [2024-02-24T04:18:01.221+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:16:00+00:00 exited with status queued for try_number 1 2024-02-24T04:18:01.244348606Z [2024-02-24T04:18:01.221+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:17:00+00:00 exited with status queued for try_number 1 2024-02-24T04:18:01.244365773Z [2024-02-24T04:18:01.221+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:17:00+00:00 exited with status queued for try_number 1 2024-02-24T04:18:01.244369159Z [2024-02-24T04:18:01.221+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:17:00+00:00 exited with status queued for try_number 1 2024-02-24T04:18:01.253999557Z [2024-02-24T04:18:01.245+0000] {scheduler_job.py:635} INFO - Setting external_id for to cfa7eda4-63f5-4b49-ade8-fdb2ba4a3575 2024-02-24T04:18:01.254021884Z [2024-02-24T04:18:01.245+0000] {scheduler_job.py:635} INFO - Setting external_id for to b1a091a4-16da-46b1-9e72-d9898feba6a6 2024-02-24T04:18:01.254039267Z [2024-02-24T04:18:01.245+0000] {scheduler_job.py:635} INFO - Setting external_id for to 09626d66-d84d-4ac6-b9b2-c00fb4f90c0c 2024-02-24T04:18:01.254043950Z [2024-02-24T04:18:01.245+0000] {scheduler_job.py:635} INFO - Setting external_id for to 198b5b76-34a6-4047-a7d7-70c52361c75b 2024-02-24T04:18:02.551622754Z [2024-02-24T04:18:02.551+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:18:02.552064174Z [2024-02-24T04:18:02.551+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 04:16:00+00:00, run_id=scheduled__2024-02-24T04:16:00+00:00, run_start_date=2024-02-24 04:18:00.570837+00:00, run_end_date=2024-02-24 04:18:02.551498+00:00, run_duration=1.980661, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:16:00+00:00, data_interval_end=2024-02-24 04:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T04:18:02.569135279Z [2024-02-24T04:18:02.568+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T04:18:00+00:00, run_after=2024-02-24T04:20:00+00:00 2024-02-24T04:18:02.582649329Z [2024-02-24T04:18:02.581+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:18:02.583496180Z [2024-02-24T04:18:02.582+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:17:00+00:00, run_id=scheduled__2024-02-24T04:17:00+00:00, run_start_date=2024-02-24 04:18:00.572533+00:00, run_end_date=2024-02-24 04:18:02.582625+00:00, run_duration=2.010092, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:17:00+00:00, data_interval_end=2024-02-24 04:18:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:18:02.610071025Z [2024-02-24T04:18:02.609+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:18:00+00:00, run_after=2024-02-24T04:19:00+00:00 2024-02-24T04:18:02.752004320Z [2024-02-24T04:18:02.751+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:16:00+00:00 exited with status success for try_number 1 2024-02-24T04:18:02.752500002Z [2024-02-24T04:18:02.751+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:17:00+00:00 exited with status success for try_number 1 2024-02-24T04:18:02.768849017Z [2024-02-24T04:18:02.768+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T04:16:00+00:00, map_index=-1, run_start_date=2024-02-24 04:18:01.557925+00:00, run_end_date=2024-02-24 04:18:01.958013+00:00, run_duration=0.400088, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1265, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:18:00.656491+00:00, queued_by_job_id=2, pid=18426 2024-02-24T04:18:02.769639958Z [2024-02-24T04:18:02.769+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:17:00+00:00, map_index=-1, run_start_date=2024-02-24 04:18:01.715040+00:00, run_end_date=2024-02-24 04:18:02.184005+00:00, run_duration=0.468965, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1266, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:18:00.656491+00:00, queued_by_job_id=2, pid=18427 2024-02-24T04:18:05.615652964Z [2024-02-24T04:18:05.615+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:18:05.616133284Z [2024-02-24T04:18:05.615+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:17:00+00:00, run_id=scheduled__2024-02-24T04:17:00+00:00, run_start_date=2024-02-24 04:18:00.575116+00:00, run_end_date=2024-02-24 04:18:05.615701+00:00, run_duration=5.040585, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:17:00+00:00, data_interval_end=2024-02-24 04:18:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:18:05.625601036Z [2024-02-24T04:18:05.625+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:18:00+00:00, run_after=2024-02-24T04:19:00+00:00 2024-02-24T04:18:05.634874603Z [2024-02-24T04:18:05.634+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:18:05.635294952Z [2024-02-24T04:18:05.635+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:17:00+00:00, run_id=scheduled__2024-02-24T04:17:00+00:00, run_start_date=2024-02-24 04:18:00.573891+00:00, run_end_date=2024-02-24 04:18:05.634751+00:00, run_duration=5.06086, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:17:00+00:00, data_interval_end=2024-02-24 04:18:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:18:05.645296415Z [2024-02-24T04:18:05.644+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:18:00+00:00, run_after=2024-02-24T04:19:00+00:00 2024-02-24T04:18:05.680038626Z [2024-02-24T04:18:05.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:17:00+00:00 exited with status success for try_number 1 2024-02-24T04:18:05.680247557Z [2024-02-24T04:18:05.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:17:00+00:00 exited with status success for try_number 1 2024-02-24T04:18:05.688753250Z [2024-02-24T04:18:05.688+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:17:00+00:00, map_index=-1, run_start_date=2024-02-24 04:18:02.990122+00:00, run_end_date=2024-02-24 04:18:04.605120+00:00, run_duration=1.614998, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1268, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:18:00.656491+00:00, queued_by_job_id=2, pid=18451 2024-02-24T04:18:05.689321394Z [2024-02-24T04:18:05.688+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:17:00+00:00, map_index=-1, run_start_date=2024-02-24 04:18:02.888612+00:00, run_end_date=2024-02-24 04:18:04.858067+00:00, run_duration=1.969455, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1267, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:18:00.656491+00:00, queued_by_job_id=2, pid=18450 2024-02-24T04:19:00.345967233Z [2024-02-24T04:19:00.342+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:19:00+00:00, run_after=2024-02-24T04:20:00+00:00 2024-02-24T04:19:00.351732046Z [2024-02-24T04:19:00.351+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:19:00.366064849Z [2024-02-24T04:19:00.365+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:19:00+00:00, run_after=2024-02-24T04:20:00+00:00 2024-02-24T04:19:00.450416785Z [2024-02-24T04:19:00.449+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T04:19:00.450446867Z 2024-02-24T04:19:00.450451997Z 2024-02-24T04:19:00.450456395Z 2024-02-24T04:19:00.450705903Z [2024-02-24T04:19:00.450+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:19:00.451006902Z [2024-02-24T04:19:00.450+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:19:00.451348188Z [2024-02-24T04:19:00.451+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:19:00.452686293Z [2024-02-24T04:19:00.452+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:19:00.452734248Z 2024-02-24T04:19:00.452741657Z 2024-02-24T04:19:00.452748665Z 2024-02-24T04:19:00.458541222Z [2024-02-24T04:19:00.458+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:19:00.458773289Z [2024-02-24T04:19:00.458+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:19:00.459166940Z [2024-02-24T04:19:00.458+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:19:00.459426128Z [2024-02-24T04:19:00.459+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:19:00.459790614Z [2024-02-24T04:19:00.459+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:19:00.460034068Z [2024-02-24T04:19:00.459+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:19:00.781738005Z [2024-02-24T04:19:00.781+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:18:00+00:00 exited with status queued for try_number 1 2024-02-24T04:19:00.781855750Z [2024-02-24T04:19:00.781+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:18:00+00:00 exited with status queued for try_number 1 2024-02-24T04:19:00.781985476Z [2024-02-24T04:19:00.781+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:18:00+00:00 exited with status queued for try_number 1 2024-02-24T04:19:00.797880996Z [2024-02-24T04:19:00.797+0000] {scheduler_job.py:635} INFO - Setting external_id for to c25c71b8-df5c-417d-bd4a-53a569d33638 2024-02-24T04:19:00.797920789Z [2024-02-24T04:19:00.797+0000] {scheduler_job.py:635} INFO - Setting external_id for to ef8d6e9e-6913-403f-bc49-df04f2898f50 2024-02-24T04:19:00.798098416Z [2024-02-24T04:19:00.797+0000] {scheduler_job.py:635} INFO - Setting external_id for to f29eb6d3-63b9-4f5c-ae0f-af3e93ea50d7 2024-02-24T04:19:01.999771218Z [2024-02-24T04:19:01.999+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:19:02.000014449Z [2024-02-24T04:19:01.999+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:18:00+00:00, run_id=scheduled__2024-02-24T04:18:00+00:00, run_start_date=2024-02-24 04:19:00.381158+00:00, run_end_date=2024-02-24 04:19:01.999631+00:00, run_duration=1.618473, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:18:00+00:00, data_interval_end=2024-02-24 04:19:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:19:02.014605000Z [2024-02-24T04:19:02.014+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:19:00+00:00, run_after=2024-02-24T04:20:00+00:00 2024-02-24T04:19:02.099533352Z [2024-02-24T04:19:02.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:18:00+00:00 exited with status success for try_number 1 2024-02-24T04:19:02.109677367Z [2024-02-24T04:19:02.109+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:18:00+00:00, map_index=-1, run_start_date=2024-02-24 04:19:01.401154+00:00, run_end_date=2024-02-24 04:19:01.843634+00:00, run_duration=0.44248, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1269, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:19:00.454370+00:00, queued_by_job_id=2, pid=18483 2024-02-24T04:19:05.387997124Z [2024-02-24T04:19:05.387+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:19:05.388619739Z [2024-02-24T04:19:05.388+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:18:00+00:00, run_id=scheduled__2024-02-24T04:18:00+00:00, run_start_date=2024-02-24 04:19:00.382620+00:00, run_end_date=2024-02-24 04:19:05.387883+00:00, run_duration=5.005263, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:18:00+00:00, data_interval_end=2024-02-24 04:19:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:19:05.401407338Z [2024-02-24T04:19:05.400+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:19:00+00:00, run_after=2024-02-24T04:20:00+00:00 2024-02-24T04:19:05.410043005Z [2024-02-24T04:19:05.409+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:19:05.410418906Z [2024-02-24T04:19:05.409+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:18:00+00:00, run_id=scheduled__2024-02-24T04:18:00+00:00, run_start_date=2024-02-24 04:19:00.384075+00:00, run_end_date=2024-02-24 04:19:05.409867+00:00, run_duration=5.025792, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:18:00+00:00, data_interval_end=2024-02-24 04:19:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:19:05.425343351Z [2024-02-24T04:19:05.424+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:19:00+00:00, run_after=2024-02-24T04:20:00+00:00 2024-02-24T04:19:05.464336400Z [2024-02-24T04:19:05.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:18:00+00:00 exited with status success for try_number 1 2024-02-24T04:19:05.464361275Z [2024-02-24T04:19:05.464+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:18:00+00:00 exited with status success for try_number 1 2024-02-24T04:19:05.472190039Z [2024-02-24T04:19:05.471+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:18:00+00:00, map_index=-1, run_start_date=2024-02-24 04:19:02.492545+00:00, run_end_date=2024-02-24 04:19:04.532668+00:00, run_duration=2.040123, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1271, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:19:00.454370+00:00, queued_by_job_id=2, pid=18502 2024-02-24T04:19:05.472592307Z [2024-02-24T04:19:05.472+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:18:00+00:00, map_index=-1, run_start_date=2024-02-24 04:19:02.443282+00:00, run_end_date=2024-02-24 04:19:04.837236+00:00, run_duration=2.393954, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1270, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:19:00.454370+00:00, queued_by_job_id=2, pid=18501 2024-02-24T04:20:00.130610664Z [2024-02-24T04:20:00.130+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:20:00+00:00, run_after=2024-02-24T04:25:00+00:00 2024-02-24T04:20:00.149918881Z [2024-02-24T04:20:00.149+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:20:00+00:00, run_after=2024-02-24T04:21:00+00:00 2024-02-24T04:20:00.159728964Z [2024-02-24T04:20:00.159+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:20:00.168004355Z [2024-02-24T04:20:00.167+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:20:00.183327668Z [2024-02-24T04:20:00.182+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:20:00+00:00, run_after=2024-02-24T04:21:00+00:00 2024-02-24T04:20:00.329310163Z [2024-02-24T04:20:00.328+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-02-24T04:20:00.329333675Z 2024-02-24T04:20:00.329337273Z 2024-02-24T04:20:00.329344495Z 2024-02-24T04:20:00.329347797Z 2024-02-24T04:20:00.329351056Z 2024-02-24T04:20:00.330060332Z [2024-02-24T04:20:00.329+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:20:00.330332744Z [2024-02-24T04:20:00.330+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T04:20:00.330538756Z [2024-02-24T04:20:00.330+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:20:00.330753747Z [2024-02-24T04:20:00.330+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:20:00.331051803Z [2024-02-24T04:20:00.330+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:20:00.331724032Z [2024-02-24T04:20:00.331+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:20:00.331736067Z 2024-02-24T04:20:00.331740322Z 2024-02-24T04:20:00.331743784Z 2024-02-24T04:20:00.331747188Z 2024-02-24T04:20:00.331765410Z 2024-02-24T04:20:00.336867813Z [2024-02-24T04:20:00.336+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T04:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T04:20:00.337152818Z [2024-02-24T04:20:00.336+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T04:20:00.337517952Z [2024-02-24T04:20:00.337+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T04:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:20:00.337735783Z [2024-02-24T04:20:00.337+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T04:20:00.338077513Z [2024-02-24T04:20:00.337+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:20:00.338278250Z [2024-02-24T04:20:00.338+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:20:00.338564815Z [2024-02-24T04:20:00.338+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:20:00.338755430Z [2024-02-24T04:20:00.338+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:20:00.339036183Z [2024-02-24T04:20:00.338+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:20:00.339257140Z [2024-02-24T04:20:00.339+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:20:00.919059068Z [2024-02-24T04:20:00.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T04:15:00+00:00 exited with status queued for try_number 1 2024-02-24T04:20:00.920810120Z [2024-02-24T04:20:00.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:18:00+00:00 exited with status queued for try_number 1 2024-02-24T04:20:00.920942359Z [2024-02-24T04:20:00.920+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:19:00+00:00 exited with status queued for try_number 1 2024-02-24T04:20:00.921024541Z [2024-02-24T04:20:00.920+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:19:00+00:00 exited with status queued for try_number 1 2024-02-24T04:20:00.921138301Z [2024-02-24T04:20:00.921+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:19:00+00:00 exited with status queued for try_number 1 2024-02-24T04:20:00.939405148Z [2024-02-24T04:20:00.939+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f8b5131-cf1e-4237-bf10-a70ef60263c4 2024-02-24T04:20:00.941097585Z [2024-02-24T04:20:00.940+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f74713d-1f3d-4533-ab19-0f6da0cfceca 2024-02-24T04:20:00.941112586Z [2024-02-24T04:20:00.940+0000] {scheduler_job.py:635} INFO - Setting external_id for to 235b4d46-d421-48a4-b21a-42c6c3920e88 2024-02-24T04:20:00.941221449Z [2024-02-24T04:20:00.940+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e89d874-d6c8-4bbb-996b-6760a9ee5da4 2024-02-24T04:20:00.946222368Z [2024-02-24T04:20:00.941+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d9e0061-b1a7-42fd-b739-1da01fb0293d 2024-02-24T04:20:02.964342318Z [2024-02-24T04:20:02.963+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:20:02.965133970Z [2024-02-24T04:20:02.964+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 04:18:00+00:00, run_id=scheduled__2024-02-24T04:18:00+00:00, run_start_date=2024-02-24 04:20:00.215582+00:00, run_end_date=2024-02-24 04:20:02.964248+00:00, run_duration=2.748666, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:18:00+00:00, data_interval_end=2024-02-24 04:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T04:20:02.973981980Z [2024-02-24T04:20:02.972+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T04:20:00+00:00, run_after=2024-02-24T04:22:00+00:00 2024-02-24T04:20:03.011365031Z [2024-02-24T04:20:03.010+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:20:03.011738349Z [2024-02-24T04:20:03.011+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:19:00+00:00, run_id=scheduled__2024-02-24T04:19:00+00:00, run_start_date=2024-02-24 04:20:00.217370+00:00, run_end_date=2024-02-24 04:20:03.011277+00:00, run_duration=2.793907, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:19:00+00:00, data_interval_end=2024-02-24 04:20:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:20:03.024926628Z [2024-02-24T04:20:03.024+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:20:00+00:00, run_after=2024-02-24T04:21:00+00:00 2024-02-24T04:20:03.084569090Z [2024-02-24T04:20:03.084+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:18:00+00:00 exited with status success for try_number 1 2024-02-24T04:20:03.084627109Z [2024-02-24T04:20:03.084+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:19:00+00:00 exited with status success for try_number 1 2024-02-24T04:20:03.093942176Z [2024-02-24T04:20:03.093+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T04:18:00+00:00, map_index=-1, run_start_date=2024-02-24 04:20:01.944686+00:00, run_end_date=2024-02-24 04:20:02.395326+00:00, run_duration=0.45064, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1273, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:20:00.332781+00:00, queued_by_job_id=2, pid=18544 2024-02-24T04:20:03.094129004Z [2024-02-24T04:20:03.093+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:19:00+00:00, map_index=-1, run_start_date=2024-02-24 04:20:01.397116+00:00, run_end_date=2024-02-24 04:20:01.850969+00:00, run_duration=0.453853, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1272, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:20:00.332781+00:00, queued_by_job_id=2, pid=18536 2024-02-24T04:20:04.181812678Z [2024-02-24T04:20:04.179+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:20:04.181841772Z 2024-02-24T04:20:04.181845870Z [2024-02-24T04:20:04.179+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:20:04.181849960Z [2024-02-24T04:20:04.180+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:20:04.181853850Z 2024-02-24T04:20:04.184830044Z [2024-02-24T04:20:04.184+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T04:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T04:20:04.185161405Z [2024-02-24T04:20:04.184+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T04:20:04.251112879Z [2024-02-24T04:20:04.250+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T04:15:00+00:00 exited with status queued for try_number 1 2024-02-24T04:20:04.251507115Z [2024-02-24T04:20:04.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T04:15:00+00:00 exited with status success for try_number 1 2024-02-24T04:20:04.260139242Z [2024-02-24T04:20:04.259+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d66e2ce-3664-45d2-b128-783d28160e00 2024-02-24T04:20:04.260511260Z [2024-02-24T04:20:04.260+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T04:15:00+00:00, map_index=-1, run_start_date=2024-02-24 04:20:02.887037+00:00, run_end_date=2024-02-24 04:20:03.355556+00:00, run_duration=0.468519, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1275, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:20:00.332781+00:00, queued_by_job_id=2, pid=18562 2024-02-24T04:20:05.444305892Z [2024-02-24T04:20:05.443+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:20:05.444373531Z [2024-02-24T04:20:05.444+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:19:00+00:00, run_id=scheduled__2024-02-24T04:19:00+00:00, run_start_date=2024-02-24 04:20:00.220587+00:00, run_end_date=2024-02-24 04:20:05.444034+00:00, run_duration=5.223447, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:19:00+00:00, data_interval_end=2024-02-24 04:20:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:20:05.455408863Z [2024-02-24T04:20:05.454+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:20:00+00:00, run_after=2024-02-24T04:21:00+00:00 2024-02-24T04:20:05.463548752Z [2024-02-24T04:20:05.463+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:20:05.463783417Z [2024-02-24T04:20:05.463+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:19:00+00:00, run_id=scheduled__2024-02-24T04:19:00+00:00, run_start_date=2024-02-24 04:20:00.222340+00:00, run_end_date=2024-02-24 04:20:05.463408+00:00, run_duration=5.241068, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:19:00+00:00, data_interval_end=2024-02-24 04:20:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:20:05.473255854Z [2024-02-24T04:20:05.472+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:20:00+00:00, run_after=2024-02-24T04:21:00+00:00 2024-02-24T04:20:05.531606155Z [2024-02-24T04:20:05.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:19:00+00:00 exited with status success for try_number 1 2024-02-24T04:20:05.531638721Z [2024-02-24T04:20:05.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:19:00+00:00 exited with status success for try_number 1 2024-02-24T04:20:05.538832629Z [2024-02-24T04:20:05.538+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:19:00+00:00, map_index=-1, run_start_date=2024-02-24 04:20:02.758873+00:00, run_end_date=2024-02-24 04:20:04.835904+00:00, run_duration=2.077031, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1274, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:20:00.332781+00:00, queued_by_job_id=2, pid=18561 2024-02-24T04:20:05.539049805Z [2024-02-24T04:20:05.538+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:19:00+00:00, map_index=-1, run_start_date=2024-02-24 04:20:03.171278+00:00, run_end_date=2024-02-24 04:20:05.051791+00:00, run_duration=1.880513, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1276, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:20:00.332781+00:00, queued_by_job_id=2, pid=18573 2024-02-24T04:20:06.616335462Z [2024-02-24T04:20:06.615+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:20:06.616443619Z 2024-02-24T04:20:06.617026142Z [2024-02-24T04:20:06.616+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:20:06.619049248Z [2024-02-24T04:20:06.618+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:20:06.619067986Z 2024-02-24T04:20:06.625391191Z [2024-02-24T04:20:06.624+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T04:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T04:20:06.626055591Z [2024-02-24T04:20:06.625+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T04:20:06.676024382Z [2024-02-24T04:20:06.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T04:15:00+00:00 exited with status queued for try_number 1 2024-02-24T04:20:06.676587077Z [2024-02-24T04:20:06.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T04:15:00+00:00 exited with status success for try_number 1 2024-02-24T04:20:06.683689216Z [2024-02-24T04:20:06.683+0000] {scheduler_job.py:635} INFO - Setting external_id for to 162b50f0-ee13-49b6-8427-a4811d39d1e7 2024-02-24T04:20:06.684155702Z [2024-02-24T04:20:06.683+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T04:15:00+00:00, map_index=-1, run_start_date=2024-02-24 04:20:05.834531+00:00, run_end_date=2024-02-24 04:20:06.246854+00:00, run_duration=0.412323, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1277, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:20:04.181396+00:00, queued_by_job_id=2, pid=18591 2024-02-24T04:20:09.187246745Z [2024-02-24T04:20:09.186+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:20:09.187280792Z 2024-02-24T04:20:09.187359725Z [2024-02-24T04:20:09.187+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:20:09.188036919Z [2024-02-24T04:20:09.187+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:20:09.188049725Z 2024-02-24T04:20:09.190367723Z [2024-02-24T04:20:09.190+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T04:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:20:09.190552849Z [2024-02-24T04:20:09.190+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T04:20:09.255546599Z [2024-02-24T04:20:09.254+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T04:15:00+00:00 exited with status queued for try_number 1 2024-02-24T04:20:09.255703794Z [2024-02-24T04:20:09.255+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T04:15:00+00:00 exited with status success for try_number 1 2024-02-24T04:20:09.266426206Z [2024-02-24T04:20:09.265+0000] {scheduler_job.py:635} INFO - Setting external_id for to bfba7c3b-18a6-48d0-b35a-c15f29a8b270 2024-02-24T04:20:09.266834120Z [2024-02-24T04:20:09.266+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T04:15:00+00:00, map_index=0, run_start_date=2024-02-24 04:20:08.177966+00:00, run_end_date=2024-02-24 04:20:08.536739+00:00, run_duration=0.358773, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1278, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:20:06.620908+00:00, queued_by_job_id=2, pid=18599 2024-02-24T04:20:11.416951899Z [2024-02-24T04:20:11.416+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:20:11.417674856Z [2024-02-24T04:20:11.417+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:15:00+00:00, run_id=scheduled__2024-02-24T04:15:00+00:00, run_start_date=2024-02-24 04:20:00.213531+00:00, run_end_date=2024-02-24 04:20:11.417058+00:00, run_duration=11.203527, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:15:00+00:00, data_interval_end=2024-02-24 04:20:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T04:20:11.425600588Z [2024-02-24T04:20:11.425+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:20:00+00:00, run_after=2024-02-24T04:25:00+00:00 2024-02-24T04:20:11.459298832Z [2024-02-24T04:20:11.458+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T04:15:00+00:00 exited with status success for try_number 1 2024-02-24T04:20:11.464636504Z [2024-02-24T04:20:11.464+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T04:15:00+00:00, map_index=-1, run_start_date=2024-02-24 04:20:10.751008+00:00, run_end_date=2024-02-24 04:20:11.136862+00:00, run_duration=0.385854, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1279, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:20:09.188397+00:00, queued_by_job_id=2, pid=18607 2024-02-24T04:21:00.868829615Z [2024-02-24T04:21:00.868+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:21:00.890694307Z [2024-02-24T04:21:00.890+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:21:00+00:00, run_after=2024-02-24T04:22:00+00:00 2024-02-24T04:21:00.925163188Z [2024-02-24T04:21:00.924+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:21:00+00:00, run_after=2024-02-24T04:22:00+00:00 2024-02-24T04:21:01.019238513Z [2024-02-24T04:21:01.018+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T04:21:01.019273352Z 2024-02-24T04:21:01.019279163Z 2024-02-24T04:21:01.019283586Z 2024-02-24T04:21:01.019436187Z [2024-02-24T04:21:01.018+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:21:01.019773402Z [2024-02-24T04:21:01.019+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:21:01.020153596Z [2024-02-24T04:21:01.019+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:21:01.022417120Z [2024-02-24T04:21:01.022+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:21:01.022453047Z 2024-02-24T04:21:01.022463034Z 2024-02-24T04:21:01.022471747Z 2024-02-24T04:21:01.026579885Z [2024-02-24T04:21:01.026+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:21:01.026676475Z [2024-02-24T04:21:01.026+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:21:01.027011624Z [2024-02-24T04:21:01.026+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:21:01.027122622Z [2024-02-24T04:21:01.026+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:21:01.027402447Z [2024-02-24T04:21:01.027+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:21:01.027685247Z [2024-02-24T04:21:01.027+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:21:01.325738927Z [2024-02-24T04:21:01.325+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:20:00+00:00 exited with status queued for try_number 1 2024-02-24T04:21:01.328369364Z [2024-02-24T04:21:01.327+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:20:00+00:00 exited with status queued for try_number 1 2024-02-24T04:21:01.328570317Z [2024-02-24T04:21:01.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:20:00+00:00 exited with status queued for try_number 1 2024-02-24T04:21:01.339515399Z [2024-02-24T04:21:01.339+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05489bbb-d9df-4850-b7b5-d5f82644683b 2024-02-24T04:21:01.339633496Z [2024-02-24T04:21:01.339+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25ec02b1-3d49-4f7f-9f7f-e36fe47cc690 2024-02-24T04:21:01.339799590Z [2024-02-24T04:21:01.339+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5184035b-9868-4e0e-8491-33948e09029e 2024-02-24T04:21:02.541964205Z [2024-02-24T04:21:02.540+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:21:02.542000302Z [2024-02-24T04:21:02.541+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:20:00+00:00, run_id=scheduled__2024-02-24T04:20:00+00:00, run_start_date=2024-02-24 04:21:00.943197+00:00, run_end_date=2024-02-24 04:21:02.541136+00:00, run_duration=1.597939, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:20:00+00:00, data_interval_end=2024-02-24 04:21:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:21:02.554764496Z [2024-02-24T04:21:02.554+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:21:00+00:00, run_after=2024-02-24T04:22:00+00:00 2024-02-24T04:21:02.700918008Z [2024-02-24T04:21:02.698+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:20:00+00:00 exited with status success for try_number 1 2024-02-24T04:21:02.720758015Z [2024-02-24T04:21:02.720+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:20:00+00:00, map_index=-1, run_start_date=2024-02-24 04:21:01.819410+00:00, run_end_date=2024-02-24 04:21:02.238151+00:00, run_duration=0.418741, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1280, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:21:01.023543+00:00, queued_by_job_id=2, pid=18628 2024-02-24T04:21:06.036399115Z [2024-02-24T04:21:06.035+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:21:06.036766029Z [2024-02-24T04:21:06.036+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:20:00+00:00, run_id=scheduled__2024-02-24T04:20:00+00:00, run_start_date=2024-02-24 04:21:00.944911+00:00, run_end_date=2024-02-24 04:21:06.036281+00:00, run_duration=5.09137, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:20:00+00:00, data_interval_end=2024-02-24 04:21:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:21:06.047198115Z [2024-02-24T04:21:06.046+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:21:00+00:00, run_after=2024-02-24T04:22:00+00:00 2024-02-24T04:21:06.055904401Z [2024-02-24T04:21:06.055+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:21:06.056032138Z [2024-02-24T04:21:06.055+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:20:00+00:00, run_id=scheduled__2024-02-24T04:20:00+00:00, run_start_date=2024-02-24 04:21:00.946685+00:00, run_end_date=2024-02-24 04:21:06.055742+00:00, run_duration=5.109057, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:20:00+00:00, data_interval_end=2024-02-24 04:21:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:21:06.065576586Z [2024-02-24T04:21:06.065+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:21:00+00:00, run_after=2024-02-24T04:22:00+00:00 2024-02-24T04:21:06.107733796Z [2024-02-24T04:21:06.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:20:00+00:00 exited with status success for try_number 1 2024-02-24T04:21:06.107831998Z [2024-02-24T04:21:06.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:20:00+00:00 exited with status success for try_number 1 2024-02-24T04:21:06.117242503Z [2024-02-24T04:21:06.116+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:20:00+00:00, map_index=-1, run_start_date=2024-02-24 04:21:03.063445+00:00, run_end_date=2024-02-24 04:21:05.323145+00:00, run_duration=2.2597, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1281, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:21:01.023543+00:00, queued_by_job_id=2, pid=18646 2024-02-24T04:21:06.117532945Z [2024-02-24T04:21:06.117+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:20:00+00:00, map_index=-1, run_start_date=2024-02-24 04:21:03.118059+00:00, run_end_date=2024-02-24 04:21:05.706337+00:00, run_duration=2.588278, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1282, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:21:01.023543+00:00, queued_by_job_id=2, pid=18647 2024-02-24T04:22:00.812477248Z [2024-02-24T04:22:00.811+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:22:00.827589171Z [2024-02-24T04:22:00.827+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:22:00+00:00, run_after=2024-02-24T04:23:00+00:00 2024-02-24T04:22:00.841918708Z [2024-02-24T04:22:00.841+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:22:00+00:00, run_after=2024-02-24T04:23:00+00:00 2024-02-24T04:22:00.851410304Z [2024-02-24T04:22:00.851+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:22:00.956442025Z [2024-02-24T04:22:00.955+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T04:22:00.956495258Z 2024-02-24T04:22:00.956507965Z 2024-02-24T04:22:00.956516977Z 2024-02-24T04:22:00.956525503Z 2024-02-24T04:22:00.956597283Z [2024-02-24T04:22:00.956+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T04:22:00.956785569Z [2024-02-24T04:22:00.956+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:22:00.956895511Z [2024-02-24T04:22:00.956+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:22:00.957139556Z [2024-02-24T04:22:00.956+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:22:00.958086932Z [2024-02-24T04:22:00.957+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:22:00.958103340Z 2024-02-24T04:22:00.958109009Z 2024-02-24T04:22:00.958113347Z 2024-02-24T04:22:00.958117956Z 2024-02-24T04:22:00.963885489Z [2024-02-24T04:22:00.963+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T04:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:22:00.964238189Z [2024-02-24T04:22:00.964+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T04:22:00.964584368Z [2024-02-24T04:22:00.964+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:22:00.964815108Z [2024-02-24T04:22:00.964+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:22:00.965128337Z [2024-02-24T04:22:00.964+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:22:00.965344333Z [2024-02-24T04:22:00.965+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:22:00.965720149Z [2024-02-24T04:22:00.965+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:22:00.966004785Z [2024-02-24T04:22:00.965+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:22:01.371657686Z [2024-02-24T04:22:01.371+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:20:00+00:00 exited with status queued for try_number 1 2024-02-24T04:22:01.371932114Z [2024-02-24T04:22:01.371+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:21:00+00:00 exited with status queued for try_number 1 2024-02-24T04:22:01.372123792Z [2024-02-24T04:22:01.371+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:21:00+00:00 exited with status queued for try_number 1 2024-02-24T04:22:01.372308404Z [2024-02-24T04:22:01.372+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:21:00+00:00 exited with status queued for try_number 1 2024-02-24T04:22:01.381877990Z [2024-02-24T04:22:01.381+0000] {scheduler_job.py:635} INFO - Setting external_id for to aeb2f7fc-7556-46f8-a8cd-4ccad235251d 2024-02-24T04:22:01.382188128Z [2024-02-24T04:22:01.381+0000] {scheduler_job.py:635} INFO - Setting external_id for to c58e4c3c-d27c-4923-9de6-0ec075249623 2024-02-24T04:22:01.382432285Z [2024-02-24T04:22:01.382+0000] {scheduler_job.py:635} INFO - Setting external_id for to 93398e57-c8c4-4092-ac6b-e526bf72d895 2024-02-24T04:22:01.382635898Z [2024-02-24T04:22:01.382+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30b5cf14-0aba-4e24-9838-b8ada9c7f60a 2024-02-24T04:22:02.541062665Z [2024-02-24T04:22:02.540+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:22:02.542033982Z [2024-02-24T04:22:02.541+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 04:20:00+00:00, run_id=scheduled__2024-02-24T04:20:00+00:00, run_start_date=2024-02-24 04:22:00.863056+00:00, run_end_date=2024-02-24 04:22:02.540932+00:00, run_duration=1.677876, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:20:00+00:00, data_interval_end=2024-02-24 04:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T04:22:02.566370265Z [2024-02-24T04:22:02.565+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T04:22:00+00:00, run_after=2024-02-24T04:24:00+00:00 2024-02-24T04:22:02.577035484Z [2024-02-24T04:22:02.576+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:22:02.577401841Z [2024-02-24T04:22:02.577+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:21:00+00:00, run_id=scheduled__2024-02-24T04:21:00+00:00, run_start_date=2024-02-24 04:22:00.864368+00:00, run_end_date=2024-02-24 04:22:02.577024+00:00, run_duration=1.712656, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:21:00+00:00, data_interval_end=2024-02-24 04:22:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:22:02.590316977Z [2024-02-24T04:22:02.589+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:22:00+00:00, run_after=2024-02-24T04:23:00+00:00 2024-02-24T04:22:02.766787502Z [2024-02-24T04:22:02.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:20:00+00:00 exited with status success for try_number 1 2024-02-24T04:22:02.766902886Z [2024-02-24T04:22:02.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:21:00+00:00 exited with status success for try_number 1 2024-02-24T04:22:02.795136131Z [2024-02-24T04:22:02.794+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T04:20:00+00:00, map_index=-1, run_start_date=2024-02-24 04:22:01.819595+00:00, run_end_date=2024-02-24 04:22:02.251442+00:00, run_duration=0.431847, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1283, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:22:00.959603+00:00, queued_by_job_id=2, pid=18680 2024-02-24T04:22:02.795285206Z [2024-02-24T04:22:02.795+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:21:00+00:00, map_index=-1, run_start_date=2024-02-24 04:22:01.866343+00:00, run_end_date=2024-02-24 04:22:02.272101+00:00, run_duration=0.405758, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1284, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:22:00.959603+00:00, queued_by_job_id=2, pid=18681 2024-02-24T04:22:06.063839078Z [2024-02-24T04:22:06.062+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:22:06.063881156Z [2024-02-24T04:22:06.062+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:21:00+00:00, run_id=scheduled__2024-02-24T04:21:00+00:00, run_start_date=2024-02-24 04:22:00.865931+00:00, run_end_date=2024-02-24 04:22:06.062515+00:00, run_duration=5.196584, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:21:00+00:00, data_interval_end=2024-02-24 04:22:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:22:06.081033328Z [2024-02-24T04:22:06.080+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:22:00+00:00, run_after=2024-02-24T04:23:00+00:00 2024-02-24T04:22:06.097247778Z [2024-02-24T04:22:06.096+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:22:06.098027633Z [2024-02-24T04:22:06.097+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:21:00+00:00, run_id=scheduled__2024-02-24T04:21:00+00:00, run_start_date=2024-02-24 04:22:00.867236+00:00, run_end_date=2024-02-24 04:22:06.097163+00:00, run_duration=5.229927, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:21:00+00:00, data_interval_end=2024-02-24 04:22:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:22:06.118648022Z [2024-02-24T04:22:06.118+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:22:00+00:00, run_after=2024-02-24T04:23:00+00:00 2024-02-24T04:22:06.162837341Z [2024-02-24T04:22:06.162+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:21:00+00:00 exited with status success for try_number 1 2024-02-24T04:22:06.163188012Z [2024-02-24T04:22:06.162+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:21:00+00:00 exited with status success for try_number 1 2024-02-24T04:22:06.173268560Z [2024-02-24T04:22:06.172+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:21:00+00:00, map_index=-1, run_start_date=2024-02-24 04:22:03.151490+00:00, run_end_date=2024-02-24 04:22:05.570805+00:00, run_duration=2.419315, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1285, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:22:00.959603+00:00, queued_by_job_id=2, pid=18704 2024-02-24T04:22:06.173972716Z [2024-02-24T04:22:06.173+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:21:00+00:00, map_index=-1, run_start_date=2024-02-24 04:22:03.383360+00:00, run_end_date=2024-02-24 04:22:05.968296+00:00, run_duration=2.584936, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1286, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:22:00.959603+00:00, queued_by_job_id=2, pid=18705 2024-02-24T04:22:06.255359169Z [2024-02-24T04:22:06.254+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T04:23:00.763825200Z [2024-02-24T04:23:00.763+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:23:00.786201517Z [2024-02-24T04:23:00.785+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:23:00+00:00, run_after=2024-02-24T04:24:00+00:00 2024-02-24T04:23:00.815241666Z [2024-02-24T04:23:00.814+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:23:00+00:00, run_after=2024-02-24T04:24:00+00:00 2024-02-24T04:23:00.906994619Z [2024-02-24T04:23:00.906+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T04:23:00.907037418Z 2024-02-24T04:23:00.907041675Z 2024-02-24T04:23:00.907044963Z 2024-02-24T04:23:00.907326203Z [2024-02-24T04:23:00.906+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:23:00.907541939Z [2024-02-24T04:23:00.907+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:23:00.907644523Z [2024-02-24T04:23:00.907+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:23:00.908223633Z [2024-02-24T04:23:00.908+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:23:00.908257060Z 2024-02-24T04:23:00.908263344Z 2024-02-24T04:23:00.908268939Z 2024-02-24T04:23:00.911861592Z [2024-02-24T04:23:00.911+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:23:00.911925745Z [2024-02-24T04:23:00.911+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:23:00.912233378Z [2024-02-24T04:23:00.912+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:23:00.912396526Z [2024-02-24T04:23:00.912+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:23:00.912645823Z [2024-02-24T04:23:00.912+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:23:00.912799345Z [2024-02-24T04:23:00.912+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:23:01.221219703Z [2024-02-24T04:23:01.220+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:22:00+00:00 exited with status queued for try_number 1 2024-02-24T04:23:01.222066932Z [2024-02-24T04:23:01.221+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:22:00+00:00 exited with status queued for try_number 1 2024-02-24T04:23:01.222081297Z [2024-02-24T04:23:01.221+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:22:00+00:00 exited with status queued for try_number 1 2024-02-24T04:23:01.261604915Z [2024-02-24T04:23:01.257+0000] {scheduler_job.py:635} INFO - Setting external_id for to aea357a0-7df4-4d8d-8cf2-ddbd59d347ce 2024-02-24T04:23:01.261623903Z [2024-02-24T04:23:01.257+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20267c4d-380e-4de1-8d5d-6d051614db21 2024-02-24T04:23:01.261645364Z [2024-02-24T04:23:01.257+0000] {scheduler_job.py:635} INFO - Setting external_id for to ec5d435b-1f8f-4e21-a83f-c5219662e424 2024-02-24T04:23:03.596032968Z [2024-02-24T04:23:03.595+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:23:03.596234421Z [2024-02-24T04:23:03.596+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:22:00+00:00, run_id=scheduled__2024-02-24T04:22:00+00:00, run_start_date=2024-02-24 04:23:00.828884+00:00, run_end_date=2024-02-24 04:23:03.595930+00:00, run_duration=2.767046, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:22:00+00:00, data_interval_end=2024-02-24 04:23:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:23:03.607137898Z [2024-02-24T04:23:03.606+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:23:00+00:00, run_after=2024-02-24T04:24:00+00:00 2024-02-24T04:23:03.665573243Z [2024-02-24T04:23:03.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:22:00+00:00 exited with status success for try_number 1 2024-02-24T04:23:03.671675935Z [2024-02-24T04:23:03.671+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:22:00+00:00, map_index=-1, run_start_date=2024-02-24 04:23:01.898761+00:00, run_end_date=2024-02-24 04:23:02.359520+00:00, run_duration=0.460759, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1287, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:23:00.908913+00:00, queued_by_job_id=2, pid=18737 2024-02-24T04:23:05.828951047Z [2024-02-24T04:23:05.828+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:23:05.829745339Z [2024-02-24T04:23:05.829+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:22:00+00:00, run_id=scheduled__2024-02-24T04:22:00+00:00, run_start_date=2024-02-24 04:23:00.830443+00:00, run_end_date=2024-02-24 04:23:05.829020+00:00, run_duration=4.998577, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:22:00+00:00, data_interval_end=2024-02-24 04:23:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:23:05.841437650Z [2024-02-24T04:23:05.841+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:23:00+00:00, run_after=2024-02-24T04:24:00+00:00 2024-02-24T04:23:05.848174879Z [2024-02-24T04:23:05.847+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:23:05.848421788Z [2024-02-24T04:23:05.848+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:22:00+00:00, run_id=scheduled__2024-02-24T04:22:00+00:00, run_start_date=2024-02-24 04:23:00.831928+00:00, run_end_date=2024-02-24 04:23:05.848143+00:00, run_duration=5.016215, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:22:00+00:00, data_interval_end=2024-02-24 04:23:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:23:05.857649553Z [2024-02-24T04:23:05.857+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:23:00+00:00, run_after=2024-02-24T04:24:00+00:00 2024-02-24T04:23:05.884518173Z [2024-02-24T04:23:05.884+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:22:00+00:00 exited with status success for try_number 1 2024-02-24T04:23:05.884682052Z [2024-02-24T04:23:05.884+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:22:00+00:00 exited with status success for try_number 1 2024-02-24T04:23:05.890951155Z [2024-02-24T04:23:05.890+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:22:00+00:00, map_index=-1, run_start_date=2024-02-24 04:23:03.020185+00:00, run_end_date=2024-02-24 04:23:04.848633+00:00, run_duration=1.828448, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1289, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:23:00.908913+00:00, queued_by_job_id=2, pid=18756 2024-02-24T04:23:05.891241626Z [2024-02-24T04:23:05.891+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:22:00+00:00, map_index=-1, run_start_date=2024-02-24 04:23:02.986313+00:00, run_end_date=2024-02-24 04:23:05.126153+00:00, run_duration=2.13984, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1288, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:23:00.908913+00:00, queued_by_job_id=2, pid=18755 2024-02-24T04:24:00.617847551Z [2024-02-24T04:24:00.617+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:24:00.626753909Z [2024-02-24T04:24:00.626+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:24:00.641144012Z [2024-02-24T04:24:00.640+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:24:00+00:00, run_after=2024-02-24T04:25:00+00:00 2024-02-24T04:24:00.653886411Z [2024-02-24T04:24:00.653+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:24:00+00:00, run_after=2024-02-24T04:25:00+00:00 2024-02-24T04:24:00.758545076Z [2024-02-24T04:24:00.757+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T04:24:00.758571937Z 2024-02-24T04:24:00.758577302Z 2024-02-24T04:24:00.758581702Z 2024-02-24T04:24:00.758601453Z 2024-02-24T04:24:00.758648209Z [2024-02-24T04:24:00.758+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T04:24:00.758654127Z [2024-02-24T04:24:00.758+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:24:00.758678349Z [2024-02-24T04:24:00.758+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:24:00.758814549Z [2024-02-24T04:24:00.758+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:24:00.759524387Z [2024-02-24T04:24:00.759+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:24:00.759540841Z 2024-02-24T04:24:00.759545661Z 2024-02-24T04:24:00.759549405Z 2024-02-24T04:24:00.759553102Z 2024-02-24T04:24:00.770380690Z [2024-02-24T04:24:00.763+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T04:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:24:00.770481745Z [2024-02-24T04:24:00.770+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T04:24:00.770947634Z [2024-02-24T04:24:00.770+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:24:00.770970309Z [2024-02-24T04:24:00.770+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:24:00.771205912Z [2024-02-24T04:24:00.770+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:24:00.771222438Z [2024-02-24T04:24:00.771+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:24:00.771399631Z [2024-02-24T04:24:00.771+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:24:00.771488844Z [2024-02-24T04:24:00.771+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:24:01.203145096Z [2024-02-24T04:24:01.202+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:22:00+00:00 exited with status queued for try_number 1 2024-02-24T04:24:01.203311343Z [2024-02-24T04:24:01.203+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:23:00+00:00 exited with status queued for try_number 1 2024-02-24T04:24:01.203478708Z [2024-02-24T04:24:01.203+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:23:00+00:00 exited with status queued for try_number 1 2024-02-24T04:24:01.203621687Z [2024-02-24T04:24:01.203+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:23:00+00:00 exited with status queued for try_number 1 2024-02-24T04:24:01.225985621Z [2024-02-24T04:24:01.224+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2a111b70-7c73-46e4-81bc-7a2e83669be1 2024-02-24T04:24:01.226012702Z [2024-02-24T04:24:01.225+0000] {scheduler_job.py:635} INFO - Setting external_id for to a3db0d72-f0c4-4420-a1d8-949fd9652bdd 2024-02-24T04:24:01.226017760Z [2024-02-24T04:24:01.225+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0237d440-cae2-4b8e-9904-f44945301c10 2024-02-24T04:24:01.242288826Z [2024-02-24T04:24:01.226+0000] {scheduler_job.py:635} INFO - Setting external_id for to f1564d5d-0ea4-47da-b90b-1c91b7720acb 2024-02-24T04:24:02.524419220Z [2024-02-24T04:24:02.524+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:24:02.524891046Z [2024-02-24T04:24:02.524+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 04:22:00+00:00, run_id=scheduled__2024-02-24T04:22:00+00:00, run_start_date=2024-02-24 04:24:00.663967+00:00, run_end_date=2024-02-24 04:24:02.524349+00:00, run_duration=1.860382, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:22:00+00:00, data_interval_end=2024-02-24 04:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T04:24:02.533828750Z [2024-02-24T04:24:02.533+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T04:24:00+00:00, run_after=2024-02-24T04:26:00+00:00 2024-02-24T04:24:02.541447680Z [2024-02-24T04:24:02.541+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:24:02.541630491Z [2024-02-24T04:24:02.541+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:23:00+00:00, run_id=scheduled__2024-02-24T04:23:00+00:00, run_start_date=2024-02-24 04:24:00.665042+00:00, run_end_date=2024-02-24 04:24:02.541308+00:00, run_duration=1.876266, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:23:00+00:00, data_interval_end=2024-02-24 04:24:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:24:02.552322261Z [2024-02-24T04:24:02.551+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:24:00+00:00, run_after=2024-02-24T04:25:00+00:00 2024-02-24T04:24:02.608782450Z [2024-02-24T04:24:02.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:22:00+00:00 exited with status success for try_number 1 2024-02-24T04:24:02.608815026Z [2024-02-24T04:24:02.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:23:00+00:00 exited with status success for try_number 1 2024-02-24T04:24:02.615695989Z [2024-02-24T04:24:02.615+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:23:00+00:00, map_index=-1, run_start_date=2024-02-24 04:24:01.745584+00:00, run_end_date=2024-02-24 04:24:02.200454+00:00, run_duration=0.45487, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1291, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:24:00.760864+00:00, queued_by_job_id=2, pid=18789 2024-02-24T04:24:02.615803455Z [2024-02-24T04:24:02.615+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T04:22:00+00:00, map_index=-1, run_start_date=2024-02-24 04:24:01.650932+00:00, run_end_date=2024-02-24 04:24:02.000336+00:00, run_duration=0.349404, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1290, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:24:00.760864+00:00, queued_by_job_id=2, pid=18788 2024-02-24T04:24:04.789384049Z [2024-02-24T04:24:04.788+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:24:04.789547114Z [2024-02-24T04:24:04.789+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:23:00+00:00, run_id=scheduled__2024-02-24T04:23:00+00:00, run_start_date=2024-02-24 04:24:00.666050+00:00, run_end_date=2024-02-24 04:24:04.789191+00:00, run_duration=4.123141, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:23:00+00:00, data_interval_end=2024-02-24 04:24:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:24:04.800633341Z [2024-02-24T04:24:04.800+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:24:00+00:00, run_after=2024-02-24T04:25:00+00:00 2024-02-24T04:24:04.843021938Z [2024-02-24T04:24:04.842+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:23:00+00:00 exited with status success for try_number 1 2024-02-24T04:24:04.848312278Z [2024-02-24T04:24:04.847+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:23:00+00:00, map_index=-1, run_start_date=2024-02-24 04:24:02.694632+00:00, run_end_date=2024-02-24 04:24:04.079571+00:00, run_duration=1.384939, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1292, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:24:00.760864+00:00, queued_by_job_id=2, pid=18812 2024-02-24T04:24:05.899362712Z [2024-02-24T04:24:05.898+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:24:05.900237661Z [2024-02-24T04:24:05.899+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:23:00+00:00, run_id=scheduled__2024-02-24T04:23:00+00:00, run_start_date=2024-02-24 04:24:00.667005+00:00, run_end_date=2024-02-24 04:24:05.899593+00:00, run_duration=5.232588, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:23:00+00:00, data_interval_end=2024-02-24 04:24:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:24:05.914927271Z [2024-02-24T04:24:05.914+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:24:00+00:00, run_after=2024-02-24T04:25:00+00:00 2024-02-24T04:24:05.957386896Z [2024-02-24T04:24:05.956+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:23:00+00:00 exited with status success for try_number 1 2024-02-24T04:24:05.967398465Z [2024-02-24T04:24:05.966+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:23:00+00:00, map_index=-1, run_start_date=2024-02-24 04:24:02.925985+00:00, run_end_date=2024-02-24 04:24:04.962706+00:00, run_duration=2.036721, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1293, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:24:00.760864+00:00, queued_by_job_id=2, pid=18813 2024-02-24T04:25:00.947918489Z [2024-02-24T04:25:00.947+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:25:00+00:00, run_after=2024-02-24T04:30:00+00:00 2024-02-24T04:25:00.967173631Z [2024-02-24T04:25:00.966+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:25:00+00:00, run_after=2024-02-24T04:26:00+00:00 2024-02-24T04:25:00.994923348Z [2024-02-24T04:25:00.994+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:25:00+00:00, run_after=2024-02-24T04:26:00+00:00 2024-02-24T04:25:01.010246140Z [2024-02-24T04:25:01.009+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:25:01.140512937Z [2024-02-24T04:25:01.140+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T04:25:01.140543670Z 2024-02-24T04:25:01.140548235Z 2024-02-24T04:25:01.140565007Z 2024-02-24T04:25:01.140568345Z 2024-02-24T04:25:01.140577682Z [2024-02-24T04:25:01.140+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:25:01.140663338Z [2024-02-24T04:25:01.140+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:25:01.140764327Z [2024-02-24T04:25:01.140+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:25:01.140864767Z [2024-02-24T04:25:01.140+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:25:01.141535812Z [2024-02-24T04:25:01.141+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:25:01.141545639Z 2024-02-24T04:25:01.141549246Z 2024-02-24T04:25:01.141552302Z 2024-02-24T04:25:01.141555347Z 2024-02-24T04:25:01.145733528Z [2024-02-24T04:25:01.145+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T04:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T04:25:01.146029701Z [2024-02-24T04:25:01.145+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T04:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T04:25:01.146289644Z [2024-02-24T04:25:01.146+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:25:01.146408230Z [2024-02-24T04:25:01.146+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:25:01.146600925Z [2024-02-24T04:25:01.146+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:25:01.146697642Z [2024-02-24T04:25:01.146+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:25:01.146893002Z [2024-02-24T04:25:01.146+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:25:01.146990349Z [2024-02-24T04:25:01.146+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:25:01.523506847Z [2024-02-24T04:25:01.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T04:20:00+00:00 exited with status queued for try_number 1 2024-02-24T04:25:01.523805836Z [2024-02-24T04:25:01.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:24:00+00:00 exited with status queued for try_number 1 2024-02-24T04:25:01.524554874Z [2024-02-24T04:25:01.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:24:00+00:00 exited with status queued for try_number 1 2024-02-24T04:25:01.524956910Z [2024-02-24T04:25:01.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:24:00+00:00 exited with status queued for try_number 1 2024-02-24T04:25:01.551941781Z [2024-02-24T04:25:01.551+0000] {scheduler_job.py:635} INFO - Setting external_id for to fede213e-d5dc-48f1-8bba-0b38003dd728 2024-02-24T04:25:01.552403648Z [2024-02-24T04:25:01.552+0000] {scheduler_job.py:635} INFO - Setting external_id for to a7eb3b57-2cd6-4b1d-8c81-6ad10a60bf53 2024-02-24T04:25:01.557998826Z [2024-02-24T04:25:01.557+0000] {scheduler_job.py:635} INFO - Setting external_id for to d403afd9-d152-4207-8c21-c35e9929a47c 2024-02-24T04:25:01.558424035Z [2024-02-24T04:25:01.558+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8485ace0-b6bf-4623-898c-0caaf2703501 2024-02-24T04:25:03.592482891Z [2024-02-24T04:25:03.590+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:25:03.593568192Z [2024-02-24T04:25:03.593+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:24:00+00:00, run_id=scheduled__2024-02-24T04:24:00+00:00, run_start_date=2024-02-24 04:25:01.033237+00:00, run_end_date=2024-02-24 04:25:03.592463+00:00, run_duration=2.559226, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:24:00+00:00, data_interval_end=2024-02-24 04:25:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:25:03.648403806Z [2024-02-24T04:25:03.647+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:25:00+00:00, run_after=2024-02-24T04:26:00+00:00 2024-02-24T04:25:03.794302091Z [2024-02-24T04:25:03.793+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:24:00+00:00 exited with status success for try_number 1 2024-02-24T04:25:03.820411807Z [2024-02-24T04:25:03.813+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:24:00+00:00, map_index=-1, run_start_date=2024-02-24 04:25:02.474819+00:00, run_end_date=2024-02-24 04:25:03.119762+00:00, run_duration=0.644943, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1294, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:25:01.142682+00:00, queued_by_job_id=2, pid=18847 2024-02-24T04:25:06.139680659Z [2024-02-24T04:25:06.139+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:25:06.139728016Z 2024-02-24T04:25:06.139761410Z [2024-02-24T04:25:06.139+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:25:06.140485386Z [2024-02-24T04:25:06.140+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:25:06.140502636Z 2024-02-24T04:25:06.143425536Z [2024-02-24T04:25:06.143+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T04:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T04:25:06.143548281Z [2024-02-24T04:25:06.143+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T04:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T04:25:06.197616745Z [2024-02-24T04:25:06.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T04:20:00+00:00 exited with status queued for try_number 1 2024-02-24T04:25:06.197677734Z [2024-02-24T04:25:06.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T04:20:00+00:00 exited with status success for try_number 1 2024-02-24T04:25:06.198198174Z [2024-02-24T04:25:06.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:24:00+00:00 exited with status success for try_number 1 2024-02-24T04:25:06.207852041Z [2024-02-24T04:25:06.207+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T04:20:00+00:00, map_index=-1, run_start_date=2024-02-24 04:25:04.429923+00:00, run_end_date=2024-02-24 04:25:04.971121+00:00, run_duration=0.541198, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1295, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:25:01.142682+00:00, queued_by_job_id=2, pid=18868 2024-02-24T04:25:06.208099879Z [2024-02-24T04:25:06.207+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:24:00+00:00, map_index=-1, run_start_date=2024-02-24 04:25:04.469449+00:00, run_end_date=2024-02-24 04:25:06.046240+00:00, run_duration=1.576791, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1296, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:25:01.142682+00:00, queued_by_job_id=2, pid=18872 2024-02-24T04:25:06.208460674Z [2024-02-24T04:25:06.208+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b94c1aa-d636-48cf-b0ad-cef6d4e3b098 2024-02-24T04:25:06.258672201Z [2024-02-24T04:25:06.258+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:25:06.259206149Z [2024-02-24T04:25:06.258+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:24:00+00:00, run_id=scheduled__2024-02-24T04:24:00+00:00, run_start_date=2024-02-24 04:25:01.035882+00:00, run_end_date=2024-02-24 04:25:06.258494+00:00, run_duration=5.222612, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:24:00+00:00, data_interval_end=2024-02-24 04:25:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:25:06.273797976Z [2024-02-24T04:25:06.273+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:25:00+00:00, run_after=2024-02-24T04:26:00+00:00 2024-02-24T04:25:08.646720300Z [2024-02-24T04:25:08.646+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:25:08.647345166Z [2024-02-24T04:25:08.646+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:24:00+00:00, run_id=scheduled__2024-02-24T04:24:00+00:00, run_start_date=2024-02-24 04:25:01.037989+00:00, run_end_date=2024-02-24 04:25:08.646775+00:00, run_duration=7.608786, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:24:00+00:00, data_interval_end=2024-02-24 04:25:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:25:08.673068334Z [2024-02-24T04:25:08.672+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:25:00+00:00, run_after=2024-02-24T04:26:00+00:00 2024-02-24T04:25:08.739727124Z [2024-02-24T04:25:08.739+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:25:08.739809443Z 2024-02-24T04:25:08.740105796Z [2024-02-24T04:25:08.739+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:25:08.740745159Z [2024-02-24T04:25:08.740+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:25:08.740899513Z 2024-02-24T04:25:08.743818286Z [2024-02-24T04:25:08.743+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T04:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T04:25:08.744064838Z [2024-02-24T04:25:08.743+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T04:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T04:25:08.808100942Z [2024-02-24T04:25:08.807+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T04:20:00+00:00 exited with status queued for try_number 1 2024-02-24T04:25:08.810305843Z [2024-02-24T04:25:08.807+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:24:00+00:00 exited with status success for try_number 1 2024-02-24T04:25:08.810854590Z [2024-02-24T04:25:08.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T04:20:00+00:00 exited with status success for try_number 1 2024-02-24T04:25:08.823605973Z [2024-02-24T04:25:08.823+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:24:00+00:00, map_index=-1, run_start_date=2024-02-24 04:25:04.749670+00:00, run_end_date=2024-02-24 04:25:08.024242+00:00, run_duration=3.274572, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1297, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:25:01.142682+00:00, queued_by_job_id=2, pid=18873 2024-02-24T04:25:08.824328201Z [2024-02-24T04:25:08.824+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T04:20:00+00:00, map_index=-1, run_start_date=2024-02-24 04:25:07.844263+00:00, run_end_date=2024-02-24 04:25:08.226656+00:00, run_duration=0.382393, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1298, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:25:06.140861+00:00, queued_by_job_id=2, pid=18896 2024-02-24T04:25:08.824824311Z [2024-02-24T04:25:08.824+0000] {scheduler_job.py:635} INFO - Setting external_id for to ec6f4d76-6fa8-418b-92f1-ba660c9885ea 2024-02-24T04:25:11.101376044Z [2024-02-24T04:25:11.100+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:25:11.101439861Z 2024-02-24T04:25:11.101843088Z [2024-02-24T04:25:11.101+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:25:11.102667986Z [2024-02-24T04:25:11.102+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:25:11.102683897Z 2024-02-24T04:25:11.106239438Z [2024-02-24T04:25:11.105+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T04:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:25:11.106546178Z [2024-02-24T04:25:11.106+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T04:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T04:25:11.170910285Z [2024-02-24T04:25:11.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T04:20:00+00:00 exited with status queued for try_number 1 2024-02-24T04:25:11.171092921Z [2024-02-24T04:25:11.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T04:20:00+00:00 exited with status success for try_number 1 2024-02-24T04:25:11.177544944Z [2024-02-24T04:25:11.177+0000] {scheduler_job.py:635} INFO - Setting external_id for to a4cc0824-f00b-42f3-be02-b0a0686e0596 2024-02-24T04:25:11.177869385Z [2024-02-24T04:25:11.177+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T04:20:00+00:00, map_index=0, run_start_date=2024-02-24 04:25:10.327918+00:00, run_end_date=2024-02-24 04:25:10.634163+00:00, run_duration=0.306245, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1299, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:25:08.741147+00:00, queued_by_job_id=2, pid=18904 2024-02-24T04:25:13.811052296Z [2024-02-24T04:25:13.810+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:25:13.811530658Z [2024-02-24T04:25:13.811+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:20:00+00:00, run_id=scheduled__2024-02-24T04:20:00+00:00, run_start_date=2024-02-24 04:25:01.031351+00:00, run_end_date=2024-02-24 04:25:13.811209+00:00, run_duration=12.779858, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:20:00+00:00, data_interval_end=2024-02-24 04:25:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T04:25:13.819773575Z [2024-02-24T04:25:13.819+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:25:00+00:00, run_after=2024-02-24T04:30:00+00:00 2024-02-24T04:25:13.855186588Z [2024-02-24T04:25:13.854+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T04:20:00+00:00 exited with status success for try_number 1 2024-02-24T04:25:13.859698053Z [2024-02-24T04:25:13.859+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T04:20:00+00:00, map_index=-1, run_start_date=2024-02-24 04:25:12.887977+00:00, run_end_date=2024-02-24 04:25:13.287174+00:00, run_duration=0.399197, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1300, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:25:11.103220+00:00, queued_by_job_id=2, pid=18912 2024-02-24T04:25:38.142095527Z [2024-02-24T04:25:38.141+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:25:38.142128386Z 2024-02-24T04:25:38.142283048Z [2024-02-24T04:25:38.141+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-02-24T04:25:38.143483860Z [2024-02-24T04:25:38.143+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:25:38.143494359Z 2024-02-24T04:25:38.147833086Z [2024-02-24T04:25:38.147+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240224042537_564072', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:25:38.147988477Z [2024-02-24T04:25:38.147+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240224042537_564072', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-02-24T04:25:38.214366274Z [2024-02-24T04:25:38.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240224042537_564072 exited with status queued for try_number 1 2024-02-24T04:25:38.222232922Z [2024-02-24T04:25:38.221+0000] {scheduler_job.py:635} INFO - Setting external_id for to 65041a03-3996-4b94-91d5-4d1e3af0cf21 2024-02-24T04:25:40.133265002Z [2024-02-24T04:25:40.132+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:25:40.133632582Z [2024-02-24T04:25:40.133+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-02-24 04:25:37.950710+00:00, run_id=vdu_down_20240224042537_564072, run_start_date=2024-02-24 04:25:38.090344+00:00, run_end_date=2024-02-24 04:25:40.133214+00:00, run_duration=2.04287, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-02-24 04:25:37.950710+00:00, data_interval_end=2024-02-24 04:25:37.950710+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-02-24T04:25:40.136599533Z [2024-02-24T04:25:40.136+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-02-24T04:25:40.169000710Z [2024-02-24T04:25:40.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240224042537_564072 exited with status success for try_number 1 2024-02-24T04:25:40.184894420Z [2024-02-24T04:25:40.184+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240224042537_564072, map_index=-1, run_start_date=2024-02-24 04:25:38.820942+00:00, run_end_date=2024-02-24 04:25:39.201790+00:00, run_duration=0.380848, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1301, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:25:38.144023+00:00, queued_by_job_id=2, pid=18914 2024-02-24T04:26:00.275346943Z [2024-02-24T04:26:00.274+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:26:00+00:00, run_after=2024-02-24T04:27:00+00:00 2024-02-24T04:26:00.281244506Z [2024-02-24T04:26:00.280+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:26:00.287580975Z [2024-02-24T04:26:00.287+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:26:00.301472857Z [2024-02-24T04:26:00.301+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:26:00+00:00, run_after=2024-02-24T04:27:00+00:00 2024-02-24T04:26:00.397206132Z [2024-02-24T04:26:00.396+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T04:26:00.397239681Z 2024-02-24T04:26:00.397247230Z 2024-02-24T04:26:00.397253265Z 2024-02-24T04:26:00.397258964Z 2024-02-24T04:26:00.397265474Z [2024-02-24T04:26:00.397+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T04:26:00.397821428Z [2024-02-24T04:26:00.397+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:26:00.397867697Z [2024-02-24T04:26:00.397+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:26:00.397955672Z [2024-02-24T04:26:00.397+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:26:00.398521311Z [2024-02-24T04:26:00.398+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:26:00.398533614Z 2024-02-24T04:26:00.398540411Z 2024-02-24T04:26:00.398546162Z 2024-02-24T04:26:00.398552024Z 2024-02-24T04:26:00.403177404Z [2024-02-24T04:26:00.402+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T04:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:26:00.403206809Z [2024-02-24T04:26:00.402+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T04:26:00.403478686Z [2024-02-24T04:26:00.403+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:26:00.403532317Z [2024-02-24T04:26:00.403+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:26:00.403739928Z [2024-02-24T04:26:00.403+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:26:00.403812908Z [2024-02-24T04:26:00.403+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:26:00.404021801Z [2024-02-24T04:26:00.403+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:26:00.404072318Z [2024-02-24T04:26:00.403+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:26:00.974972423Z [2024-02-24T04:26:00.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:24:00+00:00 exited with status queued for try_number 1 2024-02-24T04:26:00.978112259Z [2024-02-24T04:26:00.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:25:00+00:00 exited with status queued for try_number 1 2024-02-24T04:26:00.978220750Z [2024-02-24T04:26:00.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:25:00+00:00 exited with status queued for try_number 1 2024-02-24T04:26:00.978266836Z [2024-02-24T04:26:00.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:25:00+00:00 exited with status queued for try_number 1 2024-02-24T04:26:00.996192271Z [2024-02-24T04:26:00.995+0000] {scheduler_job.py:635} INFO - Setting external_id for to 411c6c55-b34f-4b09-afd8-b28aea32823a 2024-02-24T04:26:00.996259244Z [2024-02-24T04:26:00.996+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9916861f-aa88-4cf6-b36a-852297799d84 2024-02-24T04:26:00.996347604Z [2024-02-24T04:26:00.996+0000] {scheduler_job.py:635} INFO - Setting external_id for to ae8862a6-f3fe-4733-806a-8c2be6661ee4 2024-02-24T04:26:00.996438466Z [2024-02-24T04:26:00.996+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a64fa56-5c38-419c-8640-c691cc19da83 2024-02-24T04:26:02.176118701Z [2024-02-24T04:26:02.175+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:26:02.177553853Z [2024-02-24T04:26:02.176+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 04:24:00+00:00, run_id=scheduled__2024-02-24T04:24:00+00:00, run_start_date=2024-02-24 04:26:00.311951+00:00, run_end_date=2024-02-24 04:26:02.176122+00:00, run_duration=1.864171, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:24:00+00:00, data_interval_end=2024-02-24 04:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T04:26:02.189214692Z [2024-02-24T04:26:02.188+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T04:26:00+00:00, run_after=2024-02-24T04:28:00+00:00 2024-02-24T04:26:02.201406955Z [2024-02-24T04:26:02.200+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:26:02.202349737Z [2024-02-24T04:26:02.201+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:25:00+00:00, run_id=scheduled__2024-02-24T04:25:00+00:00, run_start_date=2024-02-24 04:26:00.313111+00:00, run_end_date=2024-02-24 04:26:02.201629+00:00, run_duration=1.888518, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:25:00+00:00, data_interval_end=2024-02-24 04:26:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:26:02.221737073Z [2024-02-24T04:26:02.221+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:26:00+00:00, run_after=2024-02-24T04:27:00+00:00 2024-02-24T04:26:02.287776342Z [2024-02-24T04:26:02.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:24:00+00:00 exited with status success for try_number 1 2024-02-24T04:26:02.290035437Z [2024-02-24T04:26:02.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:25:00+00:00 exited with status success for try_number 1 2024-02-24T04:26:02.300038263Z [2024-02-24T04:26:02.299+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T04:24:00+00:00, map_index=-1, run_start_date=2024-02-24 04:26:01.212855+00:00, run_end_date=2024-02-24 04:26:01.756456+00:00, run_duration=0.543601, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1302, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:26:00.399533+00:00, queued_by_job_id=2, pid=18943 2024-02-24T04:26:02.300411246Z [2024-02-24T04:26:02.300+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:25:00+00:00, map_index=-1, run_start_date=2024-02-24 04:26:01.208386+00:00, run_end_date=2024-02-24 04:26:01.708991+00:00, run_duration=0.500605, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1303, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:26:00.399533+00:00, queued_by_job_id=2, pid=18942 2024-02-24T04:26:05.783311748Z [2024-02-24T04:26:05.782+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:26:05.783808940Z [2024-02-24T04:26:05.783+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:25:00+00:00, run_id=scheduled__2024-02-24T04:25:00+00:00, run_start_date=2024-02-24 04:26:00.315121+00:00, run_end_date=2024-02-24 04:26:05.783207+00:00, run_duration=5.468086, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:25:00+00:00, data_interval_end=2024-02-24 04:26:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:26:05.797224119Z [2024-02-24T04:26:05.796+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:26:00+00:00, run_after=2024-02-24T04:27:00+00:00 2024-02-24T04:26:05.852655475Z [2024-02-24T04:26:05.852+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:25:00+00:00 exited with status success for try_number 1 2024-02-24T04:26:05.858997470Z [2024-02-24T04:26:05.858+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:25:00+00:00, map_index=-1, run_start_date=2024-02-24 04:26:02.367605+00:00, run_end_date=2024-02-24 04:26:05.136697+00:00, run_duration=2.769092, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1304, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:26:00.399533+00:00, queued_by_job_id=2, pid=18961 2024-02-24T04:26:06.902035842Z [2024-02-24T04:26:06.901+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:26:06.902940900Z [2024-02-24T04:26:06.902+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:25:00+00:00, run_id=scheduled__2024-02-24T04:25:00+00:00, run_start_date=2024-02-24 04:26:00.314155+00:00, run_end_date=2024-02-24 04:26:06.902432+00:00, run_duration=6.588277, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:25:00+00:00, data_interval_end=2024-02-24 04:26:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:26:06.921046015Z [2024-02-24T04:26:06.917+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:26:00+00:00, run_after=2024-02-24T04:27:00+00:00 2024-02-24T04:26:06.958100253Z [2024-02-24T04:26:06.957+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:25:00+00:00 exited with status success for try_number 1 2024-02-24T04:26:06.962986442Z [2024-02-24T04:26:06.962+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:25:00+00:00, map_index=-1, run_start_date=2024-02-24 04:26:02.843002+00:00, run_end_date=2024-02-24 04:26:06.158933+00:00, run_duration=3.315931, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1305, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:26:00.399533+00:00, queued_by_job_id=2, pid=18972 2024-02-24T04:27:00.649073851Z [2024-02-24T04:27:00.648+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:27:00.671175072Z [2024-02-24T04:27:00.670+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:27:00+00:00, run_after=2024-02-24T04:28:00+00:00 2024-02-24T04:27:00.691691264Z [2024-02-24T04:27:00.691+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:27:00+00:00, run_after=2024-02-24T04:28:00+00:00 2024-02-24T04:27:00.779197383Z [2024-02-24T04:27:00.778+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T04:27:00.779299534Z 2024-02-24T04:27:00.779309938Z 2024-02-24T04:27:00.779318879Z 2024-02-24T04:27:00.779327376Z [2024-02-24T04:27:00.778+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:27:00.779366465Z [2024-02-24T04:27:00.779+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:27:00.779472605Z [2024-02-24T04:27:00.779+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:27:00.780381570Z [2024-02-24T04:27:00.780+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:27:00.780397877Z 2024-02-24T04:27:00.780403240Z 2024-02-24T04:27:00.780407627Z 2024-02-24T04:27:00.784267902Z [2024-02-24T04:27:00.783+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:27:00.784457097Z [2024-02-24T04:27:00.784+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:27:00.784753262Z [2024-02-24T04:27:00.784+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:27:00.784910416Z [2024-02-24T04:27:00.784+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:27:00.785172553Z [2024-02-24T04:27:00.785+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:27:00.785323734Z [2024-02-24T04:27:00.785+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:27:01.040806943Z [2024-02-24T04:27:01.040+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:26:00+00:00 exited with status queued for try_number 1 2024-02-24T04:27:01.043169116Z [2024-02-24T04:27:01.040+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:26:00+00:00 exited with status queued for try_number 1 2024-02-24T04:27:01.043459182Z [2024-02-24T04:27:01.043+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:26:00+00:00 exited with status queued for try_number 1 2024-02-24T04:27:01.056350912Z [2024-02-24T04:27:01.055+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9ba7c178-3bf8-410d-8a42-a4ce3184e62a 2024-02-24T04:27:01.056646502Z [2024-02-24T04:27:01.056+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9fea0975-f5fe-4961-a1b5-843ce49eec31 2024-02-24T04:27:01.056867920Z [2024-02-24T04:27:01.056+0000] {scheduler_job.py:635} INFO - Setting external_id for to b40f0a28-4ad8-4852-84c0-5ec3cc857494 2024-02-24T04:27:02.204687694Z [2024-02-24T04:27:02.204+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:27:02.205052515Z [2024-02-24T04:27:02.204+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:26:00+00:00, run_id=scheduled__2024-02-24T04:26:00+00:00, run_start_date=2024-02-24 04:27:00.706931+00:00, run_end_date=2024-02-24 04:27:02.204572+00:00, run_duration=1.497641, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:26:00+00:00, data_interval_end=2024-02-24 04:27:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:27:02.215126579Z [2024-02-24T04:27:02.214+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:27:00+00:00, run_after=2024-02-24T04:28:00+00:00 2024-02-24T04:27:02.285252402Z [2024-02-24T04:27:02.284+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:26:00+00:00 exited with status success for try_number 1 2024-02-24T04:27:02.296754640Z [2024-02-24T04:27:02.296+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:26:00+00:00, map_index=-1, run_start_date=2024-02-24 04:27:01.679149+00:00, run_end_date=2024-02-24 04:27:02.099775+00:00, run_duration=0.420626, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1306, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:27:00.781327+00:00, queued_by_job_id=2, pid=18998 2024-02-24T04:27:04.487425911Z [2024-02-24T04:27:04.486+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:27:04.487959841Z [2024-02-24T04:27:04.487+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:26:00+00:00, run_id=scheduled__2024-02-24T04:26:00+00:00, run_start_date=2024-02-24 04:27:00.709283+00:00, run_end_date=2024-02-24 04:27:04.487251+00:00, run_duration=3.777968, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:26:00+00:00, data_interval_end=2024-02-24 04:27:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:27:04.499322937Z [2024-02-24T04:27:04.498+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:27:00+00:00, run_after=2024-02-24T04:28:00+00:00 2024-02-24T04:27:04.540979234Z [2024-02-24T04:27:04.540+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:26:00+00:00 exited with status success for try_number 1 2024-02-24T04:27:04.546572571Z [2024-02-24T04:27:04.546+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:26:00+00:00, map_index=-1, run_start_date=2024-02-24 04:27:02.762709+00:00, run_end_date=2024-02-24 04:27:04.059944+00:00, run_duration=1.297235, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1308, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:27:00.781327+00:00, queued_by_job_id=2, pid=19017 2024-02-24T04:27:05.601166958Z [2024-02-24T04:27:05.600+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:27:05.601491303Z [2024-02-24T04:27:05.601+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:26:00+00:00, run_id=scheduled__2024-02-24T04:26:00+00:00, run_start_date=2024-02-24 04:27:00.710981+00:00, run_end_date=2024-02-24 04:27:05.601069+00:00, run_duration=4.890088, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:26:00+00:00, data_interval_end=2024-02-24 04:27:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:27:05.610440382Z [2024-02-24T04:27:05.610+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:27:00+00:00, run_after=2024-02-24T04:28:00+00:00 2024-02-24T04:27:05.638559928Z [2024-02-24T04:27:05.638+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:26:00+00:00 exited with status success for try_number 1 2024-02-24T04:27:05.643364730Z [2024-02-24T04:27:05.643+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:26:00+00:00, map_index=-1, run_start_date=2024-02-24 04:27:02.723251+00:00, run_end_date=2024-02-24 04:27:04.674290+00:00, run_duration=1.951039, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1307, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:27:00.781327+00:00, queued_by_job_id=2, pid=19016 2024-02-24T04:27:06.320847692Z [2024-02-24T04:27:06.320+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T04:28:00.448229737Z [2024-02-24T04:28:00.446+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:28:00+00:00, run_after=2024-02-24T04:29:00+00:00 2024-02-24T04:28:00.455840003Z [2024-02-24T04:28:00.455+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:28:00.467214872Z [2024-02-24T04:28:00.466+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:28:00+00:00, run_after=2024-02-24T04:29:00+00:00 2024-02-24T04:28:00.474071461Z [2024-02-24T04:28:00.473+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:28:00.600221521Z [2024-02-24T04:28:00.599+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T04:28:00.600270444Z 2024-02-24T04:28:00.600288552Z 2024-02-24T04:28:00.600293593Z 2024-02-24T04:28:00.600298579Z 2024-02-24T04:28:00.600342691Z [2024-02-24T04:28:00.599+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T04:28:00.600667041Z [2024-02-24T04:28:00.600+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:28:00.600787445Z [2024-02-24T04:28:00.600+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:28:00.600969973Z [2024-02-24T04:28:00.600+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:28:00.601839930Z [2024-02-24T04:28:00.601+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:28:00.601854627Z 2024-02-24T04:28:00.601860324Z 2024-02-24T04:28:00.601865360Z 2024-02-24T04:28:00.601870417Z 2024-02-24T04:28:00.605826605Z [2024-02-24T04:28:00.605+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T04:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:28:00.606009167Z [2024-02-24T04:28:00.605+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T04:28:00.606420452Z [2024-02-24T04:28:00.606+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:28:00.606539756Z [2024-02-24T04:28:00.606+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:28:00.606877354Z [2024-02-24T04:28:00.606+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:28:00.607077111Z [2024-02-24T04:28:00.606+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:28:00.607357904Z [2024-02-24T04:28:00.607+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:28:00.607560127Z [2024-02-24T04:28:00.607+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:28:00.939423566Z [2024-02-24T04:28:00.938+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:26:00+00:00 exited with status queued for try_number 1 2024-02-24T04:28:00.941548985Z [2024-02-24T04:28:00.941+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:27:00+00:00 exited with status queued for try_number 1 2024-02-24T04:28:00.941836962Z [2024-02-24T04:28:00.941+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:27:00+00:00 exited with status queued for try_number 1 2024-02-24T04:28:00.942043514Z [2024-02-24T04:28:00.941+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:27:00+00:00 exited with status queued for try_number 1 2024-02-24T04:28:00.956523205Z [2024-02-24T04:28:00.956+0000] {scheduler_job.py:635} INFO - Setting external_id for to 075c26d0-4983-493c-8bb4-dd2b32fe1b1e 2024-02-24T04:28:00.956721222Z [2024-02-24T04:28:00.956+0000] {scheduler_job.py:635} INFO - Setting external_id for to 46f0df2c-8d2b-4130-9591-70c918663b41 2024-02-24T04:28:00.956941507Z [2024-02-24T04:28:00.956+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8d4c3b5-a59c-4fb5-95ef-c2708a1f1f24 2024-02-24T04:28:00.957196745Z [2024-02-24T04:28:00.957+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e0b856f-2b63-4781-b5af-0a51046b88bc 2024-02-24T04:28:02.112815793Z [2024-02-24T04:28:02.112+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:28:02.112978998Z [2024-02-24T04:28:02.112+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 04:26:00+00:00, run_id=scheduled__2024-02-24T04:26:00+00:00, run_start_date=2024-02-24 04:28:00.484091+00:00, run_end_date=2024-02-24 04:28:02.112651+00:00, run_duration=1.62856, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:26:00+00:00, data_interval_end=2024-02-24 04:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T04:28:02.124782067Z [2024-02-24T04:28:02.124+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T04:28:00+00:00, run_after=2024-02-24T04:30:00+00:00 2024-02-24T04:28:02.135955882Z [2024-02-24T04:28:02.135+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:28:02.136619205Z [2024-02-24T04:28:02.136+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:27:00+00:00, run_id=scheduled__2024-02-24T04:27:00+00:00, run_start_date=2024-02-24 04:28:00.486477+00:00, run_end_date=2024-02-24 04:28:02.136177+00:00, run_duration=1.6497, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:27:00+00:00, data_interval_end=2024-02-24 04:28:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:28:02.152880447Z [2024-02-24T04:28:02.152+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:28:00+00:00, run_after=2024-02-24T04:29:00+00:00 2024-02-24T04:28:02.224947670Z [2024-02-24T04:28:02.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:26:00+00:00 exited with status success for try_number 1 2024-02-24T04:28:02.236109631Z [2024-02-24T04:28:02.235+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T04:26:00+00:00, map_index=-1, run_start_date=2024-02-24 04:28:01.570105+00:00, run_end_date=2024-02-24 04:28:01.924053+00:00, run_duration=0.353948, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1309, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:28:00.602818+00:00, queued_by_job_id=2, pid=19050 2024-02-24T04:28:03.349384157Z [2024-02-24T04:28:03.348+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:27:00+00:00 exited with status success for try_number 1 2024-02-24T04:28:03.355482729Z [2024-02-24T04:28:03.354+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:27:00+00:00, map_index=-1, run_start_date=2024-02-24 04:28:01.619679+00:00, run_end_date=2024-02-24 04:28:02.059052+00:00, run_duration=0.439373, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1310, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:28:00.602818+00:00, queued_by_job_id=2, pid=19051 2024-02-24T04:28:05.491755458Z [2024-02-24T04:28:05.491+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:28:05.492288792Z [2024-02-24T04:28:05.491+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:27:00+00:00, run_id=scheduled__2024-02-24T04:27:00+00:00, run_start_date=2024-02-24 04:28:00.489138+00:00, run_end_date=2024-02-24 04:28:05.491563+00:00, run_duration=5.002425, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:27:00+00:00, data_interval_end=2024-02-24 04:28:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:28:05.501725041Z [2024-02-24T04:28:05.501+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:28:00+00:00, run_after=2024-02-24T04:29:00+00:00 2024-02-24T04:28:05.540170066Z [2024-02-24T04:28:05.539+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:27:00+00:00 exited with status success for try_number 1 2024-02-24T04:28:05.549125429Z [2024-02-24T04:28:05.548+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:27:00+00:00, map_index=-1, run_start_date=2024-02-24 04:28:02.744390+00:00, run_end_date=2024-02-24 04:28:04.752628+00:00, run_duration=2.008238, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1312, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:28:00.602818+00:00, queued_by_job_id=2, pid=19075 2024-02-24T04:28:06.023052820Z [2024-02-24T04:28:06.022+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:28:06.023456851Z [2024-02-24T04:28:06.022+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:27:00+00:00, run_id=scheduled__2024-02-24T04:27:00+00:00, run_start_date=2024-02-24 04:28:00.491359+00:00, run_end_date=2024-02-24 04:28:06.022879+00:00, run_duration=5.53152, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:27:00+00:00, data_interval_end=2024-02-24 04:28:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:28:06.034199514Z [2024-02-24T04:28:06.033+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:28:00+00:00, run_after=2024-02-24T04:29:00+00:00 2024-02-24T04:28:06.079223149Z [2024-02-24T04:28:06.078+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:27:00+00:00 exited with status success for try_number 1 2024-02-24T04:28:06.086362854Z [2024-02-24T04:28:06.085+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:27:00+00:00, map_index=-1, run_start_date=2024-02-24 04:28:02.670653+00:00, run_end_date=2024-02-24 04:28:05.566817+00:00, run_duration=2.896164, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1311, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:28:00.602818+00:00, queued_by_job_id=2, pid=19074 2024-02-24T04:29:00.442170194Z [2024-02-24T04:29:00.441+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:29:00+00:00, run_after=2024-02-24T04:30:00+00:00 2024-02-24T04:29:00.456158917Z [2024-02-24T04:29:00.455+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:29:00+00:00, run_after=2024-02-24T04:30:00+00:00 2024-02-24T04:29:00.467235160Z [2024-02-24T04:29:00.466+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:29:00.578657144Z [2024-02-24T04:29:00.578+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T04:29:00.578689165Z 2024-02-24T04:29:00.578694606Z 2024-02-24T04:29:00.578699037Z 2024-02-24T04:29:00.578951970Z [2024-02-24T04:29:00.578+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:29:00.579277441Z [2024-02-24T04:29:00.578+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:29:00.579356660Z [2024-02-24T04:29:00.579+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:29:00.580313884Z [2024-02-24T04:29:00.580+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:29:00.580369839Z 2024-02-24T04:29:00.580379551Z 2024-02-24T04:29:00.580388120Z 2024-02-24T04:29:00.585388410Z [2024-02-24T04:29:00.584+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:29:00.585497626Z [2024-02-24T04:29:00.585+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:29:00.585806552Z [2024-02-24T04:29:00.585+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:29:00.586090834Z [2024-02-24T04:29:00.585+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:29:00.586615111Z [2024-02-24T04:29:00.586+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:29:00.586864756Z [2024-02-24T04:29:00.586+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:29:00.889970764Z [2024-02-24T04:29:00.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:28:00+00:00 exited with status queued for try_number 1 2024-02-24T04:29:00.889994317Z [2024-02-24T04:29:00.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:28:00+00:00 exited with status queued for try_number 1 2024-02-24T04:29:00.889997993Z [2024-02-24T04:29:00.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:28:00+00:00 exited with status queued for try_number 1 2024-02-24T04:29:00.896193010Z [2024-02-24T04:29:00.895+0000] {scheduler_job.py:635} INFO - Setting external_id for to 89aba043-4cf9-446e-b8c7-01ab32783597 2024-02-24T04:29:00.898101682Z [2024-02-24T04:29:00.897+0000] {scheduler_job.py:635} INFO - Setting external_id for to a923b4ee-471c-4fd9-a537-0f69ca8582e6 2024-02-24T04:29:00.898356140Z [2024-02-24T04:29:00.898+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54e1f686-36fd-4a2f-b6ef-b53db06aef13 2024-02-24T04:29:01.897390167Z [2024-02-24T04:29:01.896+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:29:01.897612929Z [2024-02-24T04:29:01.897+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:28:00+00:00, run_id=scheduled__2024-02-24T04:28:00+00:00, run_start_date=2024-02-24 04:29:00.488587+00:00, run_end_date=2024-02-24 04:29:01.897282+00:00, run_duration=1.408695, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:28:00+00:00, data_interval_end=2024-02-24 04:29:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:29:01.915783414Z [2024-02-24T04:29:01.915+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:29:00+00:00, run_after=2024-02-24T04:30:00+00:00 2024-02-24T04:29:03.151255919Z [2024-02-24T04:29:03.150+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:28:00+00:00 exited with status success for try_number 1 2024-02-24T04:29:03.158867756Z [2024-02-24T04:29:03.158+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:28:00+00:00, map_index=-1, run_start_date=2024-02-24 04:29:01.499189+00:00, run_end_date=2024-02-24 04:29:01.837077+00:00, run_duration=0.337888, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1313, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:29:00.581250+00:00, queued_by_job_id=2, pid=19107 2024-02-24T04:29:04.210712886Z [2024-02-24T04:29:04.210+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:29:04.210864092Z [2024-02-24T04:29:04.210+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:28:00+00:00, run_id=scheduled__2024-02-24T04:28:00+00:00, run_start_date=2024-02-24 04:29:00.490940+00:00, run_end_date=2024-02-24 04:29:04.210617+00:00, run_duration=3.719677, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:28:00+00:00, data_interval_end=2024-02-24 04:29:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:29:04.220486732Z [2024-02-24T04:29:04.220+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:29:00+00:00, run_after=2024-02-24T04:30:00+00:00 2024-02-24T04:29:04.267794352Z [2024-02-24T04:29:04.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:28:00+00:00 exited with status success for try_number 1 2024-02-24T04:29:04.276011389Z [2024-02-24T04:29:04.275+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:28:00+00:00, map_index=-1, run_start_date=2024-02-24 04:29:02.505646+00:00, run_end_date=2024-02-24 04:29:04.023209+00:00, run_duration=1.517563, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1315, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:29:00.581250+00:00, queued_by_job_id=2, pid=19126 2024-02-24T04:29:05.331258790Z [2024-02-24T04:29:05.330+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:29:05.331826699Z [2024-02-24T04:29:05.331+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:28:00+00:00, run_id=scheduled__2024-02-24T04:28:00+00:00, run_start_date=2024-02-24 04:29:00.493449+00:00, run_end_date=2024-02-24 04:29:05.331143+00:00, run_duration=4.837694, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:28:00+00:00, data_interval_end=2024-02-24 04:29:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:29:05.353812174Z [2024-02-24T04:29:05.353+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:29:00+00:00, run_after=2024-02-24T04:30:00+00:00 2024-02-24T04:29:05.386572403Z [2024-02-24T04:29:05.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:28:00+00:00 exited with status success for try_number 1 2024-02-24T04:29:05.392138616Z [2024-02-24T04:29:05.391+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:28:00+00:00, map_index=-1, run_start_date=2024-02-24 04:29:02.498058+00:00, run_end_date=2024-02-24 04:29:04.225093+00:00, run_duration=1.727035, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1314, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:29:00.581250+00:00, queued_by_job_id=2, pid=19125 2024-02-24T04:30:01.024013235Z [2024-02-24T04:30:01.023+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:30:00+00:00, run_after=2024-02-24T04:35:00+00:00 2024-02-24T04:30:01.034793285Z [2024-02-24T04:30:01.034+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:30:01.048240499Z [2024-02-24T04:30:01.047+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:30:00+00:00, run_after=2024-02-24T04:31:00+00:00 2024-02-24T04:30:01.061951914Z [2024-02-24T04:30:01.061+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:30:01.075033348Z [2024-02-24T04:30:01.074+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:30:00+00:00, run_after=2024-02-24T04:31:00+00:00 2024-02-24T04:30:01.174290760Z [2024-02-24T04:30:01.173+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-02-24T04:30:01.174315592Z 2024-02-24T04:30:01.174330626Z 2024-02-24T04:30:01.174334664Z 2024-02-24T04:30:01.174337990Z 2024-02-24T04:30:01.174341264Z 2024-02-24T04:30:01.174520790Z [2024-02-24T04:30:01.174+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:30:01.174729702Z [2024-02-24T04:30:01.174+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T04:30:01.174929489Z [2024-02-24T04:30:01.174+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:30:01.175156237Z [2024-02-24T04:30:01.174+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:30:01.175551841Z [2024-02-24T04:30:01.175+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:30:01.176424385Z [2024-02-24T04:30:01.176+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:30:01.176430760Z 2024-02-24T04:30:01.176446429Z 2024-02-24T04:30:01.176449863Z 2024-02-24T04:30:01.176452902Z 2024-02-24T04:30:01.176455848Z 2024-02-24T04:30:01.182131764Z [2024-02-24T04:30:01.181+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T04:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T04:30:01.182361639Z [2024-02-24T04:30:01.182+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T04:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T04:30:01.182742849Z [2024-02-24T04:30:01.182+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T04:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:30:01.182978192Z [2024-02-24T04:30:01.182+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T04:30:01.183341358Z [2024-02-24T04:30:01.183+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:30:01.183576438Z [2024-02-24T04:30:01.183+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:30:01.183956809Z [2024-02-24T04:30:01.183+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:30:01.184185357Z [2024-02-24T04:30:01.184+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:30:01.184549751Z [2024-02-24T04:30:01.184+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:30:01.184820860Z [2024-02-24T04:30:01.184+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:30:01.716597574Z [2024-02-24T04:30:01.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T04:25:00+00:00 exited with status queued for try_number 1 2024-02-24T04:30:01.716730569Z [2024-02-24T04:30:01.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:28:00+00:00 exited with status queued for try_number 1 2024-02-24T04:30:01.716960461Z [2024-02-24T04:30:01.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:29:00+00:00 exited with status queued for try_number 1 2024-02-24T04:30:01.717151615Z [2024-02-24T04:30:01.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:29:00+00:00 exited with status queued for try_number 1 2024-02-24T04:30:01.717317460Z [2024-02-24T04:30:01.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:29:00+00:00 exited with status queued for try_number 1 2024-02-24T04:30:01.739654811Z [2024-02-24T04:30:01.739+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9b11131c-0fe9-42c9-a141-25111eb77e43 2024-02-24T04:30:01.739864042Z [2024-02-24T04:30:01.739+0000] {scheduler_job.py:635} INFO - Setting external_id for to 86b28799-7778-48a6-8bad-53d2ab1effca 2024-02-24T04:30:01.740046403Z [2024-02-24T04:30:01.739+0000] {scheduler_job.py:635} INFO - Setting external_id for to 490e0f3f-00bf-48f3-a6de-e3ed51f1c44b 2024-02-24T04:30:01.740214874Z [2024-02-24T04:30:01.740+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ee426f9-5b36-4695-91af-10060aaa7d33 2024-02-24T04:30:01.740471982Z [2024-02-24T04:30:01.740+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ffacad1-1e7b-475b-aa05-ce26dccaef2b 2024-02-24T04:30:04.183162788Z [2024-02-24T04:30:04.182+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:30:04.183892441Z [2024-02-24T04:30:04.183+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 04:28:00+00:00, run_id=scheduled__2024-02-24T04:28:00+00:00, run_start_date=2024-02-24 04:30:01.087894+00:00, run_end_date=2024-02-24 04:30:04.183059+00:00, run_duration=3.095165, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:28:00+00:00, data_interval_end=2024-02-24 04:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T04:30:04.194607824Z [2024-02-24T04:30:04.194+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T04:30:00+00:00, run_after=2024-02-24T04:32:00+00:00 2024-02-24T04:30:04.207090040Z [2024-02-24T04:30:04.206+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:30:04.207326696Z [2024-02-24T04:30:04.207+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:29:00+00:00, run_id=scheduled__2024-02-24T04:29:00+00:00, run_start_date=2024-02-24 04:30:01.088991+00:00, run_end_date=2024-02-24 04:30:04.207009+00:00, run_duration=3.118018, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:29:00+00:00, data_interval_end=2024-02-24 04:30:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:30:04.220995488Z [2024-02-24T04:30:04.220+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:30:00+00:00, run_after=2024-02-24T04:31:00+00:00 2024-02-24T04:30:04.274373831Z [2024-02-24T04:30:04.273+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:30:04.274400104Z 2024-02-24T04:30:04.274454880Z [2024-02-24T04:30:04.274+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:30:04.275359765Z [2024-02-24T04:30:04.275+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:30:04.275397995Z 2024-02-24T04:30:04.279766251Z [2024-02-24T04:30:04.279+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T04:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T04:30:04.279939305Z [2024-02-24T04:30:04.279+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T04:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T04:30:04.360055254Z [2024-02-24T04:30:04.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T04:25:00+00:00 exited with status queued for try_number 1 2024-02-24T04:30:04.360089419Z [2024-02-24T04:30:04.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:28:00+00:00 exited with status success for try_number 1 2024-02-24T04:30:04.360149845Z [2024-02-24T04:30:04.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:29:00+00:00 exited with status success for try_number 1 2024-02-24T04:30:04.370738984Z [2024-02-24T04:30:04.370+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e29445b-c540-4634-b110-078122d244da 2024-02-24T04:30:04.371040587Z [2024-02-24T04:30:04.370+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T04:28:00+00:00, map_index=-1, run_start_date=2024-02-24 04:30:02.537169+00:00, run_end_date=2024-02-24 04:30:03.152392+00:00, run_duration=0.615223, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1317, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:30:01.178056+00:00, queued_by_job_id=2, pid=19161 2024-02-24T04:30:04.371199315Z [2024-02-24T04:30:04.371+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:29:00+00:00, map_index=-1, run_start_date=2024-02-24 04:30:02.426735+00:00, run_end_date=2024-02-24 04:30:03.140253+00:00, run_duration=0.713518, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1316, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:30:01.178056+00:00, queued_by_job_id=2, pid=19160 2024-02-24T04:30:04.486055977Z [2024-02-24T04:30:04.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T04:25:00+00:00 exited with status success for try_number 1 2024-02-24T04:30:04.493136404Z [2024-02-24T04:30:04.492+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T04:25:00+00:00, map_index=-1, run_start_date=2024-02-24 04:30:03.734858+00:00, run_end_date=2024-02-24 04:30:04.183079+00:00, run_duration=0.448221, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1319, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:30:01.178056+00:00, queued_by_job_id=2, pid=19185 2024-02-24T04:30:05.550602064Z [2024-02-24T04:30:05.550+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:30:05.551206385Z [2024-02-24T04:30:05.550+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:29:00+00:00, run_id=scheduled__2024-02-24T04:29:00+00:00, run_start_date=2024-02-24 04:30:01.090120+00:00, run_end_date=2024-02-24 04:30:05.550689+00:00, run_duration=4.460569, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:29:00+00:00, data_interval_end=2024-02-24 04:30:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:30:05.570936585Z [2024-02-24T04:30:05.570+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:30:00+00:00, run_after=2024-02-24T04:31:00+00:00 2024-02-24T04:30:05.649333650Z [2024-02-24T04:30:05.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:29:00+00:00 exited with status success for try_number 1 2024-02-24T04:30:05.657111929Z [2024-02-24T04:30:05.656+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:29:00+00:00, map_index=-1, run_start_date=2024-02-24 04:30:03.721607+00:00, run_end_date=2024-02-24 04:30:05.053948+00:00, run_duration=1.332341, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1318, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:30:01.178056+00:00, queued_by_job_id=2, pid=19186 2024-02-24T04:30:06.699477098Z [2024-02-24T04:30:06.699+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:30:06.699610401Z [2024-02-24T04:30:06.699+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:29:00+00:00, run_id=scheduled__2024-02-24T04:29:00+00:00, run_start_date=2024-02-24 04:30:01.091163+00:00, run_end_date=2024-02-24 04:30:06.699323+00:00, run_duration=5.60816, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:29:00+00:00, data_interval_end=2024-02-24 04:30:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:30:06.708584388Z [2024-02-24T04:30:06.708+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:30:00+00:00, run_after=2024-02-24T04:31:00+00:00 2024-02-24T04:30:06.750194930Z [2024-02-24T04:30:06.749+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:30:06.750233619Z 2024-02-24T04:30:06.750478230Z [2024-02-24T04:30:06.750+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:30:06.751459916Z [2024-02-24T04:30:06.751+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:30:06.751478409Z 2024-02-24T04:30:06.755683600Z [2024-02-24T04:30:06.755+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T04:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T04:30:06.756002079Z [2024-02-24T04:30:06.755+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T04:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T04:30:06.816778463Z [2024-02-24T04:30:06.816+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T04:25:00+00:00 exited with status queued for try_number 1 2024-02-24T04:30:06.817047262Z [2024-02-24T04:30:06.816+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:29:00+00:00 exited with status success for try_number 1 2024-02-24T04:30:06.817357200Z [2024-02-24T04:30:06.817+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T04:25:00+00:00 exited with status success for try_number 1 2024-02-24T04:30:06.830998899Z [2024-02-24T04:30:06.830+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d1f50c0-fd8b-4461-9b3d-c54ee0b15a49 2024-02-24T04:30:06.831245896Z [2024-02-24T04:30:06.831+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:29:00+00:00, map_index=-1, run_start_date=2024-02-24 04:30:04.019970+00:00, run_end_date=2024-02-24 04:30:05.978068+00:00, run_duration=1.958098, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1320, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:30:01.178056+00:00, queued_by_job_id=2, pid=19192 2024-02-24T04:30:06.831547844Z [2024-02-24T04:30:06.831+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T04:25:00+00:00, map_index=-1, run_start_date=2024-02-24 04:30:05.972107+00:00, run_end_date=2024-02-24 04:30:06.325921+00:00, run_duration=0.353814, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1321, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:30:04.275880+00:00, queued_by_job_id=2, pid=19215 2024-02-24T04:30:09.306866857Z [2024-02-24T04:30:09.306+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:30:09.306933461Z 2024-02-24T04:30:09.306938388Z [2024-02-24T04:30:09.306+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:30:09.307507019Z [2024-02-24T04:30:09.307+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:30:09.307514749Z 2024-02-24T04:30:09.310034580Z [2024-02-24T04:30:09.309+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T04:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:30:09.310100741Z [2024-02-24T04:30:09.309+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T04:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T04:30:09.363297996Z [2024-02-24T04:30:09.362+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T04:25:00+00:00 exited with status queued for try_number 1 2024-02-24T04:30:09.363374900Z [2024-02-24T04:30:09.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T04:25:00+00:00 exited with status success for try_number 1 2024-02-24T04:30:09.373606430Z [2024-02-24T04:30:09.373+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39d7bca5-7b7b-4128-b20d-769a71d500ec 2024-02-24T04:30:09.374014073Z [2024-02-24T04:30:09.373+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T04:25:00+00:00, map_index=0, run_start_date=2024-02-24 04:30:08.476260+00:00, run_end_date=2024-02-24 04:30:08.830935+00:00, run_duration=0.354675, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1322, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:30:06.752030+00:00, queued_by_job_id=2, pid=19223 2024-02-24T04:30:11.591624668Z [2024-02-24T04:30:11.591+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:30:11.591742887Z [2024-02-24T04:30:11.591+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:25:00+00:00, run_id=scheduled__2024-02-24T04:25:00+00:00, run_start_date=2024-02-24 04:30:01.086657+00:00, run_end_date=2024-02-24 04:30:11.591454+00:00, run_duration=10.504797, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:25:00+00:00, data_interval_end=2024-02-24 04:30:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T04:30:11.601751756Z [2024-02-24T04:30:11.601+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:30:00+00:00, run_after=2024-02-24T04:35:00+00:00 2024-02-24T04:30:11.654790548Z [2024-02-24T04:30:11.654+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T04:25:00+00:00 exited with status success for try_number 1 2024-02-24T04:30:11.663014500Z [2024-02-24T04:30:11.662+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T04:25:00+00:00, map_index=-1, run_start_date=2024-02-24 04:30:10.941760+00:00, run_end_date=2024-02-24 04:30:11.289926+00:00, run_duration=0.348166, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1323, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:30:09.307921+00:00, queued_by_job_id=2, pid=19231 2024-02-24T04:31:00.186151774Z [2024-02-24T04:31:00.185+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:31:00+00:00, run_after=2024-02-24T04:32:00+00:00 2024-02-24T04:31:00.201182365Z [2024-02-24T04:31:00.200+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:31:00+00:00, run_after=2024-02-24T04:32:00+00:00 2024-02-24T04:31:00.209423948Z [2024-02-24T04:31:00.209+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:31:00.281293339Z [2024-02-24T04:31:00.280+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T04:31:00.281341297Z 2024-02-24T04:31:00.281352158Z 2024-02-24T04:31:00.281361299Z 2024-02-24T04:31:00.281449422Z [2024-02-24T04:31:00.281+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:31:00.281675216Z [2024-02-24T04:31:00.281+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:31:00.281948222Z [2024-02-24T04:31:00.281+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:31:00.282753003Z [2024-02-24T04:31:00.282+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:31:00.282777255Z 2024-02-24T04:31:00.282786435Z 2024-02-24T04:31:00.282819457Z 2024-02-24T04:31:00.289012833Z [2024-02-24T04:31:00.288+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:31:00.289087281Z [2024-02-24T04:31:00.288+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:31:00.289344049Z [2024-02-24T04:31:00.289+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:31:00.289476442Z [2024-02-24T04:31:00.289+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:31:00.289848583Z [2024-02-24T04:31:00.289+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:31:00.290023106Z [2024-02-24T04:31:00.289+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:31:00.542954266Z [2024-02-24T04:31:00.542+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:30:00+00:00 exited with status queued for try_number 1 2024-02-24T04:31:00.543046125Z [2024-02-24T04:31:00.542+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:30:00+00:00 exited with status queued for try_number 1 2024-02-24T04:31:00.543780634Z [2024-02-24T04:31:00.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:30:00+00:00 exited with status queued for try_number 1 2024-02-24T04:31:00.551869414Z [2024-02-24T04:31:00.551+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7c68d12-0e59-4bc1-802c-e56a0caeb6ca 2024-02-24T04:31:00.552085421Z [2024-02-24T04:31:00.551+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd875ee3-2217-4bef-a0d4-28cb3cf6e380 2024-02-24T04:31:00.552246889Z [2024-02-24T04:31:00.552+0000] {scheduler_job.py:635} INFO - Setting external_id for to 27e7b5c1-aa17-41ef-9dda-c3587d455fbb 2024-02-24T04:31:01.713869417Z [2024-02-24T04:31:01.713+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:31:01.714671384Z [2024-02-24T04:31:01.714+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:30:00+00:00, run_id=scheduled__2024-02-24T04:30:00+00:00, run_start_date=2024-02-24 04:31:00.224545+00:00, run_end_date=2024-02-24 04:31:01.714139+00:00, run_duration=1.489594, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:30:00+00:00, data_interval_end=2024-02-24 04:31:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:31:01.725112846Z [2024-02-24T04:31:01.724+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:31:00+00:00, run_after=2024-02-24T04:32:00+00:00 2024-02-24T04:31:02.166835567Z [2024-02-24T04:31:02.166+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:30:00+00:00 exited with status success for try_number 1 2024-02-24T04:31:02.177586280Z [2024-02-24T04:31:02.177+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:30:00+00:00, map_index=-1, run_start_date=2024-02-24 04:31:01.173512+00:00, run_end_date=2024-02-24 04:31:01.641921+00:00, run_duration=0.468409, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1324, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:31:00.283372+00:00, queued_by_job_id=2, pid=19253 2024-02-24T04:31:05.037701734Z [2024-02-24T04:31:05.036+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:31:05.038250163Z [2024-02-24T04:31:05.037+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:30:00+00:00, run_id=scheduled__2024-02-24T04:30:00+00:00, run_start_date=2024-02-24 04:31:00.226332+00:00, run_end_date=2024-02-24 04:31:05.037253+00:00, run_duration=4.810921, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:30:00+00:00, data_interval_end=2024-02-24 04:31:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:31:05.047619079Z [2024-02-24T04:31:05.047+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:31:00+00:00, run_after=2024-02-24T04:32:00+00:00 2024-02-24T04:31:05.094179265Z [2024-02-24T04:31:05.093+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:30:00+00:00 exited with status success for try_number 1 2024-02-24T04:31:05.102344134Z [2024-02-24T04:31:05.101+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:30:00+00:00, map_index=-1, run_start_date=2024-02-24 04:31:02.354384+00:00, run_end_date=2024-02-24 04:31:04.066833+00:00, run_duration=1.712449, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1325, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:31:00.283372+00:00, queued_by_job_id=2, pid=19271 2024-02-24T04:31:06.147702683Z [2024-02-24T04:31:06.147+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:31:06.148193417Z [2024-02-24T04:31:06.147+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:30:00+00:00, run_id=scheduled__2024-02-24T04:30:00+00:00, run_start_date=2024-02-24 04:31:00.227942+00:00, run_end_date=2024-02-24 04:31:06.147597+00:00, run_duration=5.919655, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:30:00+00:00, data_interval_end=2024-02-24 04:31:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:31:06.162010988Z [2024-02-24T04:31:06.161+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:31:00+00:00, run_after=2024-02-24T04:32:00+00:00 2024-02-24T04:31:06.193091024Z [2024-02-24T04:31:06.192+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:30:00+00:00 exited with status success for try_number 1 2024-02-24T04:31:06.199053317Z [2024-02-24T04:31:06.198+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:30:00+00:00, map_index=-1, run_start_date=2024-02-24 04:31:02.556356+00:00, run_end_date=2024-02-24 04:31:05.028853+00:00, run_duration=2.472497, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1326, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:31:00.283372+00:00, queued_by_job_id=2, pid=19272 2024-02-24T04:31:38.666214144Z [2024-02-24T04:31:38.665+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:31:38.666255585Z 2024-02-24T04:31:38.666534978Z [2024-02-24T04:31:38.666+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-02-24T04:31:38.668801183Z [2024-02-24T04:31:38.668+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:31:38.668828190Z 2024-02-24T04:31:38.673132964Z [2024-02-24T04:31:38.672+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240224043137_479881', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:31:38.673353751Z [2024-02-24T04:31:38.673+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240224043137_479881', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-02-24T04:31:38.734360818Z [2024-02-24T04:31:38.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240224043137_479881 exited with status queued for try_number 1 2024-02-24T04:31:38.739326547Z [2024-02-24T04:31:38.739+0000] {scheduler_job.py:635} INFO - Setting external_id for to cbfe58b8-4efe-47b5-8b7f-605dc3ce43b3 2024-02-24T04:31:40.555859718Z [2024-02-24T04:31:40.555+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:31:40.556312053Z [2024-02-24T04:31:40.555+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-02-24 04:31:37.955413+00:00, run_id=vdu_down_20240224043137_479881, run_start_date=2024-02-24 04:31:38.623679+00:00, run_end_date=2024-02-24 04:31:40.555728+00:00, run_duration=1.932049, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-02-24 04:31:37.955413+00:00, data_interval_end=2024-02-24 04:31:37.955413+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-02-24T04:31:40.559977953Z [2024-02-24T04:31:40.559+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-02-24T04:31:40.593163547Z [2024-02-24T04:31:40.592+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240224043137_479881 exited with status success for try_number 1 2024-02-24T04:31:40.599116963Z [2024-02-24T04:31:40.598+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240224043137_479881, map_index=-1, run_start_date=2024-02-24 04:31:39.353419+00:00, run_end_date=2024-02-24 04:31:39.734143+00:00, run_duration=0.380724, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1327, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:31:38.669511+00:00, queued_by_job_id=2, pid=19284 2024-02-24T04:32:00.824333308Z [2024-02-24T04:32:00.823+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:32:00+00:00, run_after=2024-02-24T04:33:00+00:00 2024-02-24T04:32:00.846102575Z [2024-02-24T04:32:00.845+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:32:00+00:00, run_after=2024-02-24T04:33:00+00:00 2024-02-24T04:32:00.854315039Z [2024-02-24T04:32:00.853+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:32:00.864068725Z [2024-02-24T04:32:00.863+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:32:00.990975093Z [2024-02-24T04:32:00.990+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T04:32:00.991012623Z 2024-02-24T04:32:00.991019929Z 2024-02-24T04:32:00.991025409Z 2024-02-24T04:32:00.991031062Z 2024-02-24T04:32:00.991285737Z [2024-02-24T04:32:00.990+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T04:32:00.991672381Z [2024-02-24T04:32:00.991+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:32:00.992033178Z [2024-02-24T04:32:00.991+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:32:00.992480818Z [2024-02-24T04:32:00.992+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:32:00.993927285Z [2024-02-24T04:32:00.993+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:32:00.993956825Z 2024-02-24T04:32:00.993963088Z 2024-02-24T04:32:00.993969562Z 2024-02-24T04:32:00.993974928Z 2024-02-24T04:32:01.000891099Z [2024-02-24T04:32:01.000+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T04:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:32:01.001364578Z [2024-02-24T04:32:01.000+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T04:32:01.001979290Z [2024-02-24T04:32:01.001+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:32:01.002313377Z [2024-02-24T04:32:01.001+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:32:01.002792642Z [2024-02-24T04:32:01.002+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:32:01.003132953Z [2024-02-24T04:32:01.002+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:32:01.003613710Z [2024-02-24T04:32:01.003+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:32:01.003916186Z [2024-02-24T04:32:01.003+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:32:01.486969436Z [2024-02-24T04:32:01.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:30:00+00:00 exited with status queued for try_number 1 2024-02-24T04:32:01.487084832Z [2024-02-24T04:32:01.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:31:00+00:00 exited with status queued for try_number 1 2024-02-24T04:32:01.487216615Z [2024-02-24T04:32:01.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:31:00+00:00 exited with status queued for try_number 1 2024-02-24T04:32:01.487331213Z [2024-02-24T04:32:01.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:31:00+00:00 exited with status queued for try_number 1 2024-02-24T04:32:01.507697970Z [2024-02-24T04:32:01.507+0000] {scheduler_job.py:635} INFO - Setting external_id for to 87185fa7-08b6-4d30-9672-58c8c99d4611 2024-02-24T04:32:01.507845973Z [2024-02-24T04:32:01.507+0000] {scheduler_job.py:635} INFO - Setting external_id for to 98fae8c1-9a95-4db7-9d18-2d82536f5c5d 2024-02-24T04:32:01.508019953Z [2024-02-24T04:32:01.507+0000] {scheduler_job.py:635} INFO - Setting external_id for to a86e6404-f3c9-4d13-b756-38def8525dec 2024-02-24T04:32:01.508176733Z [2024-02-24T04:32:01.508+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9072d9fb-2a28-4fa0-a49f-9be77d8bdd20 2024-02-24T04:32:02.507519312Z [2024-02-24T04:32:02.507+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:32:02.507921141Z [2024-02-24T04:32:02.507+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 04:30:00+00:00, run_id=scheduled__2024-02-24T04:30:00+00:00, run_start_date=2024-02-24 04:32:00.883990+00:00, run_end_date=2024-02-24 04:32:02.507422+00:00, run_duration=1.623432, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:30:00+00:00, data_interval_end=2024-02-24 04:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T04:32:02.516834166Z [2024-02-24T04:32:02.516+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T04:32:00+00:00, run_after=2024-02-24T04:34:00+00:00 2024-02-24T04:32:02.526430618Z [2024-02-24T04:32:02.526+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:32:02.526801213Z [2024-02-24T04:32:02.526+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:31:00+00:00, run_id=scheduled__2024-02-24T04:31:00+00:00, run_start_date=2024-02-24 04:32:00.886007+00:00, run_end_date=2024-02-24 04:32:02.526392+00:00, run_duration=1.640385, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:31:00+00:00, data_interval_end=2024-02-24 04:32:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:32:02.541715247Z [2024-02-24T04:32:02.541+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:32:00+00:00, run_after=2024-02-24T04:33:00+00:00 2024-02-24T04:32:02.601687495Z [2024-02-24T04:32:02.601+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:30:00+00:00 exited with status success for try_number 1 2024-02-24T04:32:02.602074548Z [2024-02-24T04:32:02.601+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:31:00+00:00 exited with status success for try_number 1 2024-02-24T04:32:02.613986872Z [2024-02-24T04:32:02.613+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T04:30:00+00:00, map_index=-1, run_start_date=2024-02-24 04:32:01.885899+00:00, run_end_date=2024-02-24 04:32:02.311695+00:00, run_duration=0.425796, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1329, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:32:00.995892+00:00, queued_by_job_id=2, pid=19317 2024-02-24T04:32:02.614765846Z [2024-02-24T04:32:02.614+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:31:00+00:00, map_index=-1, run_start_date=2024-02-24 04:32:01.882606+00:00, run_end_date=2024-02-24 04:32:02.328446+00:00, run_duration=0.44584, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1328, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:32:00.995892+00:00, queued_by_job_id=2, pid=19318 2024-02-24T04:32:06.375228222Z [2024-02-24T04:32:06.374+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:32:06.375701142Z [2024-02-24T04:32:06.375+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:31:00+00:00, run_id=scheduled__2024-02-24T04:31:00+00:00, run_start_date=2024-02-24 04:32:00.887909+00:00, run_end_date=2024-02-24 04:32:06.375346+00:00, run_duration=5.487437, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:31:00+00:00, data_interval_end=2024-02-24 04:32:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:32:06.384949071Z [2024-02-24T04:32:06.384+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:32:00+00:00, run_after=2024-02-24T04:33:00+00:00 2024-02-24T04:32:06.437236478Z [2024-02-24T04:32:06.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:31:00+00:00 exited with status success for try_number 1 2024-02-24T04:32:06.446660909Z [2024-02-24T04:32:06.446+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:31:00+00:00, map_index=-1, run_start_date=2024-02-24 04:32:03.364358+00:00, run_end_date=2024-02-24 04:32:06.026399+00:00, run_duration=2.662041, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1331, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:32:00.995892+00:00, queued_by_job_id=2, pid=19342 2024-02-24T04:32:06.459109647Z [2024-02-24T04:32:06.458+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T04:32:07.506809751Z [2024-02-24T04:32:07.506+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:32:07.507554792Z [2024-02-24T04:32:07.507+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:31:00+00:00, run_id=scheduled__2024-02-24T04:31:00+00:00, run_start_date=2024-02-24 04:32:00.889564+00:00, run_end_date=2024-02-24 04:32:07.506930+00:00, run_duration=6.617366, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:31:00+00:00, data_interval_end=2024-02-24 04:32:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:32:07.526031705Z [2024-02-24T04:32:07.525+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:32:00+00:00, run_after=2024-02-24T04:33:00+00:00 2024-02-24T04:32:07.580172135Z [2024-02-24T04:32:07.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:31:00+00:00 exited with status success for try_number 1 2024-02-24T04:32:07.587869220Z [2024-02-24T04:32:07.587+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:31:00+00:00, map_index=-1, run_start_date=2024-02-24 04:32:03.267385+00:00, run_end_date=2024-02-24 04:32:06.450448+00:00, run_duration=3.183063, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1330, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:32:00.995892+00:00, queued_by_job_id=2, pid=19341 2024-02-24T04:33:00.631587047Z [2024-02-24T04:33:00.631+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:33:00+00:00, run_after=2024-02-24T04:34:00+00:00 2024-02-24T04:33:00.638635440Z [2024-02-24T04:33:00.638+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:33:00.650691287Z [2024-02-24T04:33:00.650+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:33:00+00:00, run_after=2024-02-24T04:34:00+00:00 2024-02-24T04:33:00.710462936Z [2024-02-24T04:33:00.710+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T04:33:00.710523700Z 2024-02-24T04:33:00.710530531Z 2024-02-24T04:33:00.710536283Z 2024-02-24T04:33:00.710624776Z [2024-02-24T04:33:00.710+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:33:00.710737683Z [2024-02-24T04:33:00.710+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:33:00.710915849Z [2024-02-24T04:33:00.710+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:33:00.711470359Z [2024-02-24T04:33:00.711+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:33:00.711480839Z 2024-02-24T04:33:00.711541773Z 2024-02-24T04:33:00.711548240Z 2024-02-24T04:33:00.714781067Z [2024-02-24T04:33:00.714+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:33:00.714909711Z [2024-02-24T04:33:00.714+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:33:00.715146299Z [2024-02-24T04:33:00.715+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:33:00.715280057Z [2024-02-24T04:33:00.715+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:33:00.715507128Z [2024-02-24T04:33:00.715+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:33:00.715645735Z [2024-02-24T04:33:00.715+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:33:01.042538509Z [2024-02-24T04:33:01.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:32:00+00:00 exited with status queued for try_number 1 2024-02-24T04:33:01.042743864Z [2024-02-24T04:33:01.042+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:32:00+00:00 exited with status queued for try_number 1 2024-02-24T04:33:01.042904693Z [2024-02-24T04:33:01.042+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:32:00+00:00 exited with status queued for try_number 1 2024-02-24T04:33:01.053600911Z [2024-02-24T04:33:01.053+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0df568f5-aa1c-44cb-9b7a-e00c4b4a0fd6 2024-02-24T04:33:01.053632140Z [2024-02-24T04:33:01.053+0000] {scheduler_job.py:635} INFO - Setting external_id for to 916539ba-6315-49d6-8c9d-68ca5f216c31 2024-02-24T04:33:01.053705512Z [2024-02-24T04:33:01.053+0000] {scheduler_job.py:635} INFO - Setting external_id for to d9f09900-d503-439f-9c70-f9b674db5ca0 2024-02-24T04:33:03.007379176Z [2024-02-24T04:33:03.003+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:33:03.007409282Z [2024-02-24T04:33:03.004+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:32:00+00:00, run_id=scheduled__2024-02-24T04:32:00+00:00, run_start_date=2024-02-24 04:33:00.660452+00:00, run_end_date=2024-02-24 04:33:03.003958+00:00, run_duration=2.343506, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:32:00+00:00, data_interval_end=2024-02-24 04:33:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:33:03.014078085Z [2024-02-24T04:33:03.013+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:33:00+00:00, run_after=2024-02-24T04:34:00+00:00 2024-02-24T04:33:03.070625221Z [2024-02-24T04:33:03.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:32:00+00:00 exited with status success for try_number 1 2024-02-24T04:33:03.076404203Z [2024-02-24T04:33:03.076+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:32:00+00:00, map_index=-1, run_start_date=2024-02-24 04:33:01.901468+00:00, run_end_date=2024-02-24 04:33:02.680069+00:00, run_duration=0.778601, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1332, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:33:00.712210+00:00, queued_by_job_id=2, pid=19374 2024-02-24T04:33:05.227531606Z [2024-02-24T04:33:05.226+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:33:05.227987228Z [2024-02-24T04:33:05.227+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:32:00+00:00, run_id=scheduled__2024-02-24T04:32:00+00:00, run_start_date=2024-02-24 04:33:00.661677+00:00, run_end_date=2024-02-24 04:33:05.227589+00:00, run_duration=4.565912, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:32:00+00:00, data_interval_end=2024-02-24 04:33:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:33:05.244146774Z [2024-02-24T04:33:05.243+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:33:00+00:00, run_after=2024-02-24T04:34:00+00:00 2024-02-24T04:33:05.290622726Z [2024-02-24T04:33:05.290+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:32:00+00:00 exited with status success for try_number 1 2024-02-24T04:33:05.296414215Z [2024-02-24T04:33:05.295+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:32:00+00:00, map_index=-1, run_start_date=2024-02-24 04:33:03.046858+00:00, run_end_date=2024-02-24 04:33:05.074293+00:00, run_duration=2.027435, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1333, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:33:00.712210+00:00, queued_by_job_id=2, pid=19392 2024-02-24T04:33:07.231732978Z [2024-02-24T04:33:07.231+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:33:07.232185613Z [2024-02-24T04:33:07.231+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:32:00+00:00, run_id=scheduled__2024-02-24T04:32:00+00:00, run_start_date=2024-02-24 04:33:00.662676+00:00, run_end_date=2024-02-24 04:33:07.231610+00:00, run_duration=6.568934, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:32:00+00:00, data_interval_end=2024-02-24 04:33:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:33:07.241365423Z [2024-02-24T04:33:07.241+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:33:00+00:00, run_after=2024-02-24T04:34:00+00:00 2024-02-24T04:33:07.272159283Z [2024-02-24T04:33:07.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:32:00+00:00 exited with status success for try_number 1 2024-02-24T04:33:07.281562365Z [2024-02-24T04:33:07.281+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:32:00+00:00, map_index=-1, run_start_date=2024-02-24 04:33:03.256955+00:00, run_end_date=2024-02-24 04:33:06.311727+00:00, run_duration=3.054772, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1334, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:33:00.712210+00:00, queued_by_job_id=2, pid=19393 2024-02-24T04:33:38.828246108Z [2024-02-24T04:33:38.827+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:33:38.828298406Z 2024-02-24T04:33:38.828309199Z [2024-02-24T04:33:38.828+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-02-24T04:33:38.829078039Z [2024-02-24T04:33:38.828+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:33:38.829092460Z 2024-02-24T04:33:38.832588983Z [2024-02-24T04:33:38.832+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240224043337_827370', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:33:38.832702124Z [2024-02-24T04:33:38.832+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240224043337_827370', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-02-24T04:33:38.914406596Z [2024-02-24T04:33:38.913+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240224043337_827370 exited with status queued for try_number 1 2024-02-24T04:33:38.922714366Z [2024-02-24T04:33:38.922+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54c2dcc2-a28d-46ef-85e0-657118a9fc5f 2024-02-24T04:33:40.079949595Z [2024-02-24T04:33:40.079+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:33:40.079974165Z [2024-02-24T04:33:40.079+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-02-24 04:33:37.957605+00:00, run_id=vdu_down_20240224043337_827370, run_start_date=2024-02-24 04:33:38.782413+00:00, run_end_date=2024-02-24 04:33:40.079420+00:00, run_duration=1.297007, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-02-24 04:33:37.957605+00:00, data_interval_end=2024-02-24 04:33:37.957605+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-02-24T04:33:40.082984563Z [2024-02-24T04:33:40.082+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-02-24T04:33:41.245934002Z [2024-02-24T04:33:41.238+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240224043337_827370 exited with status success for try_number 1 2024-02-24T04:33:41.245965531Z [2024-02-24T04:33:41.245+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240224043337_827370, map_index=-1, run_start_date=2024-02-24 04:33:39.558142+00:00, run_end_date=2024-02-24 04:33:40.056799+00:00, run_duration=0.498657, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1335, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:33:38.829393+00:00, queued_by_job_id=2, pid=19405 2024-02-24T04:34:00.905167601Z [2024-02-24T04:34:00.904+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:34:00+00:00, run_after=2024-02-24T04:35:00+00:00 2024-02-24T04:34:00.920011849Z [2024-02-24T04:34:00.919+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:34:00+00:00, run_after=2024-02-24T04:35:00+00:00 2024-02-24T04:34:00.930626605Z [2024-02-24T04:34:00.930+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:34:00.939493677Z [2024-02-24T04:34:00.938+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:34:01.054957897Z [2024-02-24T04:34:01.054+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T04:34:01.054986115Z 2024-02-24T04:34:01.054994728Z 2024-02-24T04:34:01.054999740Z 2024-02-24T04:34:01.055004284Z 2024-02-24T04:34:01.055196279Z [2024-02-24T04:34:01.054+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T04:34:01.055544946Z [2024-02-24T04:34:01.055+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:34:01.055875811Z [2024-02-24T04:34:01.055+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:34:01.056279859Z [2024-02-24T04:34:01.055+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:34:01.057746937Z [2024-02-24T04:34:01.057+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:34:01.057766291Z 2024-02-24T04:34:01.057810290Z 2024-02-24T04:34:01.057813712Z 2024-02-24T04:34:01.057817381Z 2024-02-24T04:34:01.063520435Z [2024-02-24T04:34:01.063+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T04:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:34:01.063874297Z [2024-02-24T04:34:01.063+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T04:34:01.064354739Z [2024-02-24T04:34:01.064+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:34:01.064548402Z [2024-02-24T04:34:01.064+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:34:01.064927610Z [2024-02-24T04:34:01.064+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:34:01.065173595Z [2024-02-24T04:34:01.064+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:34:01.065588663Z [2024-02-24T04:34:01.065+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:34:01.065886745Z [2024-02-24T04:34:01.065+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:34:01.771692209Z [2024-02-24T04:34:01.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:32:00+00:00 exited with status queued for try_number 1 2024-02-24T04:34:01.775213435Z [2024-02-24T04:34:01.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:33:00+00:00 exited with status queued for try_number 1 2024-02-24T04:34:01.775526401Z [2024-02-24T04:34:01.775+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:33:00+00:00 exited with status queued for try_number 1 2024-02-24T04:34:01.775676679Z [2024-02-24T04:34:01.775+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:33:00+00:00 exited with status queued for try_number 1 2024-02-24T04:34:01.799227680Z [2024-02-24T04:34:01.798+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ea6dbad-27c2-4d8a-aad8-40d2bb31ff2d 2024-02-24T04:34:01.799307627Z [2024-02-24T04:34:01.799+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c2ef464-cc0f-419b-9539-c9642eaf64ef 2024-02-24T04:34:01.799392146Z [2024-02-24T04:34:01.799+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17016096-85f3-4d10-b00c-a8a53a455ec5 2024-02-24T04:34:01.799479152Z [2024-02-24T04:34:01.799+0000] {scheduler_job.py:635} INFO - Setting external_id for to 616bd8a1-cdf0-4c63-a8ed-de30ead740ce 2024-02-24T04:34:03.256834763Z [2024-02-24T04:34:03.256+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:34:03.257058638Z [2024-02-24T04:34:03.256+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 04:32:00+00:00, run_id=scheduled__2024-02-24T04:32:00+00:00, run_start_date=2024-02-24 04:34:00.954240+00:00, run_end_date=2024-02-24 04:34:03.256717+00:00, run_duration=2.302477, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:32:00+00:00, data_interval_end=2024-02-24 04:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T04:34:03.270299200Z [2024-02-24T04:34:03.269+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T04:34:00+00:00, run_after=2024-02-24T04:36:00+00:00 2024-02-24T04:34:03.286059394Z [2024-02-24T04:34:03.285+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:34:03.286213457Z [2024-02-24T04:34:03.286+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:33:00+00:00, run_id=scheduled__2024-02-24T04:33:00+00:00, run_start_date=2024-02-24 04:34:00.955531+00:00, run_end_date=2024-02-24 04:34:03.285917+00:00, run_duration=2.330386, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:33:00+00:00, data_interval_end=2024-02-24 04:34:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:34:03.301969542Z [2024-02-24T04:34:03.296+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:34:00+00:00, run_after=2024-02-24T04:35:00+00:00 2024-02-24T04:34:03.391233373Z [2024-02-24T04:34:03.390+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:32:00+00:00 exited with status success for try_number 1 2024-02-24T04:34:03.410660247Z [2024-02-24T04:34:03.410+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T04:32:00+00:00, map_index=-1, run_start_date=2024-02-24 04:34:02.150971+00:00, run_end_date=2024-02-24 04:34:02.902620+00:00, run_duration=0.751649, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1336, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:34:01.059286+00:00, queued_by_job_id=2, pid=19448 2024-02-24T04:34:04.548165739Z [2024-02-24T04:34:04.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:33:00+00:00 exited with status success for try_number 1 2024-02-24T04:34:04.556138157Z [2024-02-24T04:34:04.555+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:33:00+00:00, map_index=-1, run_start_date=2024-02-24 04:34:02.423916+00:00, run_end_date=2024-02-24 04:34:03.153588+00:00, run_duration=0.729672, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1337, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:34:01.059286+00:00, queued_by_job_id=2, pid=19449 2024-02-24T04:34:06.680738884Z [2024-02-24T04:34:06.680+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:34:06.681119820Z [2024-02-24T04:34:06.680+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:33:00+00:00, run_id=scheduled__2024-02-24T04:33:00+00:00, run_start_date=2024-02-24 04:34:00.956614+00:00, run_end_date=2024-02-24 04:34:06.680554+00:00, run_duration=5.72394, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:33:00+00:00, data_interval_end=2024-02-24 04:34:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:34:06.693723204Z [2024-02-24T04:34:06.693+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:34:00+00:00, run_after=2024-02-24T04:35:00+00:00 2024-02-24T04:34:06.754996635Z [2024-02-24T04:34:06.754+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:33:00+00:00 exited with status success for try_number 1 2024-02-24T04:34:06.760419572Z [2024-02-24T04:34:06.760+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:33:00+00:00, map_index=-1, run_start_date=2024-02-24 04:34:04.290925+00:00, run_end_date=2024-02-24 04:34:06.168728+00:00, run_duration=1.877803, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1339, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:34:01.059286+00:00, queued_by_job_id=2, pid=19473 2024-02-24T04:34:07.224110940Z [2024-02-24T04:34:07.223+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:34:07.224522972Z [2024-02-24T04:34:07.224+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:33:00+00:00, run_id=scheduled__2024-02-24T04:33:00+00:00, run_start_date=2024-02-24 04:34:00.957645+00:00, run_end_date=2024-02-24 04:34:07.223841+00:00, run_duration=6.266196, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:33:00+00:00, data_interval_end=2024-02-24 04:34:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:34:07.235903099Z [2024-02-24T04:34:07.235+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:34:00+00:00, run_after=2024-02-24T04:35:00+00:00 2024-02-24T04:34:07.274392195Z [2024-02-24T04:34:07.273+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:33:00+00:00 exited with status success for try_number 1 2024-02-24T04:34:07.281731135Z [2024-02-24T04:34:07.281+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:33:00+00:00, map_index=-1, run_start_date=2024-02-24 04:34:04.086081+00:00, run_end_date=2024-02-24 04:34:06.856692+00:00, run_duration=2.770611, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1338, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:34:01.059286+00:00, queued_by_job_id=2, pid=19472 2024-02-24T04:35:00.145142372Z [2024-02-24T04:35:00.144+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:35:00+00:00, run_after=2024-02-24T04:36:00+00:00 2024-02-24T04:35:00.153279414Z [2024-02-24T04:35:00.152+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:35:00.165247068Z [2024-02-24T04:35:00.164+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:35:00+00:00, run_after=2024-02-24T04:36:00+00:00 2024-02-24T04:35:00.177978645Z [2024-02-24T04:35:00.177+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:35:00+00:00, run_after=2024-02-24T04:40:00+00:00 2024-02-24T04:35:00.318139173Z [2024-02-24T04:35:00.317+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T04:35:00.318181422Z 2024-02-24T04:35:00.318186449Z 2024-02-24T04:35:00.318190024Z 2024-02-24T04:35:00.318193414Z 2024-02-24T04:35:00.318197023Z [2024-02-24T04:35:00.317+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:35:00.319016125Z [2024-02-24T04:35:00.318+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:35:00.319085316Z [2024-02-24T04:35:00.318+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:35:00.319100308Z [2024-02-24T04:35:00.318+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:35:00.319773983Z [2024-02-24T04:35:00.319+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:35:00.319807505Z 2024-02-24T04:35:00.319816246Z 2024-02-24T04:35:00.319823689Z 2024-02-24T04:35:00.319830806Z 2024-02-24T04:35:00.325753545Z [2024-02-24T04:35:00.324+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T04:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T04:35:00.325808940Z [2024-02-24T04:35:00.325+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T04:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T04:35:00.326261956Z [2024-02-24T04:35:00.326+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:35:00.326442712Z [2024-02-24T04:35:00.326+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:35:00.326790199Z [2024-02-24T04:35:00.326+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:35:00.327110187Z [2024-02-24T04:35:00.326+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:35:00.327425710Z [2024-02-24T04:35:00.327+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:35:00.327647460Z [2024-02-24T04:35:00.327+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:35:00.708119761Z [2024-02-24T04:35:00.707+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T04:30:00+00:00 exited with status queued for try_number 1 2024-02-24T04:35:00.708328929Z [2024-02-24T04:35:00.708+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:34:00+00:00 exited with status queued for try_number 1 2024-02-24T04:35:00.708449272Z [2024-02-24T04:35:00.708+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:34:00+00:00 exited with status queued for try_number 1 2024-02-24T04:35:00.708760313Z [2024-02-24T04:35:00.708+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:34:00+00:00 exited with status queued for try_number 1 2024-02-24T04:35:00.730590948Z [2024-02-24T04:35:00.729+0000] {scheduler_job.py:635} INFO - Setting external_id for to 00294ee9-e99a-4614-9230-f401c41111fd 2024-02-24T04:35:00.731633500Z [2024-02-24T04:35:00.730+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4ed549b-0ec5-4f1a-9132-c9078dabcad9 2024-02-24T04:35:00.732436938Z [2024-02-24T04:35:00.731+0000] {scheduler_job.py:635} INFO - Setting external_id for to bac0b0ed-849a-411b-b09d-93027d4865f6 2024-02-24T04:35:00.732652592Z [2024-02-24T04:35:00.732+0000] {scheduler_job.py:635} INFO - Setting external_id for to ae2975b0-7bc8-4c35-a2a2-bc95b5ff5690 2024-02-24T04:35:03.154535519Z [2024-02-24T04:35:03.153+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:35:03.154937036Z [2024-02-24T04:35:03.154+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:34:00+00:00, run_id=scheduled__2024-02-24T04:34:00+00:00, run_start_date=2024-02-24 04:35:00.194055+00:00, run_end_date=2024-02-24 04:35:03.154463+00:00, run_duration=2.960408, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:34:00+00:00, data_interval_end=2024-02-24 04:35:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:35:03.168914111Z [2024-02-24T04:35:03.168+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:35:00+00:00, run_after=2024-02-24T04:36:00+00:00 2024-02-24T04:35:03.215582965Z [2024-02-24T04:35:03.215+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:35:03.215608680Z 2024-02-24T04:35:03.215749239Z [2024-02-24T04:35:03.215+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:35:03.217031556Z [2024-02-24T04:35:03.216+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:35:03.217045323Z 2024-02-24T04:35:03.222199488Z [2024-02-24T04:35:03.221+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T04:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T04:35:03.222451468Z [2024-02-24T04:35:03.222+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T04:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T04:35:03.298836174Z [2024-02-24T04:35:03.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T04:30:00+00:00 exited with status queued for try_number 1 2024-02-24T04:35:03.298882476Z [2024-02-24T04:35:03.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T04:30:00+00:00 exited with status success for try_number 1 2024-02-24T04:35:03.298973530Z [2024-02-24T04:35:03.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:34:00+00:00 exited with status success for try_number 1 2024-02-24T04:35:03.310397028Z [2024-02-24T04:35:03.309+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T04:30:00+00:00, map_index=-1, run_start_date=2024-02-24 04:35:02.553268+00:00, run_end_date=2024-02-24 04:35:02.989206+00:00, run_duration=0.435938, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1342, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:35:00.320911+00:00, queued_by_job_id=2, pid=19530 2024-02-24T04:35:03.310818971Z [2024-02-24T04:35:03.310+0000] {scheduler_job.py:635} INFO - Setting external_id for to 778cdd1e-ec28-405a-9978-0afd8772f02f 2024-02-24T04:35:03.311141141Z [2024-02-24T04:35:03.310+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:34:00+00:00, map_index=-1, run_start_date=2024-02-24 04:35:01.651660+00:00, run_end_date=2024-02-24 04:35:02.102455+00:00, run_duration=0.450795, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1340, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:35:00.320911+00:00, queued_by_job_id=2, pid=19506 2024-02-24T04:35:04.857590458Z [2024-02-24T04:35:04.857+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:35:04.858015222Z [2024-02-24T04:35:04.857+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:34:00+00:00, run_id=scheduled__2024-02-24T04:34:00+00:00, run_start_date=2024-02-24 04:35:00.195272+00:00, run_end_date=2024-02-24 04:35:04.857692+00:00, run_duration=4.66242, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:34:00+00:00, data_interval_end=2024-02-24 04:35:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:35:04.870087882Z [2024-02-24T04:35:04.869+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:35:00+00:00, run_after=2024-02-24T04:36:00+00:00 2024-02-24T04:35:04.924323353Z [2024-02-24T04:35:04.923+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:34:00+00:00 exited with status success for try_number 1 2024-02-24T04:35:04.929593171Z [2024-02-24T04:35:04.929+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:34:00+00:00, map_index=-1, run_start_date=2024-02-24 04:35:02.616191+00:00, run_end_date=2024-02-24 04:35:04.616740+00:00, run_duration=2.000549, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1343, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:35:00.320911+00:00, queued_by_job_id=2, pid=19531 2024-02-24T04:35:05.982292881Z [2024-02-24T04:35:05.981+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:35:05.982746705Z [2024-02-24T04:35:05.982+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:34:00+00:00, run_id=scheduled__2024-02-24T04:34:00+00:00, run_start_date=2024-02-24 04:35:00.196386+00:00, run_end_date=2024-02-24 04:35:05.982287+00:00, run_duration=5.785901, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:34:00+00:00, data_interval_end=2024-02-24 04:35:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:35:05.996464131Z [2024-02-24T04:35:05.995+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:35:00+00:00, run_after=2024-02-24T04:36:00+00:00 2024-02-24T04:35:06.038645708Z [2024-02-24T04:35:06.038+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:35:06.038723040Z 2024-02-24T04:35:06.038782849Z [2024-02-24T04:35:06.038+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:35:06.039344098Z [2024-02-24T04:35:06.039+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:35:06.039373178Z 2024-02-24T04:35:06.042163663Z [2024-02-24T04:35:06.041+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T04:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T04:35:06.042365775Z [2024-02-24T04:35:06.042+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T04:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T04:35:06.115787845Z [2024-02-24T04:35:06.115+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T04:30:00+00:00 exited with status queued for try_number 1 2024-02-24T04:35:06.116383672Z [2024-02-24T04:35:06.115+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:34:00+00:00 exited with status success for try_number 1 2024-02-24T04:35:06.117976948Z [2024-02-24T04:35:06.116+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T04:30:00+00:00 exited with status success for try_number 1 2024-02-24T04:35:06.129646112Z [2024-02-24T04:35:06.129+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T04:30:00+00:00, map_index=-1, run_start_date=2024-02-24 04:35:04.902198+00:00, run_end_date=2024-02-24 04:35:05.286644+00:00, run_duration=0.384446, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1344, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:35:03.217927+00:00, queued_by_job_id=2, pid=19554 2024-02-24T04:35:06.130338769Z [2024-02-24T04:35:06.129+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:34:00+00:00, map_index=-1, run_start_date=2024-02-24 04:35:02.501957+00:00, run_end_date=2024-02-24 04:35:04.896710+00:00, run_duration=2.394753, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1341, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:35:00.320911+00:00, queued_by_job_id=2, pid=19529 2024-02-24T04:35:06.130949217Z [2024-02-24T04:35:06.130+0000] {scheduler_job.py:635} INFO - Setting external_id for to 53134495-5620-4d9d-9310-386d8c57c384 2024-02-24T04:35:08.395241091Z [2024-02-24T04:35:08.394+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:35:08.395267784Z 2024-02-24T04:35:08.395316226Z [2024-02-24T04:35:08.395+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:35:08.396006918Z [2024-02-24T04:35:08.395+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:35:08.396034369Z 2024-02-24T04:35:08.398690517Z [2024-02-24T04:35:08.398+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T04:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:35:08.398912762Z [2024-02-24T04:35:08.398+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T04:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T04:35:08.472630146Z [2024-02-24T04:35:08.472+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T04:30:00+00:00 exited with status queued for try_number 1 2024-02-24T04:35:08.472681454Z [2024-02-24T04:35:08.472+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T04:30:00+00:00 exited with status success for try_number 1 2024-02-24T04:35:08.480074020Z [2024-02-24T04:35:08.479+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37f06486-451b-4433-bef6-feb0de31283e 2024-02-24T04:35:08.480149535Z [2024-02-24T04:35:08.480+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T04:30:00+00:00, map_index=0, run_start_date=2024-02-24 04:35:07.664511+00:00, run_end_date=2024-02-24 04:35:08.009477+00:00, run_duration=0.344966, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1345, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:35:06.039700+00:00, queued_by_job_id=2, pid=19562 2024-02-24T04:35:10.711096748Z [2024-02-24T04:35:10.710+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:35:10.711520437Z [2024-02-24T04:35:10.711+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:30:00+00:00, run_id=scheduled__2024-02-24T04:30:00+00:00, run_start_date=2024-02-24 04:35:00.192128+00:00, run_end_date=2024-02-24 04:35:10.710977+00:00, run_duration=10.518849, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:30:00+00:00, data_interval_end=2024-02-24 04:35:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T04:35:10.719125235Z [2024-02-24T04:35:10.718+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:35:00+00:00, run_after=2024-02-24T04:40:00+00:00 2024-02-24T04:35:10.757229552Z [2024-02-24T04:35:10.756+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T04:30:00+00:00 exited with status success for try_number 1 2024-02-24T04:35:10.764500532Z [2024-02-24T04:35:10.764+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T04:30:00+00:00, map_index=-1, run_start_date=2024-02-24 04:35:10.017375+00:00, run_end_date=2024-02-24 04:35:10.407786+00:00, run_duration=0.390411, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1346, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:35:08.396586+00:00, queued_by_job_id=2, pid=19570 2024-02-24T04:36:00.235897041Z [2024-02-24T04:36:00.235+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:36:00+00:00, run_after=2024-02-24T04:37:00+00:00 2024-02-24T04:36:00.244169511Z [2024-02-24T04:36:00.243+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:36:00.255063716Z [2024-02-24T04:36:00.254+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:36:00+00:00, run_after=2024-02-24T04:37:00+00:00 2024-02-24T04:36:00.263017102Z [2024-02-24T04:36:00.262+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:36:00.359324543Z [2024-02-24T04:36:00.358+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T04:36:00.359368636Z 2024-02-24T04:36:00.359379918Z 2024-02-24T04:36:00.359388763Z 2024-02-24T04:36:00.359397289Z 2024-02-24T04:36:00.359413757Z [2024-02-24T04:36:00.358+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T04:36:00.359437599Z [2024-02-24T04:36:00.358+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:36:00.359446629Z [2024-02-24T04:36:00.359+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:36:00.359454984Z [2024-02-24T04:36:00.359+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:36:00.359842293Z [2024-02-24T04:36:00.359+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:36:00.359867789Z 2024-02-24T04:36:00.359877136Z 2024-02-24T04:36:00.359882235Z 2024-02-24T04:36:00.359886824Z 2024-02-24T04:36:00.362862769Z [2024-02-24T04:36:00.362+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T04:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:36:00.363116939Z [2024-02-24T04:36:00.362+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T04:36:00.363269932Z [2024-02-24T04:36:00.362+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:36:00.363284480Z [2024-02-24T04:36:00.362+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:36:00.363351181Z [2024-02-24T04:36:00.363+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:36:00.363566936Z [2024-02-24T04:36:00.363+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:36:00.363588605Z [2024-02-24T04:36:00.363+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:36:00.363597498Z [2024-02-24T04:36:00.363+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:36:00.589930244Z [2024-02-24T04:36:00.587+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:34:00+00:00 exited with status queued for try_number 1 2024-02-24T04:36:00.590063949Z [2024-02-24T04:36:00.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:35:00+00:00 exited with status queued for try_number 1 2024-02-24T04:36:00.590103474Z [2024-02-24T04:36:00.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:35:00+00:00 exited with status queued for try_number 1 2024-02-24T04:36:00.590179000Z [2024-02-24T04:36:00.590+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:35:00+00:00 exited with status queued for try_number 1 2024-02-24T04:36:00.601339575Z [2024-02-24T04:36:00.601+0000] {scheduler_job.py:635} INFO - Setting external_id for to 36a6f40a-b3c2-4a29-982d-cd5e1b7d04f3 2024-02-24T04:36:00.601417404Z [2024-02-24T04:36:00.601+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f3867bf-b6f5-4a62-bcb6-d6ea0d490f20 2024-02-24T04:36:00.601667763Z [2024-02-24T04:36:00.601+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7377fc2a-84c5-40f2-bf05-4369b47b40a2 2024-02-24T04:36:00.601826805Z [2024-02-24T04:36:00.601+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d651215-4c2b-4e85-a2eb-0910af73dc09 2024-02-24T04:36:02.161285918Z [2024-02-24T04:36:02.160+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:36:02.161977322Z [2024-02-24T04:36:02.161+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 04:34:00+00:00, run_id=scheduled__2024-02-24T04:34:00+00:00, run_start_date=2024-02-24 04:36:00.285240+00:00, run_end_date=2024-02-24 04:36:02.161160+00:00, run_duration=1.87592, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:34:00+00:00, data_interval_end=2024-02-24 04:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T04:36:02.171460661Z [2024-02-24T04:36:02.171+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T04:36:00+00:00, run_after=2024-02-24T04:38:00+00:00 2024-02-24T04:36:02.179662778Z [2024-02-24T04:36:02.179+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:36:02.180180273Z [2024-02-24T04:36:02.179+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:35:00+00:00, run_id=scheduled__2024-02-24T04:35:00+00:00, run_start_date=2024-02-24 04:36:00.288049+00:00, run_end_date=2024-02-24 04:36:02.179515+00:00, run_duration=1.891466, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:35:00+00:00, data_interval_end=2024-02-24 04:36:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:36:02.203339891Z [2024-02-24T04:36:02.202+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:36:00+00:00, run_after=2024-02-24T04:37:00+00:00 2024-02-24T04:36:02.268322777Z [2024-02-24T04:36:02.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:34:00+00:00 exited with status success for try_number 1 2024-02-24T04:36:02.268494982Z [2024-02-24T04:36:02.268+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:35:00+00:00 exited with status success for try_number 1 2024-02-24T04:36:02.276332726Z [2024-02-24T04:36:02.275+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T04:34:00+00:00, map_index=-1, run_start_date=2024-02-24 04:36:01.179872+00:00, run_end_date=2024-02-24 04:36:01.657662+00:00, run_duration=0.47779, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1348, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:36:00.360439+00:00, queued_by_job_id=2, pid=19596 2024-02-24T04:36:02.276530620Z [2024-02-24T04:36:02.276+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:35:00+00:00, map_index=-1, run_start_date=2024-02-24 04:36:01.203721+00:00, run_end_date=2024-02-24 04:36:01.691563+00:00, run_duration=0.487842, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1347, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:36:00.360439+00:00, queued_by_job_id=2, pid=19595 2024-02-24T04:36:04.127726275Z [2024-02-24T04:36:04.127+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:36:04.128174765Z [2024-02-24T04:36:04.127+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:35:00+00:00, run_id=scheduled__2024-02-24T04:35:00+00:00, run_start_date=2024-02-24 04:36:00.290419+00:00, run_end_date=2024-02-24 04:36:04.127612+00:00, run_duration=3.837193, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:35:00+00:00, data_interval_end=2024-02-24 04:36:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:36:04.141581301Z [2024-02-24T04:36:04.141+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:36:00+00:00, run_after=2024-02-24T04:37:00+00:00 2024-02-24T04:36:04.184688172Z [2024-02-24T04:36:04.184+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:35:00+00:00 exited with status success for try_number 1 2024-02-24T04:36:04.191601390Z [2024-02-24T04:36:04.191+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:35:00+00:00, map_index=-1, run_start_date=2024-02-24 04:36:02.425860+00:00, run_end_date=2024-02-24 04:36:03.781746+00:00, run_duration=1.355886, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1350, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:36:00.360439+00:00, queued_by_job_id=2, pid=19620 2024-02-24T04:36:05.258900037Z [2024-02-24T04:36:05.258+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:36:05.259413990Z [2024-02-24T04:36:05.259+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:35:00+00:00, run_id=scheduled__2024-02-24T04:35:00+00:00, run_start_date=2024-02-24 04:36:00.292701+00:00, run_end_date=2024-02-24 04:36:05.258792+00:00, run_duration=4.966091, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:35:00+00:00, data_interval_end=2024-02-24 04:36:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:36:05.275183553Z [2024-02-24T04:36:05.274+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:36:00+00:00, run_after=2024-02-24T04:37:00+00:00 2024-02-24T04:36:05.312674900Z [2024-02-24T04:36:05.312+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:35:00+00:00 exited with status success for try_number 1 2024-02-24T04:36:05.320811761Z [2024-02-24T04:36:05.320+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:35:00+00:00, map_index=-1, run_start_date=2024-02-24 04:36:02.427991+00:00, run_end_date=2024-02-24 04:36:04.914987+00:00, run_duration=2.486996, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1349, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:36:00.360439+00:00, queued_by_job_id=2, pid=19619 2024-02-24T04:37:00.908100093Z [2024-02-24T04:37:00.906+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:37:00+00:00, run_after=2024-02-24T04:38:00+00:00 2024-02-24T04:37:00.917080868Z [2024-02-24T04:37:00.916+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:37:00.931088478Z [2024-02-24T04:37:00.930+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:37:00+00:00, run_after=2024-02-24T04:38:00+00:00 2024-02-24T04:37:01.051699879Z [2024-02-24T04:37:01.051+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T04:37:01.051729796Z 2024-02-24T04:37:01.051734579Z 2024-02-24T04:37:01.051738493Z 2024-02-24T04:37:01.051791582Z [2024-02-24T04:37:01.051+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:37:01.052011582Z [2024-02-24T04:37:01.051+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:37:01.052187631Z [2024-02-24T04:37:01.051+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:37:01.053011321Z [2024-02-24T04:37:01.052+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:37:01.053021769Z 2024-02-24T04:37:01.053026178Z 2024-02-24T04:37:01.053030344Z 2024-02-24T04:37:01.056837169Z [2024-02-24T04:37:01.056+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:37:01.057042540Z [2024-02-24T04:37:01.056+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:37:01.057345378Z [2024-02-24T04:37:01.057+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:37:01.057547926Z [2024-02-24T04:37:01.057+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:37:01.057869206Z [2024-02-24T04:37:01.057+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:37:01.058041292Z [2024-02-24T04:37:01.057+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:37:01.393389914Z [2024-02-24T04:37:01.392+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:36:00+00:00 exited with status queued for try_number 1 2024-02-24T04:37:01.393478523Z [2024-02-24T04:37:01.393+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:36:00+00:00 exited with status queued for try_number 1 2024-02-24T04:37:01.393663474Z [2024-02-24T04:37:01.393+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:36:00+00:00 exited with status queued for try_number 1 2024-02-24T04:37:01.406002972Z [2024-02-24T04:37:01.405+0000] {scheduler_job.py:635} INFO - Setting external_id for to ec9285ac-77d3-42f1-9348-abe2649229ad 2024-02-24T04:37:01.406283758Z [2024-02-24T04:37:01.405+0000] {scheduler_job.py:635} INFO - Setting external_id for to 782a6da3-5495-4f93-87ce-11473c533c62 2024-02-24T04:37:01.406464896Z [2024-02-24T04:37:01.406+0000] {scheduler_job.py:635} INFO - Setting external_id for to d12a01c9-717f-4708-b797-47dc3df817e6 2024-02-24T04:37:02.554359680Z [2024-02-24T04:37:02.553+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:37:02.554956742Z [2024-02-24T04:37:02.554+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:36:00+00:00, run_id=scheduled__2024-02-24T04:36:00+00:00, run_start_date=2024-02-24 04:37:00.952245+00:00, run_end_date=2024-02-24 04:37:02.554180+00:00, run_duration=1.601935, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:36:00+00:00, data_interval_end=2024-02-24 04:37:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:37:02.565488526Z [2024-02-24T04:37:02.565+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:37:00+00:00, run_after=2024-02-24T04:38:00+00:00 2024-02-24T04:37:02.628410243Z [2024-02-24T04:37:02.627+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:36:00+00:00 exited with status success for try_number 1 2024-02-24T04:37:02.651792209Z [2024-02-24T04:37:02.650+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:36:00+00:00, map_index=-1, run_start_date=2024-02-24 04:37:01.895629+00:00, run_end_date=2024-02-24 04:37:02.295526+00:00, run_duration=0.399897, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1351, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:37:01.054034+00:00, queued_by_job_id=2, pid=19652 2024-02-24T04:37:04.930161579Z [2024-02-24T04:37:04.929+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:37:04.936687959Z [2024-02-24T04:37:04.935+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:36:00+00:00, run_id=scheduled__2024-02-24T04:36:00+00:00, run_start_date=2024-02-24 04:37:00.955163+00:00, run_end_date=2024-02-24 04:37:04.930056+00:00, run_duration=3.974893, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:36:00+00:00, data_interval_end=2024-02-24 04:37:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:37:04.947235228Z [2024-02-24T04:37:04.946+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:37:00+00:00, run_after=2024-02-24T04:38:00+00:00 2024-02-24T04:37:04.990337712Z [2024-02-24T04:37:04.989+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:36:00+00:00 exited with status success for try_number 1 2024-02-24T04:37:04.996803863Z [2024-02-24T04:37:04.996+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:36:00+00:00, map_index=-1, run_start_date=2024-02-24 04:37:03.012863+00:00, run_end_date=2024-02-24 04:37:04.813454+00:00, run_duration=1.800591, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1352, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:37:01.054034+00:00, queued_by_job_id=2, pid=19671 2024-02-24T04:37:06.053702250Z [2024-02-24T04:37:06.053+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:37:06.054060258Z [2024-02-24T04:37:06.053+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:36:00+00:00, run_id=scheduled__2024-02-24T04:36:00+00:00, run_start_date=2024-02-24 04:37:00.957844+00:00, run_end_date=2024-02-24 04:37:06.053682+00:00, run_duration=5.095838, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:36:00+00:00, data_interval_end=2024-02-24 04:37:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:37:06.070414355Z [2024-02-24T04:37:06.069+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:37:00+00:00, run_after=2024-02-24T04:38:00+00:00 2024-02-24T04:37:06.100753938Z [2024-02-24T04:37:06.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:36:00+00:00 exited with status success for try_number 1 2024-02-24T04:37:06.105841525Z [2024-02-24T04:37:06.105+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:36:00+00:00, map_index=-1, run_start_date=2024-02-24 04:37:03.000767+00:00, run_end_date=2024-02-24 04:37:05.418590+00:00, run_duration=2.417823, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1353, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:37:01.054034+00:00, queued_by_job_id=2, pid=19670 2024-02-24T04:37:06.544780558Z [2024-02-24T04:37:06.544+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T04:38:00.834211787Z [2024-02-24T04:38:00.833+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:38:00.847731508Z [2024-02-24T04:38:00.847+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:38:00.868442517Z [2024-02-24T04:38:00.868+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:38:00+00:00, run_after=2024-02-24T04:39:00+00:00 2024-02-24T04:38:00.883738120Z [2024-02-24T04:38:00.883+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:38:00+00:00, run_after=2024-02-24T04:39:00+00:00 2024-02-24T04:38:00.990368280Z [2024-02-24T04:38:00.989+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T04:38:00.990471788Z 2024-02-24T04:38:00.990525786Z 2024-02-24T04:38:00.990532050Z 2024-02-24T04:38:00.990576707Z 2024-02-24T04:38:00.990593282Z [2024-02-24T04:38:00.990+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T04:38:00.990599080Z [2024-02-24T04:38:00.990+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:38:00.990608698Z [2024-02-24T04:38:00.990+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:38:00.990692561Z [2024-02-24T04:38:00.990+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:38:00.991683066Z [2024-02-24T04:38:00.991+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:38:00.991699696Z 2024-02-24T04:38:00.991707664Z 2024-02-24T04:38:00.991715428Z 2024-02-24T04:38:00.991720111Z 2024-02-24T04:38:00.997696489Z [2024-02-24T04:38:00.997+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T04:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:38:00.997841022Z [2024-02-24T04:38:00.997+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T04:38:00.999592821Z [2024-02-24T04:38:00.999+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:38:00.999675853Z [2024-02-24T04:38:00.999+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:38:00.999868003Z [2024-02-24T04:38:00.999+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:38:00.999927807Z [2024-02-24T04:38:00.999+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:38:01.000096903Z [2024-02-24T04:38:00.999+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:38:01.000171794Z [2024-02-24T04:38:01.000+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:38:01.544187569Z [2024-02-24T04:38:01.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:36:00+00:00 exited with status queued for try_number 1 2024-02-24T04:38:01.544336473Z [2024-02-24T04:38:01.544+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:37:00+00:00 exited with status queued for try_number 1 2024-02-24T04:38:01.544415672Z [2024-02-24T04:38:01.544+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:37:00+00:00 exited with status queued for try_number 1 2024-02-24T04:38:01.544532071Z [2024-02-24T04:38:01.544+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:37:00+00:00 exited with status queued for try_number 1 2024-02-24T04:38:01.559825773Z [2024-02-24T04:38:01.559+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4e70afb-1fd2-485a-93be-d8cb4f61b9f3 2024-02-24T04:38:01.560358729Z [2024-02-24T04:38:01.560+0000] {scheduler_job.py:635} INFO - Setting external_id for to 579eba66-f182-46a1-9343-db0c2f723796 2024-02-24T04:38:01.560690171Z [2024-02-24T04:38:01.560+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2e4439e0-b949-4137-a9e6-3f625badc74a 2024-02-24T04:38:01.560953691Z [2024-02-24T04:38:01.560+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c1cae6d-3eb4-4092-951c-46c3571e3d88 2024-02-24T04:38:02.927355985Z [2024-02-24T04:38:02.926+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:38:02.928179725Z [2024-02-24T04:38:02.927+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 04:36:00+00:00, run_id=scheduled__2024-02-24T04:36:00+00:00, run_start_date=2024-02-24 04:38:00.907305+00:00, run_end_date=2024-02-24 04:38:02.927380+00:00, run_duration=2.020075, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:36:00+00:00, data_interval_end=2024-02-24 04:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T04:38:02.941183503Z [2024-02-24T04:38:02.940+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T04:38:00+00:00, run_after=2024-02-24T04:40:00+00:00 2024-02-24T04:38:03.043926136Z [2024-02-24T04:38:03.043+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:36:00+00:00 exited with status success for try_number 1 2024-02-24T04:38:03.052463062Z [2024-02-24T04:38:03.052+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T04:36:00+00:00, map_index=-1, run_start_date=2024-02-24 04:38:02.008976+00:00, run_end_date=2024-02-24 04:38:02.613555+00:00, run_duration=0.604579, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1354, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:38:00.993452+00:00, queued_by_job_id=2, pid=19699 2024-02-24T04:38:04.110039729Z [2024-02-24T04:38:04.109+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:38:04.110591126Z [2024-02-24T04:38:04.110+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:37:00+00:00, run_id=scheduled__2024-02-24T04:37:00+00:00, run_start_date=2024-02-24 04:38:00.910186+00:00, run_end_date=2024-02-24 04:38:04.110203+00:00, run_duration=3.200017, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:37:00+00:00, data_interval_end=2024-02-24 04:38:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:38:04.121982133Z [2024-02-24T04:38:04.121+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:38:00+00:00, run_after=2024-02-24T04:39:00+00:00 2024-02-24T04:38:04.167928034Z [2024-02-24T04:38:04.167+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:37:00+00:00 exited with status success for try_number 1 2024-02-24T04:38:04.174918030Z [2024-02-24T04:38:04.174+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:37:00+00:00, map_index=-1, run_start_date=2024-02-24 04:38:02.364417+00:00, run_end_date=2024-02-24 04:38:03.047143+00:00, run_duration=0.682726, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1355, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:38:00.993452+00:00, queued_by_job_id=2, pid=19707 2024-02-24T04:38:06.103812590Z [2024-02-24T04:38:06.103+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:38:06.104893853Z [2024-02-24T04:38:06.104+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:37:00+00:00, run_id=scheduled__2024-02-24T04:37:00+00:00, run_start_date=2024-02-24 04:38:00.911835+00:00, run_end_date=2024-02-24 04:38:06.104331+00:00, run_duration=5.192496, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:37:00+00:00, data_interval_end=2024-02-24 04:38:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:38:06.117308514Z [2024-02-24T04:38:06.116+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:38:00+00:00, run_after=2024-02-24T04:39:00+00:00 2024-02-24T04:38:06.127393195Z [2024-02-24T04:38:06.126+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:38:06.127747997Z [2024-02-24T04:38:06.127+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:37:00+00:00, run_id=scheduled__2024-02-24T04:37:00+00:00, run_start_date=2024-02-24 04:38:00.913331+00:00, run_end_date=2024-02-24 04:38:06.127299+00:00, run_duration=5.213968, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:37:00+00:00, data_interval_end=2024-02-24 04:38:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:38:06.140796435Z [2024-02-24T04:38:06.140+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:38:00+00:00, run_after=2024-02-24T04:39:00+00:00 2024-02-24T04:38:06.182074609Z [2024-02-24T04:38:06.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:37:00+00:00 exited with status success for try_number 1 2024-02-24T04:38:06.182239509Z [2024-02-24T04:38:06.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:37:00+00:00 exited with status success for try_number 1 2024-02-24T04:38:06.192320692Z [2024-02-24T04:38:06.191+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:37:00+00:00, map_index=-1, run_start_date=2024-02-24 04:38:03.545426+00:00, run_end_date=2024-02-24 04:38:05.123114+00:00, run_duration=1.577688, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1357, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:38:00.993452+00:00, queued_by_job_id=2, pid=19729 2024-02-24T04:38:06.192645216Z [2024-02-24T04:38:06.192+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:37:00+00:00, map_index=-1, run_start_date=2024-02-24 04:38:03.435795+00:00, run_end_date=2024-02-24 04:38:05.228976+00:00, run_duration=1.793181, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1356, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:38:00.993452+00:00, queued_by_job_id=2, pid=19728 2024-02-24T04:39:00.571662056Z [2024-02-24T04:39:00.571+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:39:00.589120324Z [2024-02-24T04:39:00.588+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:39:00+00:00, run_after=2024-02-24T04:40:00+00:00 2024-02-24T04:39:00.605740314Z [2024-02-24T04:39:00.605+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:39:00+00:00, run_after=2024-02-24T04:40:00+00:00 2024-02-24T04:39:00.683902163Z [2024-02-24T04:39:00.683+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T04:39:00.683946714Z 2024-02-24T04:39:00.683952048Z 2024-02-24T04:39:00.683956257Z 2024-02-24T04:39:00.684056653Z [2024-02-24T04:39:00.683+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:39:00.684306791Z [2024-02-24T04:39:00.684+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:39:00.684500244Z [2024-02-24T04:39:00.684+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:39:00.685908553Z [2024-02-24T04:39:00.685+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:39:00.685918737Z 2024-02-24T04:39:00.685923077Z 2024-02-24T04:39:00.685927527Z 2024-02-24T04:39:00.692328511Z [2024-02-24T04:39:00.691+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:39:00.692485074Z [2024-02-24T04:39:00.692+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:39:00.693030217Z [2024-02-24T04:39:00.692+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:39:00.693263268Z [2024-02-24T04:39:00.693+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:39:00.693750395Z [2024-02-24T04:39:00.693+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:39:00.694307081Z [2024-02-24T04:39:00.693+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:39:00.993588535Z [2024-02-24T04:39:00.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:38:00+00:00 exited with status queued for try_number 1 2024-02-24T04:39:00.993927799Z [2024-02-24T04:39:00.993+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:38:00+00:00 exited with status queued for try_number 1 2024-02-24T04:39:00.994183894Z [2024-02-24T04:39:00.993+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:38:00+00:00 exited with status queued for try_number 1 2024-02-24T04:39:01.008702846Z [2024-02-24T04:39:01.008+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac41769f-0233-4b99-af48-e3e2e6fc8c77 2024-02-24T04:39:01.008899525Z [2024-02-24T04:39:01.008+0000] {scheduler_job.py:635} INFO - Setting external_id for to e665ba44-491e-4b7e-8770-022eaf94584a 2024-02-24T04:39:01.009100312Z [2024-02-24T04:39:01.008+0000] {scheduler_job.py:635} INFO - Setting external_id for to b1f24336-d03c-4c21-aa83-02c566fe2e6b 2024-02-24T04:39:02.452928045Z [2024-02-24T04:39:02.452+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:39:02.453419352Z [2024-02-24T04:39:02.453+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:38:00+00:00, run_id=scheduled__2024-02-24T04:38:00+00:00, run_start_date=2024-02-24 04:39:00.622214+00:00, run_end_date=2024-02-24 04:39:02.452836+00:00, run_duration=1.830622, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:38:00+00:00, data_interval_end=2024-02-24 04:39:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:39:02.462597298Z [2024-02-24T04:39:02.462+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:39:00+00:00, run_after=2024-02-24T04:40:00+00:00 2024-02-24T04:39:02.507508979Z [2024-02-24T04:39:02.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:38:00+00:00 exited with status success for try_number 1 2024-02-24T04:39:02.512585645Z [2024-02-24T04:39:02.512+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:38:00+00:00, map_index=-1, run_start_date=2024-02-24 04:39:01.646714+00:00, run_end_date=2024-02-24 04:39:02.033124+00:00, run_duration=0.38641, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1358, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:39:00.687777+00:00, queued_by_job_id=2, pid=19762 2024-02-24T04:39:04.706208178Z [2024-02-24T04:39:04.705+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:39:04.706637239Z [2024-02-24T04:39:04.706+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:38:00+00:00, run_id=scheduled__2024-02-24T04:38:00+00:00, run_start_date=2024-02-24 04:39:00.624618+00:00, run_end_date=2024-02-24 04:39:04.706083+00:00, run_duration=4.081465, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:38:00+00:00, data_interval_end=2024-02-24 04:39:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:39:04.716879227Z [2024-02-24T04:39:04.716+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:39:00+00:00, run_after=2024-02-24T04:40:00+00:00 2024-02-24T04:39:04.763362074Z [2024-02-24T04:39:04.762+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:38:00+00:00 exited with status success for try_number 1 2024-02-24T04:39:04.770575066Z [2024-02-24T04:39:04.770+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:38:00+00:00, map_index=-1, run_start_date=2024-02-24 04:39:02.506682+00:00, run_end_date=2024-02-24 04:39:04.474427+00:00, run_duration=1.967745, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1359, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:39:00.687777+00:00, queued_by_job_id=2, pid=19780 2024-02-24T04:39:06.507068253Z [2024-02-24T04:39:06.506+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:39:06.507621788Z [2024-02-24T04:39:06.507+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:38:00+00:00, run_id=scheduled__2024-02-24T04:38:00+00:00, run_start_date=2024-02-24 04:39:00.627049+00:00, run_end_date=2024-02-24 04:39:06.506863+00:00, run_duration=5.879814, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:38:00+00:00, data_interval_end=2024-02-24 04:39:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:39:06.517304359Z [2024-02-24T04:39:06.516+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:39:00+00:00, run_after=2024-02-24T04:40:00+00:00 2024-02-24T04:39:06.554722733Z [2024-02-24T04:39:06.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:38:00+00:00 exited with status success for try_number 1 2024-02-24T04:39:06.561143411Z [2024-02-24T04:39:06.560+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:38:00+00:00, map_index=-1, run_start_date=2024-02-24 04:39:02.578883+00:00, run_end_date=2024-02-24 04:39:05.406804+00:00, run_duration=2.827921, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1360, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:39:00.687777+00:00, queued_by_job_id=2, pid=19781 2024-02-24T04:40:00.414766717Z [2024-02-24T04:40:00.414+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:40:00+00:00, run_after=2024-02-24T04:41:00+00:00 2024-02-24T04:40:00.432034207Z [2024-02-24T04:40:00.431+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:40:00+00:00, run_after=2024-02-24T04:45:00+00:00 2024-02-24T04:40:00.446966167Z [2024-02-24T04:40:00.446+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:40:00.467895131Z [2024-02-24T04:40:00.467+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:40:00+00:00, run_after=2024-02-24T04:41:00+00:00 2024-02-24T04:40:00.475216935Z [2024-02-24T04:40:00.474+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:40:00.616442782Z [2024-02-24T04:40:00.615+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-02-24T04:40:00.616486766Z 2024-02-24T04:40:00.616493680Z 2024-02-24T04:40:00.616507634Z 2024-02-24T04:40:00.616514364Z 2024-02-24T04:40:00.616520916Z 2024-02-24T04:40:00.617123331Z [2024-02-24T04:40:00.616+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:40:00.617971814Z [2024-02-24T04:40:00.617+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T04:40:00.618710945Z [2024-02-24T04:40:00.618+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:40:00.619268625Z [2024-02-24T04:40:00.618+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:40:00.619814973Z [2024-02-24T04:40:00.619+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:40:00.621138055Z [2024-02-24T04:40:00.620+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:40:00.621167227Z 2024-02-24T04:40:00.621196062Z 2024-02-24T04:40:00.621202754Z 2024-02-24T04:40:00.621208493Z 2024-02-24T04:40:00.621214580Z 2024-02-24T04:40:00.628855878Z [2024-02-24T04:40:00.628+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T04:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T04:40:00.629267365Z [2024-02-24T04:40:00.629+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T04:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T04:40:00.629836639Z [2024-02-24T04:40:00.629+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T04:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:40:00.630164749Z [2024-02-24T04:40:00.629+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T04:40:00.630568995Z [2024-02-24T04:40:00.630+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:40:00.630968709Z [2024-02-24T04:40:00.630+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:40:00.631266909Z [2024-02-24T04:40:00.631+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:40:00.631561257Z [2024-02-24T04:40:00.631+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:40:00.631955366Z [2024-02-24T04:40:00.631+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:40:00.632343459Z [2024-02-24T04:40:00.632+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:40:01.188389350Z [2024-02-24T04:40:01.187+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T04:35:00+00:00 exited with status queued for try_number 1 2024-02-24T04:40:01.188452658Z [2024-02-24T04:40:01.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:38:00+00:00 exited with status queued for try_number 1 2024-02-24T04:40:01.189396536Z [2024-02-24T04:40:01.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:39:00+00:00 exited with status queued for try_number 1 2024-02-24T04:40:01.189782091Z [2024-02-24T04:40:01.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:39:00+00:00 exited with status queued for try_number 1 2024-02-24T04:40:01.190199999Z [2024-02-24T04:40:01.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:39:00+00:00 exited with status queued for try_number 1 2024-02-24T04:40:01.217929633Z [2024-02-24T04:40:01.216+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99940f02-f00d-4c6b-8668-f776af844adc 2024-02-24T04:40:01.217955552Z [2024-02-24T04:40:01.217+0000] {scheduler_job.py:635} INFO - Setting external_id for to 792c2327-b7fc-465c-bea7-955da4e16cac 2024-02-24T04:40:01.217959412Z [2024-02-24T04:40:01.217+0000] {scheduler_job.py:635} INFO - Setting external_id for to 13e5688a-2740-4cdb-9934-f98176d9a724 2024-02-24T04:40:01.225945244Z [2024-02-24T04:40:01.217+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6fb8c4e-59bb-4f76-881e-13ff92109a9f 2024-02-24T04:40:01.225968776Z [2024-02-24T04:40:01.218+0000] {scheduler_job.py:635} INFO - Setting external_id for to 789c648e-8f9a-486c-b5aa-e656a11cdd16 2024-02-24T04:40:02.270202691Z [2024-02-24T04:40:02.269+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:40:02.270626547Z [2024-02-24T04:40:02.270+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 04:38:00+00:00, run_id=scheduled__2024-02-24T04:38:00+00:00, run_start_date=2024-02-24 04:40:00.488484+00:00, run_end_date=2024-02-24 04:40:02.270102+00:00, run_duration=1.781618, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:38:00+00:00, data_interval_end=2024-02-24 04:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T04:40:02.285570333Z [2024-02-24T04:40:02.280+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T04:40:00+00:00, run_after=2024-02-24T04:42:00+00:00 2024-02-24T04:40:03.377929058Z [2024-02-24T04:40:03.377+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:40:03.379200085Z [2024-02-24T04:40:03.378+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:39:00+00:00, run_id=scheduled__2024-02-24T04:39:00+00:00, run_start_date=2024-02-24 04:40:00.489669+00:00, run_end_date=2024-02-24 04:40:03.378828+00:00, run_duration=2.889159, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:39:00+00:00, data_interval_end=2024-02-24 04:40:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:40:03.390380550Z [2024-02-24T04:40:03.390+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:40:00+00:00, run_after=2024-02-24T04:41:00+00:00 2024-02-24T04:40:03.475727967Z [2024-02-24T04:40:03.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:38:00+00:00 exited with status success for try_number 1 2024-02-24T04:40:03.475793629Z [2024-02-24T04:40:03.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:39:00+00:00 exited with status success for try_number 1 2024-02-24T04:40:03.487614506Z [2024-02-24T04:40:03.487+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T04:38:00+00:00, map_index=-1, run_start_date=2024-02-24 04:40:01.648606+00:00, run_end_date=2024-02-24 04:40:02.237284+00:00, run_duration=0.588678, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1361, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:40:00.623343+00:00, queued_by_job_id=2, pid=19815 2024-02-24T04:40:03.487907869Z [2024-02-24T04:40:03.487+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:39:00+00:00, map_index=-1, run_start_date=2024-02-24 04:40:01.860764+00:00, run_end_date=2024-02-24 04:40:02.466591+00:00, run_duration=0.605827, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1362, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:40:00.623343+00:00, queued_by_job_id=2, pid=19816 2024-02-24T04:40:04.578724240Z [2024-02-24T04:40:04.578+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:40:04.578759898Z 2024-02-24T04:40:04.578775491Z [2024-02-24T04:40:04.578+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:40:04.579418242Z [2024-02-24T04:40:04.579+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:40:04.579438441Z 2024-02-24T04:40:04.581957036Z [2024-02-24T04:40:04.581+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T04:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T04:40:04.582122868Z [2024-02-24T04:40:04.581+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T04:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T04:40:04.652227521Z [2024-02-24T04:40:04.651+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T04:35:00+00:00 exited with status queued for try_number 1 2024-02-24T04:40:04.652440727Z [2024-02-24T04:40:04.652+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T04:35:00+00:00 exited with status success for try_number 1 2024-02-24T04:40:04.659480660Z [2024-02-24T04:40:04.659+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9141c6fb-97fc-4e0d-ab04-58325a1bcf24 2024-02-24T04:40:04.659530330Z [2024-02-24T04:40:04.659+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T04:35:00+00:00, map_index=-1, run_start_date=2024-02-24 04:40:03.126787+00:00, run_end_date=2024-02-24 04:40:03.604255+00:00, run_duration=0.477468, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1363, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:40:00.623343+00:00, queued_by_job_id=2, pid=19840 2024-02-24T04:40:05.856252140Z [2024-02-24T04:40:05.855+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:40:05.856329706Z [2024-02-24T04:40:05.856+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:39:00+00:00, run_id=scheduled__2024-02-24T04:39:00+00:00, run_start_date=2024-02-24 04:40:00.490877+00:00, run_end_date=2024-02-24 04:40:05.855927+00:00, run_duration=5.36505, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:39:00+00:00, data_interval_end=2024-02-24 04:40:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:40:05.866825843Z [2024-02-24T04:40:05.866+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:40:00+00:00, run_after=2024-02-24T04:41:00+00:00 2024-02-24T04:40:05.874913716Z [2024-02-24T04:40:05.874+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:40:05.875002397Z [2024-02-24T04:40:05.874+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:39:00+00:00, run_id=scheduled__2024-02-24T04:39:00+00:00, run_start_date=2024-02-24 04:40:00.492027+00:00, run_end_date=2024-02-24 04:40:05.874752+00:00, run_duration=5.382725, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:39:00+00:00, data_interval_end=2024-02-24 04:40:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:40:05.885285522Z [2024-02-24T04:40:05.884+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:40:00+00:00, run_after=2024-02-24T04:41:00+00:00 2024-02-24T04:40:05.950530525Z [2024-02-24T04:40:05.949+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:39:00+00:00 exited with status success for try_number 1 2024-02-24T04:40:05.953073753Z [2024-02-24T04:40:05.952+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:39:00+00:00 exited with status success for try_number 1 2024-02-24T04:40:05.963074832Z [2024-02-24T04:40:05.962+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:39:00+00:00, map_index=-1, run_start_date=2024-02-24 04:40:03.429613+00:00, run_end_date=2024-02-24 04:40:04.752413+00:00, run_duration=1.3228, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1365, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:40:00.623343+00:00, queued_by_job_id=2, pid=19847 2024-02-24T04:40:05.963642186Z [2024-02-24T04:40:05.963+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:39:00+00:00, map_index=-1, run_start_date=2024-02-24 04:40:03.346616+00:00, run_end_date=2024-02-24 04:40:05.096128+00:00, run_duration=1.749512, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1364, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:40:00.623343+00:00, queued_by_job_id=2, pid=19846 2024-02-24T04:40:07.048952602Z [2024-02-24T04:40:07.048+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:40:07.048985690Z 2024-02-24T04:40:07.049427611Z [2024-02-24T04:40:07.049+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:40:07.050322731Z [2024-02-24T04:40:07.050+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:40:07.050339293Z 2024-02-24T04:40:07.052724234Z [2024-02-24T04:40:07.052+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T04:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T04:40:07.052969520Z [2024-02-24T04:40:07.052+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T04:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T04:40:07.119597108Z [2024-02-24T04:40:07.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T04:35:00+00:00 exited with status queued for try_number 1 2024-02-24T04:40:07.119718996Z [2024-02-24T04:40:07.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T04:35:00+00:00 exited with status success for try_number 1 2024-02-24T04:40:07.126911950Z [2024-02-24T04:40:07.126+0000] {scheduler_job.py:635} INFO - Setting external_id for to 50a2d786-b73e-4f46-a620-d6882987b40d 2024-02-24T04:40:07.127133788Z [2024-02-24T04:40:07.126+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T04:35:00+00:00, map_index=-1, run_start_date=2024-02-24 04:40:06.388039+00:00, run_end_date=2024-02-24 04:40:06.758347+00:00, run_duration=0.370308, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1366, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:40:04.579769+00:00, queued_by_job_id=2, pid=19870 2024-02-24T04:40:09.699305995Z [2024-02-24T04:40:09.698+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:40:09.699358357Z 2024-02-24T04:40:09.699369309Z [2024-02-24T04:40:09.699+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:40:09.699950810Z [2024-02-24T04:40:09.699+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:40:09.699994194Z 2024-02-24T04:40:09.702836207Z [2024-02-24T04:40:09.702+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T04:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:40:09.703152784Z [2024-02-24T04:40:09.702+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T04:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T04:40:09.760515485Z [2024-02-24T04:40:09.760+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T04:35:00+00:00 exited with status queued for try_number 1 2024-02-24T04:40:09.760755519Z [2024-02-24T04:40:09.760+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T04:35:00+00:00 exited with status success for try_number 1 2024-02-24T04:40:09.770493477Z [2024-02-24T04:40:09.770+0000] {scheduler_job.py:635} INFO - Setting external_id for to 14e8aaca-81a3-4614-bb6f-15c544fe1b78 2024-02-24T04:40:09.770867230Z [2024-02-24T04:40:09.770+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T04:35:00+00:00, map_index=0, run_start_date=2024-02-24 04:40:08.645338+00:00, run_end_date=2024-02-24 04:40:09.035330+00:00, run_duration=0.389992, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1367, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:40:07.050737+00:00, queued_by_job_id=2, pid=19878 2024-02-24T04:40:12.022484608Z [2024-02-24T04:40:12.021+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:40:12.023501923Z [2024-02-24T04:40:12.023+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:35:00+00:00, run_id=scheduled__2024-02-24T04:35:00+00:00, run_start_date=2024-02-24 04:40:00.487147+00:00, run_end_date=2024-02-24 04:40:12.022912+00:00, run_duration=11.535765, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:35:00+00:00, data_interval_end=2024-02-24 04:40:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T04:40:12.039914885Z [2024-02-24T04:40:12.039+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:40:00+00:00, run_after=2024-02-24T04:45:00+00:00 2024-02-24T04:40:12.068114594Z [2024-02-24T04:40:12.067+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T04:35:00+00:00 exited with status success for try_number 1 2024-02-24T04:40:12.073306218Z [2024-02-24T04:40:12.072+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T04:35:00+00:00, map_index=-1, run_start_date=2024-02-24 04:40:11.352960+00:00, run_end_date=2024-02-24 04:40:11.713892+00:00, run_duration=0.360932, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1368, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:40:09.700376+00:00, queued_by_job_id=2, pid=19886 2024-02-24T04:41:00.425655813Z [2024-02-24T04:41:00.424+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:41:00.447664991Z [2024-02-24T04:41:00.447+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:41:00+00:00, run_after=2024-02-24T04:42:00+00:00 2024-02-24T04:41:00.464683241Z [2024-02-24T04:41:00.464+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:41:00+00:00, run_after=2024-02-24T04:42:00+00:00 2024-02-24T04:41:00.552767470Z [2024-02-24T04:41:00.552+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T04:41:00.552801441Z 2024-02-24T04:41:00.552806576Z 2024-02-24T04:41:00.552811415Z 2024-02-24T04:41:00.553087645Z [2024-02-24T04:41:00.552+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:41:00.553346738Z [2024-02-24T04:41:00.553+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:41:00.553577601Z [2024-02-24T04:41:00.553+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:41:00.554567104Z [2024-02-24T04:41:00.554+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:41:00.554632512Z 2024-02-24T04:41:00.554642806Z 2024-02-24T04:41:00.554711102Z 2024-02-24T04:41:00.558952636Z [2024-02-24T04:41:00.558+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:41:00.559217013Z [2024-02-24T04:41:00.558+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:41:00.559561720Z [2024-02-24T04:41:00.559+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:41:00.559815522Z [2024-02-24T04:41:00.559+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:41:00.560181236Z [2024-02-24T04:41:00.559+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:41:00.560488499Z [2024-02-24T04:41:00.560+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:41:00.799809301Z [2024-02-24T04:41:00.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:40:00+00:00 exited with status queued for try_number 1 2024-02-24T04:41:00.800295069Z [2024-02-24T04:41:00.799+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:40:00+00:00 exited with status queued for try_number 1 2024-02-24T04:41:00.800819299Z [2024-02-24T04:41:00.800+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:40:00+00:00 exited with status queued for try_number 1 2024-02-24T04:41:00.824070723Z [2024-02-24T04:41:00.823+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf7663b0-cc16-40ca-9905-c36f0e350806 2024-02-24T04:41:00.824488389Z [2024-02-24T04:41:00.824+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4bbae208-affc-4340-bbeb-44bbbfbdd0ea 2024-02-24T04:41:00.824813761Z [2024-02-24T04:41:00.824+0000] {scheduler_job.py:635} INFO - Setting external_id for to a80cac30-6609-48f1-b07c-93171d86f2a0 2024-02-24T04:41:01.985175902Z [2024-02-24T04:41:01.984+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:41:01.985832103Z [2024-02-24T04:41:01.985+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:40:00+00:00, run_id=scheduled__2024-02-24T04:40:00+00:00, run_start_date=2024-02-24 04:41:00.487762+00:00, run_end_date=2024-02-24 04:41:01.985337+00:00, run_duration=1.497575, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:40:00+00:00, data_interval_end=2024-02-24 04:41:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:41:01.995108102Z [2024-02-24T04:41:01.994+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:41:00+00:00, run_after=2024-02-24T04:42:00+00:00 2024-02-24T04:41:02.048343950Z [2024-02-24T04:41:02.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:40:00+00:00 exited with status success for try_number 1 2024-02-24T04:41:02.055469553Z [2024-02-24T04:41:02.055+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:40:00+00:00, map_index=-1, run_start_date=2024-02-24 04:41:01.312760+00:00, run_end_date=2024-02-24 04:41:01.703938+00:00, run_duration=0.391178, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1369, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:41:00.555387+00:00, queued_by_job_id=2, pid=19908 2024-02-24T04:41:04.428408239Z [2024-02-24T04:41:04.427+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:41:04.428969814Z [2024-02-24T04:41:04.428+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:40:00+00:00, run_id=scheduled__2024-02-24T04:40:00+00:00, run_start_date=2024-02-24 04:41:00.489649+00:00, run_end_date=2024-02-24 04:41:04.428517+00:00, run_duration=3.938868, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:40:00+00:00, data_interval_end=2024-02-24 04:41:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:41:04.443687945Z [2024-02-24T04:41:04.443+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:41:00+00:00, run_after=2024-02-24T04:42:00+00:00 2024-02-24T04:41:04.493316341Z [2024-02-24T04:41:04.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:40:00+00:00 exited with status success for try_number 1 2024-02-24T04:41:04.502009939Z [2024-02-24T04:41:04.501+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:40:00+00:00, map_index=-1, run_start_date=2024-02-24 04:41:02.316777+00:00, run_end_date=2024-02-24 04:41:04.133903+00:00, run_duration=1.817126, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1370, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:41:00.555387+00:00, queued_by_job_id=2, pid=19926 2024-02-24T04:41:05.558097021Z [2024-02-24T04:41:05.557+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:41:05.558512632Z [2024-02-24T04:41:05.558+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:40:00+00:00, run_id=scheduled__2024-02-24T04:40:00+00:00, run_start_date=2024-02-24 04:41:00.490866+00:00, run_end_date=2024-02-24 04:41:05.557963+00:00, run_duration=5.067097, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:40:00+00:00, data_interval_end=2024-02-24 04:41:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:41:05.570656606Z [2024-02-24T04:41:05.570+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:41:00+00:00, run_after=2024-02-24T04:42:00+00:00 2024-02-24T04:41:05.619959189Z [2024-02-24T04:41:05.619+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:40:00+00:00 exited with status success for try_number 1 2024-02-24T04:41:05.625848148Z [2024-02-24T04:41:05.625+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:40:00+00:00, map_index=-1, run_start_date=2024-02-24 04:41:02.539189+00:00, run_end_date=2024-02-24 04:41:04.613294+00:00, run_duration=2.074105, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1371, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:41:00.555387+00:00, queued_by_job_id=2, pid=19927 2024-02-24T04:41:38.660309238Z [2024-02-24T04:41:38.658+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:41:38.660390310Z 2024-02-24T04:41:38.660466793Z [2024-02-24T04:41:38.660+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-02-24T04:41:38.661704086Z [2024-02-24T04:41:38.661+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:41:38.661737378Z 2024-02-24T04:41:38.667518758Z [2024-02-24T04:41:38.666+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240224044137_466331', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:41:38.667694697Z [2024-02-24T04:41:38.667+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240224044137_466331', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-02-24T04:41:38.751118365Z [2024-02-24T04:41:38.750+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240224044137_466331 exited with status queued for try_number 1 2024-02-24T04:41:38.756315234Z [2024-02-24T04:41:38.756+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0dc172a3-081e-4bbe-9a88-613d685a6ac2 2024-02-24T04:41:39.897935075Z [2024-02-24T04:41:39.897+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:41:39.899010307Z [2024-02-24T04:41:39.898+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-02-24 04:41:37.954757+00:00, run_id=vdu_down_20240224044137_466331, run_start_date=2024-02-24 04:41:38.606674+00:00, run_end_date=2024-02-24 04:41:39.898360+00:00, run_duration=1.291686, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-02-24 04:41:37.954757+00:00, data_interval_end=2024-02-24 04:41:37.954757+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-02-24T04:41:39.903657546Z [2024-02-24T04:41:39.903+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-02-24T04:41:39.953219389Z [2024-02-24T04:41:39.952+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240224044137_466331 exited with status success for try_number 1 2024-02-24T04:41:39.959379257Z [2024-02-24T04:41:39.958+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240224044137_466331, map_index=-1, run_start_date=2024-02-24 04:41:39.365074+00:00, run_end_date=2024-02-24 04:41:39.756019+00:00, run_duration=0.390945, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1372, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:41:38.662923+00:00, queued_by_job_id=2, pid=19939 2024-02-24T04:42:00.274966115Z [2024-02-24T04:42:00.274+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:42:00.283568081Z [2024-02-24T04:42:00.282+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:42:00.296515424Z [2024-02-24T04:42:00.295+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:42:00+00:00, run_after=2024-02-24T04:43:00+00:00 2024-02-24T04:42:00.307782141Z [2024-02-24T04:42:00.307+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:42:00+00:00, run_after=2024-02-24T04:43:00+00:00 2024-02-24T04:42:00.396304492Z [2024-02-24T04:42:00.395+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T04:42:00.396362878Z 2024-02-24T04:42:00.396366654Z 2024-02-24T04:42:00.396369627Z 2024-02-24T04:42:00.396382540Z 2024-02-24T04:42:00.396684979Z [2024-02-24T04:42:00.396+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T04:42:00.396947746Z [2024-02-24T04:42:00.396+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:42:00.397167745Z [2024-02-24T04:42:00.396+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:42:00.397442384Z [2024-02-24T04:42:00.397+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:42:00.398154137Z [2024-02-24T04:42:00.397+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:42:00.398166421Z 2024-02-24T04:42:00.398170036Z 2024-02-24T04:42:00.398173006Z 2024-02-24T04:42:00.398175975Z 2024-02-24T04:42:00.403218692Z [2024-02-24T04:42:00.402+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T04:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:42:00.404533486Z [2024-02-24T04:42:00.403+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T04:42:00.405109546Z [2024-02-24T04:42:00.404+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:42:00.405351815Z [2024-02-24T04:42:00.405+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:42:00.405697401Z [2024-02-24T04:42:00.405+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:42:00.405977719Z [2024-02-24T04:42:00.405+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:42:00.406657682Z [2024-02-24T04:42:00.406+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:42:00.406937942Z [2024-02-24T04:42:00.406+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:42:00.841615348Z [2024-02-24T04:42:00.841+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:40:00+00:00 exited with status queued for try_number 1 2024-02-24T04:42:00.841682788Z [2024-02-24T04:42:00.841+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:41:00+00:00 exited with status queued for try_number 1 2024-02-24T04:42:00.844281771Z [2024-02-24T04:42:00.841+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:41:00+00:00 exited with status queued for try_number 1 2024-02-24T04:42:00.844365706Z [2024-02-24T04:42:00.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:41:00+00:00 exited with status queued for try_number 1 2024-02-24T04:42:00.857408246Z [2024-02-24T04:42:00.857+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b80ed17-d237-4765-8fa9-e0891d7cf6fa 2024-02-24T04:42:00.857474140Z [2024-02-24T04:42:00.857+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8fa0f995-0145-49db-82e2-dc4922bd8d3b 2024-02-24T04:42:00.857604014Z [2024-02-24T04:42:00.857+0000] {scheduler_job.py:635} INFO - Setting external_id for to 47b13868-0d37-4013-9aee-d81bd9b3e522 2024-02-24T04:42:00.857687323Z [2024-02-24T04:42:00.857+0000] {scheduler_job.py:635} INFO - Setting external_id for to 94d405af-af77-4a92-9110-c225e760817a 2024-02-24T04:42:03.149047431Z [2024-02-24T04:42:03.148+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:42:03.149629736Z [2024-02-24T04:42:03.149+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 04:40:00+00:00, run_id=scheduled__2024-02-24T04:40:00+00:00, run_start_date=2024-02-24 04:42:00.317628+00:00, run_end_date=2024-02-24 04:42:03.149213+00:00, run_duration=2.831585, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:40:00+00:00, data_interval_end=2024-02-24 04:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T04:42:03.159290111Z [2024-02-24T04:42:03.158+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T04:42:00+00:00, run_after=2024-02-24T04:44:00+00:00 2024-02-24T04:42:03.169267485Z [2024-02-24T04:42:03.168+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:42:03.169628543Z [2024-02-24T04:42:03.169+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:41:00+00:00, run_id=scheduled__2024-02-24T04:41:00+00:00, run_start_date=2024-02-24 04:42:00.318749+00:00, run_end_date=2024-02-24 04:42:03.169289+00:00, run_duration=2.85054, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:41:00+00:00, data_interval_end=2024-02-24 04:42:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:42:03.179288547Z [2024-02-24T04:42:03.179+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:42:00+00:00, run_after=2024-02-24T04:43:00+00:00 2024-02-24T04:42:03.233578340Z [2024-02-24T04:42:03.233+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:40:00+00:00 exited with status success for try_number 1 2024-02-24T04:42:03.234346970Z [2024-02-24T04:42:03.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:41:00+00:00 exited with status success for try_number 1 2024-02-24T04:42:03.246161719Z [2024-02-24T04:42:03.245+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:41:00+00:00, map_index=-1, run_start_date=2024-02-24 04:42:01.588415+00:00, run_end_date=2024-02-24 04:42:02.199286+00:00, run_duration=0.610871, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1374, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:42:00.399093+00:00, queued_by_job_id=2, pid=19968 2024-02-24T04:42:03.246735453Z [2024-02-24T04:42:03.246+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T04:40:00+00:00, map_index=-1, run_start_date=2024-02-24 04:42:01.552324+00:00, run_end_date=2024-02-24 04:42:02.212213+00:00, run_duration=0.659889, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1373, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:42:00.399093+00:00, queued_by_job_id=2, pid=19967 2024-02-24T04:42:04.334895487Z [2024-02-24T04:42:04.333+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:42:04.335986734Z [2024-02-24T04:42:04.335+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:41:00+00:00, run_id=scheduled__2024-02-24T04:41:00+00:00, run_start_date=2024-02-24 04:42:00.319852+00:00, run_end_date=2024-02-24 04:42:04.335099+00:00, run_duration=4.015247, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:41:00+00:00, data_interval_end=2024-02-24 04:42:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:42:04.359379733Z [2024-02-24T04:42:04.358+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:42:00+00:00, run_after=2024-02-24T04:43:00+00:00 2024-02-24T04:42:04.418366674Z [2024-02-24T04:42:04.417+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:41:00+00:00 exited with status success for try_number 1 2024-02-24T04:42:04.425478747Z [2024-02-24T04:42:04.424+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:41:00+00:00, map_index=-1, run_start_date=2024-02-24 04:42:02.852870+00:00, run_end_date=2024-02-24 04:42:04.192949+00:00, run_duration=1.340079, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1375, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:42:00.399093+00:00, queued_by_job_id=2, pid=19991 2024-02-24T04:42:05.481812012Z [2024-02-24T04:42:05.481+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:42:05.482263840Z [2024-02-24T04:42:05.481+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:41:00+00:00, run_id=scheduled__2024-02-24T04:41:00+00:00, run_start_date=2024-02-24 04:42:00.320976+00:00, run_end_date=2024-02-24 04:42:05.481741+00:00, run_duration=5.160765, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:41:00+00:00, data_interval_end=2024-02-24 04:42:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:42:05.493665856Z [2024-02-24T04:42:05.493+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:42:00+00:00, run_after=2024-02-24T04:43:00+00:00 2024-02-24T04:42:05.527256560Z [2024-02-24T04:42:05.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:41:00+00:00 exited with status success for try_number 1 2024-02-24T04:42:05.535035721Z [2024-02-24T04:42:05.534+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:41:00+00:00, map_index=-1, run_start_date=2024-02-24 04:42:03.050479+00:00, run_end_date=2024-02-24 04:42:05.024299+00:00, run_duration=1.97382, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1376, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:42:00.399093+00:00, queued_by_job_id=2, pid=19992 2024-02-24T04:42:06.626585834Z [2024-02-24T04:42:06.626+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T04:43:00.267329867Z [2024-02-24T04:43:00.266+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:43:00.294413907Z [2024-02-24T04:43:00.293+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:43:00+00:00, run_after=2024-02-24T04:44:00+00:00 2024-02-24T04:43:00.321576819Z [2024-02-24T04:43:00.320+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:43:00+00:00, run_after=2024-02-24T04:44:00+00:00 2024-02-24T04:43:00.407807845Z [2024-02-24T04:43:00.407+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T04:43:00.407840726Z 2024-02-24T04:43:00.407846037Z 2024-02-24T04:43:00.407851294Z 2024-02-24T04:43:00.408140175Z [2024-02-24T04:43:00.407+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:43:00.408446665Z [2024-02-24T04:43:00.408+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:43:00.408720765Z [2024-02-24T04:43:00.408+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:43:00.409678461Z [2024-02-24T04:43:00.409+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:43:00.409717639Z 2024-02-24T04:43:00.409743731Z 2024-02-24T04:43:00.409748503Z 2024-02-24T04:43:00.414614300Z [2024-02-24T04:43:00.414+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:43:00.414976297Z [2024-02-24T04:43:00.414+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:43:00.419169193Z [2024-02-24T04:43:00.418+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:43:00.419306227Z [2024-02-24T04:43:00.419+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:43:00.419837362Z [2024-02-24T04:43:00.419+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:43:00.420158768Z [2024-02-24T04:43:00.419+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:43:00.664968533Z [2024-02-24T04:43:00.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:42:00+00:00 exited with status queued for try_number 1 2024-02-24T04:43:00.665141422Z [2024-02-24T04:43:00.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:42:00+00:00 exited with status queued for try_number 1 2024-02-24T04:43:00.665296633Z [2024-02-24T04:43:00.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:42:00+00:00 exited with status queued for try_number 1 2024-02-24T04:43:00.675289823Z [2024-02-24T04:43:00.674+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9489ef26-9371-49fe-aebf-4f2c1e52b70a 2024-02-24T04:43:00.675511008Z [2024-02-24T04:43:00.675+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d8a83b0-4d5e-4724-b7f2-28695b2b4178 2024-02-24T04:43:00.675717465Z [2024-02-24T04:43:00.675+0000] {scheduler_job.py:635} INFO - Setting external_id for to 70e62ba3-054e-4f15-9ab1-001a8e0985ca 2024-02-24T04:43:01.833497323Z [2024-02-24T04:43:01.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:42:00+00:00 exited with status success for try_number 1 2024-02-24T04:43:01.841508123Z [2024-02-24T04:43:01.841+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:42:00+00:00, map_index=-1, run_start_date=2024-02-24 04:43:01.220816+00:00, run_end_date=2024-02-24 04:43:01.663490+00:00, run_duration=0.442674, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1377, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:43:00.410793+00:00, queued_by_job_id=2, pid=20025 2024-02-24T04:43:02.941852915Z [2024-02-24T04:43:02.941+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:43:02.942393294Z [2024-02-24T04:43:02.942+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:42:00+00:00, run_id=scheduled__2024-02-24T04:42:00+00:00, run_start_date=2024-02-24 04:43:00.342131+00:00, run_end_date=2024-02-24 04:43:02.941768+00:00, run_duration=2.599637, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:42:00+00:00, data_interval_end=2024-02-24 04:43:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:43:02.955418729Z [2024-02-24T04:43:02.955+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:43:00+00:00, run_after=2024-02-24T04:44:00+00:00 2024-02-24T04:43:04.582670113Z [2024-02-24T04:43:04.582+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:43:04.582949586Z [2024-02-24T04:43:04.582+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:42:00+00:00, run_id=scheduled__2024-02-24T04:42:00+00:00, run_start_date=2024-02-24 04:43:00.344252+00:00, run_end_date=2024-02-24 04:43:04.582580+00:00, run_duration=4.238328, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:42:00+00:00, data_interval_end=2024-02-24 04:43:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:43:04.592009575Z [2024-02-24T04:43:04.591+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:43:00+00:00, run_after=2024-02-24T04:44:00+00:00 2024-02-24T04:43:04.598949681Z [2024-02-24T04:43:04.598+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:43:04.599100914Z [2024-02-24T04:43:04.598+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:42:00+00:00, run_id=scheduled__2024-02-24T04:42:00+00:00, run_start_date=2024-02-24 04:43:00.346239+00:00, run_end_date=2024-02-24 04:43:04.598636+00:00, run_duration=4.252397, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:42:00+00:00, data_interval_end=2024-02-24 04:43:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:43:04.608313950Z [2024-02-24T04:43:04.607+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:43:00+00:00, run_after=2024-02-24T04:44:00+00:00 2024-02-24T04:43:04.648285639Z [2024-02-24T04:43:04.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:42:00+00:00 exited with status success for try_number 1 2024-02-24T04:43:04.648327489Z [2024-02-24T04:43:04.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:42:00+00:00 exited with status success for try_number 1 2024-02-24T04:43:04.655676660Z [2024-02-24T04:43:04.655+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:42:00+00:00, map_index=-1, run_start_date=2024-02-24 04:43:02.402334+00:00, run_end_date=2024-02-24 04:43:04.030465+00:00, run_duration=1.628131, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1379, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:43:00.410793+00:00, queued_by_job_id=2, pid=20044 2024-02-24T04:43:04.655851368Z [2024-02-24T04:43:04.655+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:42:00+00:00, map_index=-1, run_start_date=2024-02-24 04:43:02.376360+00:00, run_end_date=2024-02-24 04:43:04.412411+00:00, run_duration=2.036051, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1378, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:43:00.410793+00:00, queued_by_job_id=2, pid=20043 2024-02-24T04:43:38.574648903Z [2024-02-24T04:43:38.574+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:43:38.574776106Z 2024-02-24T04:43:38.574796481Z [2024-02-24T04:43:38.574+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-02-24T04:43:38.575596807Z [2024-02-24T04:43:38.575+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:43:38.575638266Z 2024-02-24T04:43:38.583895204Z [2024-02-24T04:43:38.582+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240224044337_299070', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:43:38.585389917Z [2024-02-24T04:43:38.583+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240224044337_299070', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-02-24T04:43:38.642882358Z [2024-02-24T04:43:38.642+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240224044337_299070 exited with status queued for try_number 1 2024-02-24T04:43:38.649402769Z [2024-02-24T04:43:38.649+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc5cd5b8-ebcb-425c-a953-fb7dea83786b 2024-02-24T04:43:40.912106650Z [2024-02-24T04:43:40.911+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:43:40.912757426Z [2024-02-24T04:43:40.912+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-02-24 04:43:37.953474+00:00, run_id=vdu_down_20240224044337_299070, run_start_date=2024-02-24 04:43:38.523411+00:00, run_end_date=2024-02-24 04:43:40.912443+00:00, run_duration=2.389032, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-02-24 04:43:37.953474+00:00, data_interval_end=2024-02-24 04:43:37.953474+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-02-24T04:43:40.915762385Z [2024-02-24T04:43:40.915+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-02-24T04:43:40.955061493Z [2024-02-24T04:43:40.954+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240224044337_299070 exited with status success for try_number 1 2024-02-24T04:43:40.963232992Z [2024-02-24T04:43:40.962+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240224044337_299070, map_index=-1, run_start_date=2024-02-24 04:43:39.266395+00:00, run_end_date=2024-02-24 04:43:39.802044+00:00, run_duration=0.535649, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1380, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:43:38.576169+00:00, queued_by_job_id=2, pid=20056 2024-02-24T04:44:01.014108663Z [2024-02-24T04:44:01.013+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:44:00+00:00, run_after=2024-02-24T04:45:00+00:00 2024-02-24T04:44:01.023599152Z [2024-02-24T04:44:01.023+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:44:01.043998146Z [2024-02-24T04:44:01.043+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:44:00+00:00, run_after=2024-02-24T04:45:00+00:00 2024-02-24T04:44:01.060198771Z [2024-02-24T04:44:01.059+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:44:01.154327642Z [2024-02-24T04:44:01.153+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T04:44:01.154356480Z 2024-02-24T04:44:01.154364625Z 2024-02-24T04:44:01.154369097Z 2024-02-24T04:44:01.154373549Z 2024-02-24T04:44:01.154605106Z [2024-02-24T04:44:01.154+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T04:44:01.154824621Z [2024-02-24T04:44:01.154+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:44:01.155041002Z [2024-02-24T04:44:01.154+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:44:01.155220004Z [2024-02-24T04:44:01.155+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:44:01.156603016Z [2024-02-24T04:44:01.156+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:44:01.156615471Z 2024-02-24T04:44:01.156619439Z 2024-02-24T04:44:01.156622552Z 2024-02-24T04:44:01.156625705Z 2024-02-24T04:44:01.163717095Z [2024-02-24T04:44:01.163+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T04:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:44:01.163835581Z [2024-02-24T04:44:01.163+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T04:44:01.164117890Z [2024-02-24T04:44:01.163+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:44:01.164213216Z [2024-02-24T04:44:01.164+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:44:01.164600695Z [2024-02-24T04:44:01.164+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:44:01.164737258Z [2024-02-24T04:44:01.164+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:44:01.165017739Z [2024-02-24T04:44:01.164+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:44:01.165174734Z [2024-02-24T04:44:01.164+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:44:01.502580569Z [2024-02-24T04:44:01.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:42:00+00:00 exited with status queued for try_number 1 2024-02-24T04:44:01.502916414Z [2024-02-24T04:44:01.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:43:00+00:00 exited with status queued for try_number 1 2024-02-24T04:44:01.503219700Z [2024-02-24T04:44:01.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:43:00+00:00 exited with status queued for try_number 1 2024-02-24T04:44:01.503439262Z [2024-02-24T04:44:01.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:43:00+00:00 exited with status queued for try_number 1 2024-02-24T04:44:01.525087085Z [2024-02-24T04:44:01.523+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6553dfea-7f6f-4484-989c-77ef51cb4d69 2024-02-24T04:44:01.525549918Z [2024-02-24T04:44:01.525+0000] {scheduler_job.py:635} INFO - Setting external_id for to 32dcbe46-07a0-47cc-82df-495ed2824f0a 2024-02-24T04:44:01.530435903Z [2024-02-24T04:44:01.530+0000] {scheduler_job.py:635} INFO - Setting external_id for to b5d93906-e736-4e55-ace7-1ac0f619d9c4 2024-02-24T04:44:01.530772797Z [2024-02-24T04:44:01.530+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4eef77d0-943a-455c-8b2d-bd20fa49764b 2024-02-24T04:44:02.843888533Z [2024-02-24T04:44:02.843+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:44:02.844474276Z [2024-02-24T04:44:02.844+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 04:42:00+00:00, run_id=scheduled__2024-02-24T04:42:00+00:00, run_start_date=2024-02-24 04:44:01.078166+00:00, run_end_date=2024-02-24 04:44:02.843891+00:00, run_duration=1.765725, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:42:00+00:00, data_interval_end=2024-02-24 04:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T04:44:02.862789960Z [2024-02-24T04:44:02.862+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T04:44:00+00:00, run_after=2024-02-24T04:46:00+00:00 2024-02-24T04:44:02.874793667Z [2024-02-24T04:44:02.874+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:44:02.875245564Z [2024-02-24T04:44:02.874+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:43:00+00:00, run_id=scheduled__2024-02-24T04:43:00+00:00, run_start_date=2024-02-24 04:44:01.080052+00:00, run_end_date=2024-02-24 04:44:02.874744+00:00, run_duration=1.794692, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:43:00+00:00, data_interval_end=2024-02-24 04:44:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:44:02.894563521Z [2024-02-24T04:44:02.894+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:44:00+00:00, run_after=2024-02-24T04:45:00+00:00 2024-02-24T04:44:02.959123001Z [2024-02-24T04:44:02.958+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:42:00+00:00 exited with status success for try_number 1 2024-02-24T04:44:02.959426101Z [2024-02-24T04:44:02.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:43:00+00:00 exited with status success for try_number 1 2024-02-24T04:44:02.969136959Z [2024-02-24T04:44:02.968+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T04:42:00+00:00, map_index=-1, run_start_date=2024-02-24 04:44:01.971086+00:00, run_end_date=2024-02-24 04:44:02.322598+00:00, run_duration=0.351512, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1381, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:44:01.159013+00:00, queued_by_job_id=2, pid=20109 2024-02-24T04:44:02.969556585Z [2024-02-24T04:44:02.969+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:43:00+00:00, map_index=-1, run_start_date=2024-02-24 04:44:02.158790+00:00, run_end_date=2024-02-24 04:44:02.570657+00:00, run_duration=0.411867, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1382, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:44:01.159013+00:00, queued_by_job_id=2, pid=20110 2024-02-24T04:44:04.858590835Z [2024-02-24T04:44:04.858+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:44:04.859067349Z [2024-02-24T04:44:04.858+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:43:00+00:00, run_id=scheduled__2024-02-24T04:43:00+00:00, run_start_date=2024-02-24 04:44:01.081939+00:00, run_end_date=2024-02-24 04:44:04.858716+00:00, run_duration=3.776777, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:43:00+00:00, data_interval_end=2024-02-24 04:44:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:44:04.870796148Z [2024-02-24T04:44:04.870+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:44:00+00:00, run_after=2024-02-24T04:45:00+00:00 2024-02-24T04:44:04.921684475Z [2024-02-24T04:44:04.921+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:43:00+00:00 exited with status success for try_number 1 2024-02-24T04:44:04.928329727Z [2024-02-24T04:44:04.927+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:43:00+00:00, map_index=-1, run_start_date=2024-02-24 04:44:03.209344+00:00, run_end_date=2024-02-24 04:44:04.623322+00:00, run_duration=1.413978, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1383, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:44:01.159013+00:00, queued_by_job_id=2, pid=20133 2024-02-24T04:44:07.048177522Z [2024-02-24T04:44:07.047+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:44:07.048630329Z [2024-02-24T04:44:07.048+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:43:00+00:00, run_id=scheduled__2024-02-24T04:43:00+00:00, run_start_date=2024-02-24 04:44:01.083475+00:00, run_end_date=2024-02-24 04:44:07.048296+00:00, run_duration=5.964821, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:43:00+00:00, data_interval_end=2024-02-24 04:44:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:44:07.057144488Z [2024-02-24T04:44:07.056+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:44:00+00:00, run_after=2024-02-24T04:45:00+00:00 2024-02-24T04:44:07.090320737Z [2024-02-24T04:44:07.090+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:43:00+00:00 exited with status success for try_number 1 2024-02-24T04:44:07.095644965Z [2024-02-24T04:44:07.095+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:43:00+00:00, map_index=-1, run_start_date=2024-02-24 04:44:03.305836+00:00, run_end_date=2024-02-24 04:44:06.662025+00:00, run_duration=3.356189, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1384, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:44:01.159013+00:00, queued_by_job_id=2, pid=20134 2024-02-24T04:45:00.916157522Z [2024-02-24T04:45:00.915+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:45:00+00:00, run_after=2024-02-24T04:46:00+00:00 2024-02-24T04:45:00.933884360Z [2024-02-24T04:45:00.933+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:45:00+00:00, run_after=2024-02-24T04:50:00+00:00 2024-02-24T04:45:00.944453781Z [2024-02-24T04:45:00.944+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:45:00.959324326Z [2024-02-24T04:45:00.958+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:45:00+00:00, run_after=2024-02-24T04:46:00+00:00 2024-02-24T04:45:01.079219567Z [2024-02-24T04:45:01.078+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T04:45:01.079250648Z 2024-02-24T04:45:01.079261173Z 2024-02-24T04:45:01.079266795Z 2024-02-24T04:45:01.079273556Z 2024-02-24T04:45:01.079289560Z [2024-02-24T04:45:01.079+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:45:01.079384561Z [2024-02-24T04:45:01.079+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:45:01.079490148Z [2024-02-24T04:45:01.079+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:45:01.079567094Z [2024-02-24T04:45:01.079+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:45:01.080360069Z [2024-02-24T04:45:01.080+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:45:01.080375290Z 2024-02-24T04:45:01.080379667Z 2024-02-24T04:45:01.080383533Z 2024-02-24T04:45:01.080387256Z 2024-02-24T04:45:01.085968763Z [2024-02-24T04:45:01.085+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T04:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T04:45:01.086063743Z [2024-02-24T04:45:01.085+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T04:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T04:45:01.086289300Z [2024-02-24T04:45:01.086+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:45:01.086346381Z [2024-02-24T04:45:01.086+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:45:01.086533966Z [2024-02-24T04:45:01.086+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:45:01.086586735Z [2024-02-24T04:45:01.086+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:45:01.086944981Z [2024-02-24T04:45:01.086+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:45:01.086975581Z [2024-02-24T04:45:01.086+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:45:01.467051832Z [2024-02-24T04:45:01.466+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T04:40:00+00:00 exited with status queued for try_number 1 2024-02-24T04:45:01.467091470Z [2024-02-24T04:45:01.466+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:44:00+00:00 exited with status queued for try_number 1 2024-02-24T04:45:01.467313750Z [2024-02-24T04:45:01.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:44:00+00:00 exited with status queued for try_number 1 2024-02-24T04:45:01.467417260Z [2024-02-24T04:45:01.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:44:00+00:00 exited with status queued for try_number 1 2024-02-24T04:45:01.487247081Z [2024-02-24T04:45:01.486+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9dea38d0-f01b-4022-9113-5f9f07cbbd33 2024-02-24T04:45:01.487486108Z [2024-02-24T04:45:01.487+0000] {scheduler_job.py:635} INFO - Setting external_id for to b2d2e356-f667-4a71-9194-1f09331b256a 2024-02-24T04:45:01.487708210Z [2024-02-24T04:45:01.487+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d37d55d-565b-4d8c-9fcd-8272c13bb8bd 2024-02-24T04:45:01.487945151Z [2024-02-24T04:45:01.487+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9bcf6821-e032-42c2-a77d-651013ad26a6 2024-02-24T04:45:02.914024120Z [2024-02-24T04:45:02.913+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:45:02.914773213Z [2024-02-24T04:45:02.914+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:44:00+00:00, run_id=scheduled__2024-02-24T04:44:00+00:00, run_start_date=2024-02-24 04:45:00.972553+00:00, run_end_date=2024-02-24 04:45:02.914209+00:00, run_duration=1.941656, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:44:00+00:00, data_interval_end=2024-02-24 04:45:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:45:02.927571715Z [2024-02-24T04:45:02.927+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:45:00+00:00, run_after=2024-02-24T04:46:00+00:00 2024-02-24T04:45:02.978242721Z [2024-02-24T04:45:02.977+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:44:00+00:00 exited with status success for try_number 1 2024-02-24T04:45:02.986268523Z [2024-02-24T04:45:02.985+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:44:00+00:00, map_index=-1, run_start_date=2024-02-24 04:45:02.146811+00:00, run_end_date=2024-02-24 04:45:02.564311+00:00, run_duration=0.4175, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1385, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:45:01.081462+00:00, queued_by_job_id=2, pid=20167 2024-02-24T04:45:04.093018713Z [2024-02-24T04:45:04.092+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:45:04.093051360Z 2024-02-24T04:45:04.093508323Z [2024-02-24T04:45:04.093+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:45:04.094468730Z [2024-02-24T04:45:04.094+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:45:04.094483601Z 2024-02-24T04:45:04.098020591Z [2024-02-24T04:45:04.097+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T04:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T04:45:04.098185613Z [2024-02-24T04:45:04.097+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T04:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T04:45:04.152477374Z [2024-02-24T04:45:04.151+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T04:40:00+00:00 exited with status queued for try_number 1 2024-02-24T04:45:04.152933319Z [2024-02-24T04:45:04.152+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T04:40:00+00:00 exited with status success for try_number 1 2024-02-24T04:45:04.166905713Z [2024-02-24T04:45:04.166+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c2d33e2-dcb6-4a68-bac5-d0ebaa3acc38 2024-02-24T04:45:04.167329475Z [2024-02-24T04:45:04.167+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T04:40:00+00:00, map_index=-1, run_start_date=2024-02-24 04:45:03.504754+00:00, run_end_date=2024-02-24 04:45:04.004105+00:00, run_duration=0.499351, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1388, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:45:01.081462+00:00, queued_by_job_id=2, pid=20193 2024-02-24T04:45:05.344200634Z [2024-02-24T04:45:05.343+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:45:05.344653681Z [2024-02-24T04:45:05.344+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:44:00+00:00, run_id=scheduled__2024-02-24T04:44:00+00:00, run_start_date=2024-02-24 04:45:00.973648+00:00, run_end_date=2024-02-24 04:45:05.344334+00:00, run_duration=4.370686, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:44:00+00:00, data_interval_end=2024-02-24 04:45:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:45:05.358125900Z [2024-02-24T04:45:05.357+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:45:00+00:00, run_after=2024-02-24T04:46:00+00:00 2024-02-24T04:45:05.416181104Z [2024-02-24T04:45:05.415+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:44:00+00:00 exited with status success for try_number 1 2024-02-24T04:45:05.423177970Z [2024-02-24T04:45:05.422+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:44:00+00:00, map_index=-1, run_start_date=2024-02-24 04:45:03.241674+00:00, run_end_date=2024-02-24 04:45:05.252171+00:00, run_duration=2.010497, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1386, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:45:01.081462+00:00, queued_by_job_id=2, pid=20188 2024-02-24T04:45:06.480823953Z [2024-02-24T04:45:06.480+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:45:06.481432248Z [2024-02-24T04:45:06.481+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:44:00+00:00, run_id=scheduled__2024-02-24T04:44:00+00:00, run_start_date=2024-02-24 04:45:00.974830+00:00, run_end_date=2024-02-24 04:45:06.480962+00:00, run_duration=5.506132, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:44:00+00:00, data_interval_end=2024-02-24 04:45:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:45:06.496725087Z [2024-02-24T04:45:06.496+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:45:00+00:00, run_after=2024-02-24T04:46:00+00:00 2024-02-24T04:45:06.570301582Z [2024-02-24T04:45:06.569+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:45:06.570329159Z 2024-02-24T04:45:06.570453076Z [2024-02-24T04:45:06.570+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:45:06.571328991Z [2024-02-24T04:45:06.570+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:45:06.571375225Z 2024-02-24T04:45:06.574693340Z [2024-02-24T04:45:06.574+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T04:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T04:45:06.574774181Z [2024-02-24T04:45:06.574+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T04:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T04:45:06.654115842Z [2024-02-24T04:45:06.653+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T04:40:00+00:00 exited with status queued for try_number 1 2024-02-24T04:45:06.654241892Z [2024-02-24T04:45:06.654+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:44:00+00:00 exited with status success for try_number 1 2024-02-24T04:45:06.654312136Z [2024-02-24T04:45:06.654+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T04:40:00+00:00 exited with status success for try_number 1 2024-02-24T04:45:06.662855575Z [2024-02-24T04:45:06.662+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T04:40:00+00:00, map_index=-1, run_start_date=2024-02-24 04:45:05.731218+00:00, run_end_date=2024-02-24 04:45:06.107996+00:00, run_duration=0.376778, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1389, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:45:04.094984+00:00, queued_by_job_id=2, pid=20216 2024-02-24T04:45:06.663103693Z [2024-02-24T04:45:06.662+0000] {scheduler_job.py:635} INFO - Setting external_id for to bfbfb918-c0ab-494e-865f-9bc140a5fafa 2024-02-24T04:45:06.663254858Z [2024-02-24T04:45:06.663+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:44:00+00:00, map_index=-1, run_start_date=2024-02-24 04:45:03.411355+00:00, run_end_date=2024-02-24 04:45:05.511999+00:00, run_duration=2.100644, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1387, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:45:01.081462+00:00, queued_by_job_id=2, pid=20192 2024-02-24T04:45:09.041761990Z [2024-02-24T04:45:09.041+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:45:09.041831914Z 2024-02-24T04:45:09.042161067Z [2024-02-24T04:45:09.041+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:45:09.043120971Z [2024-02-24T04:45:09.042+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:45:09.043134273Z 2024-02-24T04:45:09.046088104Z [2024-02-24T04:45:09.045+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T04:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:45:09.046379401Z [2024-02-24T04:45:09.046+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T04:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T04:45:09.101553806Z [2024-02-24T04:45:09.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T04:40:00+00:00 exited with status queued for try_number 1 2024-02-24T04:45:09.102088294Z [2024-02-24T04:45:09.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T04:40:00+00:00 exited with status success for try_number 1 2024-02-24T04:45:09.113712755Z [2024-02-24T04:45:09.113+0000] {scheduler_job.py:635} INFO - Setting external_id for to 566e5af3-981c-4678-8549-94d0db46c294 2024-02-24T04:45:09.114075614Z [2024-02-24T04:45:09.113+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T04:40:00+00:00, map_index=0, run_start_date=2024-02-24 04:45:08.270462+00:00, run_end_date=2024-02-24 04:45:08.591351+00:00, run_duration=0.320889, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1390, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:45:06.572002+00:00, queued_by_job_id=2, pid=20224 2024-02-24T04:45:11.326522689Z [2024-02-24T04:45:11.326+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:45:11.327139174Z [2024-02-24T04:45:11.326+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:40:00+00:00, run_id=scheduled__2024-02-24T04:40:00+00:00, run_start_date=2024-02-24 04:45:00.971270+00:00, run_end_date=2024-02-24 04:45:11.326438+00:00, run_duration=10.355168, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:40:00+00:00, data_interval_end=2024-02-24 04:45:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T04:45:11.335464210Z [2024-02-24T04:45:11.335+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:45:00+00:00, run_after=2024-02-24T04:50:00+00:00 2024-02-24T04:45:11.366819443Z [2024-02-24T04:45:11.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T04:40:00+00:00 exited with status success for try_number 1 2024-02-24T04:45:11.376866328Z [2024-02-24T04:45:11.376+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T04:40:00+00:00, map_index=-1, run_start_date=2024-02-24 04:45:10.742439+00:00, run_end_date=2024-02-24 04:45:11.053970+00:00, run_duration=0.311531, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1391, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:45:09.043692+00:00, queued_by_job_id=2, pid=20232 2024-02-24T04:46:00.758525441Z [2024-02-24T04:46:00.758+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:46:00+00:00, run_after=2024-02-24T04:47:00+00:00 2024-02-24T04:46:00.773266124Z [2024-02-24T04:46:00.772+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:46:00+00:00, run_after=2024-02-24T04:47:00+00:00 2024-02-24T04:46:00.781140305Z [2024-02-24T04:46:00.780+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:46:00.788698368Z [2024-02-24T04:46:00.788+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:46:00.887298718Z [2024-02-24T04:46:00.886+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T04:46:00.887326782Z 2024-02-24T04:46:00.887332458Z 2024-02-24T04:46:00.887336801Z 2024-02-24T04:46:00.887341045Z 2024-02-24T04:46:00.887570732Z [2024-02-24T04:46:00.887+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T04:46:00.887749677Z [2024-02-24T04:46:00.887+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:46:00.887869852Z [2024-02-24T04:46:00.887+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:46:00.888083750Z [2024-02-24T04:46:00.887+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:46:00.888926772Z [2024-02-24T04:46:00.888+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:46:00.888939833Z 2024-02-24T04:46:00.888944100Z 2024-02-24T04:46:00.888947345Z 2024-02-24T04:46:00.888950553Z 2024-02-24T04:46:00.892307906Z [2024-02-24T04:46:00.892+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T04:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:46:00.892524890Z [2024-02-24T04:46:00.892+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T04:46:00.892974038Z [2024-02-24T04:46:00.892+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:46:00.892990606Z [2024-02-24T04:46:00.892+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:46:00.893138764Z [2024-02-24T04:46:00.892+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:46:00.893235096Z [2024-02-24T04:46:00.893+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:46:00.893514197Z [2024-02-24T04:46:00.893+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:46:00.893697475Z [2024-02-24T04:46:00.893+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:46:01.337883766Z [2024-02-24T04:46:01.333+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:44:00+00:00 exited with status queued for try_number 1 2024-02-24T04:46:01.337912424Z [2024-02-24T04:46:01.334+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:45:00+00:00 exited with status queued for try_number 1 2024-02-24T04:46:01.337916391Z [2024-02-24T04:46:01.334+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:45:00+00:00 exited with status queued for try_number 1 2024-02-24T04:46:01.337919714Z [2024-02-24T04:46:01.334+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:45:00+00:00 exited with status queued for try_number 1 2024-02-24T04:46:01.346160189Z [2024-02-24T04:46:01.344+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4619ccee-0e71-4960-b636-e25d665e5fba 2024-02-24T04:46:01.346188164Z [2024-02-24T04:46:01.345+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8ea7667-bd97-4eac-9e7b-033cfb88cfa6 2024-02-24T04:46:01.346191913Z [2024-02-24T04:46:01.345+0000] {scheduler_job.py:635} INFO - Setting external_id for to be7bee03-c63e-4bc5-a9c2-48a745392516 2024-02-24T04:46:01.346195504Z [2024-02-24T04:46:01.345+0000] {scheduler_job.py:635} INFO - Setting external_id for to 95c47671-732b-454c-b4e4-a2e9527c2a88 2024-02-24T04:46:02.661019011Z [2024-02-24T04:46:02.653+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:46:02.661047156Z [2024-02-24T04:46:02.654+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 04:44:00+00:00, run_id=scheduled__2024-02-24T04:44:00+00:00, run_start_date=2024-02-24 04:46:00.804604+00:00, run_end_date=2024-02-24 04:46:02.654262+00:00, run_duration=1.849658, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:44:00+00:00, data_interval_end=2024-02-24 04:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T04:46:02.676756309Z [2024-02-24T04:46:02.670+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T04:46:00+00:00, run_after=2024-02-24T04:48:00+00:00 2024-02-24T04:46:02.701937693Z [2024-02-24T04:46:02.681+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:46:02.701963877Z [2024-02-24T04:46:02.681+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:45:00+00:00, run_id=scheduled__2024-02-24T04:45:00+00:00, run_start_date=2024-02-24 04:46:00.806565+00:00, run_end_date=2024-02-24 04:46:02.681886+00:00, run_duration=1.875321, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:45:00+00:00, data_interval_end=2024-02-24 04:46:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:46:02.701969817Z [2024-02-24T04:46:02.693+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:46:00+00:00, run_after=2024-02-24T04:47:00+00:00 2024-02-24T04:46:02.762878126Z [2024-02-24T04:46:02.762+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:44:00+00:00 exited with status success for try_number 1 2024-02-24T04:46:02.763303042Z [2024-02-24T04:46:02.762+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:45:00+00:00 exited with status success for try_number 1 2024-02-24T04:46:02.771751539Z [2024-02-24T04:46:02.771+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T04:44:00+00:00, map_index=-1, run_start_date=2024-02-24 04:46:01.837182+00:00, run_end_date=2024-02-24 04:46:02.212282+00:00, run_duration=0.3751, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1392, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:46:00.889860+00:00, queued_by_job_id=2, pid=20255 2024-02-24T04:46:02.772008354Z [2024-02-24T04:46:02.771+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:45:00+00:00, map_index=-1, run_start_date=2024-02-24 04:46:01.896177+00:00, run_end_date=2024-02-24 04:46:02.332532+00:00, run_duration=0.436355, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1393, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:46:00.889860+00:00, queued_by_job_id=2, pid=20256 2024-02-24T04:46:06.918160296Z [2024-02-24T04:46:06.917+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:46:06.918633955Z [2024-02-24T04:46:06.918+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:45:00+00:00, run_id=scheduled__2024-02-24T04:45:00+00:00, run_start_date=2024-02-24 04:46:00.808240+00:00, run_end_date=2024-02-24 04:46:06.918046+00:00, run_duration=6.109806, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:45:00+00:00, data_interval_end=2024-02-24 04:46:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:46:06.935842323Z [2024-02-24T04:46:06.935+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:46:00+00:00, run_after=2024-02-24T04:47:00+00:00 2024-02-24T04:46:06.942467135Z [2024-02-24T04:46:06.942+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:46:06.942911748Z [2024-02-24T04:46:06.942+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:45:00+00:00, run_id=scheduled__2024-02-24T04:45:00+00:00, run_start_date=2024-02-24 04:46:00.809856+00:00, run_end_date=2024-02-24 04:46:06.942370+00:00, run_duration=6.132514, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:45:00+00:00, data_interval_end=2024-02-24 04:46:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:46:06.952550465Z [2024-02-24T04:46:06.952+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:46:00+00:00, run_after=2024-02-24T04:47:00+00:00 2024-02-24T04:46:06.980948706Z [2024-02-24T04:46:06.980+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:45:00+00:00 exited with status success for try_number 1 2024-02-24T04:46:06.991445933Z [2024-02-24T04:46:06.990+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:45:00+00:00, map_index=-1, run_start_date=2024-02-24 04:46:03.060224+00:00, run_end_date=2024-02-24 04:46:06.167885+00:00, run_duration=3.107661, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1394, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:46:00.889860+00:00, queued_by_job_id=2, pid=20279 2024-02-24T04:46:08.106398818Z [2024-02-24T04:46:08.106+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:45:00+00:00 exited with status success for try_number 1 2024-02-24T04:46:08.116016244Z [2024-02-24T04:46:08.115+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:45:00+00:00, map_index=-1, run_start_date=2024-02-24 04:46:03.128723+00:00, run_end_date=2024-02-24 04:46:06.856533+00:00, run_duration=3.72781, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1395, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:46:00.889860+00:00, queued_by_job_id=2, pid=20280 2024-02-24T04:47:00.511802949Z [2024-02-24T04:47:00.511+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:47:00+00:00, run_after=2024-02-24T04:48:00+00:00 2024-02-24T04:47:00.527501623Z [2024-02-24T04:47:00.527+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:47:00+00:00, run_after=2024-02-24T04:48:00+00:00 2024-02-24T04:47:00.540685047Z [2024-02-24T04:47:00.540+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:47:00.634710858Z [2024-02-24T04:47:00.634+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T04:47:00.634753268Z 2024-02-24T04:47:00.634757199Z 2024-02-24T04:47:00.634760399Z 2024-02-24T04:47:00.634842157Z [2024-02-24T04:47:00.634+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:47:00.635010448Z [2024-02-24T04:47:00.634+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:47:00.635116500Z [2024-02-24T04:47:00.634+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:47:00.635746702Z [2024-02-24T04:47:00.635+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:47:00.635757701Z 2024-02-24T04:47:00.635761141Z 2024-02-24T04:47:00.635764291Z 2024-02-24T04:47:00.639456763Z [2024-02-24T04:47:00.639+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:47:00.639732379Z [2024-02-24T04:47:00.639+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:47:00.640059366Z [2024-02-24T04:47:00.639+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:47:00.640344582Z [2024-02-24T04:47:00.640+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:47:00.640539850Z [2024-02-24T04:47:00.640+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:47:00.640734687Z [2024-02-24T04:47:00.640+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:47:00.914801539Z [2024-02-24T04:47:00.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:46:00+00:00 exited with status queued for try_number 1 2024-02-24T04:47:00.914845143Z [2024-02-24T04:47:00.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:46:00+00:00 exited with status queued for try_number 1 2024-02-24T04:47:00.915064417Z [2024-02-24T04:47:00.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:46:00+00:00 exited with status queued for try_number 1 2024-02-24T04:47:00.925669781Z [2024-02-24T04:47:00.925+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc763a29-8b09-4233-a950-2475bfbd327e 2024-02-24T04:47:00.925850916Z [2024-02-24T04:47:00.925+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6022f0d6-d307-4775-ab0e-de36a2d7d29f 2024-02-24T04:47:00.926121705Z [2024-02-24T04:47:00.925+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7dce95ad-ce33-4c91-8f40-d6d57543c8f9 2024-02-24T04:47:02.163298066Z [2024-02-24T04:47:02.162+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:47:02.163476186Z [2024-02-24T04:47:02.163+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:46:00+00:00, run_id=scheduled__2024-02-24T04:46:00+00:00, run_start_date=2024-02-24 04:47:00.557470+00:00, run_end_date=2024-02-24 04:47:02.163170+00:00, run_duration=1.6057, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:46:00+00:00, data_interval_end=2024-02-24 04:47:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:47:02.174053079Z [2024-02-24T04:47:02.173+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:47:00+00:00, run_after=2024-02-24T04:48:00+00:00 2024-02-24T04:47:02.226723947Z [2024-02-24T04:47:02.226+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:46:00+00:00 exited with status success for try_number 1 2024-02-24T04:47:02.235700865Z [2024-02-24T04:47:02.235+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:46:00+00:00, map_index=-1, run_start_date=2024-02-24 04:47:01.450681+00:00, run_end_date=2024-02-24 04:47:01.823667+00:00, run_duration=0.372986, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1396, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:47:00.636495+00:00, queued_by_job_id=2, pid=20312 2024-02-24T04:47:04.397343150Z [2024-02-24T04:47:04.396+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:47:04.397573580Z [2024-02-24T04:47:04.397+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:46:00+00:00, run_id=scheduled__2024-02-24T04:46:00+00:00, run_start_date=2024-02-24 04:47:00.559157+00:00, run_end_date=2024-02-24 04:47:04.397209+00:00, run_duration=3.838052, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:46:00+00:00, data_interval_end=2024-02-24 04:47:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:47:04.408163980Z [2024-02-24T04:47:04.407+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:47:00+00:00, run_after=2024-02-24T04:48:00+00:00 2024-02-24T04:47:04.419279019Z [2024-02-24T04:47:04.418+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:47:04.419882409Z [2024-02-24T04:47:04.419+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:46:00+00:00, run_id=scheduled__2024-02-24T04:46:00+00:00, run_start_date=2024-02-24 04:47:00.560522+00:00, run_end_date=2024-02-24 04:47:04.419377+00:00, run_duration=3.858855, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:46:00+00:00, data_interval_end=2024-02-24 04:47:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:47:04.432252315Z [2024-02-24T04:47:04.431+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:47:00+00:00, run_after=2024-02-24T04:48:00+00:00 2024-02-24T04:47:04.464560263Z [2024-02-24T04:47:04.464+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:46:00+00:00 exited with status success for try_number 1 2024-02-24T04:47:04.464758524Z [2024-02-24T04:47:04.464+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:46:00+00:00 exited with status success for try_number 1 2024-02-24T04:47:04.471102726Z [2024-02-24T04:47:04.470+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:46:00+00:00, map_index=-1, run_start_date=2024-02-24 04:47:02.532769+00:00, run_end_date=2024-02-24 04:47:03.932722+00:00, run_duration=1.399953, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1398, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:47:00.636495+00:00, queued_by_job_id=2, pid=20331 2024-02-24T04:47:04.471158564Z [2024-02-24T04:47:04.470+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:46:00+00:00, map_index=-1, run_start_date=2024-02-24 04:47:02.432855+00:00, run_end_date=2024-02-24 04:47:04.134519+00:00, run_duration=1.701664, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1397, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:47:00.636495+00:00, queued_by_job_id=2, pid=20330 2024-02-24T04:47:06.704920627Z [2024-02-24T04:47:06.704+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T04:48:01.082801360Z [2024-02-24T04:48:01.082+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:48:00+00:00, run_after=2024-02-24T04:49:00+00:00 2024-02-24T04:48:01.090083429Z [2024-02-24T04:48:01.089+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:48:01.096374654Z [2024-02-24T04:48:01.096+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:48:01.109136747Z [2024-02-24T04:48:01.108+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:48:00+00:00, run_after=2024-02-24T04:49:00+00:00 2024-02-24T04:48:01.184187762Z [2024-02-24T04:48:01.183+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T04:48:01.184223321Z 2024-02-24T04:48:01.184227853Z 2024-02-24T04:48:01.184231090Z 2024-02-24T04:48:01.184234285Z 2024-02-24T04:48:01.184692997Z [2024-02-24T04:48:01.184+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T04:48:01.185138804Z [2024-02-24T04:48:01.184+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:48:01.185489816Z [2024-02-24T04:48:01.185+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:48:01.185894105Z [2024-02-24T04:48:01.185+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:48:01.187220056Z [2024-02-24T04:48:01.186+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:48:01.187230744Z 2024-02-24T04:48:01.187234466Z 2024-02-24T04:48:01.187237782Z 2024-02-24T04:48:01.187240867Z 2024-02-24T04:48:01.193399452Z [2024-02-24T04:48:01.192+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T04:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:48:01.193733009Z [2024-02-24T04:48:01.193+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T04:48:01.194222872Z [2024-02-24T04:48:01.193+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:48:01.194509745Z [2024-02-24T04:48:01.194+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:48:01.195057387Z [2024-02-24T04:48:01.194+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:48:01.195277759Z [2024-02-24T04:48:01.195+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:48:01.195599813Z [2024-02-24T04:48:01.195+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:48:01.195826254Z [2024-02-24T04:48:01.195+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:48:01.726994587Z [2024-02-24T04:48:01.726+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:46:00+00:00 exited with status queued for try_number 1 2024-02-24T04:48:01.727288887Z [2024-02-24T04:48:01.726+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:47:00+00:00 exited with status queued for try_number 1 2024-02-24T04:48:01.727487417Z [2024-02-24T04:48:01.727+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:47:00+00:00 exited with status queued for try_number 1 2024-02-24T04:48:01.727959734Z [2024-02-24T04:48:01.727+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:47:00+00:00 exited with status queued for try_number 1 2024-02-24T04:48:01.739718642Z [2024-02-24T04:48:01.739+0000] {scheduler_job.py:635} INFO - Setting external_id for to adc5a242-bde1-4344-9747-1c672b7ccf17 2024-02-24T04:48:01.740107612Z [2024-02-24T04:48:01.739+0000] {scheduler_job.py:635} INFO - Setting external_id for to fdeb0b3d-1518-43a2-a87f-e3af20513263 2024-02-24T04:48:01.740311130Z [2024-02-24T04:48:01.740+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3fa10f7d-eb18-4954-893c-fb6ff84f5f34 2024-02-24T04:48:01.740503700Z [2024-02-24T04:48:01.740+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee3a7b68-af37-4429-94b6-248ba5ca9707 2024-02-24T04:48:02.993980818Z [2024-02-24T04:48:02.993+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:48:02.994439670Z [2024-02-24T04:48:02.994+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 04:46:00+00:00, run_id=scheduled__2024-02-24T04:46:00+00:00, run_start_date=2024-02-24 04:48:01.123234+00:00, run_end_date=2024-02-24 04:48:02.994051+00:00, run_duration=1.870817, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:46:00+00:00, data_interval_end=2024-02-24 04:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T04:48:03.002813288Z [2024-02-24T04:48:03.002+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T04:48:00+00:00, run_after=2024-02-24T04:50:00+00:00 2024-02-24T04:48:03.011066980Z [2024-02-24T04:48:03.010+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:48:03.011506594Z [2024-02-24T04:48:03.011+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:47:00+00:00, run_id=scheduled__2024-02-24T04:47:00+00:00, run_start_date=2024-02-24 04:48:01.124368+00:00, run_end_date=2024-02-24 04:48:03.010967+00:00, run_duration=1.886599, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:47:00+00:00, data_interval_end=2024-02-24 04:48:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:48:03.024906347Z [2024-02-24T04:48:03.024+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:48:00+00:00, run_after=2024-02-24T04:49:00+00:00 2024-02-24T04:48:03.110448505Z [2024-02-24T04:48:03.109+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:46:00+00:00 exited with status success for try_number 1 2024-02-24T04:48:03.110696874Z [2024-02-24T04:48:03.110+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:47:00+00:00 exited with status success for try_number 1 2024-02-24T04:48:03.123402979Z [2024-02-24T04:48:03.122+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T04:46:00+00:00, map_index=-1, run_start_date=2024-02-24 04:48:02.056509+00:00, run_end_date=2024-02-24 04:48:02.460424+00:00, run_duration=0.403915, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1399, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:48:01.189046+00:00, queued_by_job_id=2, pid=20364 2024-02-24T04:48:03.123891324Z [2024-02-24T04:48:03.123+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:47:00+00:00, map_index=-1, run_start_date=2024-02-24 04:48:02.111981+00:00, run_end_date=2024-02-24 04:48:02.487620+00:00, run_duration=0.375639, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1400, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:48:01.189046+00:00, queued_by_job_id=2, pid=20365 2024-02-24T04:48:04.862642286Z [2024-02-24T04:48:04.862+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:48:04.862858768Z [2024-02-24T04:48:04.862+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:47:00+00:00, run_id=scheduled__2024-02-24T04:47:00+00:00, run_start_date=2024-02-24 04:48:01.125389+00:00, run_end_date=2024-02-24 04:48:04.862487+00:00, run_duration=3.737098, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:47:00+00:00, data_interval_end=2024-02-24 04:48:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:48:04.872192126Z [2024-02-24T04:48:04.871+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:48:00+00:00, run_after=2024-02-24T04:49:00+00:00 2024-02-24T04:48:05.963512330Z [2024-02-24T04:48:05.963+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:48:05.964102280Z [2024-02-24T04:48:05.963+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:47:00+00:00, run_id=scheduled__2024-02-24T04:47:00+00:00, run_start_date=2024-02-24 04:48:01.126447+00:00, run_end_date=2024-02-24 04:48:05.963520+00:00, run_duration=4.837073, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:47:00+00:00, data_interval_end=2024-02-24 04:48:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:48:05.980624849Z [2024-02-24T04:48:05.980+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:48:00+00:00, run_after=2024-02-24T04:49:00+00:00 2024-02-24T04:48:06.011504131Z [2024-02-24T04:48:06.011+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:47:00+00:00 exited with status success for try_number 1 2024-02-24T04:48:06.011839069Z [2024-02-24T04:48:06.011+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:47:00+00:00 exited with status success for try_number 1 2024-02-24T04:48:06.021170833Z [2024-02-24T04:48:06.020+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:47:00+00:00, map_index=-1, run_start_date=2024-02-24 04:48:03.337136+00:00, run_end_date=2024-02-24 04:48:04.771388+00:00, run_duration=1.434252, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1401, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:48:01.189046+00:00, queued_by_job_id=2, pid=20388 2024-02-24T04:48:06.021755237Z [2024-02-24T04:48:06.021+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:47:00+00:00, map_index=-1, run_start_date=2024-02-24 04:48:03.366823+00:00, run_end_date=2024-02-24 04:48:05.659532+00:00, run_duration=2.292709, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1402, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:48:01.189046+00:00, queued_by_job_id=2, pid=20389 2024-02-24T04:49:00.427272931Z [2024-02-24T04:49:00.426+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:49:00+00:00, run_after=2024-02-24T04:50:00+00:00 2024-02-24T04:49:00.437311013Z [2024-02-24T04:49:00.436+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:49:00.453197413Z [2024-02-24T04:49:00.452+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:49:00+00:00, run_after=2024-02-24T04:50:00+00:00 2024-02-24T04:49:00.535612783Z [2024-02-24T04:49:00.535+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T04:49:00.535650148Z 2024-02-24T04:49:00.535656729Z 2024-02-24T04:49:00.535662877Z 2024-02-24T04:49:00.536043418Z [2024-02-24T04:49:00.535+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:49:00.536405314Z [2024-02-24T04:49:00.535+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:49:00.536723655Z [2024-02-24T04:49:00.536+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:49:00.537987607Z [2024-02-24T04:49:00.537+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:49:00.538021185Z 2024-02-24T04:49:00.538029937Z 2024-02-24T04:49:00.538046459Z 2024-02-24T04:49:00.544784590Z [2024-02-24T04:49:00.544+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:49:00.545160936Z [2024-02-24T04:49:00.544+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:49:00.545925508Z [2024-02-24T04:49:00.545+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:49:00.546369592Z [2024-02-24T04:49:00.545+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:49:00.546941171Z [2024-02-24T04:49:00.546+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:49:00.547329463Z [2024-02-24T04:49:00.547+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:49:00.824987551Z [2024-02-24T04:49:00.824+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:48:00+00:00 exited with status queued for try_number 1 2024-02-24T04:49:00.825228652Z [2024-02-24T04:49:00.824+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:48:00+00:00 exited with status queued for try_number 1 2024-02-24T04:49:00.825443464Z [2024-02-24T04:49:00.825+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:48:00+00:00 exited with status queued for try_number 1 2024-02-24T04:49:00.834913216Z [2024-02-24T04:49:00.834+0000] {scheduler_job.py:635} INFO - Setting external_id for to c2e79b8c-018a-4ba6-8078-ab01984f3c8f 2024-02-24T04:49:00.835202473Z [2024-02-24T04:49:00.835+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77d7faa8-d7e8-49ab-aea5-5cdc2321cf17 2024-02-24T04:49:00.835460417Z [2024-02-24T04:49:00.835+0000] {scheduler_job.py:635} INFO - Setting external_id for to e1b1e894-4823-4aae-957e-62c3c84947e8 2024-02-24T04:49:02.079881332Z [2024-02-24T04:49:02.079+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:49:02.080557180Z [2024-02-24T04:49:02.080+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:48:00+00:00, run_id=scheduled__2024-02-24T04:48:00+00:00, run_start_date=2024-02-24 04:49:00.467185+00:00, run_end_date=2024-02-24 04:49:02.080028+00:00, run_duration=1.612843, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:48:00+00:00, data_interval_end=2024-02-24 04:49:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:49:02.097236658Z [2024-02-24T04:49:02.096+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:49:00+00:00, run_after=2024-02-24T04:50:00+00:00 2024-02-24T04:49:02.182550410Z [2024-02-24T04:49:02.182+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:48:00+00:00 exited with status success for try_number 1 2024-02-24T04:49:02.191931693Z [2024-02-24T04:49:02.191+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:48:00+00:00, map_index=-1, run_start_date=2024-02-24 04:49:01.510243+00:00, run_end_date=2024-02-24 04:49:01.939669+00:00, run_duration=0.429426, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1403, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:49:00.539213+00:00, queued_by_job_id=2, pid=20421 2024-02-24T04:49:03.925202035Z [2024-02-24T04:49:03.924+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:49:03.925527495Z [2024-02-24T04:49:03.925+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:48:00+00:00, run_id=scheduled__2024-02-24T04:48:00+00:00, run_start_date=2024-02-24 04:49:00.468496+00:00, run_end_date=2024-02-24 04:49:03.924974+00:00, run_duration=3.456478, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:48:00+00:00, data_interval_end=2024-02-24 04:49:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:49:03.938574780Z [2024-02-24T04:49:03.937+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:49:00+00:00, run_after=2024-02-24T04:50:00+00:00 2024-02-24T04:49:03.992524663Z [2024-02-24T04:49:03.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:48:00+00:00 exited with status success for try_number 1 2024-02-24T04:49:03.998892007Z [2024-02-24T04:49:03.998+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:48:00+00:00, map_index=-1, run_start_date=2024-02-24 04:49:02.346630+00:00, run_end_date=2024-02-24 04:49:03.747103+00:00, run_duration=1.400473, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1404, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:49:00.539213+00:00, queued_by_job_id=2, pid=20439 2024-02-24T04:49:05.049443896Z [2024-02-24T04:49:05.048+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:49:05.050123797Z [2024-02-24T04:49:05.049+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:48:00+00:00, run_id=scheduled__2024-02-24T04:48:00+00:00, run_start_date=2024-02-24 04:49:00.469670+00:00, run_end_date=2024-02-24 04:49:05.049622+00:00, run_duration=4.579952, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:48:00+00:00, data_interval_end=2024-02-24 04:49:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:49:05.064130217Z [2024-02-24T04:49:05.063+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:49:00+00:00, run_after=2024-02-24T04:50:00+00:00 2024-02-24T04:49:05.101786556Z [2024-02-24T04:49:05.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:48:00+00:00 exited with status success for try_number 1 2024-02-24T04:49:05.107382957Z [2024-02-24T04:49:05.107+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:48:00+00:00, map_index=-1, run_start_date=2024-02-24 04:49:02.654665+00:00, run_end_date=2024-02-24 04:49:04.437152+00:00, run_duration=1.782487, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1405, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:49:00.539213+00:00, queued_by_job_id=2, pid=20442 2024-02-24T04:49:38.418670840Z [2024-02-24T04:49:38.418+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:49:38.418701106Z 2024-02-24T04:49:38.418925383Z [2024-02-24T04:49:38.418+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-02-24T04:49:38.419631924Z [2024-02-24T04:49:38.419+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:49:38.419645231Z 2024-02-24T04:49:38.422019129Z [2024-02-24T04:49:38.421+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240224044937_366794', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:49:38.422760251Z [2024-02-24T04:49:38.422+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240224044937_366794', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-02-24T04:49:38.495437573Z [2024-02-24T04:49:38.495+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240224044937_366794 exited with status queued for try_number 1 2024-02-24T04:49:38.500644000Z [2024-02-24T04:49:38.500+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c807aaf-da35-42ea-a968-1a76b0342491 2024-02-24T04:49:40.711979781Z [2024-02-24T04:49:40.711+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:49:40.712307571Z [2024-02-24T04:49:40.712+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-02-24 04:49:37.962752+00:00, run_id=vdu_down_20240224044937_366794, run_start_date=2024-02-24 04:49:38.370345+00:00, run_end_date=2024-02-24 04:49:40.711829+00:00, run_duration=2.341484, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-02-24 04:49:37.962752+00:00, data_interval_end=2024-02-24 04:49:37.962752+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-02-24T04:49:40.715470016Z [2024-02-24T04:49:40.715+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-02-24T04:49:40.751354537Z [2024-02-24T04:49:40.750+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240224044937_366794 exited with status success for try_number 1 2024-02-24T04:49:40.756267044Z [2024-02-24T04:49:40.755+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240224044937_366794, map_index=-1, run_start_date=2024-02-24 04:49:39.107428+00:00, run_end_date=2024-02-24 04:49:39.620993+00:00, run_duration=0.513565, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1406, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:49:38.419985+00:00, queued_by_job_id=2, pid=20452 2024-02-24T04:50:00.859646860Z [2024-02-24T04:50:00.858+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:50:00+00:00, run_after=2024-02-24T04:55:00+00:00 2024-02-24T04:50:00.872407301Z [2024-02-24T04:50:00.871+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:50:00.894645163Z [2024-02-24T04:50:00.893+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:50:00+00:00, run_after=2024-02-24T04:51:00+00:00 2024-02-24T04:50:00.917941067Z [2024-02-24T04:50:00.917+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:50:00+00:00, run_after=2024-02-24T04:51:00+00:00 2024-02-24T04:50:00.930967316Z [2024-02-24T04:50:00.930+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:50:01.063674815Z [2024-02-24T04:50:01.063+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-02-24T04:50:01.063716433Z 2024-02-24T04:50:01.063727322Z 2024-02-24T04:50:01.063735036Z 2024-02-24T04:50:01.063742053Z 2024-02-24T04:50:01.063749294Z 2024-02-24T04:50:01.063972656Z [2024-02-24T04:50:01.063+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:50:01.064197404Z [2024-02-24T04:50:01.064+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T04:50:01.064388934Z [2024-02-24T04:50:01.064+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:50:01.064575264Z [2024-02-24T04:50:01.064+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:50:01.064717002Z [2024-02-24T04:50:01.064+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:50:01.065565708Z [2024-02-24T04:50:01.065+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:50:01.065588313Z 2024-02-24T04:50:01.065596580Z 2024-02-24T04:50:01.065603147Z 2024-02-24T04:50:01.065609540Z 2024-02-24T04:50:01.065615616Z 2024-02-24T04:50:01.070993205Z [2024-02-24T04:50:01.070+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T04:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T04:50:01.071246774Z [2024-02-24T04:50:01.070+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T04:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T04:50:01.071659765Z [2024-02-24T04:50:01.071+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T04:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:50:01.071869404Z [2024-02-24T04:50:01.071+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T04:50:01.072147838Z [2024-02-24T04:50:01.071+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:50:01.072245852Z [2024-02-24T04:50:01.072+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:50:01.072519778Z [2024-02-24T04:50:01.072+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:50:01.072679675Z [2024-02-24T04:50:01.072+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:50:01.072942588Z [2024-02-24T04:50:01.072+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:50:01.073126636Z [2024-02-24T04:50:01.072+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:50:01.737535333Z [2024-02-24T04:50:01.736+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T04:45:00+00:00 exited with status queued for try_number 1 2024-02-24T04:50:01.737636207Z [2024-02-24T04:50:01.737+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:48:00+00:00 exited with status queued for try_number 1 2024-02-24T04:50:01.737699364Z [2024-02-24T04:50:01.737+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:49:00+00:00 exited with status queued for try_number 1 2024-02-24T04:50:01.737722904Z [2024-02-24T04:50:01.737+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:49:00+00:00 exited with status queued for try_number 1 2024-02-24T04:50:01.737749077Z [2024-02-24T04:50:01.737+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:49:00+00:00 exited with status queued for try_number 1 2024-02-24T04:50:01.754353488Z [2024-02-24T04:50:01.753+0000] {scheduler_job.py:635} INFO - Setting external_id for to 03ad5c52-8f77-4e1f-8e98-97535075ce3e 2024-02-24T04:50:01.754391913Z [2024-02-24T04:50:01.754+0000] {scheduler_job.py:635} INFO - Setting external_id for to 76f26589-159b-43c0-b65e-c48ed785cc51 2024-02-24T04:50:01.754536250Z [2024-02-24T04:50:01.754+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3f089c6-3aa0-4571-9e25-84a63a3f69f0 2024-02-24T04:50:01.754601308Z [2024-02-24T04:50:01.754+0000] {scheduler_job.py:635} INFO - Setting external_id for to 44760a03-433b-4bc6-b995-be26596b0932 2024-02-24T04:50:01.754710438Z [2024-02-24T04:50:01.754+0000] {scheduler_job.py:635} INFO - Setting external_id for to 003d69ca-fa61-4dcd-8b02-ead4d124167e 2024-02-24T04:50:03.127603191Z [2024-02-24T04:50:03.127+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:50:03.128073306Z [2024-02-24T04:50:03.127+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 04:48:00+00:00, run_id=scheduled__2024-02-24T04:48:00+00:00, run_start_date=2024-02-24 04:50:00.956413+00:00, run_end_date=2024-02-24 04:50:03.127581+00:00, run_duration=2.171168, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:48:00+00:00, data_interval_end=2024-02-24 04:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T04:50:03.144870968Z [2024-02-24T04:50:03.144+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T04:50:00+00:00, run_after=2024-02-24T04:52:00+00:00 2024-02-24T04:50:03.159226400Z [2024-02-24T04:50:03.158+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:50:03.159638098Z [2024-02-24T04:50:03.159+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:49:00+00:00, run_id=scheduled__2024-02-24T04:49:00+00:00, run_start_date=2024-02-24 04:50:00.958121+00:00, run_end_date=2024-02-24 04:50:03.159197+00:00, run_duration=2.201076, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:49:00+00:00, data_interval_end=2024-02-24 04:50:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:50:03.172015846Z [2024-02-24T04:50:03.171+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:50:00+00:00, run_after=2024-02-24T04:51:00+00:00 2024-02-24T04:50:03.252095205Z [2024-02-24T04:50:03.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:48:00+00:00 exited with status success for try_number 1 2024-02-24T04:50:03.261346256Z [2024-02-24T04:50:03.260+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T04:48:00+00:00, map_index=-1, run_start_date=2024-02-24 04:50:02.258579+00:00, run_end_date=2024-02-24 04:50:02.855086+00:00, run_duration=0.596507, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1407, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:50:01.067033+00:00, queued_by_job_id=2, pid=20511 2024-02-24T04:50:03.987468871Z [2024-02-24T04:50:03.987+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:49:00+00:00 exited with status success for try_number 1 2024-02-24T04:50:03.993620752Z [2024-02-24T04:50:03.992+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:49:00+00:00, map_index=-1, run_start_date=2024-02-24 04:50:02.469720+00:00, run_end_date=2024-02-24 04:50:03.041301+00:00, run_duration=0.571581, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1408, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:50:01.067033+00:00, queued_by_job_id=2, pid=20512 2024-02-24T04:50:05.146769442Z [2024-02-24T04:50:05.146+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:50:05.146800406Z 2024-02-24T04:50:05.146998083Z [2024-02-24T04:50:05.146+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:50:05.148019043Z [2024-02-24T04:50:05.147+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:50:05.148037221Z 2024-02-24T04:50:05.151755111Z [2024-02-24T04:50:05.151+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T04:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T04:50:05.152000360Z [2024-02-24T04:50:05.151+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T04:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T04:50:05.209089713Z [2024-02-24T04:50:05.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T04:45:00+00:00 exited with status queued for try_number 1 2024-02-24T04:50:05.209492383Z [2024-02-24T04:50:05.209+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T04:45:00+00:00 exited with status success for try_number 1 2024-02-24T04:50:05.217516927Z [2024-02-24T04:50:05.216+0000] {scheduler_job.py:635} INFO - Setting external_id for to 450d6843-d0dc-407c-b1fd-1d013af8eb6a 2024-02-24T04:50:05.218264998Z [2024-02-24T04:50:05.217+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T04:45:00+00:00, map_index=-1, run_start_date=2024-02-24 04:50:03.847922+00:00, run_end_date=2024-02-24 04:50:04.332701+00:00, run_duration=0.484779, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1409, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:50:01.067033+00:00, queued_by_job_id=2, pid=20536 2024-02-24T04:50:06.560491101Z [2024-02-24T04:50:06.559+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:50:06.561090052Z [2024-02-24T04:50:06.560+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:49:00+00:00, run_id=scheduled__2024-02-24T04:49:00+00:00, run_start_date=2024-02-24 04:50:00.961332+00:00, run_end_date=2024-02-24 04:50:06.560540+00:00, run_duration=5.599208, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:49:00+00:00, data_interval_end=2024-02-24 04:50:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:50:06.581040956Z [2024-02-24T04:50:06.580+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:50:00+00:00, run_after=2024-02-24T04:51:00+00:00 2024-02-24T04:50:06.596365937Z [2024-02-24T04:50:06.595+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:50:06.599524520Z [2024-02-24T04:50:06.599+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:49:00+00:00, run_id=scheduled__2024-02-24T04:49:00+00:00, run_start_date=2024-02-24 04:50:00.959633+00:00, run_end_date=2024-02-24 04:50:06.596205+00:00, run_duration=5.636572, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:49:00+00:00, data_interval_end=2024-02-24 04:50:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:50:06.619129553Z [2024-02-24T04:50:06.618+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:50:00+00:00, run_after=2024-02-24T04:51:00+00:00 2024-02-24T04:50:06.699266202Z [2024-02-24T04:50:06.698+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:49:00+00:00 exited with status success for try_number 1 2024-02-24T04:50:06.699386313Z [2024-02-24T04:50:06.699+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:49:00+00:00 exited with status success for try_number 1 2024-02-24T04:50:06.711982438Z [2024-02-24T04:50:06.711+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:49:00+00:00, map_index=-1, run_start_date=2024-02-24 04:50:04.187118+00:00, run_end_date=2024-02-24 04:50:05.508394+00:00, run_duration=1.321276, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1411, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:50:01.067033+00:00, queued_by_job_id=2, pid=20543 2024-02-24T04:50:06.712469763Z [2024-02-24T04:50:06.712+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:49:00+00:00, map_index=-1, run_start_date=2024-02-24 04:50:03.975093+00:00, run_end_date=2024-02-24 04:50:05.816519+00:00, run_duration=1.841426, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1410, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:50:01.067033+00:00, queued_by_job_id=2, pid=20542 2024-02-24T04:50:07.780132488Z [2024-02-24T04:50:07.779+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:50:07.780166816Z 2024-02-24T04:50:07.780598458Z [2024-02-24T04:50:07.780+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:50:07.781427213Z [2024-02-24T04:50:07.781+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:50:07.781442402Z 2024-02-24T04:50:07.784463375Z [2024-02-24T04:50:07.784+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T04:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T04:50:07.784727574Z [2024-02-24T04:50:07.784+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T04:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T04:50:07.847573515Z [2024-02-24T04:50:07.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T04:45:00+00:00 exited with status queued for try_number 1 2024-02-24T04:50:07.847935890Z [2024-02-24T04:50:07.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T04:45:00+00:00 exited with status success for try_number 1 2024-02-24T04:50:07.854276495Z [2024-02-24T04:50:07.853+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac813c38-7d54-49a1-93ff-11dffb4dd574 2024-02-24T04:50:07.854546311Z [2024-02-24T04:50:07.854+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T04:45:00+00:00, map_index=-1, run_start_date=2024-02-24 04:50:06.935107+00:00, run_end_date=2024-02-24 04:50:07.313928+00:00, run_duration=0.378821, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1412, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:50:05.148616+00:00, queued_by_job_id=2, pid=20566 2024-02-24T04:50:09.901293057Z [2024-02-24T04:50:09.900+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:50:09.901326717Z 2024-02-24T04:50:09.902177026Z [2024-02-24T04:50:09.901+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:50:09.902953123Z [2024-02-24T04:50:09.902+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:50:09.902971237Z 2024-02-24T04:50:09.906133980Z [2024-02-24T04:50:09.905+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T04:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:50:09.906407705Z [2024-02-24T04:50:09.906+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T04:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T04:50:09.980969855Z [2024-02-24T04:50:09.980+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T04:45:00+00:00 exited with status queued for try_number 1 2024-02-24T04:50:09.981354737Z [2024-02-24T04:50:09.981+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T04:45:00+00:00 exited with status success for try_number 1 2024-02-24T04:50:09.991905964Z [2024-02-24T04:50:09.991+0000] {scheduler_job.py:635} INFO - Setting external_id for to 618cf9e9-ac51-4ce2-b7f1-d8f7470bc1c9 2024-02-24T04:50:09.992329476Z [2024-02-24T04:50:09.992+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T04:45:00+00:00, map_index=0, run_start_date=2024-02-24 04:50:09.408761+00:00, run_end_date=2024-02-24 04:50:09.790469+00:00, run_duration=0.381708, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1413, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:50:07.781984+00:00, queued_by_job_id=2, pid=20574 2024-02-24T04:50:12.272717579Z [2024-02-24T04:50:12.272+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:50:12.273068246Z [2024-02-24T04:50:12.272+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:45:00+00:00, run_id=scheduled__2024-02-24T04:45:00+00:00, run_start_date=2024-02-24 04:50:00.954450+00:00, run_end_date=2024-02-24 04:50:12.272582+00:00, run_duration=11.318132, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:45:00+00:00, data_interval_end=2024-02-24 04:50:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T04:50:12.282264925Z [2024-02-24T04:50:12.281+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:50:00+00:00, run_after=2024-02-24T04:55:00+00:00 2024-02-24T04:50:12.319368425Z [2024-02-24T04:50:12.318+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T04:45:00+00:00 exited with status success for try_number 1 2024-02-24T04:50:12.326743675Z [2024-02-24T04:50:12.326+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T04:45:00+00:00, map_index=-1, run_start_date=2024-02-24 04:50:11.537599+00:00, run_end_date=2024-02-24 04:50:11.940492+00:00, run_duration=0.402893, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1414, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:50:09.903528+00:00, queued_by_job_id=2, pid=20582 2024-02-24T04:51:00.329411036Z [2024-02-24T04:51:00.328+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:51:00.343413158Z [2024-02-24T04:51:00.343+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:51:00+00:00, run_after=2024-02-24T04:52:00+00:00 2024-02-24T04:51:00.354976315Z [2024-02-24T04:51:00.354+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:51:00+00:00, run_after=2024-02-24T04:52:00+00:00 2024-02-24T04:51:00.429624751Z [2024-02-24T04:51:00.429+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T04:51:00.429658367Z 2024-02-24T04:51:00.429664064Z 2024-02-24T04:51:00.429669371Z 2024-02-24T04:51:00.429928114Z [2024-02-24T04:51:00.429+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:51:00.430259191Z [2024-02-24T04:51:00.430+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:51:00.430435461Z [2024-02-24T04:51:00.430+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:51:00.431643110Z [2024-02-24T04:51:00.431+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:51:00.431668511Z 2024-02-24T04:51:00.431676457Z 2024-02-24T04:51:00.431683312Z 2024-02-24T04:51:00.436089224Z [2024-02-24T04:51:00.435+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:51:00.436326296Z [2024-02-24T04:51:00.436+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:51:00.436688556Z [2024-02-24T04:51:00.436+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:51:00.437005825Z [2024-02-24T04:51:00.436+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:51:00.437279114Z [2024-02-24T04:51:00.437+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:51:00.437423349Z [2024-02-24T04:51:00.437+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:51:00.660555367Z [2024-02-24T04:51:00.660+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:50:00+00:00 exited with status queued for try_number 1 2024-02-24T04:51:00.660691371Z [2024-02-24T04:51:00.660+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:50:00+00:00 exited with status queued for try_number 1 2024-02-24T04:51:00.660839361Z [2024-02-24T04:51:00.660+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:50:00+00:00 exited with status queued for try_number 1 2024-02-24T04:51:00.667972251Z [2024-02-24T04:51:00.667+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c1bd05c-222b-471e-8866-59c968da7630 2024-02-24T04:51:00.668112632Z [2024-02-24T04:51:00.667+0000] {scheduler_job.py:635} INFO - Setting external_id for to 19219b12-c8b3-4628-a466-99be54fe832d 2024-02-24T04:51:00.668262561Z [2024-02-24T04:51:00.668+0000] {scheduler_job.py:635} INFO - Setting external_id for to 633d521b-a33a-4b5d-ba06-1b479e310418 2024-02-24T04:51:01.861845577Z [2024-02-24T04:51:01.860+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:51:01.862469659Z [2024-02-24T04:51:01.862+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:50:00+00:00, run_id=scheduled__2024-02-24T04:50:00+00:00, run_start_date=2024-02-24 04:51:00.364934+00:00, run_end_date=2024-02-24 04:51:01.861882+00:00, run_duration=1.496948, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:50:00+00:00, data_interval_end=2024-02-24 04:51:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:51:01.874389019Z [2024-02-24T04:51:01.873+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:51:00+00:00, run_after=2024-02-24T04:52:00+00:00 2024-02-24T04:51:01.939124673Z [2024-02-24T04:51:01.938+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:50:00+00:00 exited with status success for try_number 1 2024-02-24T04:51:01.946512058Z [2024-02-24T04:51:01.946+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:50:00+00:00, map_index=-1, run_start_date=2024-02-24 04:51:01.319600+00:00, run_end_date=2024-02-24 04:51:01.694580+00:00, run_duration=0.37498, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1415, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:51:00.432890+00:00, queued_by_job_id=2, pid=20605 2024-02-24T04:51:04.075412193Z [2024-02-24T04:51:04.074+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:51:04.076378364Z [2024-02-24T04:51:04.075+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:50:00+00:00, run_id=scheduled__2024-02-24T04:50:00+00:00, run_start_date=2024-02-24 04:51:00.366139+00:00, run_end_date=2024-02-24 04:51:04.075264+00:00, run_duration=3.709125, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:50:00+00:00, data_interval_end=2024-02-24 04:51:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:51:04.105202323Z [2024-02-24T04:51:04.104+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:51:00+00:00, run_after=2024-02-24T04:52:00+00:00 2024-02-24T04:51:04.794300699Z [2024-02-24T04:51:04.793+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:51:04.794566189Z [2024-02-24T04:51:04.794+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:50:00+00:00, run_id=scheduled__2024-02-24T04:50:00+00:00, run_start_date=2024-02-24 04:51:00.367149+00:00, run_end_date=2024-02-24 04:51:04.794149+00:00, run_duration=4.427, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:50:00+00:00, data_interval_end=2024-02-24 04:51:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:51:04.804541007Z [2024-02-24T04:51:04.804+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:51:00+00:00, run_after=2024-02-24T04:52:00+00:00 2024-02-24T04:51:04.837717791Z [2024-02-24T04:51:04.837+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:50:00+00:00 exited with status success for try_number 1 2024-02-24T04:51:04.837959318Z [2024-02-24T04:51:04.837+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:50:00+00:00 exited with status success for try_number 1 2024-02-24T04:51:04.848721082Z [2024-02-24T04:51:04.848+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:50:00+00:00, map_index=-1, run_start_date=2024-02-24 04:51:02.415673+00:00, run_end_date=2024-02-24 04:51:04.021956+00:00, run_duration=1.606283, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1417, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:51:00.432890+00:00, queued_by_job_id=2, pid=20624 2024-02-24T04:51:04.849039369Z [2024-02-24T04:51:04.848+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:50:00+00:00, map_index=-1, run_start_date=2024-02-24 04:51:02.349495+00:00, run_end_date=2024-02-24 04:51:04.114270+00:00, run_duration=1.764775, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1416, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:51:00.432890+00:00, queued_by_job_id=2, pid=20623 2024-02-24T04:51:39.095605231Z [2024-02-24T04:51:39.094+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:51:39.095678657Z 2024-02-24T04:51:39.096084981Z [2024-02-24T04:51:39.095+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-02-24T04:51:39.097580447Z [2024-02-24T04:51:39.097+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:51:39.097604789Z 2024-02-24T04:51:39.102540495Z [2024-02-24T04:51:39.102+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240224045137_174268', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:51:39.102852974Z [2024-02-24T04:51:39.102+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240224045137_174268', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-02-24T04:51:39.178300013Z [2024-02-24T04:51:39.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240224045137_174268 exited with status queued for try_number 1 2024-02-24T04:51:39.185538306Z [2024-02-24T04:51:39.185+0000] {scheduler_job.py:635} INFO - Setting external_id for to 91b34d3d-ce03-44f6-9426-7d7b95ca803f 2024-02-24T04:51:40.333865818Z [2024-02-24T04:51:40.333+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:51:40.334261524Z [2024-02-24T04:51:40.334+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-02-24 04:51:37.946105+00:00, run_id=vdu_down_20240224045137_174268, run_start_date=2024-02-24 04:51:39.031616+00:00, run_end_date=2024-02-24 04:51:40.333955+00:00, run_duration=1.302339, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-02-24 04:51:37.946105+00:00, data_interval_end=2024-02-24 04:51:37.946105+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-02-24T04:51:40.337435113Z [2024-02-24T04:51:40.337+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-02-24T04:51:40.371142157Z [2024-02-24T04:51:40.370+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240224045137_174268 exited with status success for try_number 1 2024-02-24T04:51:40.377701910Z [2024-02-24T04:51:40.377+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240224045137_174268, map_index=-1, run_start_date=2024-02-24 04:51:39.775366+00:00, run_end_date=2024-02-24 04:51:40.202156+00:00, run_duration=0.42679, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1418, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:51:39.098777+00:00, queued_by_job_id=2, pid=20636 2024-02-24T04:52:00.671249290Z [2024-02-24T04:52:00.670+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:52:00.683777058Z [2024-02-24T04:52:00.683+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:52:00+00:00, run_after=2024-02-24T04:53:00+00:00 2024-02-24T04:52:00.691853725Z [2024-02-24T04:52:00.691+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:52:00.703729500Z [2024-02-24T04:52:00.703+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:52:00+00:00, run_after=2024-02-24T04:53:00+00:00 2024-02-24T04:52:00.816267280Z [2024-02-24T04:52:00.815+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T04:52:00.816301794Z 2024-02-24T04:52:00.816314155Z 2024-02-24T04:52:00.816322187Z 2024-02-24T04:52:00.816329419Z 2024-02-24T04:52:00.816369180Z [2024-02-24T04:52:00.816+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T04:52:00.816523474Z [2024-02-24T04:52:00.816+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:52:00.816724278Z [2024-02-24T04:52:00.816+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:52:00.816943961Z [2024-02-24T04:52:00.816+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:52:00.817630275Z [2024-02-24T04:52:00.817+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:52:00.817641257Z 2024-02-24T04:52:00.817645180Z 2024-02-24T04:52:00.817648617Z 2024-02-24T04:52:00.817655517Z 2024-02-24T04:52:00.822232600Z [2024-02-24T04:52:00.821+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T04:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:52:00.822429499Z [2024-02-24T04:52:00.822+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T04:52:00.822697742Z [2024-02-24T04:52:00.822+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:52:00.822861505Z [2024-02-24T04:52:00.822+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:52:00.823100206Z [2024-02-24T04:52:00.822+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:52:00.823247480Z [2024-02-24T04:52:00.823+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:52:00.823503232Z [2024-02-24T04:52:00.823+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:52:00.823662266Z [2024-02-24T04:52:00.823+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:52:01.136686802Z [2024-02-24T04:52:01.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:50:00+00:00 exited with status queued for try_number 1 2024-02-24T04:52:01.136754150Z [2024-02-24T04:52:01.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:51:00+00:00 exited with status queued for try_number 1 2024-02-24T04:52:01.136912442Z [2024-02-24T04:52:01.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:51:00+00:00 exited with status queued for try_number 1 2024-02-24T04:52:01.136999309Z [2024-02-24T04:52:01.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:51:00+00:00 exited with status queued for try_number 1 2024-02-24T04:52:01.145192624Z [2024-02-24T04:52:01.144+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b7d27c9-18c5-4737-bc92-1f6bcd567b17 2024-02-24T04:52:01.145349380Z [2024-02-24T04:52:01.145+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2361c2f5-5d72-4d84-9c6f-5d9abd50fc6f 2024-02-24T04:52:01.145537791Z [2024-02-24T04:52:01.145+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea4fefd5-7c6e-4288-b03b-4c5f8db528e0 2024-02-24T04:52:01.145718557Z [2024-02-24T04:52:01.145+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0fcc933-f3a4-486b-97fb-3a3a52eb5ec5 2024-02-24T04:52:02.467771211Z [2024-02-24T04:52:02.467+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:52:02.468289980Z [2024-02-24T04:52:02.468+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 04:50:00+00:00, run_id=scheduled__2024-02-24T04:50:00+00:00, run_start_date=2024-02-24 04:52:00.717567+00:00, run_end_date=2024-02-24 04:52:02.467918+00:00, run_duration=1.750351, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:50:00+00:00, data_interval_end=2024-02-24 04:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T04:52:02.476415856Z [2024-02-24T04:52:02.476+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T04:52:00+00:00, run_after=2024-02-24T04:54:00+00:00 2024-02-24T04:52:02.484190769Z [2024-02-24T04:52:02.483+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:52:02.484808229Z [2024-02-24T04:52:02.484+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:51:00+00:00, run_id=scheduled__2024-02-24T04:51:00+00:00, run_start_date=2024-02-24 04:52:00.720542+00:00, run_end_date=2024-02-24 04:52:02.484377+00:00, run_duration=1.763835, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:51:00+00:00, data_interval_end=2024-02-24 04:52:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:52:02.500826704Z [2024-02-24T04:52:02.500+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:52:00+00:00, run_after=2024-02-24T04:53:00+00:00 2024-02-24T04:52:02.567988752Z [2024-02-24T04:52:02.567+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:50:00+00:00 exited with status success for try_number 1 2024-02-24T04:52:02.568441594Z [2024-02-24T04:52:02.568+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:51:00+00:00 exited with status success for try_number 1 2024-02-24T04:52:02.580262576Z [2024-02-24T04:52:02.579+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:51:00+00:00, map_index=-1, run_start_date=2024-02-24 04:52:01.807129+00:00, run_end_date=2024-02-24 04:52:02.261873+00:00, run_duration=0.454744, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1420, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:52:00.818775+00:00, queued_by_job_id=2, pid=20680 2024-02-24T04:52:02.580828443Z [2024-02-24T04:52:02.580+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T04:50:00+00:00, map_index=-1, run_start_date=2024-02-24 04:52:01.729467+00:00, run_end_date=2024-02-24 04:52:02.310608+00:00, run_duration=0.581141, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1419, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:52:00.818775+00:00, queued_by_job_id=2, pid=20679 2024-02-24T04:52:04.730788186Z [2024-02-24T04:52:04.730+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:52:04.734487601Z [2024-02-24T04:52:04.734+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:51:00+00:00, run_id=scheduled__2024-02-24T04:51:00+00:00, run_start_date=2024-02-24 04:52:00.723027+00:00, run_end_date=2024-02-24 04:52:04.733919+00:00, run_duration=4.010892, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:51:00+00:00, data_interval_end=2024-02-24 04:52:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:52:04.756800762Z [2024-02-24T04:52:04.756+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:52:00+00:00, run_after=2024-02-24T04:53:00+00:00 2024-02-24T04:52:04.812106630Z [2024-02-24T04:52:04.811+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:51:00+00:00 exited with status success for try_number 1 2024-02-24T04:52:04.820413211Z [2024-02-24T04:52:04.819+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:51:00+00:00, map_index=-1, run_start_date=2024-02-24 04:52:03.133216+00:00, run_end_date=2024-02-24 04:52:04.583531+00:00, run_duration=1.450315, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1422, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:52:00.818775+00:00, queued_by_job_id=2, pid=20704 2024-02-24T04:52:05.872328183Z [2024-02-24T04:52:05.871+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:52:05.872733041Z [2024-02-24T04:52:05.872+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:51:00+00:00, run_id=scheduled__2024-02-24T04:51:00+00:00, run_start_date=2024-02-24 04:52:00.725864+00:00, run_end_date=2024-02-24 04:52:05.872174+00:00, run_duration=5.14631, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:51:00+00:00, data_interval_end=2024-02-24 04:52:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:52:05.884924601Z [2024-02-24T04:52:05.884+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:52:00+00:00, run_after=2024-02-24T04:53:00+00:00 2024-02-24T04:52:05.922040580Z [2024-02-24T04:52:05.921+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:51:00+00:00 exited with status success for try_number 1 2024-02-24T04:52:05.927148966Z [2024-02-24T04:52:05.926+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:51:00+00:00, map_index=-1, run_start_date=2024-02-24 04:52:02.970170+00:00, run_end_date=2024-02-24 04:52:04.765346+00:00, run_duration=1.795176, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1421, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:52:00.818775+00:00, queued_by_job_id=2, pid=20703 2024-02-24T04:52:06.774695946Z [2024-02-24T04:52:06.774+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-02-24T04:53:00.209953778Z [2024-02-24T04:53:00.209+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:53:00.229599713Z [2024-02-24T04:53:00.229+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:53:00+00:00, run_after=2024-02-24T04:54:00+00:00 2024-02-24T04:53:00.244643629Z [2024-02-24T04:53:00.244+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:53:00+00:00, run_after=2024-02-24T04:54:00+00:00 2024-02-24T04:53:00.338096531Z [2024-02-24T04:53:00.337+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-02-24T04:53:00.338145763Z 2024-02-24T04:53:00.338156329Z 2024-02-24T04:53:00.338165335Z 2024-02-24T04:53:00.338314326Z [2024-02-24T04:53:00.337+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:53:00.338396956Z [2024-02-24T04:53:00.338+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:53:00.338471026Z [2024-02-24T04:53:00.338+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:53:00.339201382Z [2024-02-24T04:53:00.338+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:53:00.339224723Z 2024-02-24T04:53:00.339233696Z 2024-02-24T04:53:00.339242246Z 2024-02-24T04:53:00.344098132Z [2024-02-24T04:53:00.343+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:53:00.344624050Z [2024-02-24T04:53:00.344+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:53:00.345439386Z [2024-02-24T04:53:00.345+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:53:00.346618581Z [2024-02-24T04:53:00.345+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:53:00.347571025Z [2024-02-24T04:53:00.347+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:53:00.348060172Z [2024-02-24T04:53:00.347+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:53:00.537338848Z [2024-02-24T04:53:00.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:52:00+00:00 exited with status queued for try_number 1 2024-02-24T04:53:00.537387402Z [2024-02-24T04:53:00.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:52:00+00:00 exited with status queued for try_number 1 2024-02-24T04:53:00.539572214Z [2024-02-24T04:53:00.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:52:00+00:00 exited with status queued for try_number 1 2024-02-24T04:53:00.547382817Z [2024-02-24T04:53:00.547+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa4b3439-85a2-4337-966f-9d57a189da8a 2024-02-24T04:53:00.547429218Z [2024-02-24T04:53:00.547+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81645225-d464-4ec2-9cc1-283226a2ca06 2024-02-24T04:53:00.547538422Z [2024-02-24T04:53:00.547+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2cd497fb-3647-424f-9dba-9c696d7a6f44 2024-02-24T04:53:01.662647438Z [2024-02-24T04:53:01.661+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:53:01.663782521Z [2024-02-24T04:53:01.663+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:52:00+00:00, run_id=scheduled__2024-02-24T04:52:00+00:00, run_start_date=2024-02-24 04:53:00.258226+00:00, run_end_date=2024-02-24 04:53:01.662911+00:00, run_duration=1.404685, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:52:00+00:00, data_interval_end=2024-02-24 04:53:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:53:01.675217687Z [2024-02-24T04:53:01.674+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:53:00+00:00, run_after=2024-02-24T04:54:00+00:00 2024-02-24T04:53:01.726642039Z [2024-02-24T04:53:01.726+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:52:00+00:00 exited with status success for try_number 1 2024-02-24T04:53:01.734422749Z [2024-02-24T04:53:01.734+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:52:00+00:00, map_index=-1, run_start_date=2024-02-24 04:53:01.139023+00:00, run_end_date=2024-02-24 04:53:01.499046+00:00, run_duration=0.360023, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1423, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:53:00.340048+00:00, queued_by_job_id=2, pid=20737 2024-02-24T04:53:04.317247559Z [2024-02-24T04:53:04.316+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:53:04.317532273Z [2024-02-24T04:53:04.317+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:52:00+00:00, run_id=scheduled__2024-02-24T04:52:00+00:00, run_start_date=2024-02-24 04:53:00.259323+00:00, run_end_date=2024-02-24 04:53:04.317042+00:00, run_duration=4.057719, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:52:00+00:00, data_interval_end=2024-02-24 04:53:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:53:04.330232896Z [2024-02-24T04:53:04.329+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:53:00+00:00, run_after=2024-02-24T04:54:00+00:00 2024-02-24T04:53:04.342550421Z [2024-02-24T04:53:04.342+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:53:04.343183235Z [2024-02-24T04:53:04.342+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:52:00+00:00, run_id=scheduled__2024-02-24T04:52:00+00:00, run_start_date=2024-02-24 04:53:00.260212+00:00, run_end_date=2024-02-24 04:53:04.342730+00:00, run_duration=4.082518, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:52:00+00:00, data_interval_end=2024-02-24 04:53:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:53:04.370529202Z [2024-02-24T04:53:04.370+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:53:00+00:00, run_after=2024-02-24T04:54:00+00:00 2024-02-24T04:53:04.417863564Z [2024-02-24T04:53:04.417+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:52:00+00:00 exited with status success for try_number 1 2024-02-24T04:53:04.418171932Z [2024-02-24T04:53:04.417+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:52:00+00:00 exited with status success for try_number 1 2024-02-24T04:53:04.431544868Z [2024-02-24T04:53:04.430+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:52:00+00:00, map_index=-1, run_start_date=2024-02-24 04:53:02.198468+00:00, run_end_date=2024-02-24 04:53:03.503497+00:00, run_duration=1.305029, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1425, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:53:00.340048+00:00, queued_by_job_id=2, pid=20756 2024-02-24T04:53:04.432168996Z [2024-02-24T04:53:04.431+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:52:00+00:00, map_index=-1, run_start_date=2024-02-24 04:53:01.985133+00:00, run_end_date=2024-02-24 04:53:03.685565+00:00, run_duration=1.700432, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1424, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:53:00.340048+00:00, queued_by_job_id=2, pid=20750 2024-02-24T04:54:00.097073011Z [2024-02-24T04:54:00.096+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:54:00.104590510Z [2024-02-24T04:54:00.104+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:54:00.124489415Z [2024-02-24T04:54:00.123+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:54:00+00:00, run_after=2024-02-24T04:55:00+00:00 2024-02-24T04:54:00.150178202Z [2024-02-24T04:54:00.149+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:54:00+00:00, run_after=2024-02-24T04:55:00+00:00 2024-02-24T04:54:00.273442195Z [2024-02-24T04:54:00.272+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T04:54:00.273508253Z 2024-02-24T04:54:00.273527853Z 2024-02-24T04:54:00.273542985Z 2024-02-24T04:54:00.273556755Z 2024-02-24T04:54:00.273677313Z [2024-02-24T04:54:00.273+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T04:54:00.273904801Z [2024-02-24T04:54:00.273+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:54:00.274355586Z [2024-02-24T04:54:00.273+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:54:00.274836685Z [2024-02-24T04:54:00.274+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:54:00.276165041Z [2024-02-24T04:54:00.275+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:54:00.276189640Z 2024-02-24T04:54:00.276196698Z 2024-02-24T04:54:00.276202178Z 2024-02-24T04:54:00.276207744Z 2024-02-24T04:54:00.283160523Z [2024-02-24T04:54:00.282+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T04:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:54:00.283521522Z [2024-02-24T04:54:00.283+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T04:54:00.284203276Z [2024-02-24T04:54:00.283+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:54:00.284277332Z [2024-02-24T04:54:00.284+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:54:00.284666590Z [2024-02-24T04:54:00.284+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:54:00.284861066Z [2024-02-24T04:54:00.284+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:54:00.285539560Z [2024-02-24T04:54:00.285+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:54:00.285829217Z [2024-02-24T04:54:00.285+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:54:00.561297489Z [2024-02-24T04:54:00.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:52:00+00:00 exited with status queued for try_number 1 2024-02-24T04:54:00.561586321Z [2024-02-24T04:54:00.561+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:53:00+00:00 exited with status queued for try_number 1 2024-02-24T04:54:00.561787156Z [2024-02-24T04:54:00.561+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:53:00+00:00 exited with status queued for try_number 1 2024-02-24T04:54:00.562006543Z [2024-02-24T04:54:00.561+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:53:00+00:00 exited with status queued for try_number 1 2024-02-24T04:54:00.589874318Z [2024-02-24T04:54:00.589+0000] {scheduler_job.py:635} INFO - Setting external_id for to 96327046-3d9f-42c2-9e78-e6ecd5908231 2024-02-24T04:54:00.593196902Z [2024-02-24T04:54:00.592+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b8ec2b3-d99b-4bfd-9301-6109a8ee28c3 2024-02-24T04:54:00.593542123Z [2024-02-24T04:54:00.593+0000] {scheduler_job.py:635} INFO - Setting external_id for to 32f178c4-054b-4e45-9293-cf4191dc197d 2024-02-24T04:54:00.594493379Z [2024-02-24T04:54:00.593+0000] {scheduler_job.py:635} INFO - Setting external_id for to 90cb25b0-62c3-468c-be19-3414973b42fd 2024-02-24T04:54:01.860627298Z [2024-02-24T04:54:01.860+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:54:01.861345911Z [2024-02-24T04:54:01.860+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 04:52:00+00:00, run_id=scheduled__2024-02-24T04:52:00+00:00, run_start_date=2024-02-24 04:54:00.165372+00:00, run_end_date=2024-02-24 04:54:01.860547+00:00, run_duration=1.695175, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:52:00+00:00, data_interval_end=2024-02-24 04:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T04:54:01.879178878Z [2024-02-24T04:54:01.878+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T04:54:00+00:00, run_after=2024-02-24T04:56:00+00:00 2024-02-24T04:54:01.897169215Z [2024-02-24T04:54:01.896+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:54:01.897968932Z [2024-02-24T04:54:01.897+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:53:00+00:00, run_id=scheduled__2024-02-24T04:53:00+00:00, run_start_date=2024-02-24 04:54:00.167229+00:00, run_end_date=2024-02-24 04:54:01.897034+00:00, run_duration=1.729805, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:53:00+00:00, data_interval_end=2024-02-24 04:54:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:54:01.912778440Z [2024-02-24T04:54:01.912+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:54:00+00:00, run_after=2024-02-24T04:55:00+00:00 2024-02-24T04:54:01.974897734Z [2024-02-24T04:54:01.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:52:00+00:00 exited with status success for try_number 1 2024-02-24T04:54:01.976427634Z [2024-02-24T04:54:01.976+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:53:00+00:00 exited with status success for try_number 1 2024-02-24T04:54:01.984710017Z [2024-02-24T04:54:01.984+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T04:52:00+00:00, map_index=-1, run_start_date=2024-02-24 04:54:01.267337+00:00, run_end_date=2024-02-24 04:54:01.643973+00:00, run_duration=0.376636, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1427, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:54:00.278175+00:00, queued_by_job_id=2, pid=20790 2024-02-24T04:54:01.985175221Z [2024-02-24T04:54:01.984+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:53:00+00:00, map_index=-1, run_start_date=2024-02-24 04:54:01.126348+00:00, run_end_date=2024-02-24 04:54:01.594570+00:00, run_duration=0.468222, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1426, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:54:00.278175+00:00, queued_by_job_id=2, pid=20789 2024-02-24T04:54:05.267437583Z [2024-02-24T04:54:05.266+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:54:05.267600579Z [2024-02-24T04:54:05.267+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:53:00+00:00, run_id=scheduled__2024-02-24T04:53:00+00:00, run_start_date=2024-02-24 04:54:00.169870+00:00, run_end_date=2024-02-24 04:54:05.267253+00:00, run_duration=5.097383, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:53:00+00:00, data_interval_end=2024-02-24 04:54:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:54:05.276607436Z [2024-02-24T04:54:05.276+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:54:00+00:00, run_after=2024-02-24T04:55:00+00:00 2024-02-24T04:54:05.283521643Z [2024-02-24T04:54:05.283+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:54:05.283827432Z [2024-02-24T04:54:05.283+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:53:00+00:00, run_id=scheduled__2024-02-24T04:53:00+00:00, run_start_date=2024-02-24 04:54:00.168640+00:00, run_end_date=2024-02-24 04:54:05.283392+00:00, run_duration=5.114752, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:53:00+00:00, data_interval_end=2024-02-24 04:54:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:54:05.293488932Z [2024-02-24T04:54:05.292+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:54:00+00:00, run_after=2024-02-24T04:55:00+00:00 2024-02-24T04:54:05.328265175Z [2024-02-24T04:54:05.327+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:53:00+00:00 exited with status success for try_number 1 2024-02-24T04:54:05.328307151Z [2024-02-24T04:54:05.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:53:00+00:00 exited with status success for try_number 1 2024-02-24T04:54:05.341853841Z [2024-02-24T04:54:05.334+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:53:00+00:00, map_index=-1, run_start_date=2024-02-24 04:54:02.445975+00:00, run_end_date=2024-02-24 04:54:04.965129+00:00, run_duration=2.519154, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1429, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:54:00.278175+00:00, queued_by_job_id=2, pid=20814 2024-02-24T04:54:05.344848295Z [2024-02-24T04:54:05.334+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:53:00+00:00, map_index=-1, run_start_date=2024-02-24 04:54:02.284715+00:00, run_end_date=2024-02-24 04:54:04.242981+00:00, run_duration=1.958266, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1428, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:54:00.278175+00:00, queued_by_job_id=2, pid=20813 2024-02-24T04:55:00.987929817Z [2024-02-24T04:55:00.987+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:55:00+00:00, run_after=2024-02-24T04:56:00+00:00 2024-02-24T04:55:01.010028940Z [2024-02-24T04:55:01.009+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:55:00+00:00, run_after=2024-02-24T04:56:00+00:00 2024-02-24T04:55:01.021671951Z [2024-02-24T04:55:01.021+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:55:01.044134955Z [2024-02-24T04:55:01.043+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:55:00+00:00, run_after=2024-02-24T05:00:00+00:00 2024-02-24T04:55:01.155820160Z [2024-02-24T04:55:01.155+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T04:55:01.155847427Z 2024-02-24T04:55:01.155851987Z 2024-02-24T04:55:01.155855407Z 2024-02-24T04:55:01.155858614Z 2024-02-24T04:55:01.155991593Z [2024-02-24T04:55:01.155+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:55:01.156060597Z [2024-02-24T04:55:01.155+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:55:01.156208111Z [2024-02-24T04:55:01.156+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:55:01.156380027Z [2024-02-24T04:55:01.156+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:55:01.157376846Z [2024-02-24T04:55:01.157+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:55:01.157385270Z 2024-02-24T04:55:01.157388736Z 2024-02-24T04:55:01.157391890Z 2024-02-24T04:55:01.157415023Z 2024-02-24T04:55:01.162370108Z [2024-02-24T04:55:01.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-02-24T04:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-02-24T04:55:01.162652246Z [2024-02-24T04:55:01.162+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T04:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T04:55:01.163051275Z [2024-02-24T04:55:01.162+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:55:01.163167592Z [2024-02-24T04:55:01.162+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:55:01.163524146Z [2024-02-24T04:55:01.163+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:55:01.163660613Z [2024-02-24T04:55:01.163+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:55:01.164057783Z [2024-02-24T04:55:01.163+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:55:01.164239789Z [2024-02-24T04:55:01.163+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:55:01.834727812Z [2024-02-24T04:55:01.834+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T04:50:00+00:00 exited with status queued for try_number 1 2024-02-24T04:55:01.834774056Z [2024-02-24T04:55:01.834+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:54:00+00:00 exited with status queued for try_number 1 2024-02-24T04:55:01.834787866Z [2024-02-24T04:55:01.834+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:54:00+00:00 exited with status queued for try_number 1 2024-02-24T04:55:01.834903632Z [2024-02-24T04:55:01.834+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:54:00+00:00 exited with status queued for try_number 1 2024-02-24T04:55:01.859441753Z [2024-02-24T04:55:01.859+0000] {scheduler_job.py:635} INFO - Setting external_id for to cfd692c4-e8d6-4d37-b89d-bde782a51caf 2024-02-24T04:55:01.859477560Z [2024-02-24T04:55:01.859+0000] {scheduler_job.py:635} INFO - Setting external_id for to b083eb15-f77c-42cd-90d0-5dcc629a9573 2024-02-24T04:55:01.859604226Z [2024-02-24T04:55:01.859+0000] {scheduler_job.py:635} INFO - Setting external_id for to bdd3effa-f2b3-43b9-ace7-8e3fd92ee4cb 2024-02-24T04:55:01.859716044Z [2024-02-24T04:55:01.859+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5be229a5-4b79-4d7d-b3e2-ae283d54650c 2024-02-24T04:55:03.920032288Z [2024-02-24T04:55:03.919+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:55:03.920464830Z [2024-02-24T04:55:03.920+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:54:00+00:00, run_id=scheduled__2024-02-24T04:54:00+00:00, run_start_date=2024-02-24 04:55:01.067477+00:00, run_end_date=2024-02-24 04:55:03.919961+00:00, run_duration=2.852484, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:54:00+00:00, data_interval_end=2024-02-24 04:55:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:55:03.931396341Z [2024-02-24T04:55:03.931+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:55:00+00:00, run_after=2024-02-24T04:56:00+00:00 2024-02-24T04:55:04.012807956Z [2024-02-24T04:55:04.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:54:00+00:00 exited with status success for try_number 1 2024-02-24T04:55:04.019871407Z [2024-02-24T04:55:04.019+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:54:00+00:00, map_index=-1, run_start_date=2024-02-24 04:55:02.276395+00:00, run_end_date=2024-02-24 04:55:02.826389+00:00, run_duration=0.549994, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1430, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:55:01.158716+00:00, queued_by_job_id=2, pid=20847 2024-02-24T04:55:05.109865483Z [2024-02-24T04:55:05.109+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:55:05.110421810Z [2024-02-24T04:55:05.109+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:54:00+00:00, run_id=scheduled__2024-02-24T04:54:00+00:00, run_start_date=2024-02-24 04:55:01.068574+00:00, run_end_date=2024-02-24 04:55:05.109716+00:00, run_duration=4.041142, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:54:00+00:00, data_interval_end=2024-02-24 04:55:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:55:05.129837654Z [2024-02-24T04:55:05.129+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:55:00+00:00, run_after=2024-02-24T04:56:00+00:00 2024-02-24T04:55:05.172126049Z [2024-02-24T04:55:05.171+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:55:05.172162719Z 2024-02-24T04:55:05.172570108Z [2024-02-24T04:55:05.172+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:55:05.174057877Z [2024-02-24T04:55:05.173+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:55:05.174105050Z 2024-02-24T04:55:05.178379013Z [2024-02-24T04:55:05.177+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='split_metrics', run_id='scheduled__2024-02-24T04:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-02-24T04:55:05.178569475Z [2024-02-24T04:55:05.178+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T04:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T04:55:05.245333937Z [2024-02-24T04:55:05.244+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T04:50:00+00:00 exited with status queued for try_number 1 2024-02-24T04:55:05.245382252Z [2024-02-24T04:55:05.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs run_id=scheduled__2024-02-24T04:50:00+00:00 exited with status success for try_number 1 2024-02-24T04:55:05.245532866Z [2024-02-24T04:55:05.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:54:00+00:00 exited with status success for try_number 1 2024-02-24T04:55:05.254400705Z [2024-02-24T04:55:05.254+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-02-24T04:50:00+00:00, map_index=-1, run_start_date=2024-02-24 04:55:03.601643+00:00, run_end_date=2024-02-24 04:55:04.057260+00:00, run_duration=0.455617, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1432, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:55:01.158716+00:00, queued_by_job_id=2, pid=20873 2024-02-24T04:55:05.254588749Z [2024-02-24T04:55:05.254+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:54:00+00:00, map_index=-1, run_start_date=2024-02-24 04:55:03.266046+00:00, run_end_date=2024-02-24 04:55:04.580800+00:00, run_duration=1.314754, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1431, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:55:01.158716+00:00, queued_by_job_id=2, pid=20861 2024-02-24T04:55:05.254782773Z [2024-02-24T04:55:05.254+0000] {scheduler_job.py:635} INFO - Setting external_id for to da9a96de-ad4c-4627-8e6f-715196f9f48c 2024-02-24T04:55:06.403038178Z [2024-02-24T04:55:06.402+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:55:06.403363324Z [2024-02-24T04:55:06.403+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:54:00+00:00, run_id=scheduled__2024-02-24T04:54:00+00:00, run_start_date=2024-02-24 04:55:01.069696+00:00, run_end_date=2024-02-24 04:55:06.402836+00:00, run_duration=5.33314, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:54:00+00:00, data_interval_end=2024-02-24 04:55:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:55:06.412786067Z [2024-02-24T04:55:06.412+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:55:00+00:00, run_after=2024-02-24T04:56:00+00:00 2024-02-24T04:55:06.479865931Z [2024-02-24T04:55:06.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:54:00+00:00 exited with status success for try_number 1 2024-02-24T04:55:06.488091779Z [2024-02-24T04:55:06.487+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:54:00+00:00, map_index=-1, run_start_date=2024-02-24 04:55:03.649169+00:00, run_end_date=2024-02-24 04:55:05.456714+00:00, run_duration=1.807545, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1433, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:55:01.158716+00:00, queued_by_job_id=2, pid=20878 2024-02-24T04:55:07.909670576Z [2024-02-24T04:55:07.909+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:55:07.909723081Z 2024-02-24T04:55:07.910012847Z [2024-02-24T04:55:07.909+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:55:07.910955828Z [2024-02-24T04:55:07.910+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:55:07.910986314Z 2024-02-24T04:55:07.914281813Z [2024-02-24T04:55:07.913+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='collect_metrics', run_id='scheduled__2024-02-24T04:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-02-24T04:55:07.914604333Z [2024-02-24T04:55:07.914+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T04:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-02-24T04:55:07.981852874Z [2024-02-24T04:55:07.981+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T04:50:00+00:00 exited with status queued for try_number 1 2024-02-24T04:55:07.982245203Z [2024-02-24T04:55:07.981+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics run_id=scheduled__2024-02-24T04:50:00+00:00 exited with status success for try_number 1 2024-02-24T04:55:07.993421608Z [2024-02-24T04:55:07.992+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ed9f6b6-957c-4eab-8681-8cf3c377edbb 2024-02-24T04:55:07.994012503Z [2024-02-24T04:55:07.993+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=split_metrics, run_id=scheduled__2024-02-24T04:50:00+00:00, map_index=-1, run_start_date=2024-02-24 04:55:06.989179+00:00, run_end_date=2024-02-24 04:55:07.424475+00:00, run_duration=0.435296, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1434, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:55:05.174504+00:00, queued_by_job_id=2, pid=20896 2024-02-24T04:55:10.216018885Z [2024-02-24T04:55:10.215+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-02-24T04:55:10.216051230Z 2024-02-24T04:55:10.216127703Z [2024-02-24T04:55:10.215+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:55:10.217167845Z [2024-02-24T04:55:10.216+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:55:10.217185081Z 2024-02-24T04:55:10.220793283Z [2024-02-24T04:55:10.220+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='send_prometheus', run_id='scheduled__2024-02-24T04:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:55:10.220930283Z [2024-02-24T04:55:10.220+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T04:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-02-24T04:55:10.286429317Z [2024-02-24T04:55:10.285+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T04:50:00+00:00 exited with status queued for try_number 1 2024-02-24T04:55:10.286482065Z [2024-02-24T04:55:10.286+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics run_id=scheduled__2024-02-24T04:50:00+00:00 exited with status success for try_number 1 2024-02-24T04:55:10.293358576Z [2024-02-24T04:55:10.292+0000] {scheduler_job.py:635} INFO - Setting external_id for to 852c6518-a7b5-4249-b359-bfba677a48be 2024-02-24T04:55:10.293470257Z [2024-02-24T04:55:10.293+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=collect_metrics, run_id=scheduled__2024-02-24T04:50:00+00:00, map_index=0, run_start_date=2024-02-24 04:55:09.571719+00:00, run_end_date=2024-02-24 04:55:09.917240+00:00, run_duration=0.345521, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1435, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:55:07.911495+00:00, queued_by_job_id=2, pid=20904 2024-02-24T04:55:12.512362796Z [2024-02-24T04:55:12.511+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:55:12.512636931Z [2024-02-24T04:55:12.512+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:50:00+00:00, run_id=scheduled__2024-02-24T04:50:00+00:00, run_start_date=2024-02-24 04:55:01.066162+00:00, run_end_date=2024-02-24 04:55:12.512096+00:00, run_duration=11.445934, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:50:00+00:00, data_interval_end=2024-02-24 04:55:00+00:00, dag_hash=ff8375339527764bd1ebb44b2568ba43 2024-02-24T04:55:12.521920970Z [2024-02-24T04:55:12.521+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:55:00+00:00, run_after=2024-02-24T05:00:00+00:00 2024-02-24T04:55:12.561005581Z [2024-02-24T04:55:12.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus run_id=scheduled__2024-02-24T04:50:00+00:00 exited with status success for try_number 1 2024-02-24T04:55:12.567046322Z [2024-02-24T04:55:12.566+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=send_prometheus, run_id=scheduled__2024-02-24T04:50:00+00:00, map_index=-1, run_start_date=2024-02-24 04:55:11.857882+00:00, run_end_date=2024-02-24 04:55:12.259474+00:00, run_duration=0.401592, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1436, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:55:10.217682+00:00, queued_by_job_id=2, pid=20912 2024-02-24T04:56:00.976873281Z [2024-02-24T04:56:00.976+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:56:00+00:00, run_after=2024-02-24T04:57:00+00:00 2024-02-24T04:56:00.986325490Z [2024-02-24T04:56:00.985+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:56:01.005551341Z [2024-02-24T04:56:01.005+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:56:00+00:00, run_after=2024-02-24T04:57:00+00:00 2024-02-24T04:56:01.017901255Z [2024-02-24T04:56:01.017+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-02-24T04:56:01.124004754Z [2024-02-24T04:56:01.123+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-02-24T04:56:01.124074569Z 2024-02-24T04:56:01.124081977Z 2024-02-24T04:56:01.124087445Z 2024-02-24T04:56:01.124092505Z 2024-02-24T04:56:01.124519304Z [2024-02-24T04:56:01.124+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-02-24T04:56:01.124916440Z [2024-02-24T04:56:01.124+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:56:01.125410463Z [2024-02-24T04:56:01.125+0000] {scheduler_job.py:425} INFO - DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 has 0/16 running and queued tasks 2024-02-24T04:56:01.125764533Z [2024-02-24T04:56:01.125+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a has 0/16 running and queued tasks 2024-02-24T04:56:01.126992242Z [2024-02-24T04:56:01.126+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-02-24T04:56:01.127036254Z 2024-02-24T04:56:01.127045293Z 2024-02-24T04:56:01.127051481Z 2024-02-24T04:56:01.127057732Z 2024-02-24T04:56:01.132690169Z [2024-02-24T04:56:01.132+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-02-24T04:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:56:01.132931249Z [2024-02-24T04:56:01.132+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-02-24T04:56:01.133292635Z [2024-02-24T04:56:01.133+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:56:01.133494821Z [2024-02-24T04:56:01.133+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-02-24T04:56:01.133830499Z [2024-02-24T04:56:01.133+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:56:01.134044184Z [2024-02-24T04:56:01.133+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-02-24T04:56:01.134321621Z [2024-02-24T04:56:01.134+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-02-24T04:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-02-24T04:56:01.134505222Z [2024-02-24T04:56:01.134+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-02-24T04:56:01.727093661Z [2024-02-24T04:56:01.726+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:54:00+00:00 exited with status queued for try_number 1 2024-02-24T04:56:01.727336380Z [2024-02-24T04:56:01.726+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:55:00+00:00 exited with status queued for try_number 1 2024-02-24T04:56:01.727493162Z [2024-02-24T04:56:01.727+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:55:00+00:00 exited with status queued for try_number 1 2024-02-24T04:56:01.727635623Z [2024-02-24T04:56:01.727+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:55:00+00:00 exited with status queued for try_number 1 2024-02-24T04:56:01.749536404Z [2024-02-24T04:56:01.749+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba93e7ef-8b59-40a8-abad-75dcce576ffc 2024-02-24T04:56:01.754429446Z [2024-02-24T04:56:01.754+0000] {scheduler_job.py:635} INFO - Setting external_id for to ec31243f-0e17-4667-ad65-02a2e0dbd76e 2024-02-24T04:56:01.754822427Z [2024-02-24T04:56:01.754+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8998a62e-556e-4f46-a002-0e48bd5a86ad 2024-02-24T04:56:01.755176218Z [2024-02-24T04:56:01.754+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb2e6993-74fd-4b62-8b81-30d1f42af3aa 2024-02-24T04:56:02.991786674Z [2024-02-24T04:56:02.991+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:56:02.992371126Z [2024-02-24T04:56:02.992+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-02-24 04:54:00+00:00, run_id=scheduled__2024-02-24T04:54:00+00:00, run_start_date=2024-02-24 04:56:01.041527+00:00, run_end_date=2024-02-24 04:56:02.991740+00:00, run_duration=1.950213, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:54:00+00:00, data_interval_end=2024-02-24 04:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-02-24T04:56:03.000705653Z [2024-02-24T04:56:03.000+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-02-24T04:56:00+00:00, run_after=2024-02-24T04:58:00+00:00 2024-02-24T04:56:03.012573447Z [2024-02-24T04:56:03.011+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:56:03.013163429Z [2024-02-24T04:56:03.012+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, execution_date=2024-02-24 04:55:00+00:00, run_id=scheduled__2024-02-24T04:55:00+00:00, run_start_date=2024-02-24 04:56:01.043529+00:00, run_end_date=2024-02-24 04:56:03.012763+00:00, run_duration=1.969234, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:55:00+00:00, data_interval_end=2024-02-24 04:56:00+00:00, dag_hash=c2217ef90cc20dd724f241b95f642047 2024-02-24T04:56:03.029008231Z [2024-02-24T04:56:03.028+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a to 2024-02-24T04:56:00+00:00, run_after=2024-02-24T04:57:00+00:00 2024-02-24T04:56:03.103222988Z [2024-02-24T04:56:03.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-02-24T04:54:00+00:00 exited with status success for try_number 1 2024-02-24T04:56:03.103332973Z [2024-02-24T04:56:03.103+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:55:00+00:00 exited with status success for try_number 1 2024-02-24T04:56:03.110659944Z [2024-02-24T04:56:03.110+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:55:00+00:00, map_index=-1, run_start_date=2024-02-24 04:56:02.097241+00:00, run_end_date=2024-02-24 04:56:02.563157+00:00, run_duration=0.465916, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1438, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:56:01.128487+00:00, queued_by_job_id=2, pid=20937 2024-02-24T04:56:03.110900135Z [2024-02-24T04:56:03.110+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-02-24T04:54:00+00:00, map_index=-1, run_start_date=2024-02-24 04:56:01.995258+00:00, run_end_date=2024-02-24 04:56:02.341729+00:00, run_duration=0.346471, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1437, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:56:01.128487+00:00, queued_by_job_id=2, pid=20936 2024-02-24T04:56:06.131459315Z [2024-02-24T04:56:06.130+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:56:06.131916096Z [2024-02-24T04:56:06.131+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:55:00+00:00, run_id=scheduled__2024-02-24T04:55:00+00:00, run_start_date=2024-02-24 04:56:01.049011+00:00, run_end_date=2024-02-24 04:56:06.131208+00:00, run_duration=5.082197, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:55:00+00:00, data_interval_end=2024-02-24 04:56:00+00:00, dag_hash=a926a52eb0d4b44206f92aceb64611e1 2024-02-24T04:56:06.149450663Z [2024-02-24T04:56:06.148+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:56:00+00:00, run_after=2024-02-24T04:57:00+00:00 2024-02-24T04:56:06.159716004Z [2024-02-24T04:56:06.159+0000] {dagrun.py:607} INFO - Marking run successful 2024-02-24T04:56:06.160251487Z [2024-02-24T04:56:06.159+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, execution_date=2024-02-24 04:55:00+00:00, run_id=scheduled__2024-02-24T04:55:00+00:00, run_start_date=2024-02-24 04:56:01.046956+00:00, run_end_date=2024-02-24 04:56:06.159558+00:00, run_duration=5.112602, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-02-24 04:55:00+00:00, data_interval_end=2024-02-24 04:56:00+00:00, dag_hash=f5588aa081ad57bb8e62d79bef7aeb54 2024-02-24T04:56:06.171845342Z [2024-02-24T04:56:06.171+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5 to 2024-02-24T04:56:00+00:00, run_after=2024-02-24T04:57:00+00:00 2024-02-24T04:56:06.220356240Z [2024-02-24T04:56:06.219+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:55:00+00:00 exited with status success for try_number 1 2024-02-24T04:56:06.220699065Z [2024-02-24T04:56:06.220+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-02-24T04:55:00+00:00 exited with status success for try_number 1 2024-02-24T04:56:06.232745423Z [2024-02-24T04:56:06.232+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:55:00+00:00, map_index=-1, run_start_date=2024-02-24 04:56:03.215056+00:00, run_end_date=2024-02-24 04:56:05.129628+00:00, run_duration=1.914572, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1440, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:56:01.128487+00:00, queued_by_job_id=2, pid=20961 2024-02-24T04:56:06.233671864Z [2024-02-24T04:56:06.232+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-02-24T04:55:00+00:00, map_index=-1, run_start_date=2024-02-24 04:56:03.178186+00:00, run_end_date=2024-02-24 04:56:05.170595+00:00, run_duration=1.992409, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1439, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-02-24 04:56:01.128487+00:00, queued_by_job_id=2, pid=20960 2024-02-23T23:31:49.093953820Z 2024-02-23T23:31:49.096986127Z Cleaning logs every 900 seconds 2024-02-23T23:31:49.096999857Z Trimming airflow logs to 15 days. 2024-02-23T23:45:00.121523084Z Trimming airflow logs to 15 days. 2024-02-23T23:45:01.155796540Z Trimming airflow logs to 15 days. 2024-02-24T00:00:00.188078381Z Trimming airflow logs to 15 days. 2024-02-24T00:00:01.231132313Z Trimming airflow logs to 15 days. 2024-02-24T00:15:00.350277917Z Trimming airflow logs to 15 days. 2024-02-24T00:15:01.371472249Z Trimming airflow logs to 15 days. 2024-02-24T00:30:00.405271112Z Trimming airflow logs to 15 days. 2024-02-24T00:30:01.438137700Z Trimming airflow logs to 15 days. 2024-02-24T00:45:00.469541903Z Trimming airflow logs to 15 days. 2024-02-24T00:45:01.491547663Z Trimming airflow logs to 15 days. 2024-02-24T01:00:00.527860338Z Trimming airflow logs to 15 days. 2024-02-24T01:00:01.555309357Z Trimming airflow logs to 15 days. 2024-02-24T01:15:00.596383689Z Trimming airflow logs to 15 days. 2024-02-24T01:15:01.623513877Z Trimming airflow logs to 15 days. 2024-02-24T01:30:00.681601186Z Trimming airflow logs to 15 days. 2024-02-24T01:30:01.708425948Z Trimming airflow logs to 15 days. 2024-02-24T01:45:00.753913632Z Trimming airflow logs to 15 days. 2024-02-24T01:45:01.786479420Z Trimming airflow logs to 15 days. 2024-02-24T02:00:00.832744070Z Trimming airflow logs to 15 days. 2024-02-24T02:00:01.866072539Z Trimming airflow logs to 15 days. 2024-02-24T02:15:00.918052912Z Trimming airflow logs to 15 days. 2024-02-24T02:15:01.938690848Z Trimming airflow logs to 15 days. 2024-02-24T02:30:00.978860959Z Trimming airflow logs to 15 days. 2024-02-24T02:45:00.022631664Z Trimming airflow logs to 15 days. 2024-02-24T02:45:01.051290147Z Trimming airflow logs to 15 days. 2024-02-24T03:00:00.075191260Z Trimming airflow logs to 15 days. 2024-02-24T03:00:01.110392405Z Trimming airflow logs to 15 days. 2024-02-24T03:15:00.147622468Z Trimming airflow logs to 15 days. 2024-02-24T03:15:01.175288692Z Trimming airflow logs to 15 days. 2024-02-24T03:30:00.236885158Z Trimming airflow logs to 15 days. 2024-02-24T03:30:01.279542499Z Trimming airflow logs to 15 days. 2024-02-24T03:45:00.315516002Z Trimming airflow logs to 15 days. 2024-02-24T03:45:01.355105957Z Trimming airflow logs to 15 days. 2024-02-24T04:00:00.402239509Z Trimming airflow logs to 15 days. 2024-02-24T04:00:01.438049647Z Trimming airflow logs to 15 days. 2024-02-24T04:15:00.481800366Z Trimming airflow logs to 15 days. 2024-02-24T04:15:01.510144985Z Trimming airflow logs to 15 days. 2024-02-24T04:30:00.550193317Z Trimming airflow logs to 15 days. 2024-02-24T04:30:01.567984128Z Trimming airflow logs to 15 days. 2024-02-24T04:45:00.616039676Z Trimming airflow logs to 15 days. 2024-02-24T04:45:01.631771698Z Trimming airflow logs to 15 days.