2024-04-06T01:29:23.162243682Z ... 2024-04-06T01:29:23.945215473Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-04-06T01:29:25.016171318Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-04-06T01:29:34.331891752Z [2024-04-06T01:29:34.325+0000] {db.py:755} INFO - Waiting for migrations... 0 second(s) 2024-04-06T01:29:35.343797134Z [2024-04-06T01:29:35.343+0000] {db.py:755} INFO - Waiting for migrations... 1 second(s) 2024-04-06T01:29:57.791985996Z 2024-04-06T01:29:59.125933593Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-04-06T01:30:00.942311268Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-04-06T01:30:16.544944369Z ____________ _____________ 2024-04-06T01:30:16.544966140Z ____ |__( )_________ __/__ /________ __ 2024-04-06T01:30:16.544969629Z ____ /| |_ /__ ___/_ /_ __ /_ __ \_ | /| / / 2024-04-06T01:30:16.544972875Z ___ ___ | / _ / _ __/ _ / / /_/ /_ |/ |/ / 2024-04-06T01:30:16.544976095Z _/_/ |_/_/ /_/ /_/ /_/ \____/____/|__/ 2024-04-06T01:30:16.544980013Z [2024-04-06T01:30:16.543+0000] {scheduler_job.py:714} INFO - Starting the scheduler 2024-04-06T01:30:16.545354474Z [2024-04-06T01:30:16.544+0000] {scheduler_job.py:719} INFO - Processing each file at most -1 times 2024-04-06T01:30:17.553762603Z [2024-04-06T01:30:17.553+0000] {executor_loader.py:107} INFO - Loaded executor: CeleryExecutor 2024-04-06T01:30:17.578006524Z [2024-04-06T01:30:17.562+0000] {manager.py:165} INFO - Launched DagFileProcessorManager with pid: 27 2024-04-06T01:30:17.585927104Z [2024-04-06T01:30:17.577+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-06T01:30:17.609918313Z [2024-04-06T01:30:17.595+0000] {settings.py:59} INFO - Configured default timezone Timezone('UTC') 2024-04-06T01:30:17.609936271Z [2024-04-06T01:30:17.607+0000] {settings.py:549} INFO - Loaded airflow_local_settings from /opt/airflow/config/airflow_local_settings.py . 2024-04-06T01:30:34.549679149Z [2024-04-06T01:30:34.549+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:30:34.606197925Z [2024-04-06T01:30:34.605+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T01:30:34.606208027Z 2024-04-06T01:30:34.606405229Z [2024-04-06T01:30:34.606+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T01:30:34.606930370Z [2024-04-06T01:30:34.606+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:30:34.606943451Z 2024-04-06T01:30:34.610004577Z [2024-04-06T01:30:34.609+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:30:34.611799578Z [2024-04-06T01:30:34.610+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:30:34.992678508Z [2024-04-06T01:30:34.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T01:28:00+00:00 exited with status queued for try_number 1 2024-04-06T01:30:35.005082908Z [2024-04-06T01:30:35.004+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30046c95-c944-47d6-ae4d-25e69963147a 2024-04-06T01:30:40.476163868Z [2024-04-06T01:30:40.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T01:28:00+00:00 exited with status success for try_number 1 2024-04-06T01:30:40.504355293Z [2024-04-06T01:30:40.504+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T01:28:00+00:00, map_index=-1, run_start_date=2024-04-06 01:30:37.733624+00:00, run_end_date=2024-04-06 01:30:39.108808+00:00, run_duration=1.375184, state=up_for_retry, executor_state=success, try_number=1, max_tries=1, job_id=3, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:30:34.607541+00:00, queued_by_job_id=2, pid=50 2024-04-06T01:30:49.662520304Z [2024-04-06T01:30:49.661+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T01:30:49.662537524Z 2024-04-06T01:30:49.662541692Z [2024-04-06T01:30:49.661+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T01:30:49.663151998Z [2024-04-06T01:30:49.662+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:30:49.663162578Z 2024-04-06T01:30:49.665249083Z [2024-04-06T01:30:49.665+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T01:28:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:30:49.665472352Z [2024-04-06T01:30:49.665+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:30:49.719789940Z [2024-04-06T01:30:49.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T01:28:00+00:00 exited with status queued for try_number 2 2024-04-06T01:30:49.728591276Z [2024-04-06T01:30:49.728+0000] {scheduler_job.py:635} INFO - Setting external_id for to b89b69ba-0b97-49e8-b8fd-092a66fbb613 2024-04-06T01:30:51.843595021Z [2024-04-06T01:30:51.842+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-06T01:30:51.843939117Z [2024-04-06T01:30:51.843+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 01:28:00+00:00, run_id=scheduled__2024-04-06T01:28:00+00:00, run_start_date=2024-04-06 01:30:34.559391+00:00, run_end_date=2024-04-06 01:30:51.843504+00:00, run_duration=17.284113, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:28:00+00:00, data_interval_end=2024-04-06 01:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T01:30:51.853549732Z [2024-04-06T01:30:51.853+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T01:30:00+00:00, run_after=2024-04-06T01:32:00+00:00 2024-04-06T01:30:51.917103477Z [2024-04-06T01:30:51.916+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T01:28:00+00:00 exited with status success for try_number 2 2024-04-06T01:30:51.926833176Z [2024-04-06T01:30:51.926+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T01:28:00+00:00, map_index=-1, run_start_date=2024-04-06 01:30:50.726607+00:00, run_end_date=2024-04-06 01:30:51.311211+00:00, run_duration=0.584604, state=failed, executor_state=success, try_number=2, max_tries=1, job_id=4, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:30:49.663291+00:00, queued_by_job_id=2, pid=61 2024-04-06T01:32:00.235066889Z [2024-04-06T01:32:00.231+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:32:00.281348437Z [2024-04-06T01:32:00.281+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T01:32:00.281361558Z 2024-04-06T01:32:00.284957714Z [2024-04-06T01:32:00.284+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T01:32:00.285991131Z [2024-04-06T01:32:00.285+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:32:00.286004120Z 2024-04-06T01:32:00.288808145Z [2024-04-06T01:32:00.288+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:32:00.288969207Z [2024-04-06T01:32:00.288+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:32:00.352060885Z [2024-04-06T01:32:00.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T01:30:00+00:00 exited with status queued for try_number 1 2024-04-06T01:32:00.357462065Z [2024-04-06T01:32:00.357+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62a2d69e-3d12-4fdb-ac4c-781e90d3f7ef 2024-04-06T01:32:03.075203605Z [2024-04-06T01:32:03.074+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:32:03.077494128Z [2024-04-06T01:32:03.077+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 01:30:00+00:00, run_id=scheduled__2024-04-06T01:30:00+00:00, run_start_date=2024-04-06 01:32:00.246871+00:00, run_end_date=2024-04-06 01:32:03.075135+00:00, run_duration=2.828264, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:30:00+00:00, data_interval_end=2024-04-06 01:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T01:32:03.095060649Z [2024-04-06T01:32:03.094+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T01:32:00+00:00, run_after=2024-04-06T01:34:00+00:00 2024-04-06T01:32:03.157739438Z [2024-04-06T01:32:03.157+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T01:30:00+00:00 exited with status success for try_number 1 2024-04-06T01:32:03.174873416Z [2024-04-06T01:32:03.174+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T01:30:00+00:00, map_index=-1, run_start_date=2024-04-06 01:32:01.442379+00:00, run_end_date=2024-04-06 01:32:02.358719+00:00, run_duration=0.91634, state=success, executor_state=success, try_number=1, max_tries=1, job_id=5, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:32:00.286444+00:00, queued_by_job_id=2, pid=85 2024-04-06T01:34:00.827541453Z [2024-04-06T01:34:00.825+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:34:00.887322692Z [2024-04-06T01:34:00.887+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T01:34:00.887336013Z 2024-04-06T01:34:00.887417483Z [2024-04-06T01:34:00.887+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T01:34:00.889217805Z [2024-04-06T01:34:00.888+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:34:00.889230571Z 2024-04-06T01:34:00.891922550Z [2024-04-06T01:34:00.891+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:34:00.891938360Z [2024-04-06T01:34:00.891+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:34:00.975613262Z [2024-04-06T01:34:00.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T01:32:00+00:00 exited with status queued for try_number 1 2024-04-06T01:34:00.981266030Z [2024-04-06T01:34:00.980+0000] {scheduler_job.py:635} INFO - Setting external_id for to 456f0d77-5581-47a3-8674-e0806edc82ca 2024-04-06T01:34:03.405504840Z [2024-04-06T01:34:03.404+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:34:03.405920719Z [2024-04-06T01:34:03.405+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 01:32:00+00:00, run_id=scheduled__2024-04-06T01:32:00+00:00, run_start_date=2024-04-06 01:34:00.842318+00:00, run_end_date=2024-04-06 01:34:03.405453+00:00, run_duration=2.563135, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:32:00+00:00, data_interval_end=2024-04-06 01:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T01:34:03.421338633Z [2024-04-06T01:34:03.421+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T01:34:00+00:00, run_after=2024-04-06T01:36:00+00:00 2024-04-06T01:34:03.454902646Z [2024-04-06T01:34:03.454+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T01:32:00+00:00 exited with status success for try_number 1 2024-04-06T01:34:03.460337213Z [2024-04-06T01:34:03.459+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T01:32:00+00:00, map_index=-1, run_start_date=2024-04-06 01:34:01.991025+00:00, run_end_date=2024-04-06 01:34:02.543232+00:00, run_duration=0.552207, state=success, executor_state=success, try_number=1, max_tries=1, job_id=6, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:34:00.889520+00:00, queued_by_job_id=2, pid=122 2024-04-06T01:35:19.133540300Z [2024-04-06T01:35:19.132+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-06T01:36:00.503461480Z [2024-04-06T01:36:00.503+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:36:00.560224527Z [2024-04-06T01:36:00.559+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T01:36:00.560243340Z 2024-04-06T01:36:00.561123684Z [2024-04-06T01:36:00.560+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T01:36:00.562447957Z [2024-04-06T01:36:00.561+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:36:00.562461090Z 2024-04-06T01:36:00.565234972Z [2024-04-06T01:36:00.564+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:36:00.565515710Z [2024-04-06T01:36:00.565+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:36:00.646227674Z [2024-04-06T01:36:00.645+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T01:34:00+00:00 exited with status queued for try_number 1 2024-04-06T01:36:00.659655399Z [2024-04-06T01:36:00.659+0000] {scheduler_job.py:635} INFO - Setting external_id for to 69960e87-382c-412b-99eb-94588c791852 2024-04-06T01:36:03.122137932Z [2024-04-06T01:36:03.121+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:36:03.122500916Z [2024-04-06T01:36:03.122+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 01:34:00+00:00, run_id=scheduled__2024-04-06T01:34:00+00:00, run_start_date=2024-04-06 01:36:00.519925+00:00, run_end_date=2024-04-06 01:36:03.122122+00:00, run_duration=2.602197, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:34:00+00:00, data_interval_end=2024-04-06 01:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T01:36:03.135359011Z [2024-04-06T01:36:03.135+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T01:36:00+00:00, run_after=2024-04-06T01:38:00+00:00 2024-04-06T01:36:03.181897396Z [2024-04-06T01:36:03.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T01:34:00+00:00 exited with status success for try_number 1 2024-04-06T01:36:03.187446750Z [2024-04-06T01:36:03.187+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T01:34:00+00:00, map_index=-1, run_start_date=2024-04-06 01:36:01.674945+00:00, run_end_date=2024-04-06 01:36:02.269419+00:00, run_duration=0.594474, state=success, executor_state=success, try_number=1, max_tries=1, job_id=7, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:36:00.562863+00:00, queued_by_job_id=2, pid=159 2024-04-06T01:37:28.161577935Z [2024-04-06T01:37:28.157+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:37:28.179642128Z [2024-04-06T01:37:28.176+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:37:28.345675936Z [2024-04-06T01:37:28.343+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T01:37:28.345695844Z 2024-04-06T01:37:28.345699617Z 2024-04-06T01:37:28.345702690Z [2024-04-06T01:37:28.343+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04 has 0/16 running and queued tasks 2024-04-06T01:37:28.345705873Z [2024-04-06T01:37:28.344+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:37:28.345709537Z [2024-04-06T01:37:28.344+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:37:28.345712404Z 2024-04-06T01:37:28.345715842Z 2024-04-06T01:37:28.348236855Z [2024-04-06T01:37:28.347+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:37:28.348527777Z [2024-04-06T01:37:28.348+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:37:28.348866192Z [2024-04-06T01:37:28.348+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:37:28.349079339Z [2024-04-06T01:37:28.348+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:37:28.793264939Z [2024-04-06T01:37:28.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:36:00+00:00 exited with status queued for try_number 1 2024-04-06T01:37:28.793292450Z [2024-04-06T01:37:28.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:36:00+00:00 exited with status queued for try_number 1 2024-04-06T01:37:28.821914217Z [2024-04-06T01:37:28.820+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ef506ab-bc5c-4286-8ee2-3f3eaa4bf412 2024-04-06T01:37:28.821938122Z [2024-04-06T01:37:28.820+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9ae8f08-5dce-46d6-9386-dc46c03b7b31 2024-04-06T01:37:31.105715990Z [2024-04-06T01:37:31.105+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_99757926-e4d9-470a-8811-67fd70635e04 to 2024-04-06T01:37:00+00:00, run_after=2024-04-06T01:38:00+00:00 2024-04-06T01:37:31.123003461Z [2024-04-06T01:37:31.122+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:37:00+00:00, run_after=2024-04-06T01:38:00+00:00 2024-04-06T01:37:31.206858631Z [2024-04-06T01:37:31.206+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T01:37:31.206888360Z 2024-04-06T01:37:31.206891964Z 2024-04-06T01:37:31.214200208Z [2024-04-06T01:37:31.206+0000] {scheduler_job.py:425} INFO - DAG vim_status_99757926-e4d9-470a-8811-67fd70635e04 has 0/16 running and queued tasks 2024-04-06T01:37:31.214455500Z [2024-04-06T01:37:31.214+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:37:31.233886808Z [2024-04-06T01:37:31.233+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:37:31.233905484Z 2024-04-06T01:37:31.233908960Z 2024-04-06T01:37:31.237185223Z [2024-04-06T01:37:31.236+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_99757926-e4d9-470a-8811-67fd70635e04', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:37:31.237249959Z [2024-04-06T01:37:31.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_99757926-e4d9-470a-8811-67fd70635e04', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:37:31.237448226Z [2024-04-06T01:37:31.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:37:31.237540291Z [2024-04-06T01:37:31.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:37:31.633660196Z [2024-04-06T01:37:31.633+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_99757926-e4d9-470a-8811-67fd70635e04.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:36:00+00:00 exited with status queued for try_number 1 2024-04-06T01:37:31.637916942Z [2024-04-06T01:37:31.633+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:36:00+00:00 exited with status queued for try_number 1 2024-04-06T01:37:31.657112391Z [2024-04-06T01:37:31.653+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b7e7548-25bb-4282-be15-3de01878f19d 2024-04-06T01:37:31.657149994Z [2024-04-06T01:37:31.654+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0c343942-784f-44d0-86c7-b5ad0610f0e3 2024-04-06T01:37:33.865516706Z [2024-04-06T01:37:33.865+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:35:00+00:00, run_after=2024-04-06T01:40:00+00:00 2024-04-06T01:37:33.878757320Z [2024-04-06T01:37:33.878+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04 to 2024-04-06T01:35:00+00:00, run_after=2024-04-06T01:40:00+00:00 2024-04-06T01:37:33.931768751Z [2024-04-06T01:37:33.931+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:37:33.932183366Z [2024-04-06T01:37:33.931+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04, execution_date=2024-04-06 01:36:00+00:00, run_id=scheduled__2024-04-06T01:36:00+00:00, run_start_date=2024-04-06 01:37:28.206060+00:00, run_end_date=2024-04-06 01:37:33.931685+00:00, run_duration=5.725625, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:36:00+00:00, data_interval_end=2024-04-06 01:37:00+00:00, dag_hash=4f042973c9086c8b5a17493e7e150819 2024-04-06T01:37:33.944194867Z [2024-04-06T01:37:33.943+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04 to 2024-04-06T01:37:00+00:00, run_after=2024-04-06T01:38:00+00:00 2024-04-06T01:37:33.951360753Z [2024-04-06T01:37:33.951+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:37:33.951523107Z [2024-04-06T01:37:33.951+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:36:00+00:00, run_id=scheduled__2024-04-06T01:36:00+00:00, run_start_date=2024-04-06 01:37:28.205395+00:00, run_end_date=2024-04-06 01:37:33.951322+00:00, run_duration=5.745927, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:36:00+00:00, data_interval_end=2024-04-06 01:37:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T01:37:33.970034312Z [2024-04-06T01:37:33.969+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:37:00+00:00, run_after=2024-04-06T01:38:00+00:00 2024-04-06T01:37:34.010012011Z [2024-04-06T01:37:34.009+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T01:37:34.010025179Z 2024-04-06T01:37:34.010028699Z 2024-04-06T01:37:34.010050655Z [2024-04-06T01:37:34.009+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04 has 0/16 running and queued tasks 2024-04-06T01:37:34.010165514Z [2024-04-06T01:37:34.010+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:37:34.013516568Z [2024-04-06T01:37:34.013+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:37:34.013528743Z 2024-04-06T01:37:34.013532169Z 2024-04-06T01:37:34.018987157Z [2024-04-06T01:37:34.018+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-06T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-06T01:37:34.023246042Z [2024-04-06T01:37:34.018+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:37:34.023995545Z [2024-04-06T01:37:34.023+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-06T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-06T01:37:34.024695450Z [2024-04-06T01:37:34.023+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:37:34.342907656Z [2024-04-06T01:37:34.342+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T01:30:00+00:00 exited with status queued for try_number 1 2024-04-06T01:37:34.342974758Z [2024-04-06T01:37:34.342+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T01:30:00+00:00 exited with status queued for try_number 1 2024-04-06T01:37:34.343067199Z [2024-04-06T01:37:34.342+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:36:00+00:00 exited with status success for try_number 1 2024-04-06T01:37:34.343097196Z [2024-04-06T01:37:34.343+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:36:00+00:00 exited with status success for try_number 1 2024-04-06T01:37:34.363516380Z [2024-04-06T01:37:34.363+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:36:00+00:00, map_index=-1, run_start_date=2024-04-06 01:37:31.035105+00:00, run_end_date=2024-04-06 01:37:33.473399+00:00, run_duration=2.438294, state=success, executor_state=success, try_number=1, max_tries=1, job_id=9, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:37:28.345484+00:00, queued_by_job_id=2, pid=219 2024-04-06T01:37:34.363656438Z [2024-04-06T01:37:34.363+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:36:00+00:00, map_index=-1, run_start_date=2024-04-06 01:37:30.931050+00:00, run_end_date=2024-04-06 01:37:33.497160+00:00, run_duration=2.56611, state=success, executor_state=success, try_number=1, max_tries=1, job_id=8, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:37:28.345484+00:00, queued_by_job_id=2, pid=218 2024-04-06T01:37:34.363837187Z [2024-04-06T01:37:34.363+0000] {scheduler_job.py:635} INFO - Setting external_id for to 93283ae1-2bb2-42a5-8cb9-e10dbd8898ac 2024-04-06T01:37:34.363926504Z [2024-04-06T01:37:34.363+0000] {scheduler_job.py:635} INFO - Setting external_id for to a4050bd9-faca-47bb-9168-063c3122560a 2024-04-06T01:37:36.690307735Z [2024-04-06T01:37:36.689+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:37:36.692038168Z [2024-04-06T01:37:36.691+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:36:00+00:00, run_id=scheduled__2024-04-06T01:36:00+00:00, run_start_date=2024-04-06 01:37:31.138823+00:00, run_end_date=2024-04-06 01:37:36.690421+00:00, run_duration=5.551598, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:36:00+00:00, data_interval_end=2024-04-06 01:37:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T01:37:36.702933867Z [2024-04-06T01:37:36.701+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:37:00+00:00, run_after=2024-04-06T01:38:00+00:00 2024-04-06T01:37:36.719375660Z [2024-04-06T01:37:36.718+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:37:36.720049024Z [2024-04-06T01:37:36.719+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_99757926-e4d9-470a-8811-67fd70635e04, execution_date=2024-04-06 01:36:00+00:00, run_id=scheduled__2024-04-06T01:36:00+00:00, run_start_date=2024-04-06 01:37:31.141244+00:00, run_end_date=2024-04-06 01:37:36.719303+00:00, run_duration=5.578059, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:36:00+00:00, data_interval_end=2024-04-06 01:37:00+00:00, dag_hash=ae23de55bd794a782094221f5e53aa43 2024-04-06T01:37:36.732695255Z [2024-04-06T01:37:36.732+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_99757926-e4d9-470a-8811-67fd70635e04 to 2024-04-06T01:37:00+00:00, run_after=2024-04-06T01:38:00+00:00 2024-04-06T01:37:36.835620484Z [2024-04-06T01:37:36.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_99757926-e4d9-470a-8811-67fd70635e04.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:36:00+00:00 exited with status success for try_number 1 2024-04-06T01:37:36.835859856Z [2024-04-06T01:37:36.835+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:36:00+00:00 exited with status success for try_number 1 2024-04-06T01:37:36.842408581Z [2024-04-06T01:37:36.842+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:36:00+00:00, map_index=-1, run_start_date=2024-04-06 01:37:34.247748+00:00, run_end_date=2024-04-06 01:37:35.939048+00:00, run_duration=1.6913, state=success, executor_state=success, try_number=1, max_tries=1, job_id=10, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:37:31.234655+00:00, queued_by_job_id=2, pid=253 2024-04-06T01:37:36.843923724Z [2024-04-06T01:37:36.843+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_99757926-e4d9-470a-8811-67fd70635e04, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:36:00+00:00, map_index=-1, run_start_date=2024-04-06 01:37:34.807573+00:00, run_end_date=2024-04-06 01:37:36.420942+00:00, run_duration=1.613369, state=success, executor_state=success, try_number=1, max_tries=1, job_id=11, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:37:31.234655+00:00, queued_by_job_id=2, pid=272 2024-04-06T01:37:38.587059915Z [2024-04-06T01:37:38.586+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T01:37:38.587082800Z 2024-04-06T01:37:38.587087721Z 2024-04-06T01:37:38.587445304Z [2024-04-06T01:37:38.587+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04 has 0/16 running and queued tasks 2024-04-06T01:37:38.587678129Z [2024-04-06T01:37:38.587+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:37:38.588283867Z [2024-04-06T01:37:38.588+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:37:38.588299609Z 2024-04-06T01:37:38.588305791Z 2024-04-06T01:37:38.594137705Z [2024-04-06T01:37:38.593+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04', task_id='split_metrics', run_id='scheduled__2024-04-06T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-06T01:37:38.594808880Z [2024-04-06T01:37:38.594+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04', 'split_metrics', 'scheduled__2024-04-06T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:37:38.595112998Z [2024-04-06T01:37:38.594+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='split_metrics', run_id='scheduled__2024-04-06T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-06T01:37:38.595241847Z [2024-04-06T01:37:38.595+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:37:38.797071751Z [2024-04-06T01:37:38.796+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04.split_metrics run_id=scheduled__2024-04-06T01:30:00+00:00 exited with status queued for try_number 1 2024-04-06T01:37:38.797251685Z [2024-04-06T01:37:38.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T01:30:00+00:00 exited with status queued for try_number 1 2024-04-06T01:37:38.797394503Z [2024-04-06T01:37:38.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T01:30:00+00:00 exited with status success for try_number 1 2024-04-06T01:37:38.797515994Z [2024-04-06T01:37:38.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T01:30:00+00:00 exited with status success for try_number 1 2024-04-06T01:37:38.811099329Z [2024-04-06T01:37:38.810+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d8068f7-6d0a-4adb-8060-51507ff645c9 2024-04-06T01:37:38.811203826Z [2024-04-06T01:37:38.811+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-06T01:30:00+00:00, map_index=-1, run_start_date=2024-04-06 01:37:36.908546+00:00, run_end_date=2024-04-06 01:37:37.416381+00:00, run_duration=0.507835, state=success, executor_state=success, try_number=1, max_tries=1, job_id=12, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:37:34.014362+00:00, queued_by_job_id=2, pid=302 2024-04-06T01:37:38.811394684Z [2024-04-06T01:37:38.811+0000] {scheduler_job.py:635} INFO - Setting external_id for to acb4dc9d-ee36-4db9-a27f-63e96f7ce885 2024-04-06T01:37:38.811667906Z [2024-04-06T01:37:38.811+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-06T01:30:00+00:00, map_index=-1, run_start_date=2024-04-06 01:37:36.936387+00:00, run_end_date=2024-04-06 01:37:37.459671+00:00, run_duration=0.523284, state=success, executor_state=success, try_number=1, max_tries=1, job_id=13, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:37:34.014362+00:00, queued_by_job_id=2, pid=303 2024-04-06T01:37:41.236488299Z [2024-04-06T01:37:41.236+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T01:37:41.236512795Z 2024-04-06T01:37:41.236645535Z [2024-04-06T01:37:41.236+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:37:41.242631436Z [2024-04-06T01:37:41.242+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:37:41.242652833Z 2024-04-06T01:37:41.248090543Z [2024-04-06T01:37:41.247+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='collect_metrics', run_id='scheduled__2024-04-06T01:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-06T01:37:41.248234592Z [2024-04-06T01:37:41.248+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T01:37:41.347461541Z [2024-04-06T01:37:41.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T01:30:00+00:00 exited with status queued for try_number 1 2024-04-06T01:37:41.366883948Z [2024-04-06T01:37:41.366+0000] {scheduler_job.py:635} INFO - Setting external_id for to 88de24eb-5356-452d-9e6a-ca93293ab7df 2024-04-06T01:37:41.484938668Z [2024-04-06T01:37:41.484+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T01:37:41.484956481Z 2024-04-06T01:37:41.485203102Z [2024-04-06T01:37:41.485+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04 has 0/16 running and queued tasks 2024-04-06T01:37:41.485978547Z [2024-04-06T01:37:41.485+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:37:41.485990610Z 2024-04-06T01:37:41.491065008Z [2024-04-06T01:37:41.490+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04', task_id='collect_metrics', run_id='scheduled__2024-04-06T01:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-06T01:37:41.492108523Z [2024-04-06T01:37:41.491+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04', 'collect_metrics', 'scheduled__2024-04-06T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T01:37:41.584702404Z [2024-04-06T01:37:41.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04.collect_metrics run_id=scheduled__2024-04-06T01:30:00+00:00 exited with status queued for try_number 1 2024-04-06T01:37:41.584988703Z [2024-04-06T01:37:41.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T01:30:00+00:00 exited with status success for try_number 1 2024-04-06T01:37:41.597153911Z [2024-04-06T01:37:41.596+0000] {scheduler_job.py:635} INFO - Setting external_id for to d54f9626-5509-430d-ab82-28ffff007c91 2024-04-06T01:37:41.597956639Z [2024-04-06T01:37:41.597+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=split_metrics, run_id=scheduled__2024-04-06T01:30:00+00:00, map_index=-1, run_start_date=2024-04-06 01:37:40.698311+00:00, run_end_date=2024-04-06 01:37:41.074561+00:00, run_duration=0.37625, state=success, executor_state=success, try_number=1, max_tries=1, job_id=14, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:37:38.588987+00:00, queued_by_job_id=2, pid=344 2024-04-06T01:37:41.826606716Z [2024-04-06T01:37:41.822+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04.split_metrics run_id=scheduled__2024-04-06T01:30:00+00:00 exited with status success for try_number 1 2024-04-06T01:37:41.839943317Z [2024-04-06T01:37:41.839+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04, task_id=split_metrics, run_id=scheduled__2024-04-06T01:30:00+00:00, map_index=-1, run_start_date=2024-04-06 01:37:40.826047+00:00, run_end_date=2024-04-06 01:37:41.329044+00:00, run_duration=0.502997, state=success, executor_state=success, try_number=1, max_tries=1, job_id=15, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:37:38.588987+00:00, queued_by_job_id=2, pid=345 2024-04-06T01:37:45.194502967Z [2024-04-06T01:37:45.194+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T01:37:45.194529711Z 2024-04-06T01:37:45.194533368Z 2024-04-06T01:37:45.194738336Z [2024-04-06T01:37:45.194+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04 has 0/16 running and queued tasks 2024-04-06T01:37:45.194957132Z [2024-04-06T01:37:45.194+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:37:45.195670494Z [2024-04-06T01:37:45.195+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:37:45.195680695Z 2024-04-06T01:37:45.195684086Z 2024-04-06T01:37:45.198309234Z [2024-04-06T01:37:45.198+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04', task_id='send_prometheus', run_id='scheduled__2024-04-06T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:37:45.198516369Z [2024-04-06T01:37:45.198+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04', 'send_prometheus', 'scheduled__2024-04-06T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:37:45.198771100Z [2024-04-06T01:37:45.198+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='send_prometheus', run_id='scheduled__2024-04-06T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:37:45.198929244Z [2024-04-06T01:37:45.198+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:37:45.400665860Z [2024-04-06T01:37:45.400+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04.send_prometheus run_id=scheduled__2024-04-06T01:30:00+00:00 exited with status queued for try_number 1 2024-04-06T01:37:45.403649629Z [2024-04-06T01:37:45.400+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T01:30:00+00:00 exited with status queued for try_number 1 2024-04-06T01:37:45.403902592Z [2024-04-06T01:37:45.403+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T01:30:00+00:00 exited with status success for try_number 1 2024-04-06T01:37:45.404498772Z [2024-04-06T01:37:45.403+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04.collect_metrics run_id=scheduled__2024-04-06T01:30:00+00:00 exited with status success for try_number 1 2024-04-06T01:37:45.418725569Z [2024-04-06T01:37:45.418+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e47edb8-4de7-44c1-bf03-e5658e0815c0 2024-04-06T01:37:45.419040172Z [2024-04-06T01:37:45.418+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=collect_metrics, run_id=scheduled__2024-04-06T01:30:00+00:00, map_index=0, run_start_date=2024-04-06 01:37:43.960917+00:00, run_end_date=2024-04-06 01:37:44.432040+00:00, run_duration=0.471123, state=success, executor_state=success, try_number=1, max_tries=1, job_id=16, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:37:41.243011+00:00, queued_by_job_id=2, pid=368 2024-04-06T01:37:45.419286546Z [2024-04-06T01:37:45.419+0000] {scheduler_job.py:635} INFO - Setting external_id for to 29dc952e-86c4-4e56-b290-03097d7706c4 2024-04-06T01:37:45.419599710Z [2024-04-06T01:37:45.419+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04, task_id=collect_metrics, run_id=scheduled__2024-04-06T01:30:00+00:00, map_index=0, run_start_date=2024-04-06 01:37:43.984176+00:00, run_end_date=2024-04-06 01:37:44.494534+00:00, run_duration=0.510358, state=success, executor_state=success, try_number=1, max_tries=1, job_id=17, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:37:41.486515+00:00, queued_by_job_id=2, pid=369 2024-04-06T01:37:48.770835509Z [2024-04-06T01:37:48.770+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:37:48.771113710Z [2024-04-06T01:37:48.770+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04, execution_date=2024-04-06 01:30:00+00:00, run_id=scheduled__2024-04-06T01:30:00+00:00, run_start_date=2024-04-06 01:37:33.891450+00:00, run_end_date=2024-04-06 01:37:48.770774+00:00, run_duration=14.879324, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:30:00+00:00, data_interval_end=2024-04-06 01:35:00+00:00, dag_hash=89fa97efc54fea6edc2ef5db288561e8 2024-04-06T01:37:48.776533389Z [2024-04-06T01:37:48.776+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04 to 2024-04-06T01:35:00+00:00, run_after=2024-04-06T01:40:00+00:00 2024-04-06T01:37:48.782687911Z [2024-04-06T01:37:48.782+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:37:48.782879601Z [2024-04-06T01:37:48.782+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:30:00+00:00, run_id=scheduled__2024-04-06T01:30:00+00:00, run_start_date=2024-04-06 01:37:33.890914+00:00, run_end_date=2024-04-06 01:37:48.782607+00:00, run_duration=14.891693, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:30:00+00:00, data_interval_end=2024-04-06 01:35:00+00:00, dag_hash=eecc559ff32fe9a7c4345875f113a0a9 2024-04-06T01:37:48.788625224Z [2024-04-06T01:37:48.788+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:35:00+00:00, run_after=2024-04-06T01:40:00+00:00 2024-04-06T01:37:48.832930944Z [2024-04-06T01:37:48.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04.send_prometheus run_id=scheduled__2024-04-06T01:30:00+00:00 exited with status success for try_number 1 2024-04-06T01:37:48.833327644Z [2024-04-06T01:37:48.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T01:30:00+00:00 exited with status success for try_number 1 2024-04-06T01:37:48.843794214Z [2024-04-06T01:37:48.843+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=send_prometheus, run_id=scheduled__2024-04-06T01:30:00+00:00, map_index=-1, run_start_date=2024-04-06 01:37:47.422978+00:00, run_end_date=2024-04-06 01:37:47.822315+00:00, run_duration=0.399337, state=success, executor_state=success, try_number=1, max_tries=1, job_id=19, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:37:45.196383+00:00, queued_by_job_id=2, pid=393 2024-04-06T01:37:48.844255748Z [2024-04-06T01:37:48.843+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_99757926-e4d9-470a-8811-67fd70635e04, task_id=send_prometheus, run_id=scheduled__2024-04-06T01:30:00+00:00, map_index=-1, run_start_date=2024-04-06 01:37:47.358774+00:00, run_end_date=2024-04-06 01:37:47.683600+00:00, run_duration=0.324826, state=success, executor_state=success, try_number=1, max_tries=1, job_id=18, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:37:45.196383+00:00, queued_by_job_id=2, pid=392 2024-04-06T01:38:01.000036573Z [2024-04-06T01:38:00.999+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:38:01.043648255Z [2024-04-06T01:38:01.043+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_99757926-e4d9-470a-8811-67fd70635e04 to 2024-04-06T01:38:00+00:00, run_after=2024-04-06T01:39:00+00:00 2024-04-06T01:38:01.056802222Z [2024-04-06T01:38:01.056+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:38:01.069527549Z [2024-04-06T01:38:01.069+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:38:01.098794366Z [2024-04-06T01:38:01.098+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:38:00+00:00, run_after=2024-04-06T01:39:00+00:00 2024-04-06T01:38:01.257010739Z [2024-04-06T01:38:01.256+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-06T01:38:01.257035779Z 2024-04-06T01:38:01.257039879Z 2024-04-06T01:38:01.257043179Z 2024-04-06T01:38:01.257046224Z 2024-04-06T01:38:01.257049315Z 2024-04-06T01:38:01.262496454Z [2024-04-06T01:38:01.256+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T01:38:01.264915049Z [2024-04-06T01:38:01.264+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04 has 0/16 running and queued tasks 2024-04-06T01:38:01.266779716Z [2024-04-06T01:38:01.266+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:38:01.269168805Z [2024-04-06T01:38:01.266+0000] {scheduler_job.py:425} INFO - DAG vim_status_99757926-e4d9-470a-8811-67fd70635e04 has 0/16 running and queued tasks 2024-04-06T01:38:01.269431253Z [2024-04-06T01:38:01.269+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:38:01.270501852Z [2024-04-06T01:38:01.270+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:38:01.270513937Z 2024-04-06T01:38:01.270517419Z 2024-04-06T01:38:01.270520270Z 2024-04-06T01:38:01.270523100Z 2024-04-06T01:38:01.270526328Z 2024-04-06T01:38:01.283341472Z [2024-04-06T01:38:01.282+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:38:01.283620952Z [2024-04-06T01:38:01.283+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:38:01.285696385Z [2024-04-06T01:38:01.283+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:38:01.289011114Z [2024-04-06T01:38:01.288+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:38:01.289391589Z [2024-04-06T01:38:01.289+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:38:01.289571165Z [2024-04-06T01:38:01.289+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:38:01.289955744Z [2024-04-06T01:38:01.289+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_99757926-e4d9-470a-8811-67fd70635e04', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:38:01.290117257Z [2024-04-06T01:38:01.289+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_99757926-e4d9-470a-8811-67fd70635e04', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:38:01.290401444Z [2024-04-06T01:38:01.290+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:38:01.290692656Z [2024-04-06T01:38:01.290+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:38:02.030758154Z [2024-04-06T01:38:02.027+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T01:36:00+00:00 exited with status queued for try_number 1 2024-04-06T01:38:02.031166248Z [2024-04-06T01:38:02.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:37:00+00:00 exited with status queued for try_number 1 2024-04-06T01:38:02.032160444Z [2024-04-06T01:38:02.031+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:37:00+00:00 exited with status queued for try_number 1 2024-04-06T01:38:02.033801252Z [2024-04-06T01:38:02.032+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_99757926-e4d9-470a-8811-67fd70635e04.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:37:00+00:00 exited with status queued for try_number 1 2024-04-06T01:38:02.033990601Z [2024-04-06T01:38:02.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:37:00+00:00 exited with status queued for try_number 1 2024-04-06T01:38:02.081700206Z [2024-04-06T01:38:02.081+0000] {scheduler_job.py:635} INFO - Setting external_id for to a28b9c42-5afe-4660-9db3-3e53b1a5f9fc 2024-04-06T01:38:02.082132603Z [2024-04-06T01:38:02.081+0000] {scheduler_job.py:635} INFO - Setting external_id for to 52de21e0-229a-4341-8feb-5be2f1cf85cd 2024-04-06T01:38:02.083282479Z [2024-04-06T01:38:02.083+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23b13a97-b7f7-41ff-8379-a93c8a17dd75 2024-04-06T01:38:02.083596284Z [2024-04-06T01:38:02.083+0000] {scheduler_job.py:635} INFO - Setting external_id for to 822f7fd4-4dea-4088-adc4-900076c22fed 2024-04-06T01:38:02.083865083Z [2024-04-06T01:38:02.083+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa337de6-360a-4dad-b49d-761684587930 2024-04-06T01:38:07.534436019Z [2024-04-06T01:38:07.516+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:38:07.551475223Z [2024-04-06T01:38:07.551+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 01:36:00+00:00, run_id=scheduled__2024-04-06T01:36:00+00:00, run_start_date=2024-04-06 01:38:01.117144+00:00, run_end_date=2024-04-06 01:38:07.534389+00:00, run_duration=6.417245, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:36:00+00:00, data_interval_end=2024-04-06 01:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T01:38:07.653611643Z [2024-04-06T01:38:07.653+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T01:38:00+00:00, run_after=2024-04-06T01:40:00+00:00 2024-04-06T01:38:08.145715749Z [2024-04-06T01:38:08.145+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T01:36:00+00:00 exited with status success for try_number 1 2024-04-06T01:38:08.153541528Z [2024-04-06T01:38:08.153+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T01:36:00+00:00, map_index=-1, run_start_date=2024-04-06 01:38:03.819430+00:00, run_end_date=2024-04-06 01:38:07.032846+00:00, run_duration=3.213416, state=success, executor_state=success, try_number=1, max_tries=1, job_id=20, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:38:01.272867+00:00, queued_by_job_id=2, pid=399 2024-04-06T01:38:09.505036717Z [2024-04-06T01:38:09.504+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:37:00+00:00 exited with status failed for try_number 1 2024-04-06T01:38:09.505320571Z [2024-04-06T01:38:09.504+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_99757926-e4d9-470a-8811-67fd70635e04.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:37:00+00:00 exited with status failed for try_number 1 2024-04-06T01:38:09.512135070Z [2024-04-06T01:38:09.511+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:37:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:38:01.272867+00:00, queued_by_job_id=2, pid=None 2024-04-06T01:38:09.512574002Z [2024-04-06T01:38:09.512+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T01:38:09.516369976Z [2024-04-06T01:38:09.515+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T01:38:09.554960872Z [2024-04-06T01:38:09.554+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240406T013700, start_date=, end_date=20240406T013809 2024-04-06T01:38:09.582441333Z [2024-04-06T01:38:09.582+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_99757926-e4d9-470a-8811-67fd70635e04, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:37:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:38:01.272867+00:00, queued_by_job_id=2, pid=None 2024-04-06T01:38:09.582997164Z [2024-04-06T01:38:09.582+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T01:38:09.585260744Z [2024-04-06T01:38:09.585+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T01:38:09.596939125Z [2024-04-06T01:38:09.596+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_99757926-e4d9-470a-8811-67fd70635e04, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240406T013700, start_date=, end_date=20240406T013809 2024-04-06T01:38:10.669458108Z [2024-04-06T01:38:10.669+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:38:10.669774447Z [2024-04-06T01:38:10.669+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:37:00+00:00, run_id=scheduled__2024-04-06T01:37:00+00:00, run_start_date=2024-04-06 01:38:01.124699+00:00, run_end_date=2024-04-06 01:38:10.669410+00:00, run_duration=9.544711, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:37:00+00:00, data_interval_end=2024-04-06 01:38:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T01:38:10.680763477Z [2024-04-06T01:38:10.680+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:38:00+00:00, run_after=2024-04-06T01:39:00+00:00 2024-04-06T01:38:10.697076529Z [2024-04-06T01:38:10.695+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:38:10.697292635Z [2024-04-06T01:38:10.697+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:37:00+00:00, run_id=scheduled__2024-04-06T01:37:00+00:00, run_start_date=2024-04-06 01:38:01.122561+00:00, run_end_date=2024-04-06 01:38:10.696996+00:00, run_duration=9.574435, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:37:00+00:00, data_interval_end=2024-04-06 01:38:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T01:38:10.714823376Z [2024-04-06T01:38:10.713+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:38:00+00:00, run_after=2024-04-06T01:39:00+00:00 2024-04-06T01:38:10.794572055Z [2024-04-06T01:38:10.793+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:37:00+00:00 exited with status success for try_number 1 2024-04-06T01:38:10.794585895Z [2024-04-06T01:38:10.793+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:37:00+00:00 exited with status success for try_number 1 2024-04-06T01:38:10.814961154Z [2024-04-06T01:38:10.814+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:37:00+00:00, map_index=-1, run_start_date=2024-04-06 01:38:07.669592+00:00, run_end_date=2024-04-06 01:38:09.807845+00:00, run_duration=2.138253, state=success, executor_state=success, try_number=1, max_tries=1, job_id=22, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:38:01.272867+00:00, queued_by_job_id=2, pid=450 2024-04-06T01:38:10.815135633Z [2024-04-06T01:38:10.814+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:37:00+00:00, map_index=-1, run_start_date=2024-04-06 01:38:06.621549+00:00, run_end_date=2024-04-06 01:38:10.183349+00:00, run_duration=3.5618, state=success, executor_state=success, try_number=1, max_tries=1, job_id=21, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:38:01.272867+00:00, queued_by_job_id=2, pid=422 2024-04-06T01:38:19.674401998Z [2024-04-06T01:38:19.673+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T01:38:19.674426404Z 2024-04-06T01:38:19.674429667Z 2024-04-06T01:38:19.674432503Z [2024-04-06T01:38:19.674+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04 has 0/16 running and queued tasks 2024-04-06T01:38:19.674514212Z [2024-04-06T01:38:19.674+0000] {scheduler_job.py:425} INFO - DAG vim_status_99757926-e4d9-470a-8811-67fd70635e04 has 0/16 running and queued tasks 2024-04-06T01:38:19.675072682Z [2024-04-06T01:38:19.674+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:38:19.675082301Z 2024-04-06T01:38:19.675085596Z 2024-04-06T01:38:19.677480721Z [2024-04-06T01:38:19.677+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:37:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:38:19.677691874Z [2024-04-06T01:38:19.677+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:38:19.677981788Z [2024-04-06T01:38:19.677+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_99757926-e4d9-470a-8811-67fd70635e04', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:37:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:38:19.678124689Z [2024-04-06T01:38:19.677+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_99757926-e4d9-470a-8811-67fd70635e04', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:38:19.872736219Z [2024-04-06T01:38:19.872+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:37:00+00:00 exited with status queued for try_number 2 2024-04-06T01:38:19.873043489Z [2024-04-06T01:38:19.872+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_99757926-e4d9-470a-8811-67fd70635e04.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:37:00+00:00 exited with status queued for try_number 2 2024-04-06T01:38:19.884919822Z [2024-04-06T01:38:19.884+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2fe9a77-f65b-4549-9ccf-cd2c2ed449c9 2024-04-06T01:38:19.885122899Z [2024-04-06T01:38:19.884+0000] {scheduler_job.py:635} INFO - Setting external_id for to 86491bf7-b831-4d69-bf47-bcef861f8f73 2024-04-06T01:38:22.353314989Z [2024-04-06T01:38:22.352+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_99757926-e4d9-470a-8811-67fd70635e04.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:37:00+00:00 exited with status failed for try_number 2 2024-04-06T01:38:22.361497910Z [2024-04-06T01:38:22.361+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_99757926-e4d9-470a-8811-67fd70635e04, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:37:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-06 01:38:09.587669+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:38:19.675547+00:00, queued_by_job_id=2, pid=None 2024-04-06T01:38:22.361864912Z [2024-04-06T01:38:22.361+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T01:38:22.366060301Z [2024-04-06T01:38:22.365+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T01:38:22.381683747Z [2024-04-06T01:38:22.380+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_99757926-e4d9-470a-8811-67fd70635e04, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240406T013700, start_date=, end_date=20240406T013822 2024-04-06T01:38:23.341215735Z [2024-04-06T01:38:23.340+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-06T01:38:23.341702645Z [2024-04-06T01:38:23.341+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_99757926-e4d9-470a-8811-67fd70635e04, execution_date=2024-04-06 01:37:00+00:00, run_id=scheduled__2024-04-06T01:37:00+00:00, run_start_date=2024-04-06 01:38:01.123678+00:00, run_end_date=2024-04-06 01:38:23.341325+00:00, run_duration=22.217647, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:37:00+00:00, data_interval_end=2024-04-06 01:38:00+00:00, dag_hash=ae23de55bd794a782094221f5e53aa43 2024-04-06T01:38:23.353630545Z [2024-04-06T01:38:23.353+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_99757926-e4d9-470a-8811-67fd70635e04 to 2024-04-06T01:38:00+00:00, run_after=2024-04-06T01:39:00+00:00 2024-04-06T01:38:23.417397446Z [2024-04-06T01:38:23.417+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:37:00+00:00 exited with status failed for try_number 2 2024-04-06T01:38:23.423037497Z [2024-04-06T01:38:23.422+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:37:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-06 01:38:09.521641+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:38:19.675547+00:00, queued_by_job_id=2, pid=None 2024-04-06T01:38:23.423688837Z [2024-04-06T01:38:23.423+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T01:38:23.426079690Z [2024-04-06T01:38:23.425+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T01:38:23.439814119Z [2024-04-06T01:38:23.439+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240406T013700, start_date=, end_date=20240406T013823 2024-04-06T01:38:23.703598539Z [2024-04-06T01:38:23.703+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-06T01:38:23.703672024Z [2024-04-06T01:38:23.703+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04, execution_date=2024-04-06 01:37:00+00:00, run_id=scheduled__2024-04-06T01:37:00+00:00, run_start_date=2024-04-06 01:38:01.125653+00:00, run_end_date=2024-04-06 01:38:23.703455+00:00, run_duration=22.577802, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:37:00+00:00, data_interval_end=2024-04-06 01:38:00+00:00, dag_hash=4f042973c9086c8b5a17493e7e150819 2024-04-06T01:38:23.711348901Z [2024-04-06T01:38:23.711+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04 to 2024-04-06T01:38:00+00:00, run_after=2024-04-06T01:39:00+00:00 2024-04-06T01:39:00.228491078Z [2024-04-06T01:39:00.227+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_99757926-e4d9-470a-8811-67fd70635e04 to 2024-04-06T01:39:00+00:00, run_after=2024-04-06T01:40:00+00:00 2024-04-06T01:39:00.239136216Z [2024-04-06T01:39:00.238+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:39:00.247338043Z [2024-04-06T01:39:00.246+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:39:00.260984979Z [2024-04-06T01:39:00.259+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:39:00+00:00, run_after=2024-04-06T01:40:00+00:00 2024-04-06T01:39:00.361268468Z [2024-04-06T01:39:00.360+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-06T01:39:00.361324869Z 2024-04-06T01:39:00.361328484Z 2024-04-06T01:39:00.361331906Z 2024-04-06T01:39:00.361334893Z 2024-04-06T01:39:00.361541767Z [2024-04-06T01:39:00.361+0000] {scheduler_job.py:425} INFO - DAG vim_status_99757926-e4d9-470a-8811-67fd70635e04 has 0/16 running and queued tasks 2024-04-06T01:39:00.361708584Z [2024-04-06T01:39:00.361+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04 has 0/16 running and queued tasks 2024-04-06T01:39:00.361974825Z [2024-04-06T01:39:00.361+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:39:00.362098908Z [2024-04-06T01:39:00.361+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:39:00.362900221Z [2024-04-06T01:39:00.362+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:39:00.362916408Z 2024-04-06T01:39:00.362921976Z 2024-04-06T01:39:00.362926361Z 2024-04-06T01:39:00.362930573Z 2024-04-06T01:39:00.367765244Z [2024-04-06T01:39:00.367+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_99757926-e4d9-470a-8811-67fd70635e04', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:39:00.367930947Z [2024-04-06T01:39:00.367+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_99757926-e4d9-470a-8811-67fd70635e04', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:39:00.368374397Z [2024-04-06T01:39:00.368+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:39:00.368435003Z [2024-04-06T01:39:00.368+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:39:00.368737151Z [2024-04-06T01:39:00.368+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:39:00.368864531Z [2024-04-06T01:39:00.368+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:39:00.369083197Z [2024-04-06T01:39:00.368+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:39:00.369182683Z [2024-04-06T01:39:00.369+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:39:00.678331341Z [2024-04-06T01:39:00.677+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_99757926-e4d9-470a-8811-67fd70635e04.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:38:00+00:00 exited with status queued for try_number 1 2024-04-06T01:39:00.678724370Z [2024-04-06T01:39:00.678+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:38:00+00:00 exited with status queued for try_number 1 2024-04-06T01:39:00.679200611Z [2024-04-06T01:39:00.678+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:38:00+00:00 exited with status queued for try_number 1 2024-04-06T01:39:00.679359437Z [2024-04-06T01:39:00.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:38:00+00:00 exited with status queued for try_number 1 2024-04-06T01:39:00.692509509Z [2024-04-06T01:39:00.692+0000] {scheduler_job.py:635} INFO - Setting external_id for to a892be8a-0338-4221-b5fe-22210b3a3163 2024-04-06T01:39:00.693082296Z [2024-04-06T01:39:00.692+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd233376-e6fa-49ac-9767-84653872e017 2024-04-06T01:39:00.693101297Z [2024-04-06T01:39:00.692+0000] {scheduler_job.py:635} INFO - Setting external_id for to e3f08210-c732-4e29-a37f-4e17fef2322a 2024-04-06T01:39:00.693116528Z [2024-04-06T01:39:00.692+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f70cdfb-3c99-48ba-8f5b-1b814d5a9df0 2024-04-06T01:39:07.216744420Z [2024-04-06T01:39:07.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_99757926-e4d9-470a-8811-67fd70635e04.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:38:00+00:00 exited with status failed for try_number 1 2024-04-06T01:39:07.216828897Z [2024-04-06T01:39:07.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:38:00+00:00 exited with status failed for try_number 1 2024-04-06T01:39:07.227713122Z [2024-04-06T01:39:07.227+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_99757926-e4d9-470a-8811-67fd70635e04, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:38:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:39:00.363591+00:00, queued_by_job_id=2, pid=None 2024-04-06T01:39:07.235753933Z [2024-04-06T01:39:07.227+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T01:39:07.242655024Z [2024-04-06T01:39:07.242+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T01:39:07.276585665Z [2024-04-06T01:39:07.276+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_99757926-e4d9-470a-8811-67fd70635e04, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240406T013800, start_date=, end_date=20240406T013907 2024-04-06T01:39:07.286356053Z [2024-04-06T01:39:07.286+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:38:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:39:00.363591+00:00, queued_by_job_id=2, pid=None 2024-04-06T01:39:07.286702668Z [2024-04-06T01:39:07.286+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T01:39:07.289184998Z [2024-04-06T01:39:07.288+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T01:39:07.304415247Z [2024-04-06T01:39:07.303+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240406T013800, start_date=, end_date=20240406T013907 2024-04-06T01:39:08.395948579Z [2024-04-06T01:39:08.395+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:39:08.396440813Z [2024-04-06T01:39:08.396+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:38:00+00:00, run_id=scheduled__2024-04-06T01:38:00+00:00, run_start_date=2024-04-06 01:39:00.282049+00:00, run_end_date=2024-04-06 01:39:08.395885+00:00, run_duration=8.113836, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:38:00+00:00, data_interval_end=2024-04-06 01:39:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T01:39:08.407082048Z [2024-04-06T01:39:08.406+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:39:00+00:00, run_after=2024-04-06T01:40:00+00:00 2024-04-06T01:39:08.416166453Z [2024-04-06T01:39:08.415+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:39:08.416623414Z [2024-04-06T01:39:08.416+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:38:00+00:00, run_id=scheduled__2024-04-06T01:38:00+00:00, run_start_date=2024-04-06 01:39:00.283846+00:00, run_end_date=2024-04-06 01:39:08.416099+00:00, run_duration=8.132253, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:38:00+00:00, data_interval_end=2024-04-06 01:39:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T01:39:08.429657513Z [2024-04-06T01:39:08.429+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:39:00+00:00, run_after=2024-04-06T01:40:00+00:00 2024-04-06T01:39:08.496295990Z [2024-04-06T01:39:08.495+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:38:00+00:00 exited with status success for try_number 1 2024-04-06T01:39:08.496663644Z [2024-04-06T01:39:08.496+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:38:00+00:00 exited with status success for try_number 1 2024-04-06T01:39:08.502088368Z [2024-04-06T01:39:08.501+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:38:00+00:00, map_index=-1, run_start_date=2024-04-06 01:39:05.657879+00:00, run_end_date=2024-04-06 01:39:07.365381+00:00, run_duration=1.707502, state=success, executor_state=success, try_number=1, max_tries=1, job_id=24, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:39:00.363591+00:00, queued_by_job_id=2, pid=575 2024-04-06T01:39:08.502623712Z [2024-04-06T01:39:08.502+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:38:00+00:00, map_index=-1, run_start_date=2024-04-06 01:39:04.728767+00:00, run_end_date=2024-04-06 01:39:07.623276+00:00, run_duration=2.894509, state=success, executor_state=success, try_number=1, max_tries=1, job_id=23, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:39:00.363591+00:00, queued_by_job_id=2, pid=556 2024-04-06T01:39:18.150818221Z [2024-04-06T01:39:18.149+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T01:39:18.150847297Z 2024-04-06T01:39:18.150851573Z 2024-04-06T01:39:18.150854604Z [2024-04-06T01:39:18.149+0000] {scheduler_job.py:425} INFO - DAG vim_status_99757926-e4d9-470a-8811-67fd70635e04 has 0/16 running and queued tasks 2024-04-06T01:39:18.150857741Z [2024-04-06T01:39:18.150+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04 has 0/16 running and queued tasks 2024-04-06T01:39:18.150861207Z [2024-04-06T01:39:18.150+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:39:18.150864384Z 2024-04-06T01:39:18.150867587Z 2024-04-06T01:39:18.160754419Z [2024-04-06T01:39:18.156+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_99757926-e4d9-470a-8811-67fd70635e04', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:38:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:39:18.160769843Z [2024-04-06T01:39:18.156+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_99757926-e4d9-470a-8811-67fd70635e04', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:39:18.160773333Z [2024-04-06T01:39:18.156+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:38:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:39:18.160776551Z [2024-04-06T01:39:18.156+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:39:18.634563582Z [2024-04-06T01:39:18.625+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_99757926-e4d9-470a-8811-67fd70635e04.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:38:00+00:00 exited with status queued for try_number 2 2024-04-06T01:39:18.634587278Z [2024-04-06T01:39:18.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:38:00+00:00 exited with status queued for try_number 2 2024-04-06T01:39:18.661992571Z [2024-04-06T01:39:18.658+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80c26df4-7ca6-49f3-af52-ba9745499e15 2024-04-06T01:39:18.662338794Z [2024-04-06T01:39:18.661+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0f04dea4-3a6f-4321-9909-d2a2c011503e 2024-04-06T01:39:21.044330748Z [2024-04-06T01:39:21.043+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_99757926-e4d9-470a-8811-67fd70635e04.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:38:00+00:00 exited with status failed for try_number 2 2024-04-06T01:39:21.044951404Z [2024-04-06T01:39:21.044+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:38:00+00:00 exited with status failed for try_number 2 2024-04-06T01:39:21.060363191Z [2024-04-06T01:39:21.059+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_99757926-e4d9-470a-8811-67fd70635e04, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:38:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-06 01:39:07.257805+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:39:18.151085+00:00, queued_by_job_id=2, pid=None 2024-04-06T01:39:21.060691729Z [2024-04-06T01:39:21.060+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T01:39:21.063829910Z [2024-04-06T01:39:21.063+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T01:39:21.080390917Z [2024-04-06T01:39:21.079+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_99757926-e4d9-470a-8811-67fd70635e04, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240406T013800, start_date=, end_date=20240406T013921 2024-04-06T01:39:21.088346868Z [2024-04-06T01:39:21.087+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:38:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-06 01:39:07.291773+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:39:18.151085+00:00, queued_by_job_id=2, pid=None 2024-04-06T01:39:21.088692194Z [2024-04-06T01:39:21.088+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T01:39:21.091292742Z [2024-04-06T01:39:21.090+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T01:39:21.104549481Z [2024-04-06T01:39:21.104+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240406T013800, start_date=, end_date=20240406T013921 2024-04-06T01:39:22.164709068Z [2024-04-06T01:39:22.164+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-06T01:39:22.165119629Z [2024-04-06T01:39:22.164+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_99757926-e4d9-470a-8811-67fd70635e04, execution_date=2024-04-06 01:38:00+00:00, run_id=scheduled__2024-04-06T01:38:00+00:00, run_start_date=2024-04-06 01:39:00.277676+00:00, run_end_date=2024-04-06 01:39:22.164546+00:00, run_duration=21.88687, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:38:00+00:00, data_interval_end=2024-04-06 01:39:00+00:00, dag_hash=ae23de55bd794a782094221f5e53aa43 2024-04-06T01:39:22.175726532Z [2024-04-06T01:39:22.175+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_99757926-e4d9-470a-8811-67fd70635e04 to 2024-04-06T01:39:00+00:00, run_after=2024-04-06T01:40:00+00:00 2024-04-06T01:39:22.186476751Z [2024-04-06T01:39:22.185+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-06T01:39:22.186995437Z [2024-04-06T01:39:22.186+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04, execution_date=2024-04-06 01:38:00+00:00, run_id=scheduled__2024-04-06T01:38:00+00:00, run_start_date=2024-04-06 01:39:00.279637+00:00, run_end_date=2024-04-06 01:39:22.186536+00:00, run_duration=21.906899, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:38:00+00:00, data_interval_end=2024-04-06 01:39:00+00:00, dag_hash=4f042973c9086c8b5a17493e7e150819 2024-04-06T01:39:22.199662617Z [2024-04-06T01:39:22.199+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_99757926-e4d9-470a-8811-67fd70635e04 to 2024-04-06T01:39:00+00:00, run_after=2024-04-06T01:40:00+00:00 2024-04-06T01:40:00.450714678Z [2024-04-06T01:40:00.449+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:40:00+00:00, run_after=2024-04-06T01:41:00+00:00 2024-04-06T01:40:00.463951899Z [2024-04-06T01:40:00.463+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:40:00.489245192Z [2024-04-06T01:40:00.488+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:40:00+00:00, run_after=2024-04-06T01:45:00+00:00 2024-04-06T01:40:00.497324160Z [2024-04-06T01:40:00.497+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:40:00.578382805Z [2024-04-06T01:40:00.578+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-06T01:40:00.578434094Z 2024-04-06T01:40:00.578439053Z 2024-04-06T01:40:00.578442570Z 2024-04-06T01:40:00.578461803Z 2024-04-06T01:40:00.578474064Z [2024-04-06T01:40:00.578+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:40:00.578542221Z [2024-04-06T01:40:00.578+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T01:40:00.578758956Z [2024-04-06T01:40:00.578+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:40:00.578882967Z [2024-04-06T01:40:00.578+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:40:00.579351875Z [2024-04-06T01:40:00.579+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:40:00.579358143Z 2024-04-06T01:40:00.579361809Z 2024-04-06T01:40:00.579365291Z 2024-04-06T01:40:00.579368265Z 2024-04-06T01:40:00.582437657Z [2024-04-06T01:40:00.582+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-06T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-06T01:40:00.582569337Z [2024-04-06T01:40:00.582+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:40:00.582730285Z [2024-04-06T01:40:00.582+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:40:00.582806420Z [2024-04-06T01:40:00.582+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:40:00.583097605Z [2024-04-06T01:40:00.582+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:40:00.583162736Z [2024-04-06T01:40:00.583+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:40:00.583367856Z [2024-04-06T01:40:00.583+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:40:00.583520086Z [2024-04-06T01:40:00.583+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:40:01.045006840Z [2024-04-06T01:40:01.044+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T01:35:00+00:00 exited with status queued for try_number 1 2024-04-06T01:40:01.045149484Z [2024-04-06T01:40:01.045+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T01:38:00+00:00 exited with status queued for try_number 1 2024-04-06T01:40:01.045315032Z [2024-04-06T01:40:01.045+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:39:00+00:00 exited with status queued for try_number 1 2024-04-06T01:40:01.045834844Z [2024-04-06T01:40:01.045+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:39:00+00:00 exited with status queued for try_number 1 2024-04-06T01:40:01.059226868Z [2024-04-06T01:40:01.057+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7788d7e5-6aa3-47f2-a721-438658af941c 2024-04-06T01:40:01.059546487Z [2024-04-06T01:40:01.059+0000] {scheduler_job.py:635} INFO - Setting external_id for to 03cff490-d63d-499f-883a-853a35a50fc2 2024-04-06T01:40:01.059722293Z [2024-04-06T01:40:01.059+0000] {scheduler_job.py:635} INFO - Setting external_id for to a284a94b-8b8e-450d-b0ca-6ae899d6b42c 2024-04-06T01:40:01.059873618Z [2024-04-06T01:40:01.059+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ce9b2b8-e904-4623-bae0-ef498be66ae9 2024-04-06T01:40:03.605230145Z [2024-04-06T01:40:03.604+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:40:03.605634198Z [2024-04-06T01:40:03.605+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 01:38:00+00:00, run_id=scheduled__2024-04-06T01:38:00+00:00, run_start_date=2024-04-06 01:40:00.507992+00:00, run_end_date=2024-04-06 01:40:03.605185+00:00, run_duration=3.097193, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:38:00+00:00, data_interval_end=2024-04-06 01:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T01:40:03.620915491Z [2024-04-06T01:40:03.618+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T01:40:00+00:00, run_after=2024-04-06T01:42:00+00:00 2024-04-06T01:40:04.181092116Z [2024-04-06T01:40:04.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T01:38:00+00:00 exited with status success for try_number 1 2024-04-06T01:40:04.200085809Z [2024-04-06T01:40:04.199+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T01:38:00+00:00, map_index=-1, run_start_date=2024-04-06 01:40:02.100495+00:00, run_end_date=2024-04-06 01:40:03.457244+00:00, run_duration=1.356749, state=success, executor_state=success, try_number=1, max_tries=1, job_id=25, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:40:00.580030+00:00, queued_by_job_id=2, pid=678 2024-04-06T01:40:07.427791352Z [2024-04-06T01:40:07.427+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:40:07.428153777Z [2024-04-06T01:40:07.427+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:39:00+00:00, run_id=scheduled__2024-04-06T01:39:00+00:00, run_start_date=2024-04-06 01:40:00.512654+00:00, run_end_date=2024-04-06 01:40:07.427719+00:00, run_duration=6.915065, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:39:00+00:00, data_interval_end=2024-04-06 01:40:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T01:40:07.439303347Z [2024-04-06T01:40:07.438+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:40:00+00:00, run_after=2024-04-06T01:41:00+00:00 2024-04-06T01:40:07.462272062Z [2024-04-06T01:40:07.461+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T01:40:07.462290727Z 2024-04-06T01:40:07.462577201Z [2024-04-06T01:40:07.462+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:40:07.463340405Z [2024-04-06T01:40:07.463+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:40:07.463358767Z 2024-04-06T01:40:07.465891381Z [2024-04-06T01:40:07.465+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='split_metrics', run_id='scheduled__2024-04-06T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-06T01:40:07.466657860Z [2024-04-06T01:40:07.466+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:40:07.511965939Z [2024-04-06T01:40:07.511+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T01:35:00+00:00 exited with status queued for try_number 1 2024-04-06T01:40:07.512114313Z [2024-04-06T01:40:07.511+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T01:35:00+00:00 exited with status success for try_number 1 2024-04-06T01:40:07.512292018Z [2024-04-06T01:40:07.512+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:39:00+00:00 exited with status success for try_number 1 2024-04-06T01:40:07.528987990Z [2024-04-06T01:40:07.528+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:39:00+00:00, map_index=-1, run_start_date=2024-04-06 01:40:05.045539+00:00, run_end_date=2024-04-06 01:40:06.924762+00:00, run_duration=1.879223, state=success, executor_state=success, try_number=1, max_tries=1, job_id=26, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:40:00.580030+00:00, queued_by_job_id=2, pid=709 2024-04-06T01:40:07.529197855Z [2024-04-06T01:40:07.529+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-06T01:35:00+00:00, map_index=-1, run_start_date=2024-04-06 01:40:05.667440+00:00, run_end_date=2024-04-06 01:40:06.347627+00:00, run_duration=0.680187, state=success, executor_state=success, try_number=1, max_tries=1, job_id=27, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:40:00.580030+00:00, queued_by_job_id=2, pid=728 2024-04-06T01:40:07.529416193Z [2024-04-06T01:40:07.529+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0dae2ee3-f2dc-4ea0-a92e-d638b440a625 2024-04-06T01:40:08.720865715Z [2024-04-06T01:40:08.720+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:40:08.721401753Z [2024-04-06T01:40:08.721+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:39:00+00:00, run_id=scheduled__2024-04-06T01:39:00+00:00, run_start_date=2024-04-06 01:40:00.509227+00:00, run_end_date=2024-04-06 01:40:08.721059+00:00, run_duration=8.211832, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:39:00+00:00, data_interval_end=2024-04-06 01:40:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T01:40:08.732760194Z [2024-04-06T01:40:08.732+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:40:00+00:00, run_after=2024-04-06T01:41:00+00:00 2024-04-06T01:40:08.799511524Z [2024-04-06T01:40:08.799+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:39:00+00:00 exited with status success for try_number 1 2024-04-06T01:40:08.807134859Z [2024-04-06T01:40:08.806+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:39:00+00:00, map_index=-1, run_start_date=2024-04-06 01:40:05.881337+00:00, run_end_date=2024-04-06 01:40:08.471969+00:00, run_duration=2.590632, state=success, executor_state=success, try_number=1, max_tries=1, job_id=28, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:40:00.580030+00:00, queued_by_job_id=2, pid=729 2024-04-06T01:40:11.164783857Z [2024-04-06T01:40:11.164+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T01:40:11.164803041Z 2024-04-06T01:40:11.165018474Z [2024-04-06T01:40:11.164+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:40:11.165887947Z [2024-04-06T01:40:11.165+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:40:11.165913048Z 2024-04-06T01:40:11.167956356Z [2024-04-06T01:40:11.167+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='collect_metrics', run_id='scheduled__2024-04-06T01:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-06T01:40:11.168687737Z [2024-04-06T01:40:11.168+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T01:40:11.266863150Z [2024-04-06T01:40:11.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T01:35:00+00:00 exited with status queued for try_number 1 2024-04-06T01:40:11.267065087Z [2024-04-06T01:40:11.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T01:35:00+00:00 exited with status success for try_number 1 2024-04-06T01:40:11.277603463Z [2024-04-06T01:40:11.277+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0f5dcfb-bb57-4fff-84dd-bf410478ec0e 2024-04-06T01:40:11.279049150Z [2024-04-06T01:40:11.278+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=split_metrics, run_id=scheduled__2024-04-06T01:35:00+00:00, map_index=-1, run_start_date=2024-04-06 01:40:09.858587+00:00, run_end_date=2024-04-06 01:40:10.364613+00:00, run_duration=0.506026, state=success, executor_state=success, try_number=1, max_tries=1, job_id=29, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:40:07.463650+00:00, queued_by_job_id=2, pid=769 2024-04-06T01:40:14.280386437Z [2024-04-06T01:40:14.280+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T01:40:14.280414959Z 2024-04-06T01:40:14.280464626Z [2024-04-06T01:40:14.280+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:40:14.280917795Z [2024-04-06T01:40:14.280+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:40:14.280923078Z 2024-04-06T01:40:14.286045103Z [2024-04-06T01:40:14.282+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='send_prometheus', run_id='scheduled__2024-04-06T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:40:14.286052933Z [2024-04-06T01:40:14.282+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:40:14.427456898Z [2024-04-06T01:40:14.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T01:35:00+00:00 exited with status queued for try_number 1 2024-04-06T01:40:14.427501542Z [2024-04-06T01:40:14.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T01:35:00+00:00 exited with status success for try_number 1 2024-04-06T01:40:14.435338088Z [2024-04-06T01:40:14.434+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=collect_metrics, run_id=scheduled__2024-04-06T01:35:00+00:00, map_index=0, run_start_date=2024-04-06 01:40:13.569417+00:00, run_end_date=2024-04-06 01:40:13.980035+00:00, run_duration=0.410618, state=success, executor_state=success, try_number=1, max_tries=1, job_id=30, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:40:11.166274+00:00, queued_by_job_id=2, pid=784 2024-04-06T01:40:14.435517665Z [2024-04-06T01:40:14.435+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd1d9188-442a-482d-8976-b33b040d92c6 2024-04-06T01:40:17.648646932Z [2024-04-06T01:40:17.648+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:40:17.649299598Z [2024-04-06T01:40:17.649+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:35:00+00:00, run_id=scheduled__2024-04-06T01:35:00+00:00, run_start_date=2024-04-06 01:40:00.506796+00:00, run_end_date=2024-04-06 01:40:17.648706+00:00, run_duration=17.14191, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:35:00+00:00, data_interval_end=2024-04-06 01:40:00+00:00, dag_hash=eecc559ff32fe9a7c4345875f113a0a9 2024-04-06T01:40:17.655676523Z [2024-04-06T01:40:17.655+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:40:00+00:00, run_after=2024-04-06T01:45:00+00:00 2024-04-06T01:40:17.682088098Z [2024-04-06T01:40:17.681+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T01:35:00+00:00 exited with status success for try_number 1 2024-04-06T01:40:17.687842071Z [2024-04-06T01:40:17.687+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=send_prometheus, run_id=scheduled__2024-04-06T01:35:00+00:00, map_index=-1, run_start_date=2024-04-06 01:40:16.814370+00:00, run_end_date=2024-04-06 01:40:17.262104+00:00, run_duration=0.447734, state=success, executor_state=success, try_number=1, max_tries=1, job_id=31, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:40:14.281171+00:00, queued_by_job_id=2, pid=796 2024-04-06T01:40:19.182420405Z [2024-04-06T01:40:19.180+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-06T01:40:44.067273536Z [2024-04-06T01:40:44.066+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:40:44.123559757Z [2024-04-06T01:40:44.123+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T01:40:44.123575852Z 2024-04-06T01:40:44.124137462Z [2024-04-06T01:40:44.123+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544 has 0/16 running and queued tasks 2024-04-06T01:40:44.124644736Z [2024-04-06T01:40:44.124+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:40:44.124650975Z 2024-04-06T01:40:44.128466987Z [2024-04-06T01:40:44.128+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:40:44.128697905Z [2024-04-06T01:40:44.128+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:40:44.180734515Z [2024-04-06T01:40:44.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:39:00+00:00 exited with status queued for try_number 1 2024-04-06T01:40:44.191056221Z [2024-04-06T01:40:44.190+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6dd72cf8-6d22-4060-81a9-3bcaf4b13301 2024-04-06T01:40:47.019039983Z [2024-04-06T01:40:47.018+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_575395ca-dce0-4ed2-a78b-1880936a2544 to 2024-04-06T01:40:00+00:00, run_after=2024-04-06T01:41:00+00:00 2024-04-06T01:40:47.072002125Z [2024-04-06T01:40:47.071+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T01:40:47.072020841Z 2024-04-06T01:40:47.072024244Z [2024-04-06T01:40:47.071+0000] {scheduler_job.py:425} INFO - DAG vim_status_575395ca-dce0-4ed2-a78b-1880936a2544 has 0/16 running and queued tasks 2024-04-06T01:40:47.072695580Z [2024-04-06T01:40:47.072+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:40:47.072710043Z 2024-04-06T01:40:47.074883937Z [2024-04-06T01:40:47.074+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_575395ca-dce0-4ed2-a78b-1880936a2544', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:40:47.075103920Z [2024-04-06T01:40:47.074+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_575395ca-dce0-4ed2-a78b-1880936a2544', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:40:47.131391774Z [2024-04-06T01:40:47.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_575395ca-dce0-4ed2-a78b-1880936a2544.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:39:00+00:00 exited with status queued for try_number 1 2024-04-06T01:40:47.136434717Z [2024-04-06T01:40:47.136+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e033673-6639-4ab8-8f7b-1728c39454d3 2024-04-06T01:40:48.359115623Z [2024-04-06T01:40:48.357+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:40:48.359460527Z [2024-04-06T01:40:48.359+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544, execution_date=2024-04-06 01:39:00+00:00, run_id=scheduled__2024-04-06T01:39:00+00:00, run_start_date=2024-04-06 01:40:44.081086+00:00, run_end_date=2024-04-06 01:40:48.359128+00:00, run_duration=4.278042, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:39:00+00:00, data_interval_end=2024-04-06 01:40:00+00:00, dag_hash=518e7ea47c1c0d135e22cbc609ad63f3 2024-04-06T01:40:48.380453172Z [2024-04-06T01:40:48.380+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544 to 2024-04-06T01:40:00+00:00, run_after=2024-04-06T01:41:00+00:00 2024-04-06T01:40:48.472865179Z [2024-04-06T01:40:48.472+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:39:00+00:00 exited with status success for try_number 1 2024-04-06T01:40:48.483347199Z [2024-04-06T01:40:48.482+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:39:00+00:00, map_index=-1, run_start_date=2024-04-06 01:40:46.226820+00:00, run_end_date=2024-04-06 01:40:47.936829+00:00, run_duration=1.710009, state=success, executor_state=success, try_number=1, max_tries=1, job_id=32, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:40:44.126557+00:00, queued_by_job_id=2, pid=808 2024-04-06T01:40:50.663115210Z [2024-04-06T01:40:50.662+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_575395ca-dce0-4ed2-a78b-1880936a2544 to 2024-04-06T01:40:00+00:00, run_after=2024-04-06T01:45:00+00:00 2024-04-06T01:40:50.711713036Z [2024-04-06T01:40:50.708+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:40:50.711748651Z [2024-04-06T01:40:50.708+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_575395ca-dce0-4ed2-a78b-1880936a2544, execution_date=2024-04-06 01:39:00+00:00, run_id=scheduled__2024-04-06T01:39:00+00:00, run_start_date=2024-04-06 01:40:47.038228+00:00, run_end_date=2024-04-06 01:40:50.708692+00:00, run_duration=3.670464, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:39:00+00:00, data_interval_end=2024-04-06 01:40:00+00:00, dag_hash=391abb96d8ad904eb489a704f7a0384f 2024-04-06T01:40:50.721186394Z [2024-04-06T01:40:50.720+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_575395ca-dce0-4ed2-a78b-1880936a2544 to 2024-04-06T01:40:00+00:00, run_after=2024-04-06T01:41:00+00:00 2024-04-06T01:40:50.739236121Z [2024-04-06T01:40:50.738+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T01:40:50.739256994Z 2024-04-06T01:40:50.739379513Z [2024-04-06T01:40:50.739+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_575395ca-dce0-4ed2-a78b-1880936a2544 has 0/16 running and queued tasks 2024-04-06T01:40:50.739892202Z [2024-04-06T01:40:50.739+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:40:50.739916257Z 2024-04-06T01:40:50.741982978Z [2024-04-06T01:40:50.741+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_575395ca-dce0-4ed2-a78b-1880936a2544', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-06T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-06T01:40:50.742128331Z [2024-04-06T01:40:50.742+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_575395ca-dce0-4ed2-a78b-1880936a2544', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:40:50.834959750Z [2024-04-06T01:40:50.831+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_575395ca-dce0-4ed2-a78b-1880936a2544.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T01:35:00+00:00 exited with status queued for try_number 1 2024-04-06T01:40:50.835314500Z [2024-04-06T01:40:50.834+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_575395ca-dce0-4ed2-a78b-1880936a2544.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:39:00+00:00 exited with status success for try_number 1 2024-04-06T01:40:50.840895132Z [2024-04-06T01:40:50.840+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_575395ca-dce0-4ed2-a78b-1880936a2544, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:39:00+00:00, map_index=-1, run_start_date=2024-04-06 01:40:49.241254+00:00, run_end_date=2024-04-06 01:40:50.554944+00:00, run_duration=1.31369, state=success, executor_state=success, try_number=1, max_tries=1, job_id=33, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:40:47.072996+00:00, queued_by_job_id=2, pid=829 2024-04-06T01:40:50.841151421Z [2024-04-06T01:40:50.840+0000] {scheduler_job.py:635} INFO - Setting external_id for to 291c43fa-eb9c-4bc4-b541-4558a9e54693 2024-04-06T01:40:53.331041483Z [2024-04-06T01:40:53.330+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T01:40:53.331069975Z 2024-04-06T01:40:53.331146490Z [2024-04-06T01:40:53.330+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_575395ca-dce0-4ed2-a78b-1880936a2544 has 0/16 running and queued tasks 2024-04-06T01:40:53.331783091Z [2024-04-06T01:40:53.331+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:40:53.331796078Z 2024-04-06T01:40:53.333799475Z [2024-04-06T01:40:53.333+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_575395ca-dce0-4ed2-a78b-1880936a2544', task_id='split_metrics', run_id='scheduled__2024-04-06T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-06T01:40:53.333972850Z [2024-04-06T01:40:53.333+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_575395ca-dce0-4ed2-a78b-1880936a2544', 'split_metrics', 'scheduled__2024-04-06T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:40:53.416438196Z [2024-04-06T01:40:53.416+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_575395ca-dce0-4ed2-a78b-1880936a2544.split_metrics run_id=scheduled__2024-04-06T01:35:00+00:00 exited with status queued for try_number 1 2024-04-06T01:40:53.424650154Z [2024-04-06T01:40:53.424+0000] {scheduler_job.py:635} INFO - Setting external_id for to 11b717dd-687f-43f0-8d12-22d148026d43 2024-04-06T01:40:53.519725774Z [2024-04-06T01:40:53.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_575395ca-dce0-4ed2-a78b-1880936a2544.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T01:35:00+00:00 exited with status success for try_number 1 2024-04-06T01:40:53.524177306Z [2024-04-06T01:40:53.523+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_575395ca-dce0-4ed2-a78b-1880936a2544, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-06T01:35:00+00:00, map_index=-1, run_start_date=2024-04-06 01:40:52.854889+00:00, run_end_date=2024-04-06 01:40:53.254803+00:00, run_duration=0.399914, state=success, executor_state=success, try_number=1, max_tries=1, job_id=34, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:40:50.740242+00:00, queued_by_job_id=2, pid=850 2024-04-06T01:40:55.984644569Z [2024-04-06T01:40:55.984+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T01:40:55.984687722Z 2024-04-06T01:40:55.984806457Z [2024-04-06T01:40:55.984+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_575395ca-dce0-4ed2-a78b-1880936a2544 has 0/16 running and queued tasks 2024-04-06T01:40:55.985682013Z [2024-04-06T01:40:55.985+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:40:55.985690160Z 2024-04-06T01:40:55.988703956Z [2024-04-06T01:40:55.988+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_575395ca-dce0-4ed2-a78b-1880936a2544', task_id='collect_metrics', run_id='scheduled__2024-04-06T01:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-06T01:40:55.988869896Z [2024-04-06T01:40:55.988+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_575395ca-dce0-4ed2-a78b-1880936a2544', 'collect_metrics', 'scheduled__2024-04-06T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T01:40:56.090147691Z [2024-04-06T01:40:56.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_575395ca-dce0-4ed2-a78b-1880936a2544.collect_metrics run_id=scheduled__2024-04-06T01:35:00+00:00 exited with status queued for try_number 1 2024-04-06T01:40:56.090405657Z [2024-04-06T01:40:56.090+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_575395ca-dce0-4ed2-a78b-1880936a2544.split_metrics run_id=scheduled__2024-04-06T01:35:00+00:00 exited with status success for try_number 1 2024-04-06T01:40:56.098410343Z [2024-04-06T01:40:56.097+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_575395ca-dce0-4ed2-a78b-1880936a2544, task_id=split_metrics, run_id=scheduled__2024-04-06T01:35:00+00:00, map_index=-1, run_start_date=2024-04-06 01:40:55.400971+00:00, run_end_date=2024-04-06 01:40:55.760484+00:00, run_duration=0.359513, state=success, executor_state=success, try_number=1, max_tries=1, job_id=35, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:40:53.332176+00:00, queued_by_job_id=2, pid=871 2024-04-06T01:40:56.098738203Z [2024-04-06T01:40:56.098+0000] {scheduler_job.py:635} INFO - Setting external_id for to 943d46bd-0a15-4b04-adbd-152e1882c8ab 2024-04-06T01:40:59.450925319Z [2024-04-06T01:40:59.450+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T01:40:59.450944023Z 2024-04-06T01:40:59.450948461Z [2024-04-06T01:40:59.450+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_575395ca-dce0-4ed2-a78b-1880936a2544 has 0/16 running and queued tasks 2024-04-06T01:40:59.451566905Z [2024-04-06T01:40:59.451+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:40:59.451576597Z 2024-04-06T01:40:59.454242009Z [2024-04-06T01:40:59.454+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_575395ca-dce0-4ed2-a78b-1880936a2544', task_id='send_prometheus', run_id='scheduled__2024-04-06T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:40:59.454547232Z [2024-04-06T01:40:59.454+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_575395ca-dce0-4ed2-a78b-1880936a2544', 'send_prometheus', 'scheduled__2024-04-06T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:40:59.511463547Z [2024-04-06T01:40:59.511+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_575395ca-dce0-4ed2-a78b-1880936a2544.send_prometheus run_id=scheduled__2024-04-06T01:35:00+00:00 exited with status queued for try_number 1 2024-04-06T01:40:59.512612640Z [2024-04-06T01:40:59.512+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_575395ca-dce0-4ed2-a78b-1880936a2544.collect_metrics run_id=scheduled__2024-04-06T01:35:00+00:00 exited with status success for try_number 1 2024-04-06T01:40:59.521959118Z [2024-04-06T01:40:59.521+0000] {scheduler_job.py:635} INFO - Setting external_id for to f5f12fa1-07d9-4b7c-b1cc-bdd67f305120 2024-04-06T01:40:59.522384707Z [2024-04-06T01:40:59.522+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_575395ca-dce0-4ed2-a78b-1880936a2544, task_id=collect_metrics, run_id=scheduled__2024-04-06T01:35:00+00:00, map_index=0, run_start_date=2024-04-06 01:40:57.923815+00:00, run_end_date=2024-04-06 01:40:58.422499+00:00, run_duration=0.498684, state=success, executor_state=success, try_number=1, max_tries=1, job_id=36, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:40:55.986416+00:00, queued_by_job_id=2, pid=883 2024-04-06T01:41:00.678813043Z [2024-04-06T01:41:00.674+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:41:00.721407002Z [2024-04-06T01:41:00.720+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:41:00+00:00, run_after=2024-04-06T01:42:00+00:00 2024-04-06T01:41:00.732720396Z [2024-04-06T01:41:00.728+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:41:00.741401874Z [2024-04-06T01:41:00.740+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_575395ca-dce0-4ed2-a78b-1880936a2544 to 2024-04-06T01:41:00+00:00, run_after=2024-04-06T01:42:00+00:00 2024-04-06T01:41:00.869168077Z [2024-04-06T01:41:00.868+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-06T01:41:00.869195802Z 2024-04-06T01:41:00.869201063Z 2024-04-06T01:41:00.869205451Z 2024-04-06T01:41:00.869209799Z 2024-04-06T01:41:00.869288568Z [2024-04-06T01:41:00.869+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544 has 0/16 running and queued tasks 2024-04-06T01:41:00.869297437Z [2024-04-06T01:41:00.869+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:41:00.869389931Z [2024-04-06T01:41:00.869+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:41:00.869441843Z [2024-04-06T01:41:00.869+0000] {scheduler_job.py:425} INFO - DAG vim_status_575395ca-dce0-4ed2-a78b-1880936a2544 has 0/16 running and queued tasks 2024-04-06T01:41:00.869984633Z [2024-04-06T01:41:00.869+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:41:00.869997791Z 2024-04-06T01:41:00.870003149Z 2024-04-06T01:41:00.870007663Z 2024-04-06T01:41:00.870012128Z 2024-04-06T01:41:00.873556883Z [2024-04-06T01:41:00.873+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:41:00.875302995Z [2024-04-06T01:41:00.873+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:41:00.875314319Z [2024-04-06T01:41:00.873+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:41:00.875317649Z [2024-04-06T01:41:00.873+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:41:00.875326947Z [2024-04-06T01:41:00.874+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:41:00.875341744Z [2024-04-06T01:41:00.874+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:41:00.875346123Z [2024-04-06T01:41:00.874+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_575395ca-dce0-4ed2-a78b-1880936a2544', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:41:00.875350243Z [2024-04-06T01:41:00.874+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_575395ca-dce0-4ed2-a78b-1880936a2544', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:41:01.256423917Z [2024-04-06T01:41:01.255+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:40:00+00:00 exited with status queued for try_number 1 2024-04-06T01:41:01.257605606Z [2024-04-06T01:41:01.256+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:40:00+00:00 exited with status queued for try_number 1 2024-04-06T01:41:01.257684174Z [2024-04-06T01:41:01.257+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:40:00+00:00 exited with status queued for try_number 1 2024-04-06T01:41:01.257738125Z [2024-04-06T01:41:01.257+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_575395ca-dce0-4ed2-a78b-1880936a2544.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:40:00+00:00 exited with status queued for try_number 1 2024-04-06T01:41:01.268870632Z [2024-04-06T01:41:01.268+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5361d3f-32fa-4c44-8f8b-582fdec1c8a9 2024-04-06T01:41:01.268980762Z [2024-04-06T01:41:01.268+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9cc4b3b8-82c8-42ce-8035-2fc1584bb55c 2024-04-06T01:41:01.269084739Z [2024-04-06T01:41:01.268+0000] {scheduler_job.py:635} INFO - Setting external_id for to efd1484c-208f-4cde-8d20-db153fc9bc9f 2024-04-06T01:41:01.269181502Z [2024-04-06T01:41:01.269+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e38dff6-4bec-40a3-a479-426d5816cf31 2024-04-06T01:41:03.870856178Z [2024-04-06T01:41:03.870+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:41:03.879870146Z [2024-04-06T01:41:03.876+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_575395ca-dce0-4ed2-a78b-1880936a2544, execution_date=2024-04-06 01:35:00+00:00, run_id=scheduled__2024-04-06T01:35:00+00:00, run_start_date=2024-04-06 01:40:50.672793+00:00, run_end_date=2024-04-06 01:41:03.876514+00:00, run_duration=13.203721, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:35:00+00:00, data_interval_end=2024-04-06 01:40:00+00:00, dag_hash=108a96777df74ff35f2bb233ba15f270 2024-04-06T01:41:03.900136458Z [2024-04-06T01:41:03.899+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_575395ca-dce0-4ed2-a78b-1880936a2544 to 2024-04-06T01:40:00+00:00, run_after=2024-04-06T01:45:00+00:00 2024-04-06T01:41:05.126546127Z [2024-04-06T01:41:05.126+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_575395ca-dce0-4ed2-a78b-1880936a2544.send_prometheus run_id=scheduled__2024-04-06T01:35:00+00:00 exited with status success for try_number 1 2024-04-06T01:41:05.139449889Z [2024-04-06T01:41:05.139+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_575395ca-dce0-4ed2-a78b-1880936a2544, task_id=send_prometheus, run_id=scheduled__2024-04-06T01:35:00+00:00, map_index=-1, run_start_date=2024-04-06 01:41:02.099110+00:00, run_end_date=2024-04-06 01:41:03.189459+00:00, run_duration=1.090349, state=success, executor_state=success, try_number=1, max_tries=1, job_id=37, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:40:59.452067+00:00, queued_by_job_id=2, pid=899 2024-04-06T01:41:08.726828723Z [2024-04-06T01:41:08.725+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:41:08.727833645Z [2024-04-06T01:41:08.727+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:40:00+00:00, run_id=scheduled__2024-04-06T01:40:00+00:00, run_start_date=2024-04-06 01:41:00.762441+00:00, run_end_date=2024-04-06 01:41:08.726925+00:00, run_duration=7.964484, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:40:00+00:00, data_interval_end=2024-04-06 01:41:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T01:41:08.740328640Z [2024-04-06T01:41:08.740+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:41:00+00:00, run_after=2024-04-06T01:42:00+00:00 2024-04-06T01:41:09.227028307Z [2024-04-06T01:41:09.226+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:41:09.227462875Z [2024-04-06T01:41:09.227+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544, execution_date=2024-04-06 01:40:00+00:00, run_id=scheduled__2024-04-06T01:40:00+00:00, run_start_date=2024-04-06 01:41:00.758207+00:00, run_end_date=2024-04-06 01:41:09.227135+00:00, run_duration=8.468928, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:40:00+00:00, data_interval_end=2024-04-06 01:41:00+00:00, dag_hash=518e7ea47c1c0d135e22cbc609ad63f3 2024-04-06T01:41:09.237861324Z [2024-04-06T01:41:09.237+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544 to 2024-04-06T01:41:00+00:00, run_after=2024-04-06T01:42:00+00:00 2024-04-06T01:41:09.321489466Z [2024-04-06T01:41:09.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:40:00+00:00 exited with status success for try_number 1 2024-04-06T01:41:09.321737835Z [2024-04-06T01:41:09.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:40:00+00:00 exited with status success for try_number 1 2024-04-06T01:41:09.326715920Z [2024-04-06T01:41:09.326+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:40:00+00:00, map_index=-1, run_start_date=2024-04-06 01:41:06.686559+00:00, run_end_date=2024-04-06 01:41:09.066081+00:00, run_duration=2.379522, state=success, executor_state=success, try_number=1, max_tries=1, job_id=39, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:41:00.870698+00:00, queued_by_job_id=2, pid=941 2024-04-06T01:41:09.327051039Z [2024-04-06T01:41:09.326+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:40:00+00:00, map_index=-1, run_start_date=2024-04-06 01:41:07.017496+00:00, run_end_date=2024-04-06 01:41:08.669394+00:00, run_duration=1.651898, state=success, executor_state=success, try_number=1, max_tries=1, job_id=40, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:41:00.870698+00:00, queued_by_job_id=2, pid=942 2024-04-06T01:41:10.372079160Z [2024-04-06T01:41:10.371+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:41:10.372688012Z [2024-04-06T01:41:10.372+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:40:00+00:00, run_id=scheduled__2024-04-06T01:40:00+00:00, run_start_date=2024-04-06 01:41:00.765466+00:00, run_end_date=2024-04-06 01:41:10.372141+00:00, run_duration=9.606675, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:40:00+00:00, data_interval_end=2024-04-06 01:41:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T01:41:10.384793567Z [2024-04-06T01:41:10.383+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:41:00+00:00, run_after=2024-04-06T01:42:00+00:00 2024-04-06T01:41:10.393094676Z [2024-04-06T01:41:10.392+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:41:10.393456219Z [2024-04-06T01:41:10.393+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_575395ca-dce0-4ed2-a78b-1880936a2544, execution_date=2024-04-06 01:40:00+00:00, run_id=scheduled__2024-04-06T01:40:00+00:00, run_start_date=2024-04-06 01:41:00.767299+00:00, run_end_date=2024-04-06 01:41:10.393024+00:00, run_duration=9.625725, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:40:00+00:00, data_interval_end=2024-04-06 01:41:00+00:00, dag_hash=391abb96d8ad904eb489a704f7a0384f 2024-04-06T01:41:10.403926644Z [2024-04-06T01:41:10.403+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_575395ca-dce0-4ed2-a78b-1880936a2544 to 2024-04-06T01:41:00+00:00, run_after=2024-04-06T01:42:00+00:00 2024-04-06T01:41:10.437323679Z [2024-04-06T01:41:10.437+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:40:00+00:00 exited with status success for try_number 1 2024-04-06T01:41:10.437427180Z [2024-04-06T01:41:10.437+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_575395ca-dce0-4ed2-a78b-1880936a2544.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:40:00+00:00 exited with status success for try_number 1 2024-04-06T01:41:10.443395867Z [2024-04-06T01:41:10.443+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:40:00+00:00, map_index=-1, run_start_date=2024-04-06 01:41:05.428509+00:00, run_end_date=2024-04-06 01:41:09.248746+00:00, run_duration=3.820237, state=success, executor_state=success, try_number=1, max_tries=1, job_id=38, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:41:00.870698+00:00, queued_by_job_id=2, pid=913 2024-04-06T01:41:10.443598749Z [2024-04-06T01:41:10.443+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_575395ca-dce0-4ed2-a78b-1880936a2544, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:40:00+00:00, map_index=-1, run_start_date=2024-04-06 01:41:07.849540+00:00, run_end_date=2024-04-06 01:41:09.434150+00:00, run_duration=1.58461, state=success, executor_state=success, try_number=1, max_tries=1, job_id=41, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:41:00.870698+00:00, queued_by_job_id=2, pid=970 2024-04-06T01:42:00.535622711Z [2024-04-06T01:42:00.535+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:42:00.545436234Z [2024-04-06T01:42:00.545+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:42:00.564382402Z [2024-04-06T01:42:00.564+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:42:00+00:00, run_after=2024-04-06T01:43:00+00:00 2024-04-06T01:42:00.573276115Z [2024-04-06T01:42:00.572+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:42:00.586416567Z [2024-04-06T01:42:00.586+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_575395ca-dce0-4ed2-a78b-1880936a2544 to 2024-04-06T01:42:00+00:00, run_after=2024-04-06T01:43:00+00:00 2024-04-06T01:42:00.694898130Z [2024-04-06T01:42:00.694+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-06T01:42:00.694916888Z 2024-04-06T01:42:00.694922933Z 2024-04-06T01:42:00.694927969Z 2024-04-06T01:42:00.694942679Z 2024-04-06T01:42:00.694947888Z 2024-04-06T01:42:00.694964922Z [2024-04-06T01:42:00.694+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T01:42:00.694977340Z [2024-04-06T01:42:00.694+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544 has 0/16 running and queued tasks 2024-04-06T01:42:00.695147125Z [2024-04-06T01:42:00.694+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:42:00.695232929Z [2024-04-06T01:42:00.695+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:42:00.695323124Z [2024-04-06T01:42:00.695+0000] {scheduler_job.py:425} INFO - DAG vim_status_575395ca-dce0-4ed2-a78b-1880936a2544 has 0/16 running and queued tasks 2024-04-06T01:42:00.695932093Z [2024-04-06T01:42:00.695+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:42:00.695944187Z 2024-04-06T01:42:00.695949810Z 2024-04-06T01:42:00.695954697Z 2024-04-06T01:42:00.695959709Z 2024-04-06T01:42:00.695964673Z 2024-04-06T01:42:00.702246047Z [2024-04-06T01:42:00.700+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:42:00.702264765Z [2024-04-06T01:42:00.700+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:42:00.702270239Z [2024-04-06T01:42:00.701+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:42:00.702274294Z [2024-04-06T01:42:00.701+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:42:00.702278178Z [2024-04-06T01:42:00.701+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:42:00.702282336Z [2024-04-06T01:42:00.701+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:42:00.702286105Z [2024-04-06T01:42:00.701+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:42:00.702299491Z [2024-04-06T01:42:00.701+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:42:00.702303768Z [2024-04-06T01:42:00.702+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_575395ca-dce0-4ed2-a78b-1880936a2544', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:42:00.702313790Z [2024-04-06T01:42:00.702+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_575395ca-dce0-4ed2-a78b-1880936a2544', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:42:01.319348438Z [2024-04-06T01:42:01.318+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T01:40:00+00:00 exited with status queued for try_number 1 2024-04-06T01:42:01.319659463Z [2024-04-06T01:42:01.319+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:41:00+00:00 exited with status queued for try_number 1 2024-04-06T01:42:01.319930057Z [2024-04-06T01:42:01.319+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:41:00+00:00 exited with status queued for try_number 1 2024-04-06T01:42:01.320219747Z [2024-04-06T01:42:01.319+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:41:00+00:00 exited with status queued for try_number 1 2024-04-06T01:42:01.320398814Z [2024-04-06T01:42:01.320+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_575395ca-dce0-4ed2-a78b-1880936a2544.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:41:00+00:00 exited with status queued for try_number 1 2024-04-06T01:42:01.348072556Z [2024-04-06T01:42:01.347+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1640f572-ec1f-4337-9c69-f1a07479be8e 2024-04-06T01:42:01.352754019Z [2024-04-06T01:42:01.352+0000] {scheduler_job.py:635} INFO - Setting external_id for to e1fe4178-08f5-4212-bbc8-17d699f77a3f 2024-04-06T01:42:01.353336360Z [2024-04-06T01:42:01.353+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa583afc-deb8-4b9c-8e7b-c2690fd4365d 2024-04-06T01:42:01.353629218Z [2024-04-06T01:42:01.353+0000] {scheduler_job.py:635} INFO - Setting external_id for to 096deb59-a850-45ae-b875-b5591bf77420 2024-04-06T01:42:01.353931867Z [2024-04-06T01:42:01.353+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7beb5c2a-2fef-4221-a6f9-90ab5a2b5b31 2024-04-06T01:42:05.492810611Z [2024-04-06T01:42:05.492+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:42:05.493240874Z [2024-04-06T01:42:05.493+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 01:40:00+00:00, run_id=scheduled__2024-04-06T01:40:00+00:00, run_start_date=2024-04-06 01:42:00.602186+00:00, run_end_date=2024-04-06 01:42:05.492770+00:00, run_duration=4.890584, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:40:00+00:00, data_interval_end=2024-04-06 01:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T01:42:05.516738305Z [2024-04-06T01:42:05.516+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T01:42:00+00:00, run_after=2024-04-06T01:44:00+00:00 2024-04-06T01:42:05.675765380Z [2024-04-06T01:42:05.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T01:40:00+00:00 exited with status success for try_number 1 2024-04-06T01:42:05.687203912Z [2024-04-06T01:42:05.686+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T01:40:00+00:00, map_index=-1, run_start_date=2024-04-06 01:42:03.449284+00:00, run_end_date=2024-04-06 01:42:05.049631+00:00, run_duration=1.600347, state=success, executor_state=success, try_number=1, max_tries=1, job_id=42, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:42:00.697747+00:00, queued_by_job_id=2, pid=998 2024-04-06T01:42:08.968024119Z [2024-04-06T01:42:08.965+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:42:08.968054489Z [2024-04-06T01:42:08.965+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_575395ca-dce0-4ed2-a78b-1880936a2544, execution_date=2024-04-06 01:41:00+00:00, run_id=scheduled__2024-04-06T01:41:00+00:00, run_start_date=2024-04-06 01:42:00.608892+00:00, run_end_date=2024-04-06 01:42:08.965407+00:00, run_duration=8.356515, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:41:00+00:00, data_interval_end=2024-04-06 01:42:00+00:00, dag_hash=391abb96d8ad904eb489a704f7a0384f 2024-04-06T01:42:08.978896255Z [2024-04-06T01:42:08.978+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_575395ca-dce0-4ed2-a78b-1880936a2544 to 2024-04-06T01:42:00+00:00, run_after=2024-04-06T01:43:00+00:00 2024-04-06T01:42:08.986598271Z [2024-04-06T01:42:08.986+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:42:08.986941348Z [2024-04-06T01:42:08.986+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:41:00+00:00, run_id=scheduled__2024-04-06T01:41:00+00:00, run_start_date=2024-04-06 01:42:00.605792+00:00, run_end_date=2024-04-06 01:42:08.986606+00:00, run_duration=8.380814, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:41:00+00:00, data_interval_end=2024-04-06 01:42:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T01:42:08.998482702Z [2024-04-06T01:42:08.998+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:42:00+00:00, run_after=2024-04-06T01:43:00+00:00 2024-04-06T01:42:09.044298950Z [2024-04-06T01:42:09.043+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:41:00+00:00 exited with status success for try_number 1 2024-04-06T01:42:09.044426764Z [2024-04-06T01:42:09.044+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_575395ca-dce0-4ed2-a78b-1880936a2544.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:41:00+00:00 exited with status success for try_number 1 2024-04-06T01:42:09.055175957Z [2024-04-06T01:42:09.054+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:41:00+00:00, map_index=-1, run_start_date=2024-04-06 01:42:06.996335+00:00, run_end_date=2024-04-06 01:42:08.590279+00:00, run_duration=1.593944, state=success, executor_state=success, try_number=1, max_tries=1, job_id=44, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:42:00.697747+00:00, queued_by_job_id=2, pid=1049 2024-04-06T01:42:09.055304313Z [2024-04-06T01:42:09.055+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_575395ca-dce0-4ed2-a78b-1880936a2544, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:41:00+00:00, map_index=-1, run_start_date=2024-04-06 01:42:05.715304+00:00, run_end_date=2024-04-06 01:42:08.060022+00:00, run_duration=2.344718, state=success, executor_state=success, try_number=1, max_tries=1, job_id=43, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:42:00.697747+00:00, queued_by_job_id=2, pid=1021 2024-04-06T01:42:09.561395077Z [2024-04-06T01:42:09.561+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:42:09.561915491Z [2024-04-06T01:42:09.561+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544, execution_date=2024-04-06 01:41:00+00:00, run_id=scheduled__2024-04-06T01:41:00+00:00, run_start_date=2024-04-06 01:42:00.604015+00:00, run_end_date=2024-04-06 01:42:09.561337+00:00, run_duration=8.957322, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:41:00+00:00, data_interval_end=2024-04-06 01:42:00+00:00, dag_hash=518e7ea47c1c0d135e22cbc609ad63f3 2024-04-06T01:42:09.571265888Z [2024-04-06T01:42:09.571+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544 to 2024-04-06T01:42:00+00:00, run_after=2024-04-06T01:43:00+00:00 2024-04-06T01:42:09.615017641Z [2024-04-06T01:42:09.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:41:00+00:00 exited with status success for try_number 1 2024-04-06T01:42:09.620076813Z [2024-04-06T01:42:09.619+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:41:00+00:00, map_index=-1, run_start_date=2024-04-06 01:42:07.498806+00:00, run_end_date=2024-04-06 01:42:09.415271+00:00, run_duration=1.916465, state=success, executor_state=success, try_number=1, max_tries=1, job_id=46, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:42:00.697747+00:00, queued_by_job_id=2, pid=1063 2024-04-06T01:42:10.677376215Z [2024-04-06T01:42:10.676+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:42:10.677738504Z [2024-04-06T01:42:10.677+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:41:00+00:00, run_id=scheduled__2024-04-06T01:41:00+00:00, run_start_date=2024-04-06 01:42:00.607294+00:00, run_end_date=2024-04-06 01:42:10.677387+00:00, run_duration=10.070093, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:41:00+00:00, data_interval_end=2024-04-06 01:42:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T01:42:10.692158407Z [2024-04-06T01:42:10.691+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:42:00+00:00, run_after=2024-04-06T01:43:00+00:00 2024-04-06T01:42:10.779641753Z [2024-04-06T01:42:10.779+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:41:00+00:00 exited with status success for try_number 1 2024-04-06T01:42:10.789555935Z [2024-04-06T01:42:10.787+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:41:00+00:00, map_index=-1, run_start_date=2024-04-06 01:42:07.301629+00:00, run_end_date=2024-04-06 01:42:09.903079+00:00, run_duration=2.60145, state=success, executor_state=success, try_number=1, max_tries=1, job_id=45, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:42:00.697747+00:00, queued_by_job_id=2, pid=1059 2024-04-06T01:43:00.864684283Z [2024-04-06T01:43:00.862+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_575395ca-dce0-4ed2-a78b-1880936a2544 to 2024-04-06T01:43:00+00:00, run_after=2024-04-06T01:44:00+00:00 2024-04-06T01:43:00.883295561Z [2024-04-06T01:43:00.883+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:43:00+00:00, run_after=2024-04-06T01:44:00+00:00 2024-04-06T01:43:00.894133406Z [2024-04-06T01:43:00.893+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:43:00.901406385Z [2024-04-06T01:43:00.901+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:43:00.993911395Z [2024-04-06T01:43:00.993+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-06T01:43:00.993926351Z 2024-04-06T01:43:00.993930063Z 2024-04-06T01:43:00.993933413Z 2024-04-06T01:43:00.993936693Z 2024-04-06T01:43:00.993944798Z [2024-04-06T01:43:00.993+0000] {scheduler_job.py:425} INFO - DAG vim_status_575395ca-dce0-4ed2-a78b-1880936a2544 has 0/16 running and queued tasks 2024-04-06T01:43:00.994036663Z [2024-04-06T01:43:00.993+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:43:00.994130455Z [2024-04-06T01:43:00.994+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544 has 0/16 running and queued tasks 2024-04-06T01:43:00.994193294Z [2024-04-06T01:43:00.994+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:43:00.994744554Z [2024-04-06T01:43:00.994+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:43:00.994754653Z 2024-04-06T01:43:00.994757873Z 2024-04-06T01:43:00.994761002Z 2024-04-06T01:43:00.994763922Z 2024-04-06T01:43:00.998065388Z [2024-04-06T01:43:00.997+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_575395ca-dce0-4ed2-a78b-1880936a2544', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:43:00.998185640Z [2024-04-06T01:43:00.998+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_575395ca-dce0-4ed2-a78b-1880936a2544', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:43:00.998806167Z [2024-04-06T01:43:00.998+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:43:00.998878269Z [2024-04-06T01:43:00.998+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:43:00.999095539Z [2024-04-06T01:43:00.998+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:43:00.999171933Z [2024-04-06T01:43:00.999+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:43:00.999336895Z [2024-04-06T01:43:00.999+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:43:00.999406619Z [2024-04-06T01:43:00.999+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:43:01.523410530Z [2024-04-06T01:43:01.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_575395ca-dce0-4ed2-a78b-1880936a2544.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:42:00+00:00 exited with status queued for try_number 1 2024-04-06T01:43:01.523561943Z [2024-04-06T01:43:01.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:42:00+00:00 exited with status queued for try_number 1 2024-04-06T01:43:01.523699896Z [2024-04-06T01:43:01.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:42:00+00:00 exited with status queued for try_number 1 2024-04-06T01:43:01.523780421Z [2024-04-06T01:43:01.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:42:00+00:00 exited with status queued for try_number 1 2024-04-06T01:43:01.550144328Z [2024-04-06T01:43:01.549+0000] {scheduler_job.py:635} INFO - Setting external_id for to 73dc016a-3d27-4912-96e4-6574e71301e9 2024-04-06T01:43:01.550380908Z [2024-04-06T01:43:01.550+0000] {scheduler_job.py:635} INFO - Setting external_id for to 365cf30e-e687-4128-a4d8-e3f78a8cb23c 2024-04-06T01:43:01.550486304Z [2024-04-06T01:43:01.550+0000] {scheduler_job.py:635} INFO - Setting external_id for to 279efcb0-ede1-4076-911d-9f2a09e3ab87 2024-04-06T01:43:01.550578570Z [2024-04-06T01:43:01.550+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5fa40f72-e1d4-4cfa-9eea-9557ca1d56d2 2024-04-06T01:43:08.675791481Z [2024-04-06T01:43:08.675+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:43:08.676273720Z [2024-04-06T01:43:08.675+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:42:00+00:00, run_id=scheduled__2024-04-06T01:42:00+00:00, run_start_date=2024-04-06 01:43:00.915310+00:00, run_end_date=2024-04-06 01:43:08.675707+00:00, run_duration=7.760397, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:42:00+00:00, data_interval_end=2024-04-06 01:43:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T01:43:08.690559448Z [2024-04-06T01:43:08.690+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:43:00+00:00, run_after=2024-04-06T01:44:00+00:00 2024-04-06T01:43:08.698973623Z [2024-04-06T01:43:08.698+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:43:08.699289327Z [2024-04-06T01:43:08.699+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_575395ca-dce0-4ed2-a78b-1880936a2544, execution_date=2024-04-06 01:42:00+00:00, run_id=scheduled__2024-04-06T01:42:00+00:00, run_start_date=2024-04-06 01:43:00.911734+00:00, run_end_date=2024-04-06 01:43:08.699019+00:00, run_duration=7.787285, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:42:00+00:00, data_interval_end=2024-04-06 01:43:00+00:00, dag_hash=391abb96d8ad904eb489a704f7a0384f 2024-04-06T01:43:08.709446668Z [2024-04-06T01:43:08.709+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_575395ca-dce0-4ed2-a78b-1880936a2544 to 2024-04-06T01:43:00+00:00, run_after=2024-04-06T01:44:00+00:00 2024-04-06T01:43:08.717214390Z [2024-04-06T01:43:08.716+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:43:08.717537389Z [2024-04-06T01:43:08.717+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:42:00+00:00, run_id=scheduled__2024-04-06T01:42:00+00:00, run_start_date=2024-04-06 01:43:00.912985+00:00, run_end_date=2024-04-06 01:43:08.717275+00:00, run_duration=7.80429, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:42:00+00:00, data_interval_end=2024-04-06 01:43:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T01:43:08.728265951Z [2024-04-06T01:43:08.727+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:43:00+00:00, run_after=2024-04-06T01:44:00+00:00 2024-04-06T01:43:08.785928539Z [2024-04-06T01:43:08.785+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:42:00+00:00 exited with status success for try_number 1 2024-04-06T01:43:08.786724122Z [2024-04-06T01:43:08.785+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:42:00+00:00 exited with status success for try_number 1 2024-04-06T01:43:08.800623545Z [2024-04-06T01:43:08.798+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:42:00+00:00, map_index=-1, run_start_date=2024-04-06 01:43:05.298354+00:00, run_end_date=2024-04-06 01:43:07.877071+00:00, run_duration=2.578717, state=success, executor_state=success, try_number=1, max_tries=1, job_id=47, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:43:00.995471+00:00, queued_by_job_id=2, pid=1119 2024-04-06T01:43:08.800650316Z [2024-04-06T01:43:08.799+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:42:00+00:00, map_index=-1, run_start_date=2024-04-06 01:43:06.128520+00:00, run_end_date=2024-04-06 01:43:08.336479+00:00, run_duration=2.207959, state=success, executor_state=success, try_number=1, max_tries=1, job_id=48, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:43:00.995471+00:00, queued_by_job_id=2, pid=1139 2024-04-06T01:43:09.818871746Z [2024-04-06T01:43:09.818+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:43:09.819783020Z [2024-04-06T01:43:09.819+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544, execution_date=2024-04-06 01:42:00+00:00, run_id=scheduled__2024-04-06T01:42:00+00:00, run_start_date=2024-04-06 01:43:00.914276+00:00, run_end_date=2024-04-06 01:43:09.818766+00:00, run_duration=8.90449, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:42:00+00:00, data_interval_end=2024-04-06 01:43:00+00:00, dag_hash=518e7ea47c1c0d135e22cbc609ad63f3 2024-04-06T01:43:09.832316625Z [2024-04-06T01:43:09.832+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544 to 2024-04-06T01:43:00+00:00, run_after=2024-04-06T01:44:00+00:00 2024-04-06T01:43:09.870847462Z [2024-04-06T01:43:09.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_575395ca-dce0-4ed2-a78b-1880936a2544.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:42:00+00:00 exited with status success for try_number 1 2024-04-06T01:43:09.871335821Z [2024-04-06T01:43:09.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:42:00+00:00 exited with status success for try_number 1 2024-04-06T01:43:09.880707535Z [2024-04-06T01:43:09.880+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_575395ca-dce0-4ed2-a78b-1880936a2544, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:42:00+00:00, map_index=-1, run_start_date=2024-04-06 01:43:06.791781+00:00, run_end_date=2024-04-06 01:43:08.601428+00:00, run_duration=1.809647, state=success, executor_state=success, try_number=1, max_tries=1, job_id=49, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:43:00.995471+00:00, queued_by_job_id=2, pid=1155 2024-04-06T01:43:09.881299174Z [2024-04-06T01:43:09.880+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:42:00+00:00, map_index=-1, run_start_date=2024-04-06 01:43:06.717108+00:00, run_end_date=2024-04-06 01:43:09.114882+00:00, run_duration=2.397774, state=success, executor_state=success, try_number=1, max_tries=1, job_id=50, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:43:00.995471+00:00, queued_by_job_id=2, pid=1156 2024-04-06T01:44:00.851451354Z [2024-04-06T01:44:00.851+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_575395ca-dce0-4ed2-a78b-1880936a2544 to 2024-04-06T01:44:00+00:00, run_after=2024-04-06T01:45:00+00:00 2024-04-06T01:44:00.884149898Z [2024-04-06T01:44:00.883+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:44:00+00:00, run_after=2024-04-06T01:45:00+00:00 2024-04-06T01:44:00.895623082Z [2024-04-06T01:44:00.895+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:44:00.905362354Z [2024-04-06T01:44:00.904+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:44:00.915787043Z [2024-04-06T01:44:00.913+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:44:01.069645861Z [2024-04-06T01:44:01.069+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-06T01:44:01.069696678Z 2024-04-06T01:44:01.069704398Z 2024-04-06T01:44:01.069710889Z 2024-04-06T01:44:01.069716837Z 2024-04-06T01:44:01.069722700Z 2024-04-06T01:44:01.069951517Z [2024-04-06T01:44:01.069+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T01:44:01.070273091Z [2024-04-06T01:44:01.069+0000] {scheduler_job.py:425} INFO - DAG vim_status_575395ca-dce0-4ed2-a78b-1880936a2544 has 0/16 running and queued tasks 2024-04-06T01:44:01.070530715Z [2024-04-06T01:44:01.070+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:44:01.070863562Z [2024-04-06T01:44:01.070+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:44:01.071106869Z [2024-04-06T01:44:01.070+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544 has 0/16 running and queued tasks 2024-04-06T01:44:01.072518019Z [2024-04-06T01:44:01.072+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:44:01.072537685Z 2024-04-06T01:44:01.072546010Z 2024-04-06T01:44:01.072553003Z 2024-04-06T01:44:01.072619000Z 2024-04-06T01:44:01.072626795Z 2024-04-06T01:44:01.079292900Z [2024-04-06T01:44:01.078+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:44:01.079570132Z [2024-04-06T01:44:01.079+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:44:01.079937001Z [2024-04-06T01:44:01.079+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_575395ca-dce0-4ed2-a78b-1880936a2544', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:44:01.080154687Z [2024-04-06T01:44:01.079+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_575395ca-dce0-4ed2-a78b-1880936a2544', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:44:01.080418763Z [2024-04-06T01:44:01.080+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:44:01.080553806Z [2024-04-06T01:44:01.080+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:44:01.080830626Z [2024-04-06T01:44:01.080+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:44:01.080966704Z [2024-04-06T01:44:01.080+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:44:01.081236392Z [2024-04-06T01:44:01.080+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:44:01.081380316Z [2024-04-06T01:44:01.081+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:44:01.597187812Z [2024-04-06T01:44:01.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T01:42:00+00:00 exited with status queued for try_number 1 2024-04-06T01:44:01.597551749Z [2024-04-06T01:44:01.597+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_575395ca-dce0-4ed2-a78b-1880936a2544.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:43:00+00:00 exited with status queued for try_number 1 2024-04-06T01:44:01.597772613Z [2024-04-06T01:44:01.597+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:43:00+00:00 exited with status queued for try_number 1 2024-04-06T01:44:01.597974207Z [2024-04-06T01:44:01.597+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:43:00+00:00 exited with status queued for try_number 1 2024-04-06T01:44:01.598174374Z [2024-04-06T01:44:01.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:43:00+00:00 exited with status queued for try_number 1 2024-04-06T01:44:01.612691117Z [2024-04-06T01:44:01.612+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f5e2910-b23f-429f-9e0c-5e00fae16689 2024-04-06T01:44:01.615051300Z [2024-04-06T01:44:01.614+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ef0b2fb-8a0d-40d1-84c0-6706da9c593f 2024-04-06T01:44:01.618758212Z [2024-04-06T01:44:01.618+0000] {scheduler_job.py:635} INFO - Setting external_id for to ce503042-bca8-43e9-bc94-5cd6af8f9619 2024-04-06T01:44:01.619084769Z [2024-04-06T01:44:01.618+0000] {scheduler_job.py:635} INFO - Setting external_id for to cfff197e-0f13-4f51-a6e5-82ce89b0b183 2024-04-06T01:44:01.619350654Z [2024-04-06T01:44:01.619+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37c6a5d2-bdee-4fbd-84fc-f517b3a82e1c 2024-04-06T01:44:05.211707706Z [2024-04-06T01:44:05.211+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:44:05.212015433Z [2024-04-06T01:44:05.211+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 01:42:00+00:00, run_id=scheduled__2024-04-06T01:42:00+00:00, run_start_date=2024-04-06 01:44:00.938251+00:00, run_end_date=2024-04-06 01:44:05.211689+00:00, run_duration=4.273438, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:42:00+00:00, data_interval_end=2024-04-06 01:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T01:44:05.231040521Z [2024-04-06T01:44:05.230+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T01:44:00+00:00, run_after=2024-04-06T01:46:00+00:00 2024-04-06T01:44:05.308984421Z [2024-04-06T01:44:05.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T01:42:00+00:00 exited with status success for try_number 1 2024-04-06T01:44:05.327074250Z [2024-04-06T01:44:05.326+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T01:42:00+00:00, map_index=-1, run_start_date=2024-04-06 01:44:03.932110+00:00, run_end_date=2024-04-06 01:44:04.682178+00:00, run_duration=0.750068, state=success, executor_state=success, try_number=1, max_tries=1, job_id=51, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:44:01.074531+00:00, queued_by_job_id=2, pid=1214 2024-04-06T01:44:06.439055186Z [2024-04-06T01:44:06.438+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_575395ca-dce0-4ed2-a78b-1880936a2544.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:43:00+00:00 exited with status failed for try_number 1 2024-04-06T01:44:06.439443473Z [2024-04-06T01:44:06.438+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:43:00+00:00 exited with status failed for try_number 1 2024-04-06T01:44:06.447862918Z [2024-04-06T01:44:06.447+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_575395ca-dce0-4ed2-a78b-1880936a2544, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:43:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:44:01.074531+00:00, queued_by_job_id=2, pid=None 2024-04-06T01:44:06.449016642Z [2024-04-06T01:44:06.448+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T01:44:06.451557666Z [2024-04-06T01:44:06.451+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T01:44:06.467358488Z [2024-04-06T01:44:06.467+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_575395ca-dce0-4ed2-a78b-1880936a2544, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240406T014300, start_date=, end_date=20240406T014406 2024-04-06T01:44:06.478818684Z [2024-04-06T01:44:06.478+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:43:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:44:01.074531+00:00, queued_by_job_id=2, pid=None 2024-04-06T01:44:06.479644804Z [2024-04-06T01:44:06.479+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T01:44:06.482098089Z [2024-04-06T01:44:06.481+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T01:44:06.493521559Z [2024-04-06T01:44:06.493+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240406T014300, start_date=, end_date=20240406T014406 2024-04-06T01:44:07.862004076Z [2024-04-06T01:44:07.861+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:44:07.862400596Z [2024-04-06T01:44:07.862+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:43:00+00:00, run_id=scheduled__2024-04-06T01:43:00+00:00, run_start_date=2024-04-06 01:44:00.942297+00:00, run_end_date=2024-04-06 01:44:07.861774+00:00, run_duration=6.919477, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:43:00+00:00, data_interval_end=2024-04-06 01:44:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T01:44:07.872647732Z [2024-04-06T01:44:07.872+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:44:00+00:00, run_after=2024-04-06T01:45:00+00:00 2024-04-06T01:44:07.880976137Z [2024-04-06T01:44:07.880+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:44:07.882494388Z [2024-04-06T01:44:07.882+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:43:00+00:00, run_id=scheduled__2024-04-06T01:43:00+00:00, run_start_date=2024-04-06 01:44:00.945030+00:00, run_end_date=2024-04-06 01:44:07.880829+00:00, run_duration=6.935799, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:43:00+00:00, data_interval_end=2024-04-06 01:44:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T01:44:07.892648560Z [2024-04-06T01:44:07.892+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:44:00+00:00, run_after=2024-04-06T01:45:00+00:00 2024-04-06T01:44:07.949564485Z [2024-04-06T01:44:07.949+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:43:00+00:00 exited with status success for try_number 1 2024-04-06T01:44:07.949944001Z [2024-04-06T01:44:07.949+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:43:00+00:00 exited with status success for try_number 1 2024-04-06T01:44:07.959910301Z [2024-04-06T01:44:07.959+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:43:00+00:00, map_index=-1, run_start_date=2024-04-06 01:44:04.052343+00:00, run_end_date=2024-04-06 01:44:07.012336+00:00, run_duration=2.959993, state=success, executor_state=success, try_number=1, max_tries=1, job_id=52, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:44:01.074531+00:00, queued_by_job_id=2, pid=1215 2024-04-06T01:44:07.960458423Z [2024-04-06T01:44:07.960+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:43:00+00:00, map_index=-1, run_start_date=2024-04-06 01:44:05.472572+00:00, run_end_date=2024-04-06 01:44:07.416870+00:00, run_duration=1.944298, state=success, executor_state=success, try_number=1, max_tries=1, job_id=53, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:44:01.074531+00:00, queued_by_job_id=2, pid=1259 2024-04-06T01:44:16.887404317Z [2024-04-06T01:44:16.886+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T01:44:16.887448950Z 2024-04-06T01:44:16.887457580Z 2024-04-06T01:44:16.887464672Z [2024-04-06T01:44:16.887+0000] {scheduler_job.py:425} INFO - DAG vim_status_575395ca-dce0-4ed2-a78b-1880936a2544 has 0/16 running and queued tasks 2024-04-06T01:44:16.887663972Z [2024-04-06T01:44:16.887+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544 has 0/16 running and queued tasks 2024-04-06T01:44:16.888498602Z [2024-04-06T01:44:16.888+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:44:16.888516925Z 2024-04-06T01:44:16.888597246Z 2024-04-06T01:44:16.892436632Z [2024-04-06T01:44:16.892+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_575395ca-dce0-4ed2-a78b-1880936a2544', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:43:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:44:16.892569756Z [2024-04-06T01:44:16.892+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_575395ca-dce0-4ed2-a78b-1880936a2544', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:44:16.892970879Z [2024-04-06T01:44:16.892+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:43:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:44:16.893137388Z [2024-04-06T01:44:16.892+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:44:17.072217249Z [2024-04-06T01:44:17.071+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_575395ca-dce0-4ed2-a78b-1880936a2544.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:43:00+00:00 exited with status queued for try_number 2 2024-04-06T01:44:17.072504902Z [2024-04-06T01:44:17.072+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:43:00+00:00 exited with status queued for try_number 2 2024-04-06T01:44:17.079983185Z [2024-04-06T01:44:17.079+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0da021d6-a186-428c-a13c-f18dd1bfca73 2024-04-06T01:44:17.080299917Z [2024-04-06T01:44:17.080+0000] {scheduler_job.py:635} INFO - Setting external_id for to df9bab30-ad38-4ba6-9c81-26b68de85cbc 2024-04-06T01:44:19.439135467Z [2024-04-06T01:44:19.438+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_575395ca-dce0-4ed2-a78b-1880936a2544.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:43:00+00:00 exited with status failed for try_number 2 2024-04-06T01:44:19.439713474Z [2024-04-06T01:44:19.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:43:00+00:00 exited with status failed for try_number 2 2024-04-06T01:44:19.451912102Z [2024-04-06T01:44:19.451+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_575395ca-dce0-4ed2-a78b-1880936a2544, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:43:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-06 01:44:06.454446+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:44:16.889249+00:00, queued_by_job_id=2, pid=None 2024-04-06T01:44:19.452898328Z [2024-04-06T01:44:19.452+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T01:44:19.456362063Z [2024-04-06T01:44:19.455+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T01:44:19.475756619Z [2024-04-06T01:44:19.475+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_575395ca-dce0-4ed2-a78b-1880936a2544, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240406T014300, start_date=, end_date=20240406T014419 2024-04-06T01:44:19.485664427Z [2024-04-06T01:44:19.485+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:43:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-06 01:44:06.484565+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:44:16.889249+00:00, queued_by_job_id=2, pid=None 2024-04-06T01:44:19.486192242Z [2024-04-06T01:44:19.485+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T01:44:19.488557051Z [2024-04-06T01:44:19.488+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T01:44:19.502948735Z [2024-04-06T01:44:19.502+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240406T014300, start_date=, end_date=20240406T014419 2024-04-06T01:44:20.217448467Z [2024-04-06T01:44:20.216+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-06T01:44:20.217754699Z [2024-04-06T01:44:20.217+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_575395ca-dce0-4ed2-a78b-1880936a2544, execution_date=2024-04-06 01:43:00+00:00, run_id=scheduled__2024-04-06T01:43:00+00:00, run_start_date=2024-04-06 01:44:00.939542+00:00, run_end_date=2024-04-06 01:44:20.217278+00:00, run_duration=19.277736, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:43:00+00:00, data_interval_end=2024-04-06 01:44:00+00:00, dag_hash=391abb96d8ad904eb489a704f7a0384f 2024-04-06T01:44:20.229531578Z [2024-04-06T01:44:20.229+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_575395ca-dce0-4ed2-a78b-1880936a2544 to 2024-04-06T01:44:00+00:00, run_after=2024-04-06T01:45:00+00:00 2024-04-06T01:44:20.247560309Z [2024-04-06T01:44:20.246+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-06T01:44:20.248159831Z [2024-04-06T01:44:20.247+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544, execution_date=2024-04-06 01:43:00+00:00, run_id=scheduled__2024-04-06T01:43:00+00:00, run_start_date=2024-04-06 01:44:00.946084+00:00, run_end_date=2024-04-06 01:44:20.247407+00:00, run_duration=19.301323, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:43:00+00:00, data_interval_end=2024-04-06 01:44:00+00:00, dag_hash=518e7ea47c1c0d135e22cbc609ad63f3 2024-04-06T01:44:20.267645209Z [2024-04-06T01:44:20.267+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_575395ca-dce0-4ed2-a78b-1880936a2544 to 2024-04-06T01:44:00+00:00, run_after=2024-04-06T01:45:00+00:00 2024-04-06T01:45:00.952475307Z [2024-04-06T01:45:00.948+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:45:00+00:00, run_after=2024-04-06T01:50:00+00:00 2024-04-06T01:45:00.972361194Z [2024-04-06T01:45:00.971+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:45:00+00:00, run_after=2024-04-06T01:46:00+00:00 2024-04-06T01:45:00.982176949Z [2024-04-06T01:45:00.981+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:45:01.068908717Z [2024-04-06T01:45:01.068+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T01:45:01.068928620Z 2024-04-06T01:45:01.068933451Z 2024-04-06T01:45:01.068936911Z 2024-04-06T01:45:01.068946163Z [2024-04-06T01:45:01.068+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:45:01.069019124Z [2024-04-06T01:45:01.068+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:45:01.069086333Z [2024-04-06T01:45:01.068+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:45:01.069795636Z [2024-04-06T01:45:01.069+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:45:01.069807358Z 2024-04-06T01:45:01.069823123Z 2024-04-06T01:45:01.069826044Z 2024-04-06T01:45:01.074215563Z [2024-04-06T01:45:01.073+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-06T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-06T01:45:01.074303523Z [2024-04-06T01:45:01.074+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:45:01.074510435Z [2024-04-06T01:45:01.074+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:45:01.074588262Z [2024-04-06T01:45:01.074+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:45:01.075932461Z [2024-04-06T01:45:01.075+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:45:01.076035459Z [2024-04-06T01:45:01.075+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:45:01.430500655Z [2024-04-06T01:45:01.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T01:40:00+00:00 exited with status queued for try_number 1 2024-04-06T01:45:01.430535467Z [2024-04-06T01:45:01.430+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:44:00+00:00 exited with status queued for try_number 1 2024-04-06T01:45:01.430595223Z [2024-04-06T01:45:01.430+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:44:00+00:00 exited with status queued for try_number 1 2024-04-06T01:45:01.444508014Z [2024-04-06T01:45:01.444+0000] {scheduler_job.py:635} INFO - Setting external_id for to b2f47e35-a1e3-47b2-b582-a75aaeb9c63a 2024-04-06T01:45:01.444639015Z [2024-04-06T01:45:01.444+0000] {scheduler_job.py:635} INFO - Setting external_id for to e77b35ec-72a0-43cf-b9ed-aa2baa88fc8a 2024-04-06T01:45:01.444805849Z [2024-04-06T01:45:01.444+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17e6b355-4088-4bd4-b398-1b6949b99f1f 2024-04-06T01:45:06.703855786Z [2024-04-06T01:45:06.703+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T01:45:06.703885087Z 2024-04-06T01:45:06.704027084Z [2024-04-06T01:45:06.703+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:45:06.704715620Z [2024-04-06T01:45:06.704+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:45:06.704727856Z 2024-04-06T01:45:06.707107683Z [2024-04-06T01:45:06.706+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='split_metrics', run_id='scheduled__2024-04-06T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-06T01:45:06.707238641Z [2024-04-06T01:45:06.706+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:45:06.753559986Z [2024-04-06T01:45:06.753+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T01:40:00+00:00 exited with status queued for try_number 1 2024-04-06T01:45:06.753862161Z [2024-04-06T01:45:06.753+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T01:40:00+00:00 exited with status success for try_number 1 2024-04-06T01:45:06.759664621Z [2024-04-06T01:45:06.759+0000] {scheduler_job.py:635} INFO - Setting external_id for to d94bba60-0b63-457b-9354-e0bbd2ff4940 2024-04-06T01:45:06.760084697Z [2024-04-06T01:45:06.759+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-06T01:40:00+00:00, map_index=-1, run_start_date=2024-04-06 01:45:05.239744+00:00, run_end_date=2024-04-06 01:45:06.102205+00:00, run_duration=0.862461, state=success, executor_state=success, try_number=1, max_tries=1, job_id=54, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:45:01.070599+00:00, queued_by_job_id=2, pid=1374 2024-04-06T01:45:07.450044394Z [2024-04-06T01:45:07.449+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:45:07.450513796Z [2024-04-06T01:45:07.450+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:44:00+00:00, run_id=scheduled__2024-04-06T01:44:00+00:00, run_start_date=2024-04-06 01:45:00.996919+00:00, run_end_date=2024-04-06 01:45:07.450053+00:00, run_duration=6.453134, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:44:00+00:00, data_interval_end=2024-04-06 01:45:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T01:45:07.460466560Z [2024-04-06T01:45:07.460+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:45:00+00:00, run_after=2024-04-06T01:46:00+00:00 2024-04-06T01:45:08.231837309Z [2024-04-06T01:45:08.231+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:45:08.232086884Z [2024-04-06T01:45:08.231+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:44:00+00:00, run_id=scheduled__2024-04-06T01:44:00+00:00, run_start_date=2024-04-06 01:45:00.995816+00:00, run_end_date=2024-04-06 01:45:08.231759+00:00, run_duration=7.235943, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:44:00+00:00, data_interval_end=2024-04-06 01:45:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T01:45:08.282553610Z [2024-04-06T01:45:08.282+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:45:00+00:00, run_after=2024-04-06T01:46:00+00:00 2024-04-06T01:45:08.363027499Z [2024-04-06T01:45:08.362+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:44:00+00:00 exited with status success for try_number 1 2024-04-06T01:45:08.363309574Z [2024-04-06T01:45:08.362+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:44:00+00:00 exited with status success for try_number 1 2024-04-06T01:45:08.374057252Z [2024-04-06T01:45:08.373+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:44:00+00:00, map_index=-1, run_start_date=2024-04-06 01:45:05.673321+00:00, run_end_date=2024-04-06 01:45:07.394026+00:00, run_duration=1.720705, state=success, executor_state=success, try_number=1, max_tries=1, job_id=56, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:45:01.070599+00:00, queued_by_job_id=2, pid=1377 2024-04-06T01:45:08.374305364Z [2024-04-06T01:45:08.374+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:44:00+00:00, map_index=-1, run_start_date=2024-04-06 01:45:05.435700+00:00, run_end_date=2024-04-06 01:45:07.480535+00:00, run_duration=2.044835, state=success, executor_state=success, try_number=1, max_tries=1, job_id=55, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:45:01.070599+00:00, queued_by_job_id=2, pid=1376 2024-04-06T01:45:09.466047108Z [2024-04-06T01:45:09.465+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T01:45:09.466093383Z 2024-04-06T01:45:09.466499050Z [2024-04-06T01:45:09.465+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:45:09.467087182Z [2024-04-06T01:45:09.466+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:45:09.467098295Z 2024-04-06T01:45:09.469372223Z [2024-04-06T01:45:09.469+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='collect_metrics', run_id='scheduled__2024-04-06T01:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-06T01:45:09.469652631Z [2024-04-06T01:45:09.469+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T01:45:09.513739303Z [2024-04-06T01:45:09.513+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T01:40:00+00:00 exited with status queued for try_number 1 2024-04-06T01:45:09.513958481Z [2024-04-06T01:45:09.513+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T01:40:00+00:00 exited with status success for try_number 1 2024-04-06T01:45:09.521533854Z [2024-04-06T01:45:09.520+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=split_metrics, run_id=scheduled__2024-04-06T01:40:00+00:00, map_index=-1, run_start_date=2024-04-06 01:45:08.526387+00:00, run_end_date=2024-04-06 01:45:08.923340+00:00, run_duration=0.396953, state=success, executor_state=success, try_number=1, max_tries=1, job_id=57, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:45:06.705097+00:00, queued_by_job_id=2, pid=1416 2024-04-06T01:45:09.522863496Z [2024-04-06T01:45:09.522+0000] {scheduler_job.py:635} INFO - Setting external_id for to b0f17175-861b-4f59-bc54-68c4d3995540 2024-04-06T01:45:13.453951817Z [2024-04-06T01:45:13.453+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T01:45:13.453979122Z 2024-04-06T01:45:13.454488790Z [2024-04-06T01:45:13.453+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:45:13.455624195Z [2024-04-06T01:45:13.455+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:45:13.455649506Z 2024-04-06T01:45:13.459173238Z [2024-04-06T01:45:13.458+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='send_prometheus', run_id='scheduled__2024-04-06T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:45:13.459611368Z [2024-04-06T01:45:13.458+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:45:13.521054933Z [2024-04-06T01:45:13.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T01:40:00+00:00 exited with status queued for try_number 1 2024-04-06T01:45:13.521427356Z [2024-04-06T01:45:13.521+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T01:40:00+00:00 exited with status success for try_number 1 2024-04-06T01:45:13.528741685Z [2024-04-06T01:45:13.528+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=collect_metrics, run_id=scheduled__2024-04-06T01:40:00+00:00, map_index=0, run_start_date=2024-04-06 01:45:11.435809+00:00, run_end_date=2024-04-06 01:45:12.816938+00:00, run_duration=1.381129, state=success, executor_state=success, try_number=1, max_tries=1, job_id=58, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:45:09.467517+00:00, queued_by_job_id=2, pid=1442 2024-04-06T01:45:13.529081621Z [2024-04-06T01:45:13.528+0000] {scheduler_job.py:635} INFO - Setting external_id for to 11c41120-a717-4f70-8051-cfd73543bdea 2024-04-06T01:45:15.792170203Z [2024-04-06T01:45:15.791+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:45:15.792429752Z [2024-04-06T01:45:15.792+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:40:00+00:00, run_id=scheduled__2024-04-06T01:40:00+00:00, run_start_date=2024-04-06 01:45:00.994501+00:00, run_end_date=2024-04-06 01:45:15.791844+00:00, run_duration=14.797343, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:40:00+00:00, data_interval_end=2024-04-06 01:45:00+00:00, dag_hash=eecc559ff32fe9a7c4345875f113a0a9 2024-04-06T01:45:15.802302480Z [2024-04-06T01:45:15.801+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:45:00+00:00, run_after=2024-04-06T01:50:00+00:00 2024-04-06T01:45:16.928737972Z [2024-04-06T01:45:16.927+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T01:40:00+00:00 exited with status success for try_number 1 2024-04-06T01:45:16.939792725Z [2024-04-06T01:45:16.939+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=send_prometheus, run_id=scheduled__2024-04-06T01:40:00+00:00, map_index=-1, run_start_date=2024-04-06 01:45:15.422155+00:00, run_end_date=2024-04-06 01:45:15.768580+00:00, run_duration=0.346425, state=success, executor_state=success, try_number=1, max_tries=1, job_id=59, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:45:13.456384+00:00, queued_by_job_id=2, pid=1463 2024-04-06T01:45:19.247351271Z [2024-04-06T01:45:19.246+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-06T01:46:00.237107552Z [2024-04-06T01:46:00.236+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:46:00+00:00, run_after=2024-04-06T01:47:00+00:00 2024-04-06T01:46:00.253031514Z [2024-04-06T01:46:00.252+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:46:00.261072095Z [2024-04-06T01:46:00.260+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:46:00.332985927Z [2024-04-06T01:46:00.332+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T01:46:00.333009515Z 2024-04-06T01:46:00.333014016Z 2024-04-06T01:46:00.333017338Z 2024-04-06T01:46:00.333347345Z [2024-04-06T01:46:00.332+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T01:46:00.333606211Z [2024-04-06T01:46:00.333+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:46:00.333801792Z [2024-04-06T01:46:00.333+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:46:00.334554067Z [2024-04-06T01:46:00.334+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:46:00.334580878Z 2024-04-06T01:46:00.334584517Z 2024-04-06T01:46:00.334587613Z 2024-04-06T01:46:00.337152103Z [2024-04-06T01:46:00.336+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:46:00.337534959Z [2024-04-06T01:46:00.337+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:46:00.337890073Z [2024-04-06T01:46:00.337+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:46:00.338114695Z [2024-04-06T01:46:00.337+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:46:00.338401687Z [2024-04-06T01:46:00.338+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:46:00.338643670Z [2024-04-06T01:46:00.338+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:46:00.645074105Z [2024-04-06T01:46:00.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T01:44:00+00:00 exited with status queued for try_number 1 2024-04-06T01:46:00.645884163Z [2024-04-06T01:46:00.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:45:00+00:00 exited with status queued for try_number 1 2024-04-06T01:46:00.646511019Z [2024-04-06T01:46:00.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:45:00+00:00 exited with status queued for try_number 1 2024-04-06T01:46:00.664400480Z [2024-04-06T01:46:00.664+0000] {scheduler_job.py:635} INFO - Setting external_id for to 38a69a49-671e-4498-a6de-a706dfd9d256 2024-04-06T01:46:00.666918695Z [2024-04-06T01:46:00.666+0000] {scheduler_job.py:635} INFO - Setting external_id for to 26b69cd0-5112-495d-8704-6acec45ffb50 2024-04-06T01:46:00.668081108Z [2024-04-06T01:46:00.667+0000] {scheduler_job.py:635} INFO - Setting external_id for to edbf4268-98e2-4588-961f-44462b33b631 2024-04-06T01:46:03.238823833Z [2024-04-06T01:46:03.238+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:46:03.239183783Z [2024-04-06T01:46:03.238+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 01:44:00+00:00, run_id=scheduled__2024-04-06T01:44:00+00:00, run_start_date=2024-04-06 01:46:00.273582+00:00, run_end_date=2024-04-06 01:46:03.238783+00:00, run_duration=2.965201, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:44:00+00:00, data_interval_end=2024-04-06 01:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T01:46:03.261033567Z [2024-04-06T01:46:03.260+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T01:46:00+00:00, run_after=2024-04-06T01:48:00+00:00 2024-04-06T01:46:03.434242230Z [2024-04-06T01:46:03.433+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T01:44:00+00:00 exited with status success for try_number 1 2024-04-06T01:46:03.450885742Z [2024-04-06T01:46:03.450+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T01:44:00+00:00, map_index=-1, run_start_date=2024-04-06 01:46:01.456357+00:00, run_end_date=2024-04-06 01:46:02.482480+00:00, run_duration=1.026123, state=success, executor_state=success, try_number=1, max_tries=1, job_id=60, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:46:00.335306+00:00, queued_by_job_id=2, pid=1467 2024-04-06T01:46:05.353069245Z [2024-04-06T01:46:05.352+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:46:05.353486883Z [2024-04-06T01:46:05.353+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:45:00+00:00, run_id=scheduled__2024-04-06T01:45:00+00:00, run_start_date=2024-04-06 01:46:00.275195+00:00, run_end_date=2024-04-06 01:46:05.352907+00:00, run_duration=5.077712, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:45:00+00:00, data_interval_end=2024-04-06 01:46:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T01:46:05.363493821Z [2024-04-06T01:46:05.363+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:46:00+00:00, run_after=2024-04-06T01:47:00+00:00 2024-04-06T01:46:06.482641707Z [2024-04-06T01:46:06.482+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:46:06.482966204Z [2024-04-06T01:46:06.482+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:45:00+00:00, run_id=scheduled__2024-04-06T01:45:00+00:00, run_start_date=2024-04-06 01:46:00.276624+00:00, run_end_date=2024-04-06 01:46:06.482524+00:00, run_duration=6.2059, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:45:00+00:00, data_interval_end=2024-04-06 01:46:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T01:46:06.493777187Z [2024-04-06T01:46:06.493+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:46:00+00:00, run_after=2024-04-06T01:47:00+00:00 2024-04-06T01:46:06.538481409Z [2024-04-06T01:46:06.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:45:00+00:00 exited with status success for try_number 1 2024-04-06T01:46:06.539186692Z [2024-04-06T01:46:06.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:45:00+00:00 exited with status success for try_number 1 2024-04-06T01:46:06.552774362Z [2024-04-06T01:46:06.552+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:45:00+00:00, map_index=-1, run_start_date=2024-04-06 01:46:03.564642+00:00, run_end_date=2024-04-06 01:46:05.502289+00:00, run_duration=1.937647, state=success, executor_state=success, try_number=1, max_tries=1, job_id=61, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:46:00.335306+00:00, queued_by_job_id=2, pid=1497 2024-04-06T01:46:06.553323848Z [2024-04-06T01:46:06.552+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:45:00+00:00, map_index=-1, run_start_date=2024-04-06 01:46:03.800270+00:00, run_end_date=2024-04-06 01:46:05.254944+00:00, run_duration=1.454674, state=success, executor_state=success, try_number=1, max_tries=1, job_id=62, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:46:00.335306+00:00, queued_by_job_id=2, pid=1498 2024-04-06T01:47:00.105282028Z [2024-04-06T01:47:00.104+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:47:00+00:00, run_after=2024-04-06T01:48:00+00:00 2024-04-06T01:47:00.112528321Z [2024-04-06T01:47:00.112+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:47:00.179510087Z [2024-04-06T01:47:00.179+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T01:47:00.179550026Z 2024-04-06T01:47:00.179559789Z 2024-04-06T01:47:00.179621082Z [2024-04-06T01:47:00.179+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:47:00.179967714Z [2024-04-06T01:47:00.179+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:47:00.180738560Z [2024-04-06T01:47:00.180+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:47:00.180753273Z 2024-04-06T01:47:00.180756980Z 2024-04-06T01:47:00.183516581Z [2024-04-06T01:47:00.183+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:47:00.183755132Z [2024-04-06T01:47:00.183+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:47:00.184063763Z [2024-04-06T01:47:00.183+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:47:00.184232382Z [2024-04-06T01:47:00.184+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:47:00.360694126Z [2024-04-06T01:47:00.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:46:00+00:00 exited with status queued for try_number 1 2024-04-06T01:47:00.361080358Z [2024-04-06T01:47:00.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:46:00+00:00 exited with status queued for try_number 1 2024-04-06T01:47:00.378251625Z [2024-04-06T01:47:00.377+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33e0b415-c1a7-48ab-9a2e-c25b72908c9e 2024-04-06T01:47:00.378386150Z [2024-04-06T01:47:00.378+0000] {scheduler_job.py:635} INFO - Setting external_id for to 21fab0d9-29e6-4ab4-92ad-0290f6a50a73 2024-04-06T01:47:04.991440102Z [2024-04-06T01:47:04.991+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:47:04.991674915Z [2024-04-06T01:47:04.991+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:46:00+00:00, run_id=scheduled__2024-04-06T01:46:00+00:00, run_start_date=2024-04-06 01:47:00.125464+00:00, run_end_date=2024-04-06 01:47:04.991352+00:00, run_duration=4.865888, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:46:00+00:00, data_interval_end=2024-04-06 01:47:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T01:47:05.020403942Z [2024-04-06T01:47:05.020+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:47:00+00:00, run_after=2024-04-06T01:48:00+00:00 2024-04-06T01:47:05.028165610Z [2024-04-06T01:47:05.027+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:47:05.028236057Z [2024-04-06T01:47:05.027+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:46:00+00:00, run_id=scheduled__2024-04-06T01:46:00+00:00, run_start_date=2024-04-06 01:47:00.128845+00:00, run_end_date=2024-04-06 01:47:05.027877+00:00, run_duration=4.899032, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:46:00+00:00, data_interval_end=2024-04-06 01:47:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T01:47:05.038473409Z [2024-04-06T01:47:05.038+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:47:00+00:00, run_after=2024-04-06T01:48:00+00:00 2024-04-06T01:47:05.081065351Z [2024-04-06T01:47:05.080+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:46:00+00:00 exited with status success for try_number 1 2024-04-06T01:47:05.081225306Z [2024-04-06T01:47:05.080+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:46:00+00:00 exited with status success for try_number 1 2024-04-06T01:47:05.090668424Z [2024-04-06T01:47:05.090+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:46:00+00:00, map_index=-1, run_start_date=2024-04-06 01:47:02.342916+00:00, run_end_date=2024-04-06 01:47:03.908434+00:00, run_duration=1.565518, state=success, executor_state=success, try_number=1, max_tries=1, job_id=63, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:47:00.181336+00:00, queued_by_job_id=2, pid=1552 2024-04-06T01:47:05.090935042Z [2024-04-06T01:47:05.090+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:46:00+00:00, map_index=-1, run_start_date=2024-04-06 01:47:02.410504+00:00, run_end_date=2024-04-06 01:47:04.221457+00:00, run_duration=1.810953, state=success, executor_state=success, try_number=1, max_tries=1, job_id=64, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:47:00.181336+00:00, queued_by_job_id=2, pid=1553 2024-04-06T01:48:00.747380891Z [2024-04-06T01:48:00.739+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:48:00.763035782Z [2024-04-06T01:48:00.762+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:48:00+00:00, run_after=2024-04-06T01:49:00+00:00 2024-04-06T01:48:00.775989934Z [2024-04-06T01:48:00.775+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:48:00.884315133Z [2024-04-06T01:48:00.883+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T01:48:00.884341404Z 2024-04-06T01:48:00.884345765Z 2024-04-06T01:48:00.884349212Z 2024-04-06T01:48:00.884411546Z [2024-04-06T01:48:00.884+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T01:48:00.884610955Z [2024-04-06T01:48:00.884+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:48:00.884769150Z [2024-04-06T01:48:00.884+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:48:00.885484490Z [2024-04-06T01:48:00.885+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:48:00.885499121Z 2024-04-06T01:48:00.885505020Z 2024-04-06T01:48:00.885519490Z 2024-04-06T01:48:00.890102034Z [2024-04-06T01:48:00.889+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:48:00.890318334Z [2024-04-06T01:48:00.890+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:48:00.890757791Z [2024-04-06T01:48:00.890+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:48:00.890962102Z [2024-04-06T01:48:00.890+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:48:00.891314797Z [2024-04-06T01:48:00.891+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:48:00.891736480Z [2024-04-06T01:48:00.891+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:48:01.238655312Z [2024-04-06T01:48:01.238+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T01:46:00+00:00 exited with status queued for try_number 1 2024-04-06T01:48:01.238697281Z [2024-04-06T01:48:01.238+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:47:00+00:00 exited with status queued for try_number 1 2024-04-06T01:48:01.238730585Z [2024-04-06T01:48:01.238+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:47:00+00:00 exited with status queued for try_number 1 2024-04-06T01:48:01.252566362Z [2024-04-06T01:48:01.249+0000] {scheduler_job.py:635} INFO - Setting external_id for to ade278f8-813d-4d26-9bfe-6dd0d3c4ee6b 2024-04-06T01:48:01.253560666Z [2024-04-06T01:48:01.252+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71f4abcf-bacc-4e8a-9834-f74969ae8155 2024-04-06T01:48:01.253679178Z [2024-04-06T01:48:01.253+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6181681d-5f7a-4678-8a68-e16610d1135e 2024-04-06T01:48:03.769174752Z [2024-04-06T01:48:03.768+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:48:03.772462272Z [2024-04-06T01:48:03.771+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 01:46:00+00:00, run_id=scheduled__2024-04-06T01:46:00+00:00, run_start_date=2024-04-06 01:48:00.796724+00:00, run_end_date=2024-04-06 01:48:03.771786+00:00, run_duration=2.975062, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:46:00+00:00, data_interval_end=2024-04-06 01:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T01:48:03.788805057Z [2024-04-06T01:48:03.788+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T01:48:00+00:00, run_after=2024-04-06T01:50:00+00:00 2024-04-06T01:48:03.881889218Z [2024-04-06T01:48:03.881+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T01:46:00+00:00 exited with status success for try_number 1 2024-04-06T01:48:03.902587722Z [2024-04-06T01:48:03.902+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T01:46:00+00:00, map_index=-1, run_start_date=2024-04-06 01:48:02.117079+00:00, run_end_date=2024-04-06 01:48:02.776752+00:00, run_duration=0.659673, state=success, executor_state=success, try_number=1, max_tries=1, job_id=65, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:48:00.886503+00:00, queued_by_job_id=2, pid=1588 2024-04-06T01:48:06.290238649Z [2024-04-06T01:48:06.289+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:48:06.290417692Z [2024-04-06T01:48:06.289+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:47:00+00:00, run_id=scheduled__2024-04-06T01:47:00+00:00, run_start_date=2024-04-06 01:48:00.798617+00:00, run_end_date=2024-04-06 01:48:06.289530+00:00, run_duration=5.490913, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:47:00+00:00, data_interval_end=2024-04-06 01:48:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T01:48:06.297687048Z [2024-04-06T01:48:06.297+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:48:00+00:00, run_after=2024-04-06T01:49:00+00:00 2024-04-06T01:48:06.303096116Z [2024-04-06T01:48:06.302+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:48:06.303145873Z [2024-04-06T01:48:06.302+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:47:00+00:00, run_id=scheduled__2024-04-06T01:47:00+00:00, run_start_date=2024-04-06 01:48:00.800349+00:00, run_end_date=2024-04-06 01:48:06.302903+00:00, run_duration=5.502554, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:47:00+00:00, data_interval_end=2024-04-06 01:48:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T01:48:06.311925640Z [2024-04-06T01:48:06.311+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:48:00+00:00, run_after=2024-04-06T01:49:00+00:00 2024-04-06T01:48:06.352333480Z [2024-04-06T01:48:06.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:47:00+00:00 exited with status success for try_number 1 2024-04-06T01:48:06.352748742Z [2024-04-06T01:48:06.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:47:00+00:00 exited with status success for try_number 1 2024-04-06T01:48:06.364395262Z [2024-04-06T01:48:06.363+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:47:00+00:00, map_index=-1, run_start_date=2024-04-06 01:48:03.543680+00:00, run_end_date=2024-04-06 01:48:05.354768+00:00, run_duration=1.811088, state=success, executor_state=success, try_number=1, max_tries=1, job_id=66, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:48:00.886503+00:00, queued_by_job_id=2, pid=1609 2024-04-06T01:48:06.364949453Z [2024-04-06T01:48:06.364+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:47:00+00:00, map_index=-1, run_start_date=2024-04-06 01:48:03.874853+00:00, run_end_date=2024-04-06 01:48:05.769218+00:00, run_duration=1.894365, state=success, executor_state=success, try_number=1, max_tries=1, job_id=67, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:48:00.886503+00:00, queued_by_job_id=2, pid=1619 2024-04-06T01:49:00.131980344Z [2024-04-06T01:49:00.131+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:49:00.147037748Z [2024-04-06T01:49:00.146+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:49:00+00:00, run_after=2024-04-06T01:50:00+00:00 2024-04-06T01:49:00.211413415Z [2024-04-06T01:49:00.210+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T01:49:00.211516888Z 2024-04-06T01:49:00.211605204Z 2024-04-06T01:49:00.211682346Z [2024-04-06T01:49:00.211+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:49:00.211920780Z [2024-04-06T01:49:00.211+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:49:00.213515719Z [2024-04-06T01:49:00.212+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:49:00.213583975Z 2024-04-06T01:49:00.213593759Z 2024-04-06T01:49:00.219715398Z [2024-04-06T01:49:00.219+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:49:00.220017803Z [2024-04-06T01:49:00.219+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:49:00.220589374Z [2024-04-06T01:49:00.220+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:49:00.220930725Z [2024-04-06T01:49:00.220+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:49:00.394444734Z [2024-04-06T01:49:00.393+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:48:00+00:00 exited with status queued for try_number 1 2024-04-06T01:49:00.394784517Z [2024-04-06T01:49:00.394+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:48:00+00:00 exited with status queued for try_number 1 2024-04-06T01:49:00.404310056Z [2024-04-06T01:49:00.403+0000] {scheduler_job.py:635} INFO - Setting external_id for to 96ad2dde-1d0a-4f4b-ba00-30c02ec35507 2024-04-06T01:49:00.404811982Z [2024-04-06T01:49:00.404+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e94698e-4441-450f-bf67-85e81952a304 2024-04-06T01:49:05.707512367Z [2024-04-06T01:49:05.707+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:49:05.707902596Z [2024-04-06T01:49:05.707+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:48:00+00:00, run_id=scheduled__2024-04-06T01:48:00+00:00, run_start_date=2024-04-06 01:49:00.167661+00:00, run_end_date=2024-04-06 01:49:05.707504+00:00, run_duration=5.539843, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:48:00+00:00, data_interval_end=2024-04-06 01:49:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T01:49:05.719702005Z [2024-04-06T01:49:05.719+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:49:00+00:00, run_after=2024-04-06T01:50:00+00:00 2024-04-06T01:49:05.726127533Z [2024-04-06T01:49:05.725+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:49:05.726379776Z [2024-04-06T01:49:05.726+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:48:00+00:00, run_id=scheduled__2024-04-06T01:48:00+00:00, run_start_date=2024-04-06 01:49:00.165753+00:00, run_end_date=2024-04-06 01:49:05.726125+00:00, run_duration=5.560372, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:48:00+00:00, data_interval_end=2024-04-06 01:49:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T01:49:05.735750936Z [2024-04-06T01:49:05.735+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:49:00+00:00, run_after=2024-04-06T01:50:00+00:00 2024-04-06T01:49:05.761454653Z [2024-04-06T01:49:05.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:48:00+00:00 exited with status success for try_number 1 2024-04-06T01:49:05.761691179Z [2024-04-06T01:49:05.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:48:00+00:00 exited with status success for try_number 1 2024-04-06T01:49:05.766987637Z [2024-04-06T01:49:05.766+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:48:00+00:00, map_index=-1, run_start_date=2024-04-06 01:49:03.169406+00:00, run_end_date=2024-04-06 01:49:05.544404+00:00, run_duration=2.374998, state=success, executor_state=success, try_number=1, max_tries=1, job_id=69, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:49:00.215354+00:00, queued_by_job_id=2, pid=1674 2024-04-06T01:49:05.767369909Z [2024-04-06T01:49:05.767+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:48:00+00:00, map_index=-1, run_start_date=2024-04-06 01:49:02.739417+00:00, run_end_date=2024-04-06 01:49:04.873212+00:00, run_duration=2.133795, state=success, executor_state=success, try_number=1, max_tries=1, job_id=68, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:49:00.215354+00:00, queued_by_job_id=2, pid=1673 2024-04-06T01:50:00.592649278Z [2024-04-06T01:50:00.591+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:50:00.601566387Z [2024-04-06T01:50:00.601+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:50:00.620344362Z [2024-04-06T01:50:00.618+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:50:00+00:00, run_after=2024-04-06T01:55:00+00:00 2024-04-06T01:50:00.635425244Z [2024-04-06T01:50:00.635+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:50:00+00:00, run_after=2024-04-06T01:51:00+00:00 2024-04-06T01:50:00.722107534Z [2024-04-06T01:50:00.719+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-06T01:50:00.722188609Z 2024-04-06T01:50:00.722205124Z 2024-04-06T01:50:00.722224208Z 2024-04-06T01:50:00.722239219Z 2024-04-06T01:50:00.722254142Z [2024-04-06T01:50:00.719+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:50:00.722267889Z [2024-04-06T01:50:00.719+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T01:50:00.722280624Z [2024-04-06T01:50:00.719+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:50:00.722296526Z [2024-04-06T01:50:00.719+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:50:00.722310070Z [2024-04-06T01:50:00.720+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:50:00.722331605Z 2024-04-06T01:50:00.722351188Z 2024-04-06T01:50:00.722366003Z 2024-04-06T01:50:00.722382032Z 2024-04-06T01:50:00.723610038Z [2024-04-06T01:50:00.723+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-06T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-06T01:50:00.723658957Z [2024-04-06T01:50:00.723+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:50:00.723910373Z [2024-04-06T01:50:00.723+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:50:00.723985957Z [2024-04-06T01:50:00.723+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:50:00.724179590Z [2024-04-06T01:50:00.723+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:50:00.724193122Z [2024-04-06T01:50:00.723+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:50:00.724372913Z [2024-04-06T01:50:00.724+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:50:00.724651996Z [2024-04-06T01:50:00.724+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:50:01.105512695Z [2024-04-06T01:50:01.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T01:45:00+00:00 exited with status queued for try_number 1 2024-04-06T01:50:01.109785134Z [2024-04-06T01:50:01.105+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T01:48:00+00:00 exited with status queued for try_number 1 2024-04-06T01:50:01.109877045Z [2024-04-06T01:50:01.109+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:49:00+00:00 exited with status queued for try_number 1 2024-04-06T01:50:01.109962408Z [2024-04-06T01:50:01.109+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:49:00+00:00 exited with status queued for try_number 1 2024-04-06T01:50:01.119387110Z [2024-04-06T01:50:01.119+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb72f4b7-5415-4bf4-9e88-cdd79766ef01 2024-04-06T01:50:01.119640327Z [2024-04-06T01:50:01.119+0000] {scheduler_job.py:635} INFO - Setting external_id for to cf82a052-15ff-4169-bacf-e4bc204ae287 2024-04-06T01:50:01.119759686Z [2024-04-06T01:50:01.119+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6f5aea7-202c-4d2f-bdbe-adc6d7850b2b 2024-04-06T01:50:01.119864618Z [2024-04-06T01:50:01.119+0000] {scheduler_job.py:635} INFO - Setting external_id for to cf3895f6-5e86-4558-9f44-8b36d2b841bb 2024-04-06T01:50:03.345802719Z [2024-04-06T01:50:03.345+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:50:03.346385906Z [2024-04-06T01:50:03.346+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 01:48:00+00:00, run_id=scheduled__2024-04-06T01:48:00+00:00, run_start_date=2024-04-06 01:50:00.657012+00:00, run_end_date=2024-04-06 01:50:03.345721+00:00, run_duration=2.688709, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:48:00+00:00, data_interval_end=2024-04-06 01:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T01:50:03.355117922Z [2024-04-06T01:50:03.354+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T01:50:00+00:00, run_after=2024-04-06T01:52:00+00:00 2024-04-06T01:50:03.446837666Z [2024-04-06T01:50:03.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T01:48:00+00:00 exited with status success for try_number 1 2024-04-06T01:50:03.454875052Z [2024-04-06T01:50:03.454+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T01:48:00+00:00, map_index=-1, run_start_date=2024-04-06 01:50:01.989314+00:00, run_end_date=2024-04-06 01:50:02.909967+00:00, run_duration=0.920653, state=success, executor_state=success, try_number=1, max_tries=1, job_id=70, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:50:00.721438+00:00, queued_by_job_id=2, pid=1709 2024-04-06T01:50:06.958448943Z [2024-04-06T01:50:06.957+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:50:06.959984026Z [2024-04-06T01:50:06.958+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:49:00+00:00, run_id=scheduled__2024-04-06T01:49:00+00:00, run_start_date=2024-04-06 01:50:00.659412+00:00, run_end_date=2024-04-06 01:50:06.958330+00:00, run_duration=6.298918, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:49:00+00:00, data_interval_end=2024-04-06 01:50:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T01:50:06.975004641Z [2024-04-06T01:50:06.974+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:50:00+00:00, run_after=2024-04-06T01:51:00+00:00 2024-04-06T01:50:07.023767635Z [2024-04-06T01:50:07.023+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T01:50:07.023812081Z 2024-04-06T01:50:07.025852786Z [2024-04-06T01:50:07.023+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:50:07.027887262Z [2024-04-06T01:50:07.027+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:50:07.027906699Z 2024-04-06T01:50:07.033033130Z [2024-04-06T01:50:07.032+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='split_metrics', run_id='scheduled__2024-04-06T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-06T01:50:07.033258382Z [2024-04-06T01:50:07.032+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:50:07.088085464Z [2024-04-06T01:50:07.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T01:45:00+00:00 exited with status queued for try_number 1 2024-04-06T01:50:07.088314025Z [2024-04-06T01:50:07.088+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T01:45:00+00:00 exited with status success for try_number 1 2024-04-06T01:50:07.088444090Z [2024-04-06T01:50:07.088+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:49:00+00:00 exited with status success for try_number 1 2024-04-06T01:50:07.096922616Z [2024-04-06T01:50:07.096+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:49:00+00:00, map_index=-1, run_start_date=2024-04-06 01:50:04.157067+00:00, run_end_date=2024-04-06 01:50:05.699578+00:00, run_duration=1.542511, state=success, executor_state=success, try_number=1, max_tries=1, job_id=71, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:50:00.721438+00:00, queued_by_job_id=2, pid=1731 2024-04-06T01:50:07.097070077Z [2024-04-06T01:50:07.096+0000] {scheduler_job.py:635} INFO - Setting external_id for to cc899ed7-773d-497f-99e5-6116258b8bac 2024-04-06T01:50:07.097219119Z [2024-04-06T01:50:07.097+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-06T01:45:00+00:00, map_index=-1, run_start_date=2024-04-06 01:50:05.540631+00:00, run_end_date=2024-04-06 01:50:05.959674+00:00, run_duration=0.419043, state=success, executor_state=success, try_number=1, max_tries=1, job_id=73, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:50:00.721438+00:00, queued_by_job_id=2, pid=1760 2024-04-06T01:50:08.300308915Z [2024-04-06T01:50:08.299+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:50:08.300783682Z [2024-04-06T01:50:08.300+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:49:00+00:00, run_id=scheduled__2024-04-06T01:49:00+00:00, run_start_date=2024-04-06 01:50:00.658260+00:00, run_end_date=2024-04-06 01:50:08.300230+00:00, run_duration=7.64197, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:49:00+00:00, data_interval_end=2024-04-06 01:50:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T01:50:08.310222430Z [2024-04-06T01:50:08.309+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:50:00+00:00, run_after=2024-04-06T01:51:00+00:00 2024-04-06T01:50:08.418616712Z [2024-04-06T01:50:08.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:49:00+00:00 exited with status success for try_number 1 2024-04-06T01:50:08.434717904Z [2024-04-06T01:50:08.434+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:49:00+00:00, map_index=-1, run_start_date=2024-04-06 01:50:05.094370+00:00, run_end_date=2024-04-06 01:50:07.248674+00:00, run_duration=2.154304, state=success, executor_state=success, try_number=1, max_tries=1, job_id=72, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:50:00.721438+00:00, queued_by_job_id=2, pid=1750 2024-04-06T01:50:09.618695511Z [2024-04-06T01:50:09.617+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T01:50:09.618731255Z 2024-04-06T01:50:09.618734688Z [2024-04-06T01:50:09.618+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:50:09.619934678Z [2024-04-06T01:50:09.619+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:50:09.619951907Z 2024-04-06T01:50:09.624227870Z [2024-04-06T01:50:09.623+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='collect_metrics', run_id='scheduled__2024-04-06T01:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-06T01:50:09.624653304Z [2024-04-06T01:50:09.624+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T01:50:09.696900493Z [2024-04-06T01:50:09.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T01:45:00+00:00 exited with status queued for try_number 1 2024-04-06T01:50:09.697112325Z [2024-04-06T01:50:09.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T01:45:00+00:00 exited with status success for try_number 1 2024-04-06T01:50:09.708597305Z [2024-04-06T01:50:09.708+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=split_metrics, run_id=scheduled__2024-04-06T01:45:00+00:00, map_index=-1, run_start_date=2024-04-06 01:50:08.758378+00:00, run_end_date=2024-04-06 01:50:09.172107+00:00, run_duration=0.413729, state=success, executor_state=success, try_number=1, max_tries=1, job_id=74, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:50:07.028738+00:00, queued_by_job_id=2, pid=1788 2024-04-06T01:50:09.708676687Z [2024-04-06T01:50:09.708+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77acd554-ecc1-478f-bccc-fcff26ef3cf2 2024-04-06T01:50:11.789525684Z [2024-04-06T01:50:11.789+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T01:50:11.789566027Z 2024-04-06T01:50:11.789802152Z [2024-04-06T01:50:11.789+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:50:11.790458798Z [2024-04-06T01:50:11.790+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:50:11.790470375Z 2024-04-06T01:50:11.792824771Z [2024-04-06T01:50:11.792+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='send_prometheus', run_id='scheduled__2024-04-06T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:50:11.793036530Z [2024-04-06T01:50:11.792+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:50:11.854985143Z [2024-04-06T01:50:11.854+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T01:45:00+00:00 exited with status queued for try_number 1 2024-04-06T01:50:11.859838296Z [2024-04-06T01:50:11.859+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6984d141-ab3a-4280-974e-327f5a143dc3 2024-04-06T01:50:11.946979930Z [2024-04-06T01:50:11.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T01:45:00+00:00 exited with status success for try_number 1 2024-04-06T01:50:11.958924819Z [2024-04-06T01:50:11.958+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=collect_metrics, run_id=scheduled__2024-04-06T01:45:00+00:00, map_index=0, run_start_date=2024-04-06 01:50:11.283252+00:00, run_end_date=2024-04-06 01:50:11.644099+00:00, run_duration=0.360847, state=success, executor_state=success, try_number=1, max_tries=1, job_id=75, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:50:09.620677+00:00, queued_by_job_id=2, pid=1813 2024-04-06T01:50:14.771710125Z [2024-04-06T01:50:14.766+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:50:14.772490549Z [2024-04-06T01:50:14.771+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:45:00+00:00, run_id=scheduled__2024-04-06T01:45:00+00:00, run_start_date=2024-04-06 01:50:00.655567+00:00, run_end_date=2024-04-06 01:50:14.771713+00:00, run_duration=14.116146, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:45:00+00:00, data_interval_end=2024-04-06 01:50:00+00:00, dag_hash=eecc559ff32fe9a7c4345875f113a0a9 2024-04-06T01:50:14.782549498Z [2024-04-06T01:50:14.782+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:50:00+00:00, run_after=2024-04-06T01:55:00+00:00 2024-04-06T01:50:14.834287359Z [2024-04-06T01:50:14.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T01:45:00+00:00 exited with status success for try_number 1 2024-04-06T01:50:14.842049677Z [2024-04-06T01:50:14.841+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=send_prometheus, run_id=scheduled__2024-04-06T01:45:00+00:00, map_index=-1, run_start_date=2024-04-06 01:50:13.701578+00:00, run_end_date=2024-04-06 01:50:14.085502+00:00, run_duration=0.383924, state=success, executor_state=success, try_number=1, max_tries=1, job_id=76, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:50:11.790950+00:00, queued_by_job_id=2, pid=1825 2024-04-06T01:50:19.324419108Z [2024-04-06T01:50:19.323+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-06T01:51:01.105011227Z [2024-04-06T01:51:01.104+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:51:01.123683901Z [2024-04-06T01:51:01.123+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:51:00+00:00, run_after=2024-04-06T01:52:00+00:00 2024-04-06T01:51:01.199086206Z [2024-04-06T01:51:01.198+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T01:51:01.199115434Z 2024-04-06T01:51:01.199120402Z 2024-04-06T01:51:01.199198609Z [2024-04-06T01:51:01.198+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:51:01.199204712Z [2024-04-06T01:51:01.199+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:51:01.199662681Z [2024-04-06T01:51:01.199+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:51:01.199670638Z 2024-04-06T01:51:01.199675316Z 2024-04-06T01:51:01.203632289Z [2024-04-06T01:51:01.203+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:51:01.203724472Z [2024-04-06T01:51:01.203+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:51:01.203931889Z [2024-04-06T01:51:01.203+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:51:01.204048375Z [2024-04-06T01:51:01.203+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:51:01.419073614Z [2024-04-06T01:51:01.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:50:00+00:00 exited with status queued for try_number 1 2024-04-06T01:51:01.419386419Z [2024-04-06T01:51:01.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:50:00+00:00 exited with status queued for try_number 1 2024-04-06T01:51:01.428192257Z [2024-04-06T01:51:01.427+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e5866d1-dfc9-4277-938d-17d8361e9f91 2024-04-06T01:51:01.428803991Z [2024-04-06T01:51:01.428+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8b8f87f-a593-4a91-ab7a-9f3fbc6cc7ee 2024-04-06T01:51:05.654101305Z [2024-04-06T01:51:05.653+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:51:05.654684568Z [2024-04-06T01:51:05.654+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:50:00+00:00, run_id=scheduled__2024-04-06T01:50:00+00:00, run_start_date=2024-04-06 01:51:01.142691+00:00, run_end_date=2024-04-06 01:51:05.653976+00:00, run_duration=4.511285, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:50:00+00:00, data_interval_end=2024-04-06 01:51:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T01:51:05.664051206Z [2024-04-06T01:51:05.663+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:51:00+00:00, run_after=2024-04-06T01:52:00+00:00 2024-04-06T01:51:05.687800293Z [2024-04-06T01:51:05.687+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:51:05.690332342Z [2024-04-06T01:51:05.689+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:50:00+00:00, run_id=scheduled__2024-04-06T01:50:00+00:00, run_start_date=2024-04-06 01:51:01.144078+00:00, run_end_date=2024-04-06 01:51:05.687644+00:00, run_duration=4.543566, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:50:00+00:00, data_interval_end=2024-04-06 01:51:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T01:51:05.701356973Z [2024-04-06T01:51:05.701+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:51:00+00:00, run_after=2024-04-06T01:52:00+00:00 2024-04-06T01:51:05.738625276Z [2024-04-06T01:51:05.738+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:50:00+00:00 exited with status success for try_number 1 2024-04-06T01:51:05.738874103Z [2024-04-06T01:51:05.738+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:50:00+00:00 exited with status success for try_number 1 2024-04-06T01:51:05.747002151Z [2024-04-06T01:51:05.746+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:50:00+00:00, map_index=-1, run_start_date=2024-04-06 01:51:03.247664+00:00, run_end_date=2024-04-06 01:51:04.516858+00:00, run_duration=1.269194, state=success, executor_state=success, try_number=1, max_tries=1, job_id=78, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:51:01.200131+00:00, queued_by_job_id=2, pid=1847 2024-04-06T01:51:05.747405593Z [2024-04-06T01:51:05.747+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:50:00+00:00, map_index=-1, run_start_date=2024-04-06 01:51:03.268421+00:00, run_end_date=2024-04-06 01:51:05.104225+00:00, run_duration=1.835804, state=success, executor_state=success, try_number=1, max_tries=1, job_id=77, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:51:01.200131+00:00, queued_by_job_id=2, pid=1848 2024-04-06T01:52:00.395065089Z [2024-04-06T01:52:00.394+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:52:00.412611226Z [2024-04-06T01:52:00.412+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:52:00+00:00, run_after=2024-04-06T01:53:00+00:00 2024-04-06T01:52:00.419275839Z [2024-04-06T01:52:00.418+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:52:00.497384522Z [2024-04-06T01:52:00.496+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T01:52:00.497429304Z 2024-04-06T01:52:00.497478257Z 2024-04-06T01:52:00.497497490Z 2024-04-06T01:52:00.498134068Z [2024-04-06T01:52:00.497+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T01:52:00.498499970Z [2024-04-06T01:52:00.498+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:52:00.498919951Z [2024-04-06T01:52:00.498+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:52:00.500048521Z [2024-04-06T01:52:00.499+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:52:00.500066266Z 2024-04-06T01:52:00.500128094Z 2024-04-06T01:52:00.500134131Z 2024-04-06T01:52:00.505252634Z [2024-04-06T01:52:00.504+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:52:00.506459102Z [2024-04-06T01:52:00.505+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:52:00.507061051Z [2024-04-06T01:52:00.506+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:52:00.507578465Z [2024-04-06T01:52:00.507+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:52:00.508398090Z [2024-04-06T01:52:00.507+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:52:00.508921190Z [2024-04-06T01:52:00.508+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:52:00.885463987Z [2024-04-06T01:52:00.884+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T01:50:00+00:00 exited with status queued for try_number 1 2024-04-06T01:52:00.885505033Z [2024-04-06T01:52:00.885+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:51:00+00:00 exited with status queued for try_number 1 2024-04-06T01:52:00.885711205Z [2024-04-06T01:52:00.885+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:51:00+00:00 exited with status queued for try_number 1 2024-04-06T01:52:00.912990129Z [2024-04-06T01:52:00.912+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc795500-e996-40f7-98b6-cdc8ad961cb1 2024-04-06T01:52:00.913603209Z [2024-04-06T01:52:00.913+0000] {scheduler_job.py:635} INFO - Setting external_id for to e06b8897-f2f8-4b9c-b9c8-cf2d299dac48 2024-04-06T01:52:00.914603630Z [2024-04-06T01:52:00.914+0000] {scheduler_job.py:635} INFO - Setting external_id for to 85de58c3-d8c8-4856-bc59-820f8870be99 2024-04-06T01:52:02.166379849Z [2024-04-06T01:52:02.165+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:52:02.166740342Z [2024-04-06T01:52:02.166+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 01:50:00+00:00, run_id=scheduled__2024-04-06T01:50:00+00:00, run_start_date=2024-04-06 01:52:00.433237+00:00, run_end_date=2024-04-06 01:52:02.166331+00:00, run_duration=1.733094, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:50:00+00:00, data_interval_end=2024-04-06 01:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T01:52:02.191431783Z [2024-04-06T01:52:02.190+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T01:52:00+00:00, run_after=2024-04-06T01:54:00+00:00 2024-04-06T01:52:02.347984102Z [2024-04-06T01:52:02.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T01:50:00+00:00 exited with status success for try_number 1 2024-04-06T01:52:02.359595995Z [2024-04-06T01:52:02.359+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T01:50:00+00:00, map_index=-1, run_start_date=2024-04-06 01:52:01.283701+00:00, run_end_date=2024-04-06 01:52:01.780523+00:00, run_duration=0.496822, state=success, executor_state=success, try_number=1, max_tries=1, job_id=79, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:52:00.501503+00:00, queued_by_job_id=2, pid=1883 2024-04-06T01:52:05.651981646Z [2024-04-06T01:52:05.651+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:52:05.652203098Z [2024-04-06T01:52:05.651+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:51:00+00:00, run_id=scheduled__2024-04-06T01:51:00+00:00, run_start_date=2024-04-06 01:52:00.438244+00:00, run_end_date=2024-04-06 01:52:05.651897+00:00, run_duration=5.213653, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:51:00+00:00, data_interval_end=2024-04-06 01:52:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T01:52:05.666313913Z [2024-04-06T01:52:05.666+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:52:00+00:00, run_after=2024-04-06T01:53:00+00:00 2024-04-06T01:52:05.672625810Z [2024-04-06T01:52:05.672+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:52:05.672776255Z [2024-04-06T01:52:05.672+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:51:00+00:00, run_id=scheduled__2024-04-06T01:51:00+00:00, run_start_date=2024-04-06 01:52:00.436225+00:00, run_end_date=2024-04-06 01:52:05.672554+00:00, run_duration=5.236329, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:51:00+00:00, data_interval_end=2024-04-06 01:52:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T01:52:05.682194206Z [2024-04-06T01:52:05.681+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:52:00+00:00, run_after=2024-04-06T01:53:00+00:00 2024-04-06T01:52:05.720232573Z [2024-04-06T01:52:05.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:51:00+00:00 exited with status success for try_number 1 2024-04-06T01:52:05.729768905Z [2024-04-06T01:52:05.729+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:51:00+00:00, map_index=-1, run_start_date=2024-04-06 01:52:03.201391+00:00, run_end_date=2024-04-06 01:52:04.637318+00:00, run_duration=1.435927, state=success, executor_state=success, try_number=1, max_tries=1, job_id=80, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:52:00.501503+00:00, queued_by_job_id=2, pid=1913 2024-04-06T01:52:06.050678028Z [2024-04-06T01:52:06.049+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:51:00+00:00 exited with status success for try_number 1 2024-04-06T01:52:06.060297573Z [2024-04-06T01:52:06.059+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:51:00+00:00, map_index=-1, run_start_date=2024-04-06 01:52:03.376981+00:00, run_end_date=2024-04-06 01:52:05.571132+00:00, run_duration=2.194151, state=success, executor_state=success, try_number=1, max_tries=1, job_id=81, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:52:00.501503+00:00, queued_by_job_id=2, pid=1914 2024-04-06T01:53:00.737863000Z [2024-04-06T01:53:00.736+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:53:00.751220843Z [2024-04-06T01:53:00.750+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:53:00+00:00, run_after=2024-04-06T01:54:00+00:00 2024-04-06T01:53:00.811940322Z [2024-04-06T01:53:00.811+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T01:53:00.811970988Z 2024-04-06T01:53:00.811976216Z 2024-04-06T01:53:00.812006160Z [2024-04-06T01:53:00.811+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:53:00.812102941Z [2024-04-06T01:53:00.811+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:53:00.812597259Z [2024-04-06T01:53:00.812+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:53:00.812626213Z 2024-04-06T01:53:00.812632589Z 2024-04-06T01:53:00.815942378Z [2024-04-06T01:53:00.815+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:53:00.815962978Z [2024-04-06T01:53:00.815+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:53:00.815968607Z [2024-04-06T01:53:00.815+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:53:00.815973878Z [2024-04-06T01:53:00.815+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:53:01.197255268Z [2024-04-06T01:53:01.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:52:00+00:00 exited with status queued for try_number 1 2024-04-06T01:53:01.197294856Z [2024-04-06T01:53:01.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:52:00+00:00 exited with status queued for try_number 1 2024-04-06T01:53:01.218401171Z [2024-04-06T01:53:01.218+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad1932f6-d4af-4a10-9589-38ef7ca03198 2024-04-06T01:53:01.218473636Z [2024-04-06T01:53:01.218+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc20f2d1-4329-4205-a78c-295f01eeeb0e 2024-04-06T01:53:05.353777971Z [2024-04-06T01:53:05.353+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:53:05.354140715Z [2024-04-06T01:53:05.353+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:52:00+00:00, run_id=scheduled__2024-04-06T01:52:00+00:00, run_start_date=2024-04-06 01:53:00.768258+00:00, run_end_date=2024-04-06 01:53:05.353706+00:00, run_duration=4.585448, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:52:00+00:00, data_interval_end=2024-04-06 01:53:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T01:53:05.371048992Z [2024-04-06T01:53:05.370+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:53:00+00:00, run_after=2024-04-06T01:54:00+00:00 2024-04-06T01:53:05.412440998Z [2024-04-06T01:53:05.412+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:52:00+00:00 exited with status success for try_number 1 2024-04-06T01:53:05.421490350Z [2024-04-06T01:53:05.421+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:52:00+00:00, map_index=-1, run_start_date=2024-04-06 01:53:03.442720+00:00, run_end_date=2024-04-06 01:53:05.125899+00:00, run_duration=1.683179, state=success, executor_state=success, try_number=1, max_tries=1, job_id=82, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:53:00.813154+00:00, queued_by_job_id=2, pid=1969 2024-04-06T01:53:06.486928569Z [2024-04-06T01:53:06.486+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:53:06.487328153Z [2024-04-06T01:53:06.486+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:52:00+00:00, run_id=scheduled__2024-04-06T01:52:00+00:00, run_start_date=2024-04-06 01:53:00.766623+00:00, run_end_date=2024-04-06 01:53:06.486674+00:00, run_duration=5.720051, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:52:00+00:00, data_interval_end=2024-04-06 01:53:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T01:53:06.499112690Z [2024-04-06T01:53:06.498+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:53:00+00:00, run_after=2024-04-06T01:54:00+00:00 2024-04-06T01:53:06.537089229Z [2024-04-06T01:53:06.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:52:00+00:00 exited with status success for try_number 1 2024-04-06T01:53:06.545726948Z [2024-04-06T01:53:06.545+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:52:00+00:00, map_index=-1, run_start_date=2024-04-06 01:53:03.461647+00:00, run_end_date=2024-04-06 01:53:05.602036+00:00, run_duration=2.140389, state=success, executor_state=success, try_number=1, max_tries=1, job_id=83, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:53:00.813154+00:00, queued_by_job_id=2, pid=1970 2024-04-06T01:54:00.102163492Z [2024-04-06T01:54:00.101+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:54:00.122796008Z [2024-04-06T01:54:00.122+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:54:00+00:00, run_after=2024-04-06T01:55:00+00:00 2024-04-06T01:54:00.132380650Z [2024-04-06T01:54:00.132+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:54:00.212422471Z [2024-04-06T01:54:00.211+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T01:54:00.212465852Z 2024-04-06T01:54:00.212476791Z 2024-04-06T01:54:00.212485731Z 2024-04-06T01:54:00.212624802Z [2024-04-06T01:54:00.212+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T01:54:00.212842792Z [2024-04-06T01:54:00.212+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:54:00.213092440Z [2024-04-06T01:54:00.212+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:54:00.213945599Z [2024-04-06T01:54:00.213+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:54:00.213968561Z 2024-04-06T01:54:00.213977959Z 2024-04-06T01:54:00.213986660Z 2024-04-06T01:54:00.220105828Z [2024-04-06T01:54:00.219+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:54:00.220693251Z [2024-04-06T01:54:00.220+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:54:00.221634359Z [2024-04-06T01:54:00.221+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:54:00.222294091Z [2024-04-06T01:54:00.221+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:54:00.223185115Z [2024-04-06T01:54:00.222+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:54:00.223679071Z [2024-04-06T01:54:00.223+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:54:00.457854798Z [2024-04-06T01:54:00.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T01:52:00+00:00 exited with status queued for try_number 1 2024-04-06T01:54:00.459893192Z [2024-04-06T01:54:00.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:53:00+00:00 exited with status queued for try_number 1 2024-04-06T01:54:00.460114319Z [2024-04-06T01:54:00.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:53:00+00:00 exited with status queued for try_number 1 2024-04-06T01:54:00.467008420Z [2024-04-06T01:54:00.466+0000] {scheduler_job.py:635} INFO - Setting external_id for to e89e5849-fd31-4a4c-b875-fc3fb12c22d8 2024-04-06T01:54:00.467202701Z [2024-04-06T01:54:00.467+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20805d6a-ab08-46e8-95b7-338800f414cd 2024-04-06T01:54:00.467396264Z [2024-04-06T01:54:00.467+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca124b73-12e9-45aa-b691-2ffd0c605640 2024-04-06T01:54:01.634733960Z [2024-04-06T01:54:01.633+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:54:01.635040438Z [2024-04-06T01:54:01.634+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 01:52:00+00:00, run_id=scheduled__2024-04-06T01:52:00+00:00, run_start_date=2024-04-06 01:54:00.145072+00:00, run_end_date=2024-04-06 01:54:01.634664+00:00, run_duration=1.489592, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:52:00+00:00, data_interval_end=2024-04-06 01:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T01:54:01.650018182Z [2024-04-06T01:54:01.649+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T01:54:00+00:00, run_after=2024-04-06T01:56:00+00:00 2024-04-06T01:54:01.916873404Z [2024-04-06T01:54:01.916+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T01:52:00+00:00 exited with status success for try_number 1 2024-04-06T01:54:01.922087030Z [2024-04-06T01:54:01.921+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T01:52:00+00:00, map_index=-1, run_start_date=2024-04-06 01:54:01.121998+00:00, run_end_date=2024-04-06 01:54:01.582043+00:00, run_duration=0.460045, state=success, executor_state=success, try_number=1, max_tries=1, job_id=84, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:54:00.214847+00:00, queued_by_job_id=2, pid=2005 2024-04-06T01:54:05.270990011Z [2024-04-06T01:54:05.270+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:54:05.272748513Z [2024-04-06T01:54:05.272+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:53:00+00:00, run_id=scheduled__2024-04-06T01:53:00+00:00, run_start_date=2024-04-06 01:54:00.146652+00:00, run_end_date=2024-04-06 01:54:05.272354+00:00, run_duration=5.125702, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:53:00+00:00, data_interval_end=2024-04-06 01:54:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T01:54:05.296383554Z [2024-04-06T01:54:05.296+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:54:00+00:00, run_after=2024-04-06T01:55:00+00:00 2024-04-06T01:54:05.382078880Z [2024-04-06T01:54:05.381+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:53:00+00:00 exited with status success for try_number 1 2024-04-06T01:54:05.387873496Z [2024-04-06T01:54:05.387+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:53:00+00:00, map_index=-1, run_start_date=2024-04-06 01:54:02.931437+00:00, run_end_date=2024-04-06 01:54:04.905974+00:00, run_duration=1.974537, state=success, executor_state=success, try_number=1, max_tries=1, job_id=85, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:54:00.214847+00:00, queued_by_job_id=2, pid=2026 2024-04-06T01:54:06.464616161Z [2024-04-06T01:54:06.464+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:54:06.464783431Z [2024-04-06T01:54:06.464+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:53:00+00:00, run_id=scheduled__2024-04-06T01:53:00+00:00, run_start_date=2024-04-06 01:54:00.147848+00:00, run_end_date=2024-04-06 01:54:06.464438+00:00, run_duration=6.31659, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:53:00+00:00, data_interval_end=2024-04-06 01:54:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T01:54:06.473941912Z [2024-04-06T01:54:06.473+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:54:00+00:00, run_after=2024-04-06T01:55:00+00:00 2024-04-06T01:54:06.501349000Z [2024-04-06T01:54:06.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:53:00+00:00 exited with status success for try_number 1 2024-04-06T01:54:06.507864050Z [2024-04-06T01:54:06.507+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:53:00+00:00, map_index=-1, run_start_date=2024-04-06 01:54:03.527117+00:00, run_end_date=2024-04-06 01:54:05.213600+00:00, run_duration=1.686483, state=success, executor_state=success, try_number=1, max_tries=1, job_id=86, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:54:00.214847+00:00, queued_by_job_id=2, pid=2045 2024-04-06T01:55:00.960436486Z [2024-04-06T01:55:00.959+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:55:00.975498839Z [2024-04-06T01:55:00.975+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:55:00+00:00, run_after=2024-04-06T02:00:00+00:00 2024-04-06T01:55:00.992978405Z [2024-04-06T01:55:00.992+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:55:00+00:00, run_after=2024-04-06T01:56:00+00:00 2024-04-06T01:55:01.108264714Z [2024-04-06T01:55:01.107+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T01:55:01.108321302Z 2024-04-06T01:55:01.108336670Z 2024-04-06T01:55:01.108346020Z 2024-04-06T01:55:01.108370932Z [2024-04-06T01:55:01.108+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:55:01.108607213Z [2024-04-06T01:55:01.108+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:55:01.108793501Z [2024-04-06T01:55:01.108+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:55:01.109566315Z [2024-04-06T01:55:01.109+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:55:01.109581815Z 2024-04-06T01:55:01.109590783Z 2024-04-06T01:55:01.109599135Z 2024-04-06T01:55:01.114307767Z [2024-04-06T01:55:01.114+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-06T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-06T01:55:01.114352263Z [2024-04-06T01:55:01.114+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:55:01.114834434Z [2024-04-06T01:55:01.114+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:55:01.115014659Z [2024-04-06T01:55:01.114+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:55:01.115379541Z [2024-04-06T01:55:01.115+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:55:01.115695073Z [2024-04-06T01:55:01.115+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:55:01.415638089Z [2024-04-06T01:55:01.415+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T01:50:00+00:00 exited with status queued for try_number 1 2024-04-06T01:55:01.416302237Z [2024-04-06T01:55:01.416+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:54:00+00:00 exited with status queued for try_number 1 2024-04-06T01:55:01.418154767Z [2024-04-06T01:55:01.417+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:54:00+00:00 exited with status queued for try_number 1 2024-04-06T01:55:01.427717819Z [2024-04-06T01:55:01.427+0000] {scheduler_job.py:635} INFO - Setting external_id for to c262c7ce-bfa6-4f02-af66-91639f5b53d4 2024-04-06T01:55:01.427893571Z [2024-04-06T01:55:01.427+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97008b10-eaa7-4c29-9912-bfc4cff6e92e 2024-04-06T01:55:01.428190937Z [2024-04-06T01:55:01.427+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35c2946e-1e82-41b5-bb0a-2d19faba45a1 2024-04-06T01:55:05.216804310Z [2024-04-06T01:55:05.216+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T01:55:05.216822171Z 2024-04-06T01:55:05.217111889Z [2024-04-06T01:55:05.216+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:55:05.217733485Z [2024-04-06T01:55:05.217+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:55:05.217742429Z 2024-04-06T01:55:05.220386073Z [2024-04-06T01:55:05.220+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='split_metrics', run_id='scheduled__2024-04-06T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-06T01:55:05.220566931Z [2024-04-06T01:55:05.220+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:55:05.292478688Z [2024-04-06T01:55:05.292+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T01:50:00+00:00 exited with status queued for try_number 1 2024-04-06T01:55:05.292548529Z [2024-04-06T01:55:05.292+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T01:50:00+00:00 exited with status success for try_number 1 2024-04-06T01:55:05.297023327Z [2024-04-06T01:55:05.296+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-06T01:50:00+00:00, map_index=-1, run_start_date=2024-04-06 01:55:03.660523+00:00, run_end_date=2024-04-06 01:55:04.213642+00:00, run_duration=0.553119, state=success, executor_state=success, try_number=1, max_tries=1, job_id=87, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:55:01.110659+00:00, queued_by_job_id=2, pid=2092 2024-04-06T01:55:05.297164646Z [2024-04-06T01:55:05.297+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8f376083-8b24-45ad-92d5-ee21cd115626 2024-04-06T01:55:06.430808062Z [2024-04-06T01:55:06.430+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:55:06.431352162Z [2024-04-06T01:55:06.431+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:54:00+00:00, run_id=scheduled__2024-04-06T01:54:00+00:00, run_start_date=2024-04-06 01:55:01.013594+00:00, run_end_date=2024-04-06 01:55:06.430745+00:00, run_duration=5.417151, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:54:00+00:00, data_interval_end=2024-04-06 01:55:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T01:55:06.461143723Z [2024-04-06T01:55:06.460+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:55:00+00:00, run_after=2024-04-06T01:56:00+00:00 2024-04-06T01:55:06.524721505Z [2024-04-06T01:55:06.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:54:00+00:00 exited with status success for try_number 1 2024-04-06T01:55:06.529288497Z [2024-04-06T01:55:06.528+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:54:00+00:00, map_index=-1, run_start_date=2024-04-06 01:55:03.976386+00:00, run_end_date=2024-04-06 01:55:05.463083+00:00, run_duration=1.486697, state=success, executor_state=success, try_number=1, max_tries=1, job_id=88, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:55:01.110659+00:00, queued_by_job_id=2, pid=2093 2024-04-06T01:55:07.595112979Z [2024-04-06T01:55:07.594+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:55:07.595474724Z [2024-04-06T01:55:07.595+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:54:00+00:00, run_id=scheduled__2024-04-06T01:54:00+00:00, run_start_date=2024-04-06 01:55:01.012124+00:00, run_end_date=2024-04-06 01:55:07.595009+00:00, run_duration=6.582885, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:54:00+00:00, data_interval_end=2024-04-06 01:55:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T01:55:07.612510135Z [2024-04-06T01:55:07.612+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:55:00+00:00, run_after=2024-04-06T01:56:00+00:00 2024-04-06T01:55:07.640560202Z [2024-04-06T01:55:07.640+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T01:55:07.640581587Z 2024-04-06T01:55:07.640818703Z [2024-04-06T01:55:07.640+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:55:07.641500662Z [2024-04-06T01:55:07.641+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:55:07.641511761Z 2024-04-06T01:55:07.644304937Z [2024-04-06T01:55:07.644+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='collect_metrics', run_id='scheduled__2024-04-06T01:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-06T01:55:07.644693537Z [2024-04-06T01:55:07.644+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T01:55:07.710259200Z [2024-04-06T01:55:07.709+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T01:50:00+00:00 exited with status queued for try_number 1 2024-04-06T01:55:07.711092957Z [2024-04-06T01:55:07.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:54:00+00:00 exited with status success for try_number 1 2024-04-06T01:55:07.711366501Z [2024-04-06T01:55:07.711+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T01:50:00+00:00 exited with status success for try_number 1 2024-04-06T01:55:07.721528403Z [2024-04-06T01:55:07.721+0000] {scheduler_job.py:635} INFO - Setting external_id for to 41603358-6f0b-4c21-8b6b-4e0fa5176793 2024-04-06T01:55:07.722081984Z [2024-04-06T01:55:07.721+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=split_metrics, run_id=scheduled__2024-04-06T01:50:00+00:00, map_index=-1, run_start_date=2024-04-06 01:55:07.017106+00:00, run_end_date=2024-04-06 01:55:07.405606+00:00, run_duration=0.3885, state=success, executor_state=success, try_number=1, max_tries=1, job_id=90, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:55:05.218249+00:00, queued_by_job_id=2, pid=2142 2024-04-06T01:55:07.722279216Z [2024-04-06T01:55:07.722+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:54:00+00:00, map_index=-1, run_start_date=2024-04-06 01:55:04.699627+00:00, run_end_date=2024-04-06 01:55:07.208840+00:00, run_duration=2.509213, state=success, executor_state=success, try_number=1, max_tries=1, job_id=89, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:55:01.110659+00:00, queued_by_job_id=2, pid=2121 2024-04-06T01:55:10.179716301Z [2024-04-06T01:55:10.179+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T01:55:10.179760702Z 2024-04-06T01:55:10.179897021Z [2024-04-06T01:55:10.179+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:55:10.180483222Z [2024-04-06T01:55:10.180+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:55:10.180500004Z 2024-04-06T01:55:10.182566617Z [2024-04-06T01:55:10.182+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='send_prometheus', run_id='scheduled__2024-04-06T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:55:10.182802064Z [2024-04-06T01:55:10.182+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T01:55:10.228912481Z [2024-04-06T01:55:10.228+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T01:50:00+00:00 exited with status queued for try_number 1 2024-04-06T01:55:10.229074787Z [2024-04-06T01:55:10.228+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T01:50:00+00:00 exited with status success for try_number 1 2024-04-06T01:55:10.238266817Z [2024-04-06T01:55:10.237+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=collect_metrics, run_id=scheduled__2024-04-06T01:50:00+00:00, map_index=0, run_start_date=2024-04-06 01:55:09.480823+00:00, run_end_date=2024-04-06 01:55:09.780676+00:00, run_duration=0.299853, state=success, executor_state=success, try_number=1, max_tries=1, job_id=91, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:55:07.642150+00:00, queued_by_job_id=2, pid=2164 2024-04-06T01:55:10.238528736Z [2024-04-06T01:55:10.238+0000] {scheduler_job.py:635} INFO - Setting external_id for to b322b6bd-746b-4447-9d8e-c925029af700 2024-04-06T01:55:13.136521045Z [2024-04-06T01:55:13.135+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:55:13.136843278Z [2024-04-06T01:55:13.136+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:50:00+00:00, run_id=scheduled__2024-04-06T01:50:00+00:00, run_start_date=2024-04-06 01:55:01.010401+00:00, run_end_date=2024-04-06 01:55:13.136509+00:00, run_duration=12.126108, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:50:00+00:00, data_interval_end=2024-04-06 01:55:00+00:00, dag_hash=eecc559ff32fe9a7c4345875f113a0a9 2024-04-06T01:55:13.142679361Z [2024-04-06T01:55:13.142+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:55:00+00:00, run_after=2024-04-06T02:00:00+00:00 2024-04-06T01:55:13.175852487Z [2024-04-06T01:55:13.175+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T01:50:00+00:00 exited with status success for try_number 1 2024-04-06T01:55:13.181450199Z [2024-04-06T01:55:13.181+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=send_prometheus, run_id=scheduled__2024-04-06T01:50:00+00:00, map_index=-1, run_start_date=2024-04-06 01:55:12.249516+00:00, run_end_date=2024-04-06 01:55:12.715902+00:00, run_duration=0.466386, state=success, executor_state=success, try_number=1, max_tries=1, job_id=92, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:55:10.180821+00:00, queued_by_job_id=2, pid=2179 2024-04-06T01:55:19.406248680Z [2024-04-06T01:55:19.405+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-06T01:56:00.914452073Z [2024-04-06T01:56:00.913+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:56:00+00:00, run_after=2024-04-06T01:57:00+00:00 2024-04-06T01:56:00.920903751Z [2024-04-06T01:56:00.920+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:56:00.929617128Z [2024-04-06T01:56:00.929+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:56:00.994015425Z [2024-04-06T01:56:00.993+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T01:56:00.994084217Z 2024-04-06T01:56:00.994094612Z 2024-04-06T01:56:00.994102821Z 2024-04-06T01:56:00.994281744Z [2024-04-06T01:56:00.993+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T01:56:00.994395277Z [2024-04-06T01:56:00.994+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:56:00.994493174Z [2024-04-06T01:56:00.994+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:56:00.995087824Z [2024-04-06T01:56:00.994+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:56:00.995147728Z 2024-04-06T01:56:00.995156933Z 2024-04-06T01:56:00.995164704Z 2024-04-06T01:56:00.999886207Z [2024-04-06T01:56:00.999+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:56:01.000003372Z [2024-04-06T01:56:00.999+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:56:01.000145392Z [2024-04-06T01:56:00.999+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:56:01.011082548Z [2024-04-06T01:56:01.010+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:56:01.011268601Z [2024-04-06T01:56:01.011+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:56:01.011350006Z [2024-04-06T01:56:01.011+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:56:01.330990911Z [2024-04-06T01:56:01.330+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T01:54:00+00:00 exited with status queued for try_number 1 2024-04-06T01:56:01.332191836Z [2024-04-06T01:56:01.331+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:55:00+00:00 exited with status queued for try_number 1 2024-04-06T01:56:01.332508546Z [2024-04-06T01:56:01.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:55:00+00:00 exited with status queued for try_number 1 2024-04-06T01:56:01.347198054Z [2024-04-06T01:56:01.346+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8cd0c42d-f0f4-4cb1-9065-ab3cfb0efb50 2024-04-06T01:56:01.347256813Z [2024-04-06T01:56:01.347+0000] {scheduler_job.py:635} INFO - Setting external_id for to 918e3f99-712a-4194-8004-cfebd9be7de3 2024-04-06T01:56:01.347372198Z [2024-04-06T01:56:01.347+0000] {scheduler_job.py:635} INFO - Setting external_id for to 343d77e1-ab1a-4bfe-a3e5-117709c229f3 2024-04-06T01:56:03.111235947Z [2024-04-06T01:56:03.110+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:56:03.111492339Z [2024-04-06T01:56:03.111+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 01:54:00+00:00, run_id=scheduled__2024-04-06T01:54:00+00:00, run_start_date=2024-04-06 01:56:00.942312+00:00, run_end_date=2024-04-06 01:56:03.111199+00:00, run_duration=2.168887, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:54:00+00:00, data_interval_end=2024-04-06 01:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T01:56:03.118604690Z [2024-04-06T01:56:03.118+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T01:56:00+00:00, run_after=2024-04-06T01:58:00+00:00 2024-04-06T01:56:03.226769991Z [2024-04-06T01:56:03.226+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T01:54:00+00:00 exited with status success for try_number 1 2024-04-06T01:56:03.238840579Z [2024-04-06T01:56:03.238+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T01:54:00+00:00, map_index=-1, run_start_date=2024-04-06 01:56:02.135074+00:00, run_end_date=2024-04-06 01:56:03.004773+00:00, run_duration=0.869699, state=success, executor_state=success, try_number=1, max_tries=1, job_id=93, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:56:00.995663+00:00, queued_by_job_id=2, pid=2183 2024-04-06T01:56:07.149566898Z [2024-04-06T01:56:07.149+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:56:07.149885978Z [2024-04-06T01:56:07.149+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:55:00+00:00, run_id=scheduled__2024-04-06T01:55:00+00:00, run_start_date=2024-04-06 01:56:00.944476+00:00, run_end_date=2024-04-06 01:56:07.149446+00:00, run_duration=6.20497, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:55:00+00:00, data_interval_end=2024-04-06 01:56:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T01:56:07.158706221Z [2024-04-06T01:56:07.158+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:56:00+00:00, run_after=2024-04-06T01:57:00+00:00 2024-04-06T01:56:07.164637472Z [2024-04-06T01:56:07.164+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:56:07.165951014Z [2024-04-06T01:56:07.164+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:55:00+00:00, run_id=scheduled__2024-04-06T01:55:00+00:00, run_start_date=2024-04-06 01:56:00.946368+00:00, run_end_date=2024-04-06 01:56:07.164526+00:00, run_duration=6.218158, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:55:00+00:00, data_interval_end=2024-04-06 01:56:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T01:56:07.186015041Z [2024-04-06T01:56:07.185+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:56:00+00:00, run_after=2024-04-06T01:57:00+00:00 2024-04-06T01:56:07.237328963Z [2024-04-06T01:56:07.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:55:00+00:00 exited with status success for try_number 1 2024-04-06T01:56:07.237419546Z [2024-04-06T01:56:07.237+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:55:00+00:00 exited with status success for try_number 1 2024-04-06T01:56:07.251813407Z [2024-04-06T01:56:07.251+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:55:00+00:00, map_index=-1, run_start_date=2024-04-06 01:56:03.872260+00:00, run_end_date=2024-04-06 01:56:06.051109+00:00, run_duration=2.178849, state=success, executor_state=success, try_number=1, max_tries=1, job_id=94, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:56:00.995663+00:00, queued_by_job_id=2, pid=2204 2024-04-06T01:56:07.252658804Z [2024-04-06T01:56:07.252+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:55:00+00:00, map_index=-1, run_start_date=2024-04-06 01:56:04.618112+00:00, run_end_date=2024-04-06 01:56:06.947156+00:00, run_duration=2.329044, state=success, executor_state=success, try_number=1, max_tries=1, job_id=95, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:56:00.995663+00:00, queued_by_job_id=2, pid=2223 2024-04-06T01:57:00.814648719Z [2024-04-06T01:57:00.814+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:57:00.833323539Z [2024-04-06T01:57:00.832+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:57:00+00:00, run_after=2024-04-06T01:58:00+00:00 2024-04-06T01:57:00.895435506Z [2024-04-06T01:57:00.895+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T01:57:00.895461156Z 2024-04-06T01:57:00.895464787Z 2024-04-06T01:57:00.896562618Z [2024-04-06T01:57:00.895+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:57:00.896759854Z [2024-04-06T01:57:00.896+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:57:00.897333386Z [2024-04-06T01:57:00.897+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:57:00.897340256Z 2024-04-06T01:57:00.897343725Z 2024-04-06T01:57:00.901662833Z [2024-04-06T01:57:00.901+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:57:00.901739526Z [2024-04-06T01:57:00.901+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:57:00.902081899Z [2024-04-06T01:57:00.901+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:57:00.902156412Z [2024-04-06T01:57:00.902+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:57:01.127541786Z [2024-04-06T01:57:01.126+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:56:00+00:00 exited with status queued for try_number 1 2024-04-06T01:57:01.127638722Z [2024-04-06T01:57:01.127+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:56:00+00:00 exited with status queued for try_number 1 2024-04-06T01:57:01.136058510Z [2024-04-06T01:57:01.135+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5944c543-d338-4302-bd60-b12a09f65cb4 2024-04-06T01:57:01.136179741Z [2024-04-06T01:57:01.135+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25ee221e-c11f-43c3-a44a-4e55d25d7cc6 2024-04-06T01:57:04.713260172Z [2024-04-06T01:57:04.712+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:57:04.713656592Z [2024-04-06T01:57:04.713+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:56:00+00:00, run_id=scheduled__2024-04-06T01:56:00+00:00, run_start_date=2024-04-06 01:57:00.845262+00:00, run_end_date=2024-04-06 01:57:04.713184+00:00, run_duration=3.867922, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:56:00+00:00, data_interval_end=2024-04-06 01:57:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T01:57:04.724527547Z [2024-04-06T01:57:04.724+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:57:00+00:00, run_after=2024-04-06T01:58:00+00:00 2024-04-06T01:57:04.778449467Z [2024-04-06T01:57:04.778+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:56:00+00:00 exited with status success for try_number 1 2024-04-06T01:57:04.783719022Z [2024-04-06T01:57:04.783+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:56:00+00:00, map_index=-1, run_start_date=2024-04-06 01:57:03.036727+00:00, run_end_date=2024-04-06 01:57:04.539038+00:00, run_duration=1.502311, state=success, executor_state=success, try_number=1, max_tries=1, job_id=96, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:57:00.897805+00:00, queued_by_job_id=2, pid=2268 2024-04-06T01:57:05.845406894Z [2024-04-06T01:57:05.844+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:57:05.846518509Z [2024-04-06T01:57:05.845+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:56:00+00:00, run_id=scheduled__2024-04-06T01:56:00+00:00, run_start_date=2024-04-06 01:57:00.843817+00:00, run_end_date=2024-04-06 01:57:05.845545+00:00, run_duration=5.001728, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:56:00+00:00, data_interval_end=2024-04-06 01:57:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T01:57:05.859295121Z [2024-04-06T01:57:05.858+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:57:00+00:00, run_after=2024-04-06T01:58:00+00:00 2024-04-06T01:57:05.903781988Z [2024-04-06T01:57:05.903+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:56:00+00:00 exited with status success for try_number 1 2024-04-06T01:57:05.911816075Z [2024-04-06T01:57:05.911+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:56:00+00:00, map_index=-1, run_start_date=2024-04-06 01:57:03.134092+00:00, run_end_date=2024-04-06 01:57:05.297344+00:00, run_duration=2.163252, state=success, executor_state=success, try_number=1, max_tries=1, job_id=97, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:57:00.897805+00:00, queued_by_job_id=2, pid=2269 2024-04-06T01:58:00.062647454Z [2024-04-06T01:58:00.061+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:58:00+00:00, run_after=2024-04-06T01:59:00+00:00 2024-04-06T01:58:00.076739798Z [2024-04-06T01:58:00.076+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:58:00.084116772Z [2024-04-06T01:58:00.083+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:58:00.168083204Z [2024-04-06T01:58:00.167+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T01:58:00.168117797Z 2024-04-06T01:58:00.168125209Z 2024-04-06T01:58:00.168130761Z 2024-04-06T01:58:00.168412906Z [2024-04-06T01:58:00.167+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T01:58:00.168800282Z [2024-04-06T01:58:00.168+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:58:00.169071904Z [2024-04-06T01:58:00.168+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:58:00.170079252Z [2024-04-06T01:58:00.169+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:58:00.170105034Z 2024-04-06T01:58:00.170114733Z 2024-04-06T01:58:00.170123422Z 2024-04-06T01:58:00.175511296Z [2024-04-06T01:58:00.175+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:58:00.175876124Z [2024-04-06T01:58:00.175+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T01:58:00.176361675Z [2024-04-06T01:58:00.176+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:58:00.176585798Z [2024-04-06T01:58:00.176+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:58:00.176981190Z [2024-04-06T01:58:00.176+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:58:00.177241331Z [2024-04-06T01:58:00.176+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:58:00.417217472Z [2024-04-06T01:58:00.416+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T01:56:00+00:00 exited with status queued for try_number 1 2024-04-06T01:58:00.417323763Z [2024-04-06T01:58:00.417+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:57:00+00:00 exited with status queued for try_number 1 2024-04-06T01:58:00.417700745Z [2024-04-06T01:58:00.417+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:57:00+00:00 exited with status queued for try_number 1 2024-04-06T01:58:00.427901018Z [2024-04-06T01:58:00.427+0000] {scheduler_job.py:635} INFO - Setting external_id for to b65c2d32-e754-4c4d-83fa-86cb9be4214c 2024-04-06T01:58:00.428300135Z [2024-04-06T01:58:00.428+0000] {scheduler_job.py:635} INFO - Setting external_id for to 96e2f0a6-a966-41e8-9b83-f953e25b6a91 2024-04-06T01:58:00.428572795Z [2024-04-06T01:58:00.428+0000] {scheduler_job.py:635} INFO - Setting external_id for to efc3d5ce-b0fa-4f24-be7c-4db2acacac90 2024-04-06T01:58:02.151225070Z [2024-04-06T01:58:02.150+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:58:02.151621604Z [2024-04-06T01:58:02.151+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 01:56:00+00:00, run_id=scheduled__2024-04-06T01:56:00+00:00, run_start_date=2024-04-06 01:58:00.097093+00:00, run_end_date=2024-04-06 01:58:02.151261+00:00, run_duration=2.054168, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:56:00+00:00, data_interval_end=2024-04-06 01:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T01:58:02.162356894Z [2024-04-06T01:58:02.162+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T01:58:00+00:00, run_after=2024-04-06T02:00:00+00:00 2024-04-06T01:58:02.256312521Z [2024-04-06T01:58:02.255+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T01:56:00+00:00 exited with status success for try_number 1 2024-04-06T01:58:02.268070022Z [2024-04-06T01:58:02.267+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T01:56:00+00:00, map_index=-1, run_start_date=2024-04-06 01:58:01.164962+00:00, run_end_date=2024-04-06 01:58:01.638502+00:00, run_duration=0.47354, state=success, executor_state=success, try_number=1, max_tries=1, job_id=98, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:58:00.171193+00:00, queued_by_job_id=2, pid=2305 2024-04-06T01:58:05.191599055Z [2024-04-06T01:58:05.191+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:58:05.191701727Z [2024-04-06T01:58:05.191+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:57:00+00:00, run_id=scheduled__2024-04-06T01:57:00+00:00, run_start_date=2024-04-06 01:58:00.098523+00:00, run_end_date=2024-04-06 01:58:05.191383+00:00, run_duration=5.09286, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:57:00+00:00, data_interval_end=2024-04-06 01:58:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T01:58:05.217840246Z [2024-04-06T01:58:05.216+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:58:00+00:00, run_after=2024-04-06T01:59:00+00:00 2024-04-06T01:58:05.270965664Z [2024-04-06T01:58:05.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:57:00+00:00 exited with status success for try_number 1 2024-04-06T01:58:05.277804775Z [2024-04-06T01:58:05.277+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:57:00+00:00, map_index=-1, run_start_date=2024-04-06 01:58:02.661094+00:00, run_end_date=2024-04-06 01:58:05.012462+00:00, run_duration=2.351368, state=success, executor_state=success, try_number=1, max_tries=1, job_id=100, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:58:00.171193+00:00, queued_by_job_id=2, pid=2335 2024-04-06T01:58:06.312362639Z [2024-04-06T01:58:06.311+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:58:06.312658326Z [2024-04-06T01:58:06.312+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:57:00+00:00, run_id=scheduled__2024-04-06T01:57:00+00:00, run_start_date=2024-04-06 01:58:00.099625+00:00, run_end_date=2024-04-06 01:58:06.312269+00:00, run_duration=6.212644, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:57:00+00:00, data_interval_end=2024-04-06 01:58:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T01:58:06.339485944Z [2024-04-06T01:58:06.339+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:58:00+00:00, run_after=2024-04-06T01:59:00+00:00 2024-04-06T01:58:06.367949250Z [2024-04-06T01:58:06.367+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:57:00+00:00 exited with status success for try_number 1 2024-04-06T01:58:06.373244960Z [2024-04-06T01:58:06.372+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:57:00+00:00, map_index=-1, run_start_date=2024-04-06 01:58:02.671119+00:00, run_end_date=2024-04-06 01:58:06.152845+00:00, run_duration=3.481726, state=success, executor_state=success, try_number=1, max_tries=1, job_id=99, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:58:00.171193+00:00, queued_by_job_id=2, pid=2336 2024-04-06T01:59:00.331262461Z [2024-04-06T01:59:00.330+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T01:59:00.345315188Z [2024-04-06T01:59:00.344+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:59:00+00:00, run_after=2024-04-06T02:00:00+00:00 2024-04-06T01:59:00.417932408Z [2024-04-06T01:59:00.417+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T01:59:00.417961133Z 2024-04-06T01:59:00.417966113Z 2024-04-06T01:59:00.418176597Z [2024-04-06T01:59:00.417+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:59:00.418418165Z [2024-04-06T01:59:00.418+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T01:59:00.419180303Z [2024-04-06T01:59:00.418+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T01:59:00.419195405Z 2024-04-06T01:59:00.419220107Z 2024-04-06T01:59:00.423453052Z [2024-04-06T01:59:00.423+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:59:00.423786010Z [2024-04-06T01:59:00.423+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T01:59:00.424343864Z [2024-04-06T01:59:00.424+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T01:59:00.424621548Z [2024-04-06T01:59:00.424+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T01:59:00.591358261Z [2024-04-06T01:59:00.590+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:58:00+00:00 exited with status queued for try_number 1 2024-04-06T01:59:00.591613304Z [2024-04-06T01:59:00.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:58:00+00:00 exited with status queued for try_number 1 2024-04-06T01:59:00.598240173Z [2024-04-06T01:59:00.597+0000] {scheduler_job.py:635} INFO - Setting external_id for to d41b5458-ee18-4bd5-89cc-76d7ceb41d3a 2024-04-06T01:59:00.598559316Z [2024-04-06T01:59:00.598+0000] {scheduler_job.py:635} INFO - Setting external_id for to 50d4db5e-7016-4cc0-8c7a-73fa10f1549c 2024-04-06T01:59:05.622240303Z [2024-04-06T01:59:05.621+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:59:05.623338212Z [2024-04-06T01:59:05.622+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:58:00+00:00, run_id=scheduled__2024-04-06T01:58:00+00:00, run_start_date=2024-04-06 01:59:00.358179+00:00, run_end_date=2024-04-06 01:59:05.622066+00:00, run_duration=5.263887, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:58:00+00:00, data_interval_end=2024-04-06 01:59:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T01:59:05.639910529Z [2024-04-06T01:59:05.639+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:59:00+00:00, run_after=2024-04-06T02:00:00+00:00 2024-04-06T01:59:05.675317371Z [2024-04-06T01:59:05.673+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T01:59:05.675337697Z [2024-04-06T01:59:05.674+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:58:00+00:00, run_id=scheduled__2024-04-06T01:58:00+00:00, run_start_date=2024-04-06 01:59:00.362179+00:00, run_end_date=2024-04-06 01:59:05.673753+00:00, run_duration=5.311574, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:58:00+00:00, data_interval_end=2024-04-06 01:59:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T01:59:05.690006988Z [2024-04-06T01:59:05.689+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T01:59:00+00:00, run_after=2024-04-06T02:00:00+00:00 2024-04-06T01:59:05.720277626Z [2024-04-06T01:59:05.718+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:58:00+00:00 exited with status success for try_number 1 2024-04-06T01:59:05.720294115Z [2024-04-06T01:59:05.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:58:00+00:00 exited with status success for try_number 1 2024-04-06T01:59:05.727651739Z [2024-04-06T01:59:05.727+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:58:00+00:00, map_index=-1, run_start_date=2024-04-06 01:59:02.733659+00:00, run_end_date=2024-04-06 01:59:05.106168+00:00, run_duration=2.372509, state=success, executor_state=success, try_number=1, max_tries=1, job_id=101, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:59:00.419887+00:00, queued_by_job_id=2, pid=2381 2024-04-06T01:59:05.727808963Z [2024-04-06T01:59:05.727+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:58:00+00:00, map_index=-1, run_start_date=2024-04-06 01:59:03.013211+00:00, run_end_date=2024-04-06 01:59:04.891510+00:00, run_duration=1.878299, state=success, executor_state=success, try_number=1, max_tries=1, job_id=102, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 01:59:00.419887+00:00, queued_by_job_id=2, pid=2391 2024-04-06T02:00:00.566339850Z [2024-04-06T02:00:00.565+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:00:00+00:00, run_after=2024-04-06T02:01:00+00:00 2024-04-06T02:00:00.576718921Z [2024-04-06T02:00:00.576+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:00:00.584129086Z [2024-04-06T02:00:00.583+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:00:00.596179029Z [2024-04-06T02:00:00.595+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:00:00+00:00, run_after=2024-04-06T02:05:00+00:00 2024-04-06T02:00:00.710796576Z [2024-04-06T02:00:00.710+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-06T02:00:00.710845455Z 2024-04-06T02:00:00.710852543Z 2024-04-06T02:00:00.710859664Z 2024-04-06T02:00:00.710865984Z 2024-04-06T02:00:00.712020643Z [2024-04-06T02:00:00.711+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:00:00.712338738Z [2024-04-06T02:00:00.712+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T02:00:00.713338917Z [2024-04-06T02:00:00.712+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:00:00.713351142Z [2024-04-06T02:00:00.712+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:00:00.725979111Z [2024-04-06T02:00:00.713+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:00:00.726004112Z 2024-04-06T02:00:00.726008552Z 2024-04-06T02:00:00.726012776Z 2024-04-06T02:00:00.726016197Z 2024-04-06T02:00:00.728134914Z [2024-04-06T02:00:00.726+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-06T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-06T02:00:00.728156816Z [2024-04-06T02:00:00.726+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:00:00.728167745Z [2024-04-06T02:00:00.726+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:00:00.728185068Z [2024-04-06T02:00:00.727+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:00:00.728192406Z [2024-04-06T02:00:00.727+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:00:00.728201322Z [2024-04-06T02:00:00.727+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:00:00.728225758Z [2024-04-06T02:00:00.727+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:00:00.728232460Z [2024-04-06T02:00:00.727+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:00:01.226851508Z [2024-04-06T02:00:01.226+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T01:55:00+00:00 exited with status queued for try_number 1 2024-04-06T02:00:01.228335438Z [2024-04-06T02:00:01.228+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T01:58:00+00:00 exited with status queued for try_number 1 2024-04-06T02:00:01.228559513Z [2024-04-06T02:00:01.228+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:59:00+00:00 exited with status queued for try_number 1 2024-04-06T02:00:01.228725280Z [2024-04-06T02:00:01.228+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:59:00+00:00 exited with status queued for try_number 1 2024-04-06T02:00:01.253766330Z [2024-04-06T02:00:01.253+0000] {scheduler_job.py:635} INFO - Setting external_id for to 473804d3-d417-4d5e-a70a-cf3b84c02baa 2024-04-06T02:00:01.255257872Z [2024-04-06T02:00:01.254+0000] {scheduler_job.py:635} INFO - Setting external_id for to a3a0e477-3a26-4644-b9b1-b66efe874bd4 2024-04-06T02:00:01.255534141Z [2024-04-06T02:00:01.255+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ff2498d-102d-4609-a759-b6dfe7e1a9b8 2024-04-06T02:00:01.255761617Z [2024-04-06T02:00:01.255+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba9983ed-a324-4517-ab73-b31ca57d56b9 2024-04-06T02:00:03.929904681Z [2024-04-06T02:00:03.929+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:00:03.930863713Z [2024-04-06T02:00:03.930+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 01:58:00+00:00, run_id=scheduled__2024-04-06T01:58:00+00:00, run_start_date=2024-04-06 02:00:00.608744+00:00, run_end_date=2024-04-06 02:00:03.929806+00:00, run_duration=3.321062, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:58:00+00:00, data_interval_end=2024-04-06 02:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T02:00:03.959854503Z [2024-04-06T02:00:03.959+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T02:00:00+00:00, run_after=2024-04-06T02:02:00+00:00 2024-04-06T02:00:04.107130193Z [2024-04-06T02:00:04.106+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T01:58:00+00:00 exited with status success for try_number 1 2024-04-06T02:00:04.118608793Z [2024-04-06T02:00:04.118+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T01:58:00+00:00, map_index=-1, run_start_date=2024-04-06 02:00:02.506819+00:00, run_end_date=2024-04-06 02:00:03.279761+00:00, run_duration=0.772942, state=success, executor_state=success, try_number=1, max_tries=1, job_id=103, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:00:00.723288+00:00, queued_by_job_id=2, pid=2427 2024-04-06T02:00:06.245229405Z [2024-04-06T02:00:06.244+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:00:06.245268371Z 2024-04-06T02:00:06.245646654Z [2024-04-06T02:00:06.245+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:00:06.246335827Z [2024-04-06T02:00:06.246+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:00:06.246352325Z 2024-04-06T02:00:06.249122272Z [2024-04-06T02:00:06.248+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='split_metrics', run_id='scheduled__2024-04-06T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-06T02:00:06.249293798Z [2024-04-06T02:00:06.249+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:00:06.352186793Z [2024-04-06T02:00:06.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T01:55:00+00:00 exited with status queued for try_number 1 2024-04-06T02:00:06.352604303Z [2024-04-06T02:00:06.352+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T01:55:00+00:00 exited with status success for try_number 1 2024-04-06T02:00:06.360200986Z [2024-04-06T02:00:06.359+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-06T01:55:00+00:00, map_index=-1, run_start_date=2024-04-06 02:00:04.947679+00:00, run_end_date=2024-04-06 02:00:05.721694+00:00, run_duration=0.774015, state=success, executor_state=success, try_number=1, max_tries=1, job_id=105, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:00:00.723288+00:00, queued_by_job_id=2, pid=2468 2024-04-06T02:00:06.360646853Z [2024-04-06T02:00:06.360+0000] {scheduler_job.py:635} INFO - Setting external_id for to b9f50862-6dc6-4c85-8843-4ed94c4136a7 2024-04-06T02:00:06.423296990Z [2024-04-06T02:00:06.422+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:00:06.424052067Z [2024-04-06T02:00:06.423+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:59:00+00:00, run_id=scheduled__2024-04-06T01:59:00+00:00, run_start_date=2024-04-06 02:00:00.609894+00:00, run_end_date=2024-04-06 02:00:06.423392+00:00, run_duration=5.813498, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:59:00+00:00, data_interval_end=2024-04-06 02:00:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:00:06.434164777Z [2024-04-06T02:00:06.433+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:00:00+00:00, run_after=2024-04-06T02:01:00+00:00 2024-04-06T02:00:06.503443476Z [2024-04-06T02:00:06.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:59:00+00:00 exited with status success for try_number 1 2024-04-06T02:00:06.510291284Z [2024-04-06T02:00:06.509+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:59:00+00:00, map_index=-1, run_start_date=2024-04-06 02:00:04.157437+00:00, run_end_date=2024-04-06 02:00:06.276872+00:00, run_duration=2.119435, state=success, executor_state=success, try_number=1, max_tries=1, job_id=104, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:00:00.723288+00:00, queued_by_job_id=2, pid=2458 2024-04-06T02:00:08.674880275Z [2024-04-06T02:00:08.674+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:00:08.675281701Z [2024-04-06T02:00:08.675+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:59:00+00:00, run_id=scheduled__2024-04-06T01:59:00+00:00, run_start_date=2024-04-06 02:00:00.610992+00:00, run_end_date=2024-04-06 02:00:08.674974+00:00, run_duration=8.063982, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:59:00+00:00, data_interval_end=2024-04-06 02:00:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:00:08.686256528Z [2024-04-06T02:00:08.685+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:00:00+00:00, run_after=2024-04-06T02:01:00+00:00 2024-04-06T02:00:08.724122969Z [2024-04-06T02:00:08.720+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T01:59:00+00:00 exited with status success for try_number 1 2024-04-06T02:00:08.725164434Z [2024-04-06T02:00:08.724+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T01:59:00+00:00, map_index=-1, run_start_date=2024-04-06 02:00:05.412612+00:00, run_end_date=2024-04-06 02:00:07.719134+00:00, run_duration=2.306522, state=success, executor_state=success, try_number=1, max_tries=1, job_id=106, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:00:00.723288+00:00, queued_by_job_id=2, pid=2478 2024-04-06T02:00:09.746885040Z [2024-04-06T02:00:09.746+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:00:09.746925198Z 2024-04-06T02:00:09.747026736Z [2024-04-06T02:00:09.746+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:00:09.747549331Z [2024-04-06T02:00:09.747+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:00:09.747560959Z 2024-04-06T02:00:09.749761100Z [2024-04-06T02:00:09.749+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='collect_metrics', run_id='scheduled__2024-04-06T01:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-06T02:00:09.749960543Z [2024-04-06T02:00:09.749+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T02:00:09.796494805Z [2024-04-06T02:00:09.796+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T01:55:00+00:00 exited with status queued for try_number 1 2024-04-06T02:00:09.796824047Z [2024-04-06T02:00:09.796+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T01:55:00+00:00 exited with status success for try_number 1 2024-04-06T02:00:09.802210650Z [2024-04-06T02:00:09.801+0000] {scheduler_job.py:635} INFO - Setting external_id for to 92b8bff3-20b2-45e2-8767-593eb15c04d1 2024-04-06T02:00:09.802385892Z [2024-04-06T02:00:09.802+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=split_metrics, run_id=scheduled__2024-04-06T01:55:00+00:00, map_index=-1, run_start_date=2024-04-06 02:00:08.019433+00:00, run_end_date=2024-04-06 02:00:08.539526+00:00, run_duration=0.520093, state=success, executor_state=success, try_number=1, max_tries=1, job_id=107, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:00:06.246755+00:00, queued_by_job_id=2, pid=2508 2024-04-06T02:00:12.090622649Z [2024-04-06T02:00:12.090+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:00:12.090654572Z 2024-04-06T02:00:12.092482259Z [2024-04-06T02:00:12.092+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:00:12.093085224Z [2024-04-06T02:00:12.092+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:00:12.093094707Z 2024-04-06T02:00:12.098488602Z [2024-04-06T02:00:12.098+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='send_prometheus', run_id='scheduled__2024-04-06T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:00:12.098632945Z [2024-04-06T02:00:12.098+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:00:12.159867889Z [2024-04-06T02:00:12.159+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T01:55:00+00:00 exited with status queued for try_number 1 2024-04-06T02:00:12.171103592Z [2024-04-06T02:00:12.170+0000] {scheduler_job.py:635} INFO - Setting external_id for to 65c0beef-4029-4a16-bfb5-99b77d865c4a 2024-04-06T02:00:12.291191116Z [2024-04-06T02:00:12.289+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T01:55:00+00:00 exited with status success for try_number 1 2024-04-06T02:00:12.297366863Z [2024-04-06T02:00:12.296+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=collect_metrics, run_id=scheduled__2024-04-06T01:55:00+00:00, map_index=0, run_start_date=2024-04-06 02:00:11.562879+00:00, run_end_date=2024-04-06 02:00:11.978598+00:00, run_duration=0.415719, state=success, executor_state=success, try_number=1, max_tries=1, job_id=108, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:00:09.747881+00:00, queued_by_job_id=2, pid=2533 2024-04-06T02:00:14.437113506Z [2024-04-06T02:00:14.436+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:00:14.437628686Z [2024-04-06T02:00:14.437+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 01:55:00+00:00, run_id=scheduled__2024-04-06T01:55:00+00:00, run_start_date=2024-04-06 02:00:00.607345+00:00, run_end_date=2024-04-06 02:00:14.437066+00:00, run_duration=13.829721, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 01:55:00+00:00, data_interval_end=2024-04-06 02:00:00+00:00, dag_hash=eecc559ff32fe9a7c4345875f113a0a9 2024-04-06T02:00:14.447587717Z [2024-04-06T02:00:14.447+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:00:00+00:00, run_after=2024-04-06T02:05:00+00:00 2024-04-06T02:00:14.485062487Z [2024-04-06T02:00:14.484+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T01:55:00+00:00 exited with status success for try_number 1 2024-04-06T02:00:14.494277317Z [2024-04-06T02:00:14.493+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=send_prometheus, run_id=scheduled__2024-04-06T01:55:00+00:00, map_index=-1, run_start_date=2024-04-06 02:00:13.834995+00:00, run_end_date=2024-04-06 02:00:14.207083+00:00, run_duration=0.372088, state=success, executor_state=success, try_number=1, max_tries=1, job_id=109, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:00:12.094139+00:00, queued_by_job_id=2, pid=2545 2024-04-06T02:00:19.476875668Z [2024-04-06T02:00:19.476+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-06T02:01:00.530921263Z [2024-04-06T02:01:00.530+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:01:00+00:00, run_after=2024-04-06T02:02:00+00:00 2024-04-06T02:01:00.544446028Z [2024-04-06T02:01:00.544+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:01:00.602249949Z [2024-04-06T02:01:00.601+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T02:01:00.602273398Z 2024-04-06T02:01:00.602277721Z 2024-04-06T02:01:00.602298423Z [2024-04-06T02:01:00.602+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:01:00.602460885Z [2024-04-06T02:01:00.602+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:01:00.603106884Z [2024-04-06T02:01:00.602+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:01:00.603126007Z 2024-04-06T02:01:00.603129246Z 2024-04-06T02:01:00.606010550Z [2024-04-06T02:01:00.605+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:01:00.606272506Z [2024-04-06T02:01:00.605+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:01:00.606525150Z [2024-04-06T02:01:00.606+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:01:00.606605537Z [2024-04-06T02:01:00.606+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:01:00.904209655Z [2024-04-06T02:01:00.903+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:00:00+00:00 exited with status queued for try_number 1 2024-04-06T02:01:00.904270592Z [2024-04-06T02:01:00.904+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:00:00+00:00 exited with status queued for try_number 1 2024-04-06T02:01:00.928696365Z [2024-04-06T02:01:00.925+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48e0bca3-a4de-4389-9968-db60c6d4daaf 2024-04-06T02:01:00.928820160Z [2024-04-06T02:01:00.928+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a04043d-2e14-42fc-aed0-c75c0f54f2da 2024-04-06T02:01:07.155991795Z [2024-04-06T02:01:07.155+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:01:07.156565365Z [2024-04-06T02:01:07.156+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:00:00+00:00, run_id=scheduled__2024-04-06T02:00:00+00:00, run_start_date=2024-04-06 02:01:00.557080+00:00, run_end_date=2024-04-06 02:01:07.155804+00:00, run_duration=6.598724, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:00:00+00:00, data_interval_end=2024-04-06 02:01:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:01:07.176911332Z [2024-04-06T02:01:07.176+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:01:00+00:00, run_after=2024-04-06T02:02:00+00:00 2024-04-06T02:01:07.246354200Z [2024-04-06T02:01:07.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:00:00+00:00 exited with status success for try_number 1 2024-04-06T02:01:07.257461535Z [2024-04-06T02:01:07.256+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:00:00+00:00, map_index=-1, run_start_date=2024-04-06 02:01:03.676258+00:00, run_end_date=2024-04-06 02:01:06.740293+00:00, run_duration=3.064035, state=success, executor_state=success, try_number=1, max_tries=1, job_id=110, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:01:00.603568+00:00, queued_by_job_id=2, pid=2568 2024-04-06T02:01:08.332780655Z [2024-04-06T02:01:08.332+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:01:08.333119455Z [2024-04-06T02:01:08.332+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:00:00+00:00, run_id=scheduled__2024-04-06T02:00:00+00:00, run_start_date=2024-04-06 02:01:00.558639+00:00, run_end_date=2024-04-06 02:01:08.332795+00:00, run_duration=7.774156, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:00:00+00:00, data_interval_end=2024-04-06 02:01:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:01:08.343780498Z [2024-04-06T02:01:08.343+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:01:00+00:00, run_after=2024-04-06T02:02:00+00:00 2024-04-06T02:01:08.381190814Z [2024-04-06T02:01:08.380+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:00:00+00:00 exited with status success for try_number 1 2024-04-06T02:01:08.387625162Z [2024-04-06T02:01:08.387+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:00:00+00:00, map_index=-1, run_start_date=2024-04-06 02:01:03.717777+00:00, run_end_date=2024-04-06 02:01:07.350545+00:00, run_duration=3.632768, state=success, executor_state=success, try_number=1, max_tries=1, job_id=111, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:01:00.603568+00:00, queued_by_job_id=2, pid=2569 2024-04-06T02:02:00.962968161Z [2024-04-06T02:02:00.962+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:02:00.977395081Z [2024-04-06T02:02:00.976+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:02:00+00:00, run_after=2024-04-06T02:03:00+00:00 2024-04-06T02:02:00.991511305Z [2024-04-06T02:02:00.991+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:02:01.060853233Z [2024-04-06T02:02:01.060+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T02:02:01.060880392Z 2024-04-06T02:02:01.060885483Z 2024-04-06T02:02:01.060888958Z 2024-04-06T02:02:01.061081963Z [2024-04-06T02:02:01.060+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T02:02:01.061217059Z [2024-04-06T02:02:01.061+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:02:01.061402860Z [2024-04-06T02:02:01.061+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:02:01.062244510Z [2024-04-06T02:02:01.061+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:02:01.062258995Z 2024-04-06T02:02:01.062263613Z 2024-04-06T02:02:01.062266803Z 2024-04-06T02:02:01.064887779Z [2024-04-06T02:02:01.064+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:02:01.064989296Z [2024-04-06T02:02:01.064+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:02:01.065203799Z [2024-04-06T02:02:01.065+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:02:01.065261823Z [2024-04-06T02:02:01.065+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:02:01.065423384Z [2024-04-06T02:02:01.065+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:02:01.065474231Z [2024-04-06T02:02:01.065+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:02:01.319125846Z [2024-04-06T02:02:01.318+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:00:00+00:00 exited with status queued for try_number 1 2024-04-06T02:02:01.319323116Z [2024-04-06T02:02:01.319+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:01:00+00:00 exited with status queued for try_number 1 2024-04-06T02:02:01.319477273Z [2024-04-06T02:02:01.319+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:01:00+00:00 exited with status queued for try_number 1 2024-04-06T02:02:01.337201987Z [2024-04-06T02:02:01.336+0000] {scheduler_job.py:635} INFO - Setting external_id for to 02476348-bd52-46cf-a212-cd98d13f2138 2024-04-06T02:02:01.337461295Z [2024-04-06T02:02:01.337+0000] {scheduler_job.py:635} INFO - Setting external_id for to 382d31ed-7e33-45ec-9dc0-118e21093bba 2024-04-06T02:02:01.337645567Z [2024-04-06T02:02:01.337+0000] {scheduler_job.py:635} INFO - Setting external_id for to 704d528a-a5a3-4ec3-ae61-f0f0e2b2d87c 2024-04-06T02:02:03.267412530Z [2024-04-06T02:02:03.267+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:02:03.267743069Z [2024-04-06T02:02:03.267+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 02:00:00+00:00, run_id=scheduled__2024-04-06T02:00:00+00:00, run_start_date=2024-04-06 02:02:01.009339+00:00, run_end_date=2024-04-06 02:02:03.267329+00:00, run_duration=2.25799, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:00:00+00:00, data_interval_end=2024-04-06 02:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T02:02:03.277200323Z [2024-04-06T02:02:03.276+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T02:02:00+00:00, run_after=2024-04-06T02:04:00+00:00 2024-04-06T02:02:03.325302669Z [2024-04-06T02:02:03.324+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:00:00+00:00 exited with status success for try_number 1 2024-04-06T02:02:03.336724227Z [2024-04-06T02:02:03.336+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T02:00:00+00:00, map_index=-1, run_start_date=2024-04-06 02:02:02.013677+00:00, run_end_date=2024-04-06 02:02:02.630237+00:00, run_duration=0.61656, state=success, executor_state=success, try_number=1, max_tries=1, job_id=112, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:02:01.062629+00:00, queued_by_job_id=2, pid=2604 2024-04-06T02:02:07.082933951Z [2024-04-06T02:02:07.082+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:02:07.083094409Z [2024-04-06T02:02:07.082+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:01:00+00:00, run_id=scheduled__2024-04-06T02:01:00+00:00, run_start_date=2024-04-06 02:02:01.010532+00:00, run_end_date=2024-04-06 02:02:07.082842+00:00, run_duration=6.07231, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:01:00+00:00, data_interval_end=2024-04-06 02:02:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:02:07.092867648Z [2024-04-06T02:02:07.092+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:02:00+00:00, run_after=2024-04-06T02:03:00+00:00 2024-04-06T02:02:07.169994321Z [2024-04-06T02:02:07.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:01:00+00:00 exited with status success for try_number 1 2024-04-06T02:02:07.179388207Z [2024-04-06T02:02:07.177+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:01:00+00:00, map_index=-1, run_start_date=2024-04-06 02:02:03.628678+00:00, run_end_date=2024-04-06 02:02:05.997472+00:00, run_duration=2.368794, state=success, executor_state=success, try_number=1, max_tries=1, job_id=113, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:02:01.062629+00:00, queued_by_job_id=2, pid=2634 2024-04-06T02:02:08.231558778Z [2024-04-06T02:02:08.231+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:02:08.231938795Z [2024-04-06T02:02:08.231+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:01:00+00:00, run_id=scheduled__2024-04-06T02:01:00+00:00, run_start_date=2024-04-06 02:02:01.011579+00:00, run_end_date=2024-04-06 02:02:08.231636+00:00, run_duration=7.220057, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:01:00+00:00, data_interval_end=2024-04-06 02:02:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:02:08.240659267Z [2024-04-06T02:02:08.240+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:02:00+00:00, run_after=2024-04-06T02:03:00+00:00 2024-04-06T02:02:08.309375055Z [2024-04-06T02:02:08.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:01:00+00:00 exited with status success for try_number 1 2024-04-06T02:02:08.323163618Z [2024-04-06T02:02:08.322+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:01:00+00:00, map_index=-1, run_start_date=2024-04-06 02:02:03.889780+00:00, run_end_date=2024-04-06 02:02:07.096130+00:00, run_duration=3.20635, state=success, executor_state=success, try_number=1, max_tries=1, job_id=114, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:02:01.062629+00:00, queued_by_job_id=2, pid=2635 2024-04-06T02:03:00.045144730Z [2024-04-06T02:03:00.044+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:03:00.069269642Z [2024-04-06T02:03:00.068+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:03:00+00:00, run_after=2024-04-06T02:04:00+00:00 2024-04-06T02:03:00.153333041Z [2024-04-06T02:03:00.152+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T02:03:00.153380803Z 2024-04-06T02:03:00.153393712Z 2024-04-06T02:03:00.153427161Z [2024-04-06T02:03:00.153+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:03:00.153689067Z [2024-04-06T02:03:00.153+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:03:00.154603685Z [2024-04-06T02:03:00.154+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:03:00.154627204Z 2024-04-06T02:03:00.154653339Z 2024-04-06T02:03:00.158474280Z [2024-04-06T02:03:00.158+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:03:00.158726938Z [2024-04-06T02:03:00.158+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:03:00.159078232Z [2024-04-06T02:03:00.158+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:03:00.159357427Z [2024-04-06T02:03:00.159+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:03:00.328097299Z [2024-04-06T02:03:00.327+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:02:00+00:00 exited with status queued for try_number 1 2024-04-06T02:03:00.328330485Z [2024-04-06T02:03:00.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:02:00+00:00 exited with status queued for try_number 1 2024-04-06T02:03:00.341281304Z [2024-04-06T02:03:00.340+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3162883b-15cf-4863-8704-3821d96eccf1 2024-04-06T02:03:00.341733795Z [2024-04-06T02:03:00.341+0000] {scheduler_job.py:635} INFO - Setting external_id for to a06d51f2-f5a7-4e2b-8f54-5fdf9d31d2fd 2024-04-06T02:03:04.105074987Z [2024-04-06T02:03:04.100+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:03:04.105152861Z [2024-04-06T02:03:04.101+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:02:00+00:00, run_id=scheduled__2024-04-06T02:02:00+00:00, run_start_date=2024-04-06 02:03:00.086442+00:00, run_end_date=2024-04-06 02:03:04.100797+00:00, run_duration=4.014355, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:02:00+00:00, data_interval_end=2024-04-06 02:03:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:03:04.120125296Z [2024-04-06T02:03:04.119+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:03:00+00:00, run_after=2024-04-06T02:04:00+00:00 2024-04-06T02:03:04.128146314Z [2024-04-06T02:03:04.127+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:03:04.128707568Z [2024-04-06T02:03:04.128+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:02:00+00:00, run_id=scheduled__2024-04-06T02:02:00+00:00, run_start_date=2024-04-06 02:03:00.088859+00:00, run_end_date=2024-04-06 02:03:04.128055+00:00, run_duration=4.039196, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:02:00+00:00, data_interval_end=2024-04-06 02:03:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:03:04.138827541Z [2024-04-06T02:03:04.138+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:03:00+00:00, run_after=2024-04-06T02:04:00+00:00 2024-04-06T02:03:04.198379286Z [2024-04-06T02:03:04.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:02:00+00:00 exited with status success for try_number 1 2024-04-06T02:03:04.218852805Z [2024-04-06T02:03:04.218+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:02:00+00:00, map_index=-1, run_start_date=2024-04-06 02:03:02.220221+00:00, run_end_date=2024-04-06 02:03:03.749356+00:00, run_duration=1.529135, state=success, executor_state=success, try_number=1, max_tries=1, job_id=116, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:03:00.155421+00:00, queued_by_job_id=2, pid=2690 2024-04-06T02:03:05.299679149Z [2024-04-06T02:03:05.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:02:00+00:00 exited with status success for try_number 1 2024-04-06T02:03:05.307602562Z [2024-04-06T02:03:05.307+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:02:00+00:00, map_index=-1, run_start_date=2024-04-06 02:03:02.146706+00:00, run_end_date=2024-04-06 02:03:04.014229+00:00, run_duration=1.867523, state=success, executor_state=success, try_number=1, max_tries=1, job_id=115, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:03:00.155421+00:00, queued_by_job_id=2, pid=2689 2024-04-06T02:04:00.612538954Z [2024-04-06T02:04:00.612+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:04:00.629140493Z [2024-04-06T02:04:00.628+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:04:00+00:00, run_after=2024-04-06T02:05:00+00:00 2024-04-06T02:04:00.635838460Z [2024-04-06T02:04:00.635+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:04:00.701915701Z [2024-04-06T02:04:00.697+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T02:04:00.701937926Z 2024-04-06T02:04:00.701941836Z 2024-04-06T02:04:00.701944928Z 2024-04-06T02:04:00.701948418Z [2024-04-06T02:04:00.698+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T02:04:00.701951593Z [2024-04-06T02:04:00.698+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:04:00.701955125Z [2024-04-06T02:04:00.698+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:04:00.701958051Z [2024-04-06T02:04:00.698+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:04:00.701960870Z 2024-04-06T02:04:00.701963689Z 2024-04-06T02:04:00.701966454Z 2024-04-06T02:04:00.701971850Z [2024-04-06T02:04:00.701+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:04:00.701975296Z [2024-04-06T02:04:00.701+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:04:00.703054098Z [2024-04-06T02:04:00.702+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:04:00.703083044Z [2024-04-06T02:04:00.702+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:04:00.703086231Z [2024-04-06T02:04:00.702+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:04:00.703089050Z [2024-04-06T02:04:00.702+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:04:01.179012498Z [2024-04-06T02:04:01.178+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:02:00+00:00 exited with status queued for try_number 1 2024-04-06T02:04:01.179045936Z [2024-04-06T02:04:01.178+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:03:00+00:00 exited with status queued for try_number 1 2024-04-06T02:04:01.179101149Z [2024-04-06T02:04:01.178+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:03:00+00:00 exited with status queued for try_number 1 2024-04-06T02:04:01.195874312Z [2024-04-06T02:04:01.195+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b3187c9-fa5b-4f54-af6c-2e19a24d24e2 2024-04-06T02:04:01.196083906Z [2024-04-06T02:04:01.195+0000] {scheduler_job.py:635} INFO - Setting external_id for to 936e94a4-402e-4209-b802-3be7c28c23fe 2024-04-06T02:04:01.196201650Z [2024-04-06T02:04:01.196+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3d9e04e-856d-46d7-a4e5-bbf49bb38728 2024-04-06T02:04:02.394395560Z [2024-04-06T02:04:02.393+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:04:02.394679343Z [2024-04-06T02:04:02.394+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 02:02:00+00:00, run_id=scheduled__2024-04-06T02:02:00+00:00, run_start_date=2024-04-06 02:04:00.646181+00:00, run_end_date=2024-04-06 02:04:02.394321+00:00, run_duration=1.74814, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:02:00+00:00, data_interval_end=2024-04-06 02:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T02:04:02.413847402Z [2024-04-06T02:04:02.413+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T02:04:00+00:00, run_after=2024-04-06T02:06:00+00:00 2024-04-06T02:04:02.549963979Z [2024-04-06T02:04:02.549+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:02:00+00:00 exited with status success for try_number 1 2024-04-06T02:04:02.569203115Z [2024-04-06T02:04:02.568+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T02:02:00+00:00, map_index=-1, run_start_date=2024-04-06 02:04:01.528995+00:00, run_end_date=2024-04-06 02:04:02.091700+00:00, run_duration=0.562705, state=success, executor_state=success, try_number=1, max_tries=1, job_id=117, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:04:00.699377+00:00, queued_by_job_id=2, pid=2725 2024-04-06T02:04:06.772299029Z [2024-04-06T02:04:06.771+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:04:06.772429600Z [2024-04-06T02:04:06.772+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:03:00+00:00, run_id=scheduled__2024-04-06T02:03:00+00:00, run_start_date=2024-04-06 02:04:00.649050+00:00, run_end_date=2024-04-06 02:04:06.772148+00:00, run_duration=6.123098, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:03:00+00:00, data_interval_end=2024-04-06 02:04:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:04:06.780997339Z [2024-04-06T02:04:06.780+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:04:00+00:00, run_after=2024-04-06T02:05:00+00:00 2024-04-06T02:04:06.832829411Z [2024-04-06T02:04:06.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:03:00+00:00 exited with status success for try_number 1 2024-04-06T02:04:06.841265404Z [2024-04-06T02:04:06.840+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:03:00+00:00, map_index=-1, run_start_date=2024-04-06 02:04:03.728983+00:00, run_end_date=2024-04-06 02:04:06.262026+00:00, run_duration=2.533043, state=success, executor_state=success, try_number=1, max_tries=1, job_id=118, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:04:00.699377+00:00, queued_by_job_id=2, pid=2755 2024-04-06T02:04:09.014600605Z [2024-04-06T02:04:09.014+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:04:09.014762157Z [2024-04-06T02:04:09.014+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:03:00+00:00, run_id=scheduled__2024-04-06T02:03:00+00:00, run_start_date=2024-04-06 02:04:00.647732+00:00, run_end_date=2024-04-06 02:04:09.014383+00:00, run_duration=8.366651, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:03:00+00:00, data_interval_end=2024-04-06 02:04:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:04:09.026039225Z [2024-04-06T02:04:09.025+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:04:00+00:00, run_after=2024-04-06T02:05:00+00:00 2024-04-06T02:04:09.072814795Z [2024-04-06T02:04:09.072+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:03:00+00:00 exited with status success for try_number 1 2024-04-06T02:04:09.081645042Z [2024-04-06T02:04:09.081+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:03:00+00:00, map_index=-1, run_start_date=2024-04-06 02:04:03.981534+00:00, run_end_date=2024-04-06 02:04:08.068839+00:00, run_duration=4.087305, state=success, executor_state=success, try_number=1, max_tries=1, job_id=119, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:04:00.699377+00:00, queued_by_job_id=2, pid=2756 2024-04-06T02:05:00.894066312Z [2024-04-06T02:05:00.893+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:05:00+00:00, run_after=2024-04-06T02:10:00+00:00 2024-04-06T02:05:00.913779086Z [2024-04-06T02:05:00.913+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:05:00+00:00, run_after=2024-04-06T02:06:00+00:00 2024-04-06T02:05:00.922969211Z [2024-04-06T02:05:00.922+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:05:01.005069891Z [2024-04-06T02:05:01.003+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T02:05:01.005104054Z 2024-04-06T02:05:01.005119705Z 2024-04-06T02:05:01.005125364Z 2024-04-06T02:05:01.005139557Z [2024-04-06T02:05:01.004+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:05:01.005283017Z [2024-04-06T02:05:01.005+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:05:01.005349245Z [2024-04-06T02:05:01.005+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:05:01.006366770Z [2024-04-06T02:05:01.005+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:05:01.006390674Z 2024-04-06T02:05:01.006396832Z 2024-04-06T02:05:01.006402183Z 2024-04-06T02:05:01.011332866Z [2024-04-06T02:05:01.011+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-06T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-06T02:05:01.011388699Z [2024-04-06T02:05:01.011+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:05:01.011604979Z [2024-04-06T02:05:01.011+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:05:01.011655758Z [2024-04-06T02:05:01.011+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:05:01.011816780Z [2024-04-06T02:05:01.011+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:05:01.011872385Z [2024-04-06T02:05:01.011+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:05:01.235987933Z [2024-04-06T02:05:01.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T02:00:00+00:00 exited with status queued for try_number 1 2024-04-06T02:05:01.236084963Z [2024-04-06T02:05:01.235+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:04:00+00:00 exited with status queued for try_number 1 2024-04-06T02:05:01.236166350Z [2024-04-06T02:05:01.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:04:00+00:00 exited with status queued for try_number 1 2024-04-06T02:05:01.250639440Z [2024-04-06T02:05:01.249+0000] {scheduler_job.py:635} INFO - Setting external_id for to 76be6586-8cca-46ff-894c-9c2356d558c1 2024-04-06T02:05:01.250664953Z [2024-04-06T02:05:01.250+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2cd2f5d6-7765-4127-ab3a-f576737ff781 2024-04-06T02:05:01.255766790Z [2024-04-06T02:05:01.250+0000] {scheduler_job.py:635} INFO - Setting external_id for to 57a945d1-9ab0-4506-bc8b-a6123f9d7ba7 2024-04-06T02:05:06.340629521Z [2024-04-06T02:05:06.340+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:05:06.340659859Z 2024-04-06T02:05:06.341030209Z [2024-04-06T02:05:06.340+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:05:06.342238218Z [2024-04-06T02:05:06.341+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:05:06.342250534Z 2024-04-06T02:05:06.346544636Z [2024-04-06T02:05:06.346+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='split_metrics', run_id='scheduled__2024-04-06T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-06T02:05:06.346664023Z [2024-04-06T02:05:06.346+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:05:06.404656862Z [2024-04-06T02:05:06.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T02:00:00+00:00 exited with status queued for try_number 1 2024-04-06T02:05:06.404711583Z [2024-04-06T02:05:06.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T02:00:00+00:00 exited with status success for try_number 1 2024-04-06T02:05:06.411472735Z [2024-04-06T02:05:06.411+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0faa941a-760f-407d-b3ae-06b5bb66f3d8 2024-04-06T02:05:06.411740280Z [2024-04-06T02:05:06.411+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-06T02:00:00+00:00, map_index=-1, run_start_date=2024-04-06 02:05:04.427588+00:00, run_end_date=2024-04-06 02:05:05.488145+00:00, run_duration=1.060557, state=success, executor_state=success, try_number=1, max_tries=1, job_id=121, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:05:01.007424+00:00, queued_by_job_id=2, pid=2823 2024-04-06T02:05:07.271315924Z [2024-04-06T02:05:07.270+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:05:07.271695057Z [2024-04-06T02:05:07.271+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:04:00+00:00, run_id=scheduled__2024-04-06T02:04:00+00:00, run_start_date=2024-04-06 02:05:00.938836+00:00, run_end_date=2024-04-06 02:05:07.271142+00:00, run_duration=6.332306, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:04:00+00:00, data_interval_end=2024-04-06 02:05:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:05:07.293542082Z [2024-04-06T02:05:07.293+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:05:00+00:00, run_after=2024-04-06T02:06:00+00:00 2024-04-06T02:05:07.306728655Z [2024-04-06T02:05:07.306+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:05:07.306898531Z [2024-04-06T02:05:07.306+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:04:00+00:00, run_id=scheduled__2024-04-06T02:04:00+00:00, run_start_date=2024-04-06 02:05:00.937621+00:00, run_end_date=2024-04-06 02:05:07.306520+00:00, run_duration=6.368899, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:04:00+00:00, data_interval_end=2024-04-06 02:05:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:05:07.324321785Z [2024-04-06T02:05:07.323+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:05:00+00:00, run_after=2024-04-06T02:06:00+00:00 2024-04-06T02:05:07.370755362Z [2024-04-06T02:05:07.370+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:04:00+00:00 exited with status success for try_number 1 2024-04-06T02:05:07.370844737Z [2024-04-06T02:05:07.370+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:04:00+00:00 exited with status success for try_number 1 2024-04-06T02:05:07.378269857Z [2024-04-06T02:05:07.377+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:04:00+00:00, map_index=-1, run_start_date=2024-04-06 02:05:04.319627+00:00, run_end_date=2024-04-06 02:05:06.786358+00:00, run_duration=2.466731, state=success, executor_state=success, try_number=1, max_tries=1, job_id=120, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:05:01.007424+00:00, queued_by_job_id=2, pid=2813 2024-04-06T02:05:07.378479550Z [2024-04-06T02:05:07.378+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:04:00+00:00, map_index=-1, run_start_date=2024-04-06 02:05:04.967871+00:00, run_end_date=2024-04-06 02:05:06.765554+00:00, run_duration=1.797683, state=success, executor_state=success, try_number=1, max_tries=1, job_id=122, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:05:01.007424+00:00, queued_by_job_id=2, pid=2824 2024-04-06T02:05:08.527191515Z [2024-04-06T02:05:08.526+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:05:08.527216909Z 2024-04-06T02:05:08.527420338Z [2024-04-06T02:05:08.527+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:05:08.528425976Z [2024-04-06T02:05:08.528+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:05:08.528440767Z 2024-04-06T02:05:08.535408369Z [2024-04-06T02:05:08.535+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='collect_metrics', run_id='scheduled__2024-04-06T02:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-06T02:05:08.535637948Z [2024-04-06T02:05:08.535+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T02:05:08.659192253Z [2024-04-06T02:05:08.658+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T02:00:00+00:00 exited with status queued for try_number 1 2024-04-06T02:05:08.672366965Z [2024-04-06T02:05:08.671+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b51cd3b-38a5-4a22-83f3-404cbfb10334 2024-04-06T02:05:08.761785166Z [2024-04-06T02:05:08.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T02:00:00+00:00 exited with status success for try_number 1 2024-04-06T02:05:08.770392362Z [2024-04-06T02:05:08.769+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=split_metrics, run_id=scheduled__2024-04-06T02:00:00+00:00, map_index=-1, run_start_date=2024-04-06 02:05:07.991101+00:00, run_end_date=2024-04-06 02:05:08.432870+00:00, run_duration=0.441769, state=success, executor_state=success, try_number=1, max_tries=1, job_id=123, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:05:06.342622+00:00, queued_by_job_id=2, pid=2863 2024-04-06T02:05:11.392508124Z [2024-04-06T02:05:11.392+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:05:11.392538717Z 2024-04-06T02:05:11.392932345Z [2024-04-06T02:05:11.392+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:05:11.393608695Z [2024-04-06T02:05:11.393+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:05:11.393635407Z 2024-04-06T02:05:11.395791793Z [2024-04-06T02:05:11.395+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='send_prometheus', run_id='scheduled__2024-04-06T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:05:11.396196405Z [2024-04-06T02:05:11.396+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:05:11.442246081Z [2024-04-06T02:05:11.441+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T02:00:00+00:00 exited with status queued for try_number 1 2024-04-06T02:05:11.442545349Z [2024-04-06T02:05:11.442+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T02:00:00+00:00 exited with status success for try_number 1 2024-04-06T02:05:11.448192023Z [2024-04-06T02:05:11.447+0000] {scheduler_job.py:635} INFO - Setting external_id for to f3d21fab-091f-4e34-868a-93d3fc8fd147 2024-04-06T02:05:11.448549407Z [2024-04-06T02:05:11.448+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=collect_metrics, run_id=scheduled__2024-04-06T02:00:00+00:00, map_index=0, run_start_date=2024-04-06 02:05:10.193482+00:00, run_end_date=2024-04-06 02:05:10.495687+00:00, run_duration=0.302205, state=success, executor_state=success, try_number=1, max_tries=1, job_id=124, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:05:08.531734+00:00, queued_by_job_id=2, pid=2885 2024-04-06T02:05:13.687886258Z [2024-04-06T02:05:13.687+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:05:13.688376797Z [2024-04-06T02:05:13.688+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:00:00+00:00, run_id=scheduled__2024-04-06T02:00:00+00:00, run_start_date=2024-04-06 02:05:00.936233+00:00, run_end_date=2024-04-06 02:05:13.687702+00:00, run_duration=12.751469, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:00:00+00:00, data_interval_end=2024-04-06 02:05:00+00:00, dag_hash=eecc559ff32fe9a7c4345875f113a0a9 2024-04-06T02:05:13.699990195Z [2024-04-06T02:05:13.699+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:05:00+00:00, run_after=2024-04-06T02:10:00+00:00 2024-04-06T02:05:13.734674412Z [2024-04-06T02:05:13.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T02:00:00+00:00 exited with status success for try_number 1 2024-04-06T02:05:13.740038840Z [2024-04-06T02:05:13.739+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=send_prometheus, run_id=scheduled__2024-04-06T02:00:00+00:00, map_index=-1, run_start_date=2024-04-06 02:05:13.124495+00:00, run_end_date=2024-04-06 02:05:13.522464+00:00, run_duration=0.397969, state=success, executor_state=success, try_number=1, max_tries=1, job_id=125, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:05:11.394088+00:00, queued_by_job_id=2, pid=2900 2024-04-06T02:05:19.537250343Z [2024-04-06T02:05:19.536+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-06T02:06:00.926954820Z [2024-04-06T02:06:00.926+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:06:00.936165295Z [2024-04-06T02:06:00.935+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:06:00.948212181Z [2024-04-06T02:06:00.947+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:06:00+00:00, run_after=2024-04-06T02:07:00+00:00 2024-04-06T02:06:01.022353502Z [2024-04-06T02:06:01.021+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T02:06:01.022382202Z 2024-04-06T02:06:01.022388158Z 2024-04-06T02:06:01.022393079Z 2024-04-06T02:06:01.022495831Z [2024-04-06T02:06:01.022+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T02:06:01.022503905Z [2024-04-06T02:06:01.022+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:06:01.022508597Z [2024-04-06T02:06:01.022+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:06:01.023150540Z [2024-04-06T02:06:01.022+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:06:01.023198938Z 2024-04-06T02:06:01.023206726Z 2024-04-06T02:06:01.023213322Z 2024-04-06T02:06:01.026619253Z [2024-04-06T02:06:01.026+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:06:01.026753817Z [2024-04-06T02:06:01.026+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:06:01.026885193Z [2024-04-06T02:06:01.026+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:06:01.026989846Z [2024-04-06T02:06:01.026+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:06:01.027224097Z [2024-04-06T02:06:01.026+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:06:01.027336608Z [2024-04-06T02:06:01.027+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:06:01.472322995Z [2024-04-06T02:06:01.471+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:04:00+00:00 exited with status queued for try_number 1 2024-04-06T02:06:01.472407874Z [2024-04-06T02:06:01.472+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:05:00+00:00 exited with status queued for try_number 1 2024-04-06T02:06:01.472436737Z [2024-04-06T02:06:01.472+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:05:00+00:00 exited with status queued for try_number 1 2024-04-06T02:06:01.485367835Z [2024-04-06T02:06:01.485+0000] {scheduler_job.py:635} INFO - Setting external_id for to 438e81e1-d1f6-43d2-b8ef-15ebb7f1c43c 2024-04-06T02:06:01.485457642Z [2024-04-06T02:06:01.485+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1199f722-eb4d-42d3-a333-5e858e2691d4 2024-04-06T02:06:01.485554376Z [2024-04-06T02:06:01.485+0000] {scheduler_job.py:635} INFO - Setting external_id for to 502a324b-7ea7-4548-8a3f-8f6c1a1f7eb5 2024-04-06T02:06:03.067671160Z [2024-04-06T02:06:03.067+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:06:03.067900702Z [2024-04-06T02:06:03.067+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 02:04:00+00:00, run_id=scheduled__2024-04-06T02:04:00+00:00, run_start_date=2024-04-06 02:06:00.959533+00:00, run_end_date=2024-04-06 02:06:03.067587+00:00, run_duration=2.108054, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:04:00+00:00, data_interval_end=2024-04-06 02:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T02:06:03.083700160Z [2024-04-06T02:06:03.083+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T02:06:00+00:00, run_after=2024-04-06T02:08:00+00:00 2024-04-06T02:06:03.167453434Z [2024-04-06T02:06:03.167+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:04:00+00:00 exited with status success for try_number 1 2024-04-06T02:06:03.174092142Z [2024-04-06T02:06:03.173+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T02:04:00+00:00, map_index=-1, run_start_date=2024-04-06 02:06:01.900743+00:00, run_end_date=2024-04-06 02:06:02.801280+00:00, run_duration=0.900537, state=success, executor_state=success, try_number=1, max_tries=1, job_id=126, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:06:01.023866+00:00, queued_by_job_id=2, pid=2904 2024-04-06T02:06:06.482321096Z [2024-04-06T02:06:06.481+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:06:06.482460115Z [2024-04-06T02:06:06.482+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:05:00+00:00, run_id=scheduled__2024-04-06T02:05:00+00:00, run_start_date=2024-04-06 02:06:00.961863+00:00, run_end_date=2024-04-06 02:06:06.482166+00:00, run_duration=5.520303, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:05:00+00:00, data_interval_end=2024-04-06 02:06:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:06:06.492485593Z [2024-04-06T02:06:06.492+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:06:00+00:00, run_after=2024-04-06T02:07:00+00:00 2024-04-06T02:06:06.541888010Z [2024-04-06T02:06:06.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:05:00+00:00 exited with status success for try_number 1 2024-04-06T02:06:06.552851803Z [2024-04-06T02:06:06.552+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:05:00+00:00, map_index=-1, run_start_date=2024-04-06 02:06:03.638918+00:00, run_end_date=2024-04-06 02:06:05.876631+00:00, run_duration=2.237713, state=success, executor_state=success, try_number=1, max_tries=1, job_id=127, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:06:01.023866+00:00, queued_by_job_id=2, pid=2925 2024-04-06T02:06:07.634620657Z [2024-04-06T02:06:07.634+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:06:07.634955791Z [2024-04-06T02:06:07.634+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:05:00+00:00, run_id=scheduled__2024-04-06T02:05:00+00:00, run_start_date=2024-04-06 02:06:00.960773+00:00, run_end_date=2024-04-06 02:06:07.634484+00:00, run_duration=6.673711, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:05:00+00:00, data_interval_end=2024-04-06 02:06:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:06:07.648343401Z [2024-04-06T02:06:07.647+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:06:00+00:00, run_after=2024-04-06T02:07:00+00:00 2024-04-06T02:06:07.690541271Z [2024-04-06T02:06:07.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:05:00+00:00 exited with status success for try_number 1 2024-04-06T02:06:07.705068801Z [2024-04-06T02:06:07.704+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:05:00+00:00, map_index=-1, run_start_date=2024-04-06 02:06:04.110020+00:00, run_end_date=2024-04-06 02:06:06.871063+00:00, run_duration=2.761043, state=success, executor_state=success, try_number=1, max_tries=1, job_id=128, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:06:01.023866+00:00, queued_by_job_id=2, pid=2940 2024-04-06T02:07:00.370773296Z [2024-04-06T02:07:00.370+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:07:00+00:00, run_after=2024-04-06T02:08:00+00:00 2024-04-06T02:07:00.380900170Z [2024-04-06T02:07:00.380+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:07:00.450861155Z [2024-04-06T02:07:00.450+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T02:07:00.450906232Z 2024-04-06T02:07:00.450916244Z 2024-04-06T02:07:00.451956279Z [2024-04-06T02:07:00.451+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:07:00.455030380Z [2024-04-06T02:07:00.454+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:07:00.456674659Z [2024-04-06T02:07:00.456+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:07:00.456698432Z 2024-04-06T02:07:00.456707799Z 2024-04-06T02:07:00.465619156Z [2024-04-06T02:07:00.465+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:07:00.466016385Z [2024-04-06T02:07:00.465+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:07:00.467060412Z [2024-04-06T02:07:00.466+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:07:00.467421851Z [2024-04-06T02:07:00.467+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:07:00.619853508Z [2024-04-06T02:07:00.619+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:06:00+00:00 exited with status queued for try_number 1 2024-04-06T02:07:00.619875099Z [2024-04-06T02:07:00.619+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:06:00+00:00 exited with status queued for try_number 1 2024-04-06T02:07:00.626873440Z [2024-04-06T02:07:00.626+0000] {scheduler_job.py:635} INFO - Setting external_id for to bbb61cd0-56e7-48d0-8982-e8116f7d0ab8 2024-04-06T02:07:00.626898012Z [2024-04-06T02:07:00.626+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba6eb4d8-2c2a-4335-a32b-fa507bfaaf66 2024-04-06T02:07:04.830543942Z [2024-04-06T02:07:04.830+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:07:04.831165181Z [2024-04-06T02:07:04.830+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:06:00+00:00, run_id=scheduled__2024-04-06T02:06:00+00:00, run_start_date=2024-04-06 02:07:00.393563+00:00, run_end_date=2024-04-06 02:07:04.830479+00:00, run_duration=4.436916, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:06:00+00:00, data_interval_end=2024-04-06 02:07:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:07:04.843379423Z [2024-04-06T02:07:04.842+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:07:00+00:00, run_after=2024-04-06T02:08:00+00:00 2024-04-06T02:07:04.856022458Z [2024-04-06T02:07:04.855+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:07:04.858579417Z [2024-04-06T02:07:04.857+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:06:00+00:00, run_id=scheduled__2024-04-06T02:06:00+00:00, run_start_date=2024-04-06 02:07:00.394926+00:00, run_end_date=2024-04-06 02:07:04.855946+00:00, run_duration=4.46102, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:06:00+00:00, data_interval_end=2024-04-06 02:07:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:07:04.873847937Z [2024-04-06T02:07:04.873+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:07:00+00:00, run_after=2024-04-06T02:08:00+00:00 2024-04-06T02:07:04.905898958Z [2024-04-06T02:07:04.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:06:00+00:00 exited with status success for try_number 1 2024-04-06T02:07:04.906301645Z [2024-04-06T02:07:04.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:06:00+00:00 exited with status success for try_number 1 2024-04-06T02:07:04.920860094Z [2024-04-06T02:07:04.919+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:06:00+00:00, map_index=-1, run_start_date=2024-04-06 02:07:02.556620+00:00, run_end_date=2024-04-06 02:07:03.983227+00:00, run_duration=1.426607, state=success, executor_state=success, try_number=1, max_tries=1, job_id=129, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:07:00.458231+00:00, queued_by_job_id=2, pid=2989 2024-04-06T02:07:04.920875736Z [2024-04-06T02:07:04.919+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:06:00+00:00, map_index=-1, run_start_date=2024-04-06 02:07:02.566229+00:00, run_end_date=2024-04-06 02:07:04.476516+00:00, run_duration=1.910287, state=success, executor_state=success, try_number=1, max_tries=1, job_id=130, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:07:00.458231+00:00, queued_by_job_id=2, pid=2990 2024-04-06T02:08:00.753707598Z [2024-04-06T02:08:00.753+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:08:00.769706802Z [2024-04-06T02:08:00.768+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:08:00+00:00, run_after=2024-04-06T02:09:00+00:00 2024-04-06T02:08:00.775961837Z [2024-04-06T02:08:00.775+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:08:00.846422395Z [2024-04-06T02:08:00.845+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T02:08:00.846464057Z 2024-04-06T02:08:00.846471541Z 2024-04-06T02:08:00.846477984Z 2024-04-06T02:08:00.846856776Z [2024-04-06T02:08:00.846+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T02:08:00.847181518Z [2024-04-06T02:08:00.846+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:08:00.847386839Z [2024-04-06T02:08:00.847+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:08:00.848016001Z [2024-04-06T02:08:00.847+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:08:00.848066799Z 2024-04-06T02:08:00.848073329Z 2024-04-06T02:08:00.848079001Z 2024-04-06T02:08:00.851104434Z [2024-04-06T02:08:00.850+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:08:00.851354876Z [2024-04-06T02:08:00.851+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:08:00.851694895Z [2024-04-06T02:08:00.851+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:08:00.851899481Z [2024-04-06T02:08:00.851+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:08:00.852209821Z [2024-04-06T02:08:00.852+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:08:00.852433505Z [2024-04-06T02:08:00.852+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:08:01.264963921Z [2024-04-06T02:08:01.264+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:06:00+00:00 exited with status queued for try_number 1 2024-04-06T02:08:01.265437150Z [2024-04-06T02:08:01.264+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:07:00+00:00 exited with status queued for try_number 1 2024-04-06T02:08:01.265603270Z [2024-04-06T02:08:01.265+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:07:00+00:00 exited with status queued for try_number 1 2024-04-06T02:08:01.274157899Z [2024-04-06T02:08:01.273+0000] {scheduler_job.py:635} INFO - Setting external_id for to 45a01798-def8-4c9e-ab5c-60482cc241e7 2024-04-06T02:08:01.274338159Z [2024-04-06T02:08:01.274+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62074ad3-d3e4-4a9c-a514-a09c5a78afbc 2024-04-06T02:08:01.274477345Z [2024-04-06T02:08:01.274+0000] {scheduler_job.py:635} INFO - Setting external_id for to 70a3e78e-216c-48ce-b693-0a446e15aca2 2024-04-06T02:08:03.711292046Z [2024-04-06T02:08:03.710+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:08:03.714961954Z [2024-04-06T02:08:03.714+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 02:06:00+00:00, run_id=scheduled__2024-04-06T02:06:00+00:00, run_start_date=2024-04-06 02:08:00.784980+00:00, run_end_date=2024-04-06 02:08:03.714464+00:00, run_duration=2.929484, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:06:00+00:00, data_interval_end=2024-04-06 02:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T02:08:03.735163075Z [2024-04-06T02:08:03.734+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T02:08:00+00:00, run_after=2024-04-06T02:10:00+00:00 2024-04-06T02:08:03.793684675Z [2024-04-06T02:08:03.793+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:06:00+00:00 exited with status success for try_number 1 2024-04-06T02:08:03.799460188Z [2024-04-06T02:08:03.799+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T02:06:00+00:00, map_index=-1, run_start_date=2024-04-06 02:08:02.559770+00:00, run_end_date=2024-04-06 02:08:03.399456+00:00, run_duration=0.839686, state=success, executor_state=success, try_number=1, max_tries=1, job_id=131, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:08:00.848873+00:00, queued_by_job_id=2, pid=3026 2024-04-06T02:08:06.041089167Z [2024-04-06T02:08:06.040+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:08:06.041510953Z [2024-04-06T02:08:06.041+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:07:00+00:00, run_id=scheduled__2024-04-06T02:07:00+00:00, run_start_date=2024-04-06 02:08:00.787236+00:00, run_end_date=2024-04-06 02:08:06.041214+00:00, run_duration=5.253978, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:07:00+00:00, data_interval_end=2024-04-06 02:08:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:08:06.050159235Z [2024-04-06T02:08:06.049+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:08:00+00:00, run_after=2024-04-06T02:09:00+00:00 2024-04-06T02:08:06.055746524Z [2024-04-06T02:08:06.055+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:08:06.056129486Z [2024-04-06T02:08:06.055+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:07:00+00:00, run_id=scheduled__2024-04-06T02:07:00+00:00, run_start_date=2024-04-06 02:08:00.786176+00:00, run_end_date=2024-04-06 02:08:06.055852+00:00, run_duration=5.269676, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:07:00+00:00, data_interval_end=2024-04-06 02:08:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:08:06.064885824Z [2024-04-06T02:08:06.064+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:08:00+00:00, run_after=2024-04-06T02:09:00+00:00 2024-04-06T02:08:06.100435673Z [2024-04-06T02:08:06.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:07:00+00:00 exited with status success for try_number 1 2024-04-06T02:08:06.107629649Z [2024-04-06T02:08:06.107+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:07:00+00:00, map_index=-1, run_start_date=2024-04-06 02:08:03.444888+00:00, run_end_date=2024-04-06 02:08:05.354086+00:00, run_duration=1.909198, state=success, executor_state=success, try_number=1, max_tries=1, job_id=132, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:08:00.848873+00:00, queued_by_job_id=2, pid=3045 2024-04-06T02:08:07.202752699Z [2024-04-06T02:08:07.202+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:07:00+00:00 exited with status success for try_number 1 2024-04-06T02:08:07.209977987Z [2024-04-06T02:08:07.209+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:07:00+00:00, map_index=-1, run_start_date=2024-04-06 02:08:04.463942+00:00, run_end_date=2024-04-06 02:08:05.958281+00:00, run_duration=1.494339, state=success, executor_state=success, try_number=1, max_tries=1, job_id=133, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:08:00.848873+00:00, queued_by_job_id=2, pid=3065 2024-04-06T02:09:00.823755134Z [2024-04-06T02:09:00.823+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:09:00+00:00, run_after=2024-04-06T02:10:00+00:00 2024-04-06T02:09:00.832330155Z [2024-04-06T02:09:00.832+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:09:00.921448882Z [2024-04-06T02:09:00.920+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T02:09:00.921482622Z 2024-04-06T02:09:00.921486114Z 2024-04-06T02:09:00.922482907Z [2024-04-06T02:09:00.921+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:09:00.923572447Z [2024-04-06T02:09:00.922+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:09:00.925796352Z [2024-04-06T02:09:00.925+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:09:00.925808246Z 2024-04-06T02:09:00.925826682Z 2024-04-06T02:09:00.938596866Z [2024-04-06T02:09:00.937+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:09:00.939001082Z [2024-04-06T02:09:00.938+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:09:00.939445379Z [2024-04-06T02:09:00.939+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:09:00.939707220Z [2024-04-06T02:09:00.939+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:09:01.153005106Z [2024-04-06T02:09:01.152+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:08:00+00:00 exited with status queued for try_number 1 2024-04-06T02:09:01.153037676Z [2024-04-06T02:09:01.152+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:08:00+00:00 exited with status queued for try_number 1 2024-04-06T02:09:01.160449429Z [2024-04-06T02:09:01.160+0000] {scheduler_job.py:635} INFO - Setting external_id for to d8bcea56-1972-493c-a22b-ce245f871fc9 2024-04-06T02:09:01.160523223Z [2024-04-06T02:09:01.160+0000] {scheduler_job.py:635} INFO - Setting external_id for to d63d04fd-37e1-472b-b817-d4feda8f40e4 2024-04-06T02:09:05.989995654Z [2024-04-06T02:09:05.989+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:09:05.991477226Z [2024-04-06T02:09:05.990+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:08:00+00:00, run_id=scheduled__2024-04-06T02:08:00+00:00, run_start_date=2024-04-06 02:09:00.846203+00:00, run_end_date=2024-04-06 02:09:05.989873+00:00, run_duration=5.14367, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:08:00+00:00, data_interval_end=2024-04-06 02:09:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:09:06.014964825Z [2024-04-06T02:09:06.014+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:09:00+00:00, run_after=2024-04-06T02:10:00+00:00 2024-04-06T02:09:06.033268204Z [2024-04-06T02:09:06.032+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:09:06.033727736Z [2024-04-06T02:09:06.033+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:08:00+00:00, run_id=scheduled__2024-04-06T02:08:00+00:00, run_start_date=2024-04-06 02:09:00.847914+00:00, run_end_date=2024-04-06 02:09:06.033332+00:00, run_duration=5.185418, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:08:00+00:00, data_interval_end=2024-04-06 02:09:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:09:06.045396022Z [2024-04-06T02:09:06.045+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:09:00+00:00, run_after=2024-04-06T02:10:00+00:00 2024-04-06T02:09:06.092261259Z [2024-04-06T02:09:06.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:08:00+00:00 exited with status success for try_number 1 2024-04-06T02:09:06.092705935Z [2024-04-06T02:09:06.092+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:08:00+00:00 exited with status success for try_number 1 2024-04-06T02:09:06.105646102Z [2024-04-06T02:09:06.105+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:08:00+00:00, map_index=-1, run_start_date=2024-04-06 02:09:03.235824+00:00, run_end_date=2024-04-06 02:09:05.223556+00:00, run_duration=1.987732, state=success, executor_state=success, try_number=1, max_tries=1, job_id=135, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:09:00.928240+00:00, queued_by_job_id=2, pid=3112 2024-04-06T02:09:06.106803403Z [2024-04-06T02:09:06.106+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:08:00+00:00, map_index=-1, run_start_date=2024-04-06 02:09:02.966493+00:00, run_end_date=2024-04-06 02:09:05.582910+00:00, run_duration=2.616417, state=success, executor_state=success, try_number=1, max_tries=1, job_id=134, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:09:00.928240+00:00, queued_by_job_id=2, pid=3111 2024-04-06T02:10:00.448887238Z [2024-04-06T02:10:00.447+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:10:00+00:00, run_after=2024-04-06T02:11:00+00:00 2024-04-06T02:10:00.458950794Z [2024-04-06T02:10:00.458+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:10:00.467916544Z [2024-04-06T02:10:00.467+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:10:00.481172281Z [2024-04-06T02:10:00.480+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:10:00+00:00, run_after=2024-04-06T02:15:00+00:00 2024-04-06T02:10:00.612074704Z [2024-04-06T02:10:00.611+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-06T02:10:00.612116148Z 2024-04-06T02:10:00.612119903Z 2024-04-06T02:10:00.612124653Z 2024-04-06T02:10:00.612127882Z 2024-04-06T02:10:00.612138993Z [2024-04-06T02:10:00.611+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:10:00.612393115Z [2024-04-06T02:10:00.612+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T02:10:00.612626943Z [2024-04-06T02:10:00.612+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:10:00.612829683Z [2024-04-06T02:10:00.612+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:10:00.613706449Z [2024-04-06T02:10:00.613+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:10:00.613722496Z 2024-04-06T02:10:00.613727879Z 2024-04-06T02:10:00.613732563Z 2024-04-06T02:10:00.613737205Z 2024-04-06T02:10:00.618485763Z [2024-04-06T02:10:00.618+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-06T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-06T02:10:00.618908429Z [2024-04-06T02:10:00.618+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:10:00.619213402Z [2024-04-06T02:10:00.618+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:10:00.619459922Z [2024-04-06T02:10:00.619+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:10:00.619873068Z [2024-04-06T02:10:00.619+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:10:00.620239676Z [2024-04-06T02:10:00.619+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:10:00.620530893Z [2024-04-06T02:10:00.620+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:10:00.620754086Z [2024-04-06T02:10:00.620+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:10:01.126578829Z [2024-04-06T02:10:01.126+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T02:05:00+00:00 exited with status queued for try_number 1 2024-04-06T02:10:01.126649423Z [2024-04-06T02:10:01.126+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:08:00+00:00 exited with status queued for try_number 1 2024-04-06T02:10:01.126733923Z [2024-04-06T02:10:01.126+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:09:00+00:00 exited with status queued for try_number 1 2024-04-06T02:10:01.126740181Z [2024-04-06T02:10:01.126+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:09:00+00:00 exited with status queued for try_number 1 2024-04-06T02:10:01.167226198Z [2024-04-06T02:10:01.166+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1969ce0-04e7-4b5b-917c-c3193c9142ec 2024-04-06T02:10:01.167278015Z [2024-04-06T02:10:01.167+0000] {scheduler_job.py:635} INFO - Setting external_id for to 829e865d-fd5e-4d73-9b80-b104efb63959 2024-04-06T02:10:01.167354743Z [2024-04-06T02:10:01.167+0000] {scheduler_job.py:635} INFO - Setting external_id for to b1a47408-d824-4404-a17b-4be9092a611c 2024-04-06T02:10:01.167451448Z [2024-04-06T02:10:01.167+0000] {scheduler_job.py:635} INFO - Setting external_id for to 82457bf8-87ab-48d5-a10e-44b6aa3710db 2024-04-06T02:10:04.543187983Z [2024-04-06T02:10:04.542+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:10:04.546381057Z [2024-04-06T02:10:04.546+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 02:08:00+00:00, run_id=scheduled__2024-04-06T02:08:00+00:00, run_start_date=2024-04-06 02:10:00.497694+00:00, run_end_date=2024-04-06 02:10:04.545942+00:00, run_duration=4.048248, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:08:00+00:00, data_interval_end=2024-04-06 02:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T02:10:04.563510825Z [2024-04-06T02:10:04.563+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T02:10:00+00:00, run_after=2024-04-06T02:12:00+00:00 2024-04-06T02:10:04.636405880Z [2024-04-06T02:10:04.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:08:00+00:00 exited with status success for try_number 1 2024-04-06T02:10:04.641300731Z [2024-04-06T02:10:04.640+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T02:08:00+00:00, map_index=-1, run_start_date=2024-04-06 02:10:02.676224+00:00, run_end_date=2024-04-06 02:10:04.225601+00:00, run_duration=1.549377, state=success, executor_state=success, try_number=1, max_tries=1, job_id=136, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:10:00.615016+00:00, queued_by_job_id=2, pid=3149 2024-04-06T02:10:06.369008118Z [2024-04-06T02:10:06.368+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:10:06.369044399Z 2024-04-06T02:10:06.369387549Z [2024-04-06T02:10:06.369+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:10:06.370538418Z [2024-04-06T02:10:06.370+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:10:06.370557381Z 2024-04-06T02:10:06.373571332Z [2024-04-06T02:10:06.373+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='split_metrics', run_id='scheduled__2024-04-06T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-06T02:10:06.374095767Z [2024-04-06T02:10:06.373+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:10:06.434758827Z [2024-04-06T02:10:06.433+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T02:05:00+00:00 exited with status queued for try_number 1 2024-04-06T02:10:06.435124944Z [2024-04-06T02:10:06.434+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T02:05:00+00:00 exited with status success for try_number 1 2024-04-06T02:10:06.442042468Z [2024-04-06T02:10:06.441+0000] {scheduler_job.py:635} INFO - Setting external_id for to f940cf7b-d2f8-44c4-99d1-d4c0cbe5f1d2 2024-04-06T02:10:06.442416524Z [2024-04-06T02:10:06.442+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-06T02:05:00+00:00, map_index=-1, run_start_date=2024-04-06 02:10:05.156298+00:00, run_end_date=2024-04-06 02:10:05.730765+00:00, run_duration=0.574467, state=success, executor_state=success, try_number=1, max_tries=1, job_id=138, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:10:00.615016+00:00, queued_by_job_id=2, pid=3179 2024-04-06T02:10:08.744892706Z [2024-04-06T02:10:08.744+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:10:08.745094984Z [2024-04-06T02:10:08.744+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:09:00+00:00, run_id=scheduled__2024-04-06T02:09:00+00:00, run_start_date=2024-04-06 02:10:00.499304+00:00, run_end_date=2024-04-06 02:10:08.744759+00:00, run_duration=8.245455, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:09:00+00:00, data_interval_end=2024-04-06 02:10:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:10:08.754458984Z [2024-04-06T02:10:08.754+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:10:00+00:00, run_after=2024-04-06T02:11:00+00:00 2024-04-06T02:10:08.762828503Z [2024-04-06T02:10:08.762+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:10:08.763015248Z [2024-04-06T02:10:08.762+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:09:00+00:00, run_id=scheduled__2024-04-06T02:09:00+00:00, run_start_date=2024-04-06 02:10:00.500598+00:00, run_end_date=2024-04-06 02:10:08.762657+00:00, run_duration=8.262059, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:09:00+00:00, data_interval_end=2024-04-06 02:10:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:10:08.772450793Z [2024-04-06T02:10:08.772+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:10:00+00:00, run_after=2024-04-06T02:11:00+00:00 2024-04-06T02:10:08.805124201Z [2024-04-06T02:10:08.804+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:10:08.805161395Z 2024-04-06T02:10:08.805319476Z [2024-04-06T02:10:08.804+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:10:08.806160690Z [2024-04-06T02:10:08.805+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:10:08.806178472Z 2024-04-06T02:10:08.818910355Z [2024-04-06T02:10:08.815+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='collect_metrics', run_id='scheduled__2024-04-06T02:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-06T02:10:08.818934240Z [2024-04-06T02:10:08.816+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T02:10:08.872741193Z [2024-04-06T02:10:08.872+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T02:05:00+00:00 exited with status queued for try_number 1 2024-04-06T02:10:08.872843969Z [2024-04-06T02:10:08.872+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:09:00+00:00 exited with status success for try_number 1 2024-04-06T02:10:08.872862679Z [2024-04-06T02:10:08.872+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:09:00+00:00 exited with status success for try_number 1 2024-04-06T02:10:08.872917746Z [2024-04-06T02:10:08.872+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T02:05:00+00:00 exited with status success for try_number 1 2024-04-06T02:10:08.884595336Z [2024-04-06T02:10:08.884+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:09:00+00:00, map_index=-1, run_start_date=2024-04-06 02:10:05.885037+00:00, run_end_date=2024-04-06 02:10:08.044506+00:00, run_duration=2.159469, state=success, executor_state=success, try_number=1, max_tries=1, job_id=139, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:10:00.615016+00:00, queued_by_job_id=2, pid=3208 2024-04-06T02:10:08.885793758Z [2024-04-06T02:10:08.885+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=split_metrics, run_id=scheduled__2024-04-06T02:05:00+00:00, map_index=-1, run_start_date=2024-04-06 02:10:08.013963+00:00, run_end_date=2024-04-06 02:10:08.628166+00:00, run_duration=0.614203, state=success, executor_state=success, try_number=1, max_tries=1, job_id=140, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:10:06.371187+00:00, queued_by_job_id=2, pid=3228 2024-04-06T02:10:08.886508899Z [2024-04-06T02:10:08.886+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ea63718-e06e-49b2-b86e-425f37ae4893 2024-04-06T02:10:08.887157516Z [2024-04-06T02:10:08.886+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:09:00+00:00, map_index=-1, run_start_date=2024-04-06 02:10:05.201606+00:00, run_end_date=2024-04-06 02:10:08.327286+00:00, run_duration=3.12568, state=success, executor_state=success, try_number=1, max_tries=1, job_id=137, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:10:00.615016+00:00, queued_by_job_id=2, pid=3180 2024-04-06T02:10:11.543127107Z [2024-04-06T02:10:11.542+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:10:11.543161081Z 2024-04-06T02:10:11.543621540Z [2024-04-06T02:10:11.543+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:10:11.545208429Z [2024-04-06T02:10:11.544+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:10:11.545218524Z 2024-04-06T02:10:11.549329185Z [2024-04-06T02:10:11.548+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='send_prometheus', run_id='scheduled__2024-04-06T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:10:11.549782072Z [2024-04-06T02:10:11.549+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:10:11.631681366Z [2024-04-06T02:10:11.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T02:05:00+00:00 exited with status queued for try_number 1 2024-04-06T02:10:11.631714450Z [2024-04-06T02:10:11.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T02:05:00+00:00 exited with status success for try_number 1 2024-04-06T02:10:11.638804813Z [2024-04-06T02:10:11.638+0000] {scheduler_job.py:635} INFO - Setting external_id for to edb1d474-fe6d-467a-bf8c-7b7a6279cc06 2024-04-06T02:10:11.638996749Z [2024-04-06T02:10:11.638+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=collect_metrics, run_id=scheduled__2024-04-06T02:05:00+00:00, map_index=0, run_start_date=2024-04-06 02:10:10.490871+00:00, run_end_date=2024-04-06 02:10:10.867943+00:00, run_duration=0.377072, state=success, executor_state=success, try_number=1, max_tries=1, job_id=141, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:10:08.806645+00:00, queued_by_job_id=2, pid=3249 2024-04-06T02:10:13.954559157Z [2024-04-06T02:10:13.953+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:10:13.955195116Z [2024-04-06T02:10:13.954+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:05:00+00:00, run_id=scheduled__2024-04-06T02:05:00+00:00, run_start_date=2024-04-06 02:10:00.495857+00:00, run_end_date=2024-04-06 02:10:13.954350+00:00, run_duration=13.458493, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:05:00+00:00, data_interval_end=2024-04-06 02:10:00+00:00, dag_hash=eecc559ff32fe9a7c4345875f113a0a9 2024-04-06T02:10:13.966069085Z [2024-04-06T02:10:13.965+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:10:00+00:00, run_after=2024-04-06T02:15:00+00:00 2024-04-06T02:10:14.013990422Z [2024-04-06T02:10:14.013+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T02:05:00+00:00 exited with status success for try_number 1 2024-04-06T02:10:14.026019775Z [2024-04-06T02:10:14.025+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=send_prometheus, run_id=scheduled__2024-04-06T02:05:00+00:00, map_index=-1, run_start_date=2024-04-06 02:10:13.259302+00:00, run_end_date=2024-04-06 02:10:13.700234+00:00, run_duration=0.440932, state=success, executor_state=success, try_number=1, max_tries=1, job_id=142, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:10:11.545985+00:00, queued_by_job_id=2, pid=3264 2024-04-06T02:10:19.560258815Z [2024-04-06T02:10:19.559+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-06T02:11:00.841614718Z [2024-04-06T02:11:00.841+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:11:00+00:00, run_after=2024-04-06T02:12:00+00:00 2024-04-06T02:11:00.851453783Z [2024-04-06T02:11:00.851+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:11:00.934443209Z [2024-04-06T02:11:00.933+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T02:11:00.934481687Z 2024-04-06T02:11:00.934489230Z 2024-04-06T02:11:00.934616972Z [2024-04-06T02:11:00.934+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:11:00.936509948Z [2024-04-06T02:11:00.934+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:11:00.938397279Z [2024-04-06T02:11:00.937+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:11:00.938428525Z 2024-04-06T02:11:00.938435708Z 2024-04-06T02:11:00.944576933Z [2024-04-06T02:11:00.944+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:11:00.944621479Z [2024-04-06T02:11:00.944+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:11:00.945208836Z [2024-04-06T02:11:00.944+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:11:00.945380146Z [2024-04-06T02:11:00.945+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:11:01.190905104Z [2024-04-06T02:11:01.190+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:10:00+00:00 exited with status queued for try_number 1 2024-04-06T02:11:01.191032313Z [2024-04-06T02:11:01.190+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:10:00+00:00 exited with status queued for try_number 1 2024-04-06T02:11:01.206177554Z [2024-04-06T02:11:01.205+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71ac8565-a16b-47ec-8bfc-e78cc977f9e1 2024-04-06T02:11:01.206507532Z [2024-04-06T02:11:01.206+0000] {scheduler_job.py:635} INFO - Setting external_id for to f619ef5b-4474-496b-902b-7d2b69621f71 2024-04-06T02:11:05.942334771Z [2024-04-06T02:11:05.941+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:11:05.942453837Z [2024-04-06T02:11:05.942+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:10:00+00:00, run_id=scheduled__2024-04-06T02:10:00+00:00, run_start_date=2024-04-06 02:11:00.865302+00:00, run_end_date=2024-04-06 02:11:05.942018+00:00, run_duration=5.076716, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:10:00+00:00, data_interval_end=2024-04-06 02:11:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:11:05.953099666Z [2024-04-06T02:11:05.952+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:11:00+00:00, run_after=2024-04-06T02:12:00+00:00 2024-04-06T02:11:05.963259681Z [2024-04-06T02:11:05.962+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:11:05.964316987Z [2024-04-06T02:11:05.963+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:10:00+00:00, run_id=scheduled__2024-04-06T02:10:00+00:00, run_start_date=2024-04-06 02:11:00.867255+00:00, run_end_date=2024-04-06 02:11:05.963047+00:00, run_duration=5.095792, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:10:00+00:00, data_interval_end=2024-04-06 02:11:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:11:05.985044622Z [2024-04-06T02:11:05.984+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:11:00+00:00, run_after=2024-04-06T02:12:00+00:00 2024-04-06T02:11:06.030954645Z [2024-04-06T02:11:06.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:10:00+00:00 exited with status success for try_number 1 2024-04-06T02:11:06.030979213Z [2024-04-06T02:11:06.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:10:00+00:00 exited with status success for try_number 1 2024-04-06T02:11:06.038320688Z [2024-04-06T02:11:06.037+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:10:00+00:00, map_index=-1, run_start_date=2024-04-06 02:11:03.227565+00:00, run_end_date=2024-04-06 02:11:05.100817+00:00, run_duration=1.873252, state=success, executor_state=success, try_number=1, max_tries=1, job_id=144, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:11:00.939964+00:00, queued_by_job_id=2, pid=3288 2024-04-06T02:11:06.038412426Z [2024-04-06T02:11:06.038+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:10:00+00:00, map_index=-1, run_start_date=2024-04-06 02:11:03.061060+00:00, run_end_date=2024-04-06 02:11:05.183220+00:00, run_duration=2.12216, state=success, executor_state=success, try_number=1, max_tries=1, job_id=143, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:11:00.939964+00:00, queued_by_job_id=2, pid=3287 2024-04-06T02:12:00.152987228Z [2024-04-06T02:12:00.151+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:12:00.168734267Z [2024-04-06T02:12:00.168+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:12:00.184486769Z [2024-04-06T02:12:00.182+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:12:00+00:00, run_after=2024-04-06T02:13:00+00:00 2024-04-06T02:12:00.260377773Z [2024-04-06T02:12:00.259+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T02:12:00.260431446Z 2024-04-06T02:12:00.260439175Z 2024-04-06T02:12:00.260445585Z 2024-04-06T02:12:00.260992193Z [2024-04-06T02:12:00.260+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T02:12:00.261445755Z [2024-04-06T02:12:00.261+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:12:00.262235621Z [2024-04-06T02:12:00.262+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:12:00.263109573Z [2024-04-06T02:12:00.262+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:12:00.263123231Z 2024-04-06T02:12:00.263178696Z 2024-04-06T02:12:00.263183166Z 2024-04-06T02:12:00.267223483Z [2024-04-06T02:12:00.266+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:12:00.267521478Z [2024-04-06T02:12:00.267+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:12:00.267861029Z [2024-04-06T02:12:00.267+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:12:00.268158025Z [2024-04-06T02:12:00.267+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:12:00.268563317Z [2024-04-06T02:12:00.268+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:12:00.268741735Z [2024-04-06T02:12:00.268+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:12:00.468812728Z [2024-04-06T02:12:00.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:10:00+00:00 exited with status queued for try_number 1 2024-04-06T02:12:00.468903703Z [2024-04-06T02:12:00.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:11:00+00:00 exited with status queued for try_number 1 2024-04-06T02:12:00.469010756Z [2024-04-06T02:12:00.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:11:00+00:00 exited with status queued for try_number 1 2024-04-06T02:12:00.477462937Z [2024-04-06T02:12:00.477+0000] {scheduler_job.py:635} INFO - Setting external_id for to 964d5f56-876c-4549-9e12-a21e074ce7d7 2024-04-06T02:12:00.477818143Z [2024-04-06T02:12:00.477+0000] {scheduler_job.py:635} INFO - Setting external_id for to 92aedbf6-4ccd-46d1-9519-499b8851c56f 2024-04-06T02:12:00.478041828Z [2024-04-06T02:12:00.477+0000] {scheduler_job.py:635} INFO - Setting external_id for to 86408658-3327-488e-9e78-d48df1c71810 2024-04-06T02:12:02.853403409Z [2024-04-06T02:12:02.852+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:12:02.854034926Z [2024-04-06T02:12:02.853+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 02:10:00+00:00, run_id=scheduled__2024-04-06T02:10:00+00:00, run_start_date=2024-04-06 02:12:00.198489+00:00, run_end_date=2024-04-06 02:12:02.853597+00:00, run_duration=2.655108, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:10:00+00:00, data_interval_end=2024-04-06 02:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T02:12:02.866200392Z [2024-04-06T02:12:02.865+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T02:12:00+00:00, run_after=2024-04-06T02:14:00+00:00 2024-04-06T02:12:02.927898961Z [2024-04-06T02:12:02.927+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:10:00+00:00 exited with status success for try_number 1 2024-04-06T02:12:02.933409284Z [2024-04-06T02:12:02.933+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T02:10:00+00:00, map_index=-1, run_start_date=2024-04-06 02:12:01.203979+00:00, run_end_date=2024-04-06 02:12:01.875098+00:00, run_duration=0.671119, state=success, executor_state=success, try_number=1, max_tries=1, job_id=145, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:12:00.264036+00:00, queued_by_job_id=2, pid=3323 2024-04-06T02:12:04.042967211Z [2024-04-06T02:12:04.042+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:12:04.043662908Z [2024-04-06T02:12:04.043+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:11:00+00:00, run_id=scheduled__2024-04-06T02:11:00+00:00, run_start_date=2024-04-06 02:12:00.201073+00:00, run_end_date=2024-04-06 02:12:04.042853+00:00, run_duration=3.84178, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:11:00+00:00, data_interval_end=2024-04-06 02:12:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:12:04.064138722Z [2024-04-06T02:12:04.063+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:12:00+00:00, run_after=2024-04-06T02:13:00+00:00 2024-04-06T02:12:05.179602847Z [2024-04-06T02:12:05.179+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:12:05.180178947Z [2024-04-06T02:12:05.179+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:11:00+00:00, run_id=scheduled__2024-04-06T02:11:00+00:00, run_start_date=2024-04-06 02:12:00.199865+00:00, run_end_date=2024-04-06 02:12:05.179497+00:00, run_duration=4.979632, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:11:00+00:00, data_interval_end=2024-04-06 02:12:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:12:05.189750959Z [2024-04-06T02:12:05.189+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:12:00+00:00, run_after=2024-04-06T02:13:00+00:00 2024-04-06T02:12:05.226084688Z [2024-04-06T02:12:05.225+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:11:00+00:00 exited with status success for try_number 1 2024-04-06T02:12:05.226840934Z [2024-04-06T02:12:05.226+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:11:00+00:00 exited with status success for try_number 1 2024-04-06T02:12:05.238752603Z [2024-04-06T02:12:05.238+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:11:00+00:00, map_index=-1, run_start_date=2024-04-06 02:12:02.471706+00:00, run_end_date=2024-04-06 02:12:03.966443+00:00, run_duration=1.494737, state=success, executor_state=success, try_number=1, max_tries=1, job_id=146, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:12:00.264036+00:00, queued_by_job_id=2, pid=3354 2024-04-06T02:12:05.239326231Z [2024-04-06T02:12:05.239+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:11:00+00:00, map_index=-1, run_start_date=2024-04-06 02:12:02.494616+00:00, run_end_date=2024-04-06 02:12:04.558150+00:00, run_duration=2.063534, state=success, executor_state=success, try_number=1, max_tries=1, job_id=147, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:12:00.264036+00:00, queued_by_job_id=2, pid=3353 2024-04-06T02:13:00.361363827Z [2024-04-06T02:13:00.360+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:13:00+00:00, run_after=2024-04-06T02:14:00+00:00 2024-04-06T02:13:00.372609056Z [2024-04-06T02:13:00.372+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:13:00.459880705Z [2024-04-06T02:13:00.459+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T02:13:00.459930850Z 2024-04-06T02:13:00.459937982Z 2024-04-06T02:13:00.459999549Z [2024-04-06T02:13:00.459+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:13:00.460310179Z [2024-04-06T02:13:00.459+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:13:00.461368942Z [2024-04-06T02:13:00.461+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:13:00.461380027Z 2024-04-06T02:13:00.461386197Z 2024-04-06T02:13:00.466908000Z [2024-04-06T02:13:00.466+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:13:00.467119113Z [2024-04-06T02:13:00.466+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:13:00.467739370Z [2024-04-06T02:13:00.467+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:13:00.468013911Z [2024-04-06T02:13:00.467+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:13:00.731762963Z [2024-04-06T02:13:00.730+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:12:00+00:00 exited with status queued for try_number 1 2024-04-06T02:13:00.731788015Z [2024-04-06T02:13:00.730+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:12:00+00:00 exited with status queued for try_number 1 2024-04-06T02:13:00.739263154Z [2024-04-06T02:13:00.736+0000] {scheduler_job.py:635} INFO - Setting external_id for to 233d2a11-c2a4-452b-ac2d-28ca6450645f 2024-04-06T02:13:00.739278094Z [2024-04-06T02:13:00.737+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0378c7f1-87f4-403f-9f83-729c7722073b 2024-04-06T02:13:05.482393736Z [2024-04-06T02:13:05.481+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:13:05.483117166Z [2024-04-06T02:13:05.482+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:12:00+00:00, run_id=scheduled__2024-04-06T02:12:00+00:00, run_start_date=2024-04-06 02:13:00.383995+00:00, run_end_date=2024-04-06 02:13:05.482265+00:00, run_duration=5.09827, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:12:00+00:00, data_interval_end=2024-04-06 02:13:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:13:05.496297214Z [2024-04-06T02:13:05.495+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:13:00+00:00, run_after=2024-04-06T02:14:00+00:00 2024-04-06T02:13:05.548012409Z [2024-04-06T02:13:05.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:12:00+00:00 exited with status success for try_number 1 2024-04-06T02:13:05.559129719Z [2024-04-06T02:13:05.558+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:12:00+00:00, map_index=-1, run_start_date=2024-04-06 02:13:02.841874+00:00, run_end_date=2024-04-06 02:13:04.817099+00:00, run_duration=1.975225, state=success, executor_state=success, try_number=1, max_tries=1, job_id=148, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:13:00.462848+00:00, queued_by_job_id=2, pid=3408 2024-04-06T02:13:06.616357338Z [2024-04-06T02:13:06.615+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:13:06.616933015Z [2024-04-06T02:13:06.616+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:12:00+00:00, run_id=scheduled__2024-04-06T02:12:00+00:00, run_start_date=2024-04-06 02:13:00.385284+00:00, run_end_date=2024-04-06 02:13:06.616466+00:00, run_duration=6.231182, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:12:00+00:00, data_interval_end=2024-04-06 02:13:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:13:06.639100379Z [2024-04-06T02:13:06.638+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:13:00+00:00, run_after=2024-04-06T02:14:00+00:00 2024-04-06T02:13:06.697093871Z [2024-04-06T02:13:06.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:12:00+00:00 exited with status success for try_number 1 2024-04-06T02:13:06.705270466Z [2024-04-06T02:13:06.704+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:12:00+00:00, map_index=-1, run_start_date=2024-04-06 02:13:03.150179+00:00, run_end_date=2024-04-06 02:13:05.874793+00:00, run_duration=2.724614, state=success, executor_state=success, try_number=1, max_tries=1, job_id=149, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:13:00.462848+00:00, queued_by_job_id=2, pid=3409 2024-04-06T02:14:00.191278814Z [2024-04-06T02:14:00.190+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:14:00.205847364Z [2024-04-06T02:14:00.205+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:14:00.219933676Z [2024-04-06T02:14:00.219+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:14:00+00:00, run_after=2024-04-06T02:15:00+00:00 2024-04-06T02:14:00.318290326Z [2024-04-06T02:14:00.317+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T02:14:00.318336235Z 2024-04-06T02:14:00.318374933Z 2024-04-06T02:14:00.318385222Z 2024-04-06T02:14:00.318416685Z [2024-04-06T02:14:00.318+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T02:14:00.318720603Z [2024-04-06T02:14:00.318+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:14:00.318911173Z [2024-04-06T02:14:00.318+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:14:00.319781044Z [2024-04-06T02:14:00.319+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:14:00.319798030Z 2024-04-06T02:14:00.319831197Z 2024-04-06T02:14:00.319839382Z 2024-04-06T02:14:00.324239514Z [2024-04-06T02:14:00.323+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:14:00.324351729Z [2024-04-06T02:14:00.324+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:14:00.324623038Z [2024-04-06T02:14:00.324+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:14:00.324872526Z [2024-04-06T02:14:00.324+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:14:00.325132777Z [2024-04-06T02:14:00.324+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:14:00.325263744Z [2024-04-06T02:14:00.325+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:14:00.558448184Z [2024-04-06T02:14:00.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:12:00+00:00 exited with status queued for try_number 1 2024-04-06T02:14:00.558806502Z [2024-04-06T02:14:00.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:13:00+00:00 exited with status queued for try_number 1 2024-04-06T02:14:00.559076280Z [2024-04-06T02:14:00.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:13:00+00:00 exited with status queued for try_number 1 2024-04-06T02:14:00.566683248Z [2024-04-06T02:14:00.566+0000] {scheduler_job.py:635} INFO - Setting external_id for to 522b7e07-8587-40f6-8b27-c57d13569d54 2024-04-06T02:14:00.567260542Z [2024-04-06T02:14:00.567+0000] {scheduler_job.py:635} INFO - Setting external_id for to c499586a-b1d7-49f6-98bb-8f9eb093a45b 2024-04-06T02:14:00.567523544Z [2024-04-06T02:14:00.567+0000] {scheduler_job.py:635} INFO - Setting external_id for to b4a425c2-c54e-4508-b6ef-76d986c1ced2 2024-04-06T02:14:02.390480173Z [2024-04-06T02:14:02.390+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:14:02.391114614Z [2024-04-06T02:14:02.390+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 02:12:00+00:00, run_id=scheduled__2024-04-06T02:12:00+00:00, run_start_date=2024-04-06 02:14:00.233215+00:00, run_end_date=2024-04-06 02:14:02.390717+00:00, run_duration=2.157502, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:12:00+00:00, data_interval_end=2024-04-06 02:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T02:14:02.405121140Z [2024-04-06T02:14:02.404+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T02:14:00+00:00, run_after=2024-04-06T02:16:00+00:00 2024-04-06T02:14:02.479623633Z [2024-04-06T02:14:02.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:12:00+00:00 exited with status success for try_number 1 2024-04-06T02:14:02.490811316Z [2024-04-06T02:14:02.490+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T02:12:00+00:00, map_index=-1, run_start_date=2024-04-06 02:14:01.461554+00:00, run_end_date=2024-04-06 02:14:01.865057+00:00, run_duration=0.403503, state=success, executor_state=success, try_number=1, max_tries=1, job_id=150, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:14:00.320698+00:00, queued_by_job_id=2, pid=3444 2024-04-06T02:14:04.692937858Z [2024-04-06T02:14:04.692+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:14:04.701984267Z [2024-04-06T02:14:04.701+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:13:00+00:00, run_id=scheduled__2024-04-06T02:13:00+00:00, run_start_date=2024-04-06 02:14:00.234662+00:00, run_end_date=2024-04-06 02:14:04.701186+00:00, run_duration=4.466524, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:13:00+00:00, data_interval_end=2024-04-06 02:14:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:14:04.717154539Z [2024-04-06T02:14:04.716+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:14:00+00:00, run_after=2024-04-06T02:15:00+00:00 2024-04-06T02:14:04.764130881Z [2024-04-06T02:14:04.763+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:13:00+00:00 exited with status success for try_number 1 2024-04-06T02:14:04.769083562Z [2024-04-06T02:14:04.768+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:13:00+00:00, map_index=-1, run_start_date=2024-04-06 02:14:02.972586+00:00, run_end_date=2024-04-06 02:14:04.515444+00:00, run_duration=1.542858, state=success, executor_state=success, try_number=1, max_tries=1, job_id=151, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:14:00.320698+00:00, queued_by_job_id=2, pid=3474 2024-04-06T02:14:05.670808803Z [2024-04-06T02:14:05.670+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:14:05.671178719Z [2024-04-06T02:14:05.670+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:13:00+00:00, run_id=scheduled__2024-04-06T02:13:00+00:00, run_start_date=2024-04-06 02:14:00.235875+00:00, run_end_date=2024-04-06 02:14:05.670707+00:00, run_duration=5.434832, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:13:00+00:00, data_interval_end=2024-04-06 02:14:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:14:05.680819105Z [2024-04-06T02:14:05.680+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:14:00+00:00, run_after=2024-04-06T02:15:00+00:00 2024-04-06T02:14:05.716343934Z [2024-04-06T02:14:05.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:13:00+00:00 exited with status success for try_number 1 2024-04-06T02:14:05.722429316Z [2024-04-06T02:14:05.722+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:13:00+00:00, map_index=-1, run_start_date=2024-04-06 02:14:03.176747+00:00, run_end_date=2024-04-06 02:14:05.231387+00:00, run_duration=2.05464, state=success, executor_state=success, try_number=1, max_tries=1, job_id=152, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:14:00.320698+00:00, queued_by_job_id=2, pid=3475 2024-04-06T02:15:00.716445596Z [2024-04-06T02:15:00.712+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:15:00+00:00, run_after=2024-04-06T02:20:00+00:00 2024-04-06T02:15:00.737977001Z [2024-04-06T02:15:00.733+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:15:00+00:00, run_after=2024-04-06T02:16:00+00:00 2024-04-06T02:15:00.741640890Z [2024-04-06T02:15:00.741+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:15:00.830004041Z [2024-04-06T02:15:00.829+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T02:15:00.830028595Z 2024-04-06T02:15:00.830032577Z 2024-04-06T02:15:00.830035855Z 2024-04-06T02:15:00.830284176Z [2024-04-06T02:15:00.829+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:15:00.830496026Z [2024-04-06T02:15:00.830+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:15:00.830705457Z [2024-04-06T02:15:00.830+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:15:00.831638472Z [2024-04-06T02:15:00.831+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:15:00.831649570Z 2024-04-06T02:15:00.831653309Z 2024-04-06T02:15:00.831656544Z 2024-04-06T02:15:00.835288656Z [2024-04-06T02:15:00.835+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-06T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-06T02:15:00.835520435Z [2024-04-06T02:15:00.835+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:15:00.835858184Z [2024-04-06T02:15:00.835+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:15:00.836074570Z [2024-04-06T02:15:00.835+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:15:00.836384204Z [2024-04-06T02:15:00.836+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:15:00.836613619Z [2024-04-06T02:15:00.836+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:15:01.217671654Z [2024-04-06T02:15:01.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T02:10:00+00:00 exited with status queued for try_number 1 2024-04-06T02:15:01.217698751Z [2024-04-06T02:15:01.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:14:00+00:00 exited with status queued for try_number 1 2024-04-06T02:15:01.217777948Z [2024-04-06T02:15:01.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:14:00+00:00 exited with status queued for try_number 1 2024-04-06T02:15:01.236113896Z [2024-04-06T02:15:01.235+0000] {scheduler_job.py:635} INFO - Setting external_id for to edd33bd1-e590-4036-9528-234c9219cf34 2024-04-06T02:15:01.236385564Z [2024-04-06T02:15:01.236+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7fc220b9-8689-4889-8627-f8e45594836d 2024-04-06T02:15:01.236501127Z [2024-04-06T02:15:01.236+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f7b6f6b-ca15-4075-9672-3bd22f8dc634 2024-04-06T02:15:05.076524900Z [2024-04-06T02:15:05.076+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:15:05.076550573Z 2024-04-06T02:15:05.076934178Z [2024-04-06T02:15:05.076+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:15:05.077614505Z [2024-04-06T02:15:05.077+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:15:05.077627609Z 2024-04-06T02:15:05.081196987Z [2024-04-06T02:15:05.080+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='split_metrics', run_id='scheduled__2024-04-06T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-06T02:15:05.081411190Z [2024-04-06T02:15:05.081+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:15:05.163675750Z [2024-04-06T02:15:05.163+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T02:10:00+00:00 exited with status queued for try_number 1 2024-04-06T02:15:05.163910817Z [2024-04-06T02:15:05.163+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T02:10:00+00:00 exited with status success for try_number 1 2024-04-06T02:15:05.169515249Z [2024-04-06T02:15:05.169+0000] {scheduler_job.py:635} INFO - Setting external_id for to 11df39be-fafb-4bf5-9ca9-ce251154a698 2024-04-06T02:15:05.170191147Z [2024-04-06T02:15:05.169+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-06T02:10:00+00:00, map_index=-1, run_start_date=2024-04-06 02:15:04.060668+00:00, run_end_date=2024-04-06 02:15:04.744400+00:00, run_duration=0.683732, state=success, executor_state=success, try_number=1, max_tries=1, job_id=154, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:15:00.832532+00:00, queued_by_job_id=2, pid=3542 2024-04-06T02:15:06.361187682Z [2024-04-06T02:15:06.360+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:15:06.361693139Z [2024-04-06T02:15:06.361+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:14:00+00:00, run_id=scheduled__2024-04-06T02:14:00+00:00, run_start_date=2024-04-06 02:15:00.757151+00:00, run_end_date=2024-04-06 02:15:06.361137+00:00, run_duration=5.603986, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:14:00+00:00, data_interval_end=2024-04-06 02:15:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:15:06.371035372Z [2024-04-06T02:15:06.370+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:15:00+00:00, run_after=2024-04-06T02:16:00+00:00 2024-04-06T02:15:06.458632670Z [2024-04-06T02:15:06.458+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:14:00+00:00 exited with status success for try_number 1 2024-04-06T02:15:06.468822875Z [2024-04-06T02:15:06.468+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:14:00+00:00, map_index=-1, run_start_date=2024-04-06 02:15:03.851255+00:00, run_end_date=2024-04-06 02:15:06.125432+00:00, run_duration=2.274177, state=success, executor_state=success, try_number=1, max_tries=1, job_id=153, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:15:00.832532+00:00, queued_by_job_id=2, pid=3540 2024-04-06T02:15:07.695889640Z [2024-04-06T02:15:07.695+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:15:07.696475012Z [2024-04-06T02:15:07.696+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:14:00+00:00, run_id=scheduled__2024-04-06T02:14:00+00:00, run_start_date=2024-04-06 02:15:00.758332+00:00, run_end_date=2024-04-06 02:15:07.695812+00:00, run_duration=6.93748, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:14:00+00:00, data_interval_end=2024-04-06 02:15:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:15:07.711744000Z [2024-04-06T02:15:07.711+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:15:00+00:00, run_after=2024-04-06T02:16:00+00:00 2024-04-06T02:15:07.754878039Z [2024-04-06T02:15:07.754+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:15:07.754918734Z 2024-04-06T02:15:07.758519644Z [2024-04-06T02:15:07.758+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:15:07.759516833Z [2024-04-06T02:15:07.759+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:15:07.759552837Z 2024-04-06T02:15:07.764861713Z [2024-04-06T02:15:07.764+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='collect_metrics', run_id='scheduled__2024-04-06T02:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-06T02:15:07.765150295Z [2024-04-06T02:15:07.764+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T02:15:07.837523157Z [2024-04-06T02:15:07.836+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T02:10:00+00:00 exited with status queued for try_number 1 2024-04-06T02:15:07.838375495Z [2024-04-06T02:15:07.837+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:14:00+00:00 exited with status success for try_number 1 2024-04-06T02:15:07.838807952Z [2024-04-06T02:15:07.838+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T02:10:00+00:00 exited with status success for try_number 1 2024-04-06T02:15:07.849213177Z [2024-04-06T02:15:07.848+0000] {scheduler_job.py:635} INFO - Setting external_id for to d8c7d224-24fa-4e13-9913-5f1af5ecb5a4 2024-04-06T02:15:07.849622086Z [2024-04-06T02:15:07.849+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=split_metrics, run_id=scheduled__2024-04-06T02:10:00+00:00, map_index=-1, run_start_date=2024-04-06 02:15:06.909352+00:00, run_end_date=2024-04-06 02:15:07.284679+00:00, run_duration=0.375327, state=success, executor_state=success, try_number=1, max_tries=1, job_id=156, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:15:05.078095+00:00, queued_by_job_id=2, pid=3581 2024-04-06T02:15:07.850008783Z [2024-04-06T02:15:07.849+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:14:00+00:00, map_index=-1, run_start_date=2024-04-06 02:15:04.065591+00:00, run_end_date=2024-04-06 02:15:06.686510+00:00, run_duration=2.620919, state=success, executor_state=success, try_number=1, max_tries=1, job_id=155, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:15:00.832532+00:00, queued_by_job_id=2, pid=3541 2024-04-06T02:15:10.113546114Z [2024-04-06T02:15:10.113+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:15:10.113573019Z 2024-04-06T02:15:10.113791534Z [2024-04-06T02:15:10.113+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:15:10.115101680Z [2024-04-06T02:15:10.114+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:15:10.115121961Z 2024-04-06T02:15:10.119372062Z [2024-04-06T02:15:10.119+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='send_prometheus', run_id='scheduled__2024-04-06T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:15:10.119528768Z [2024-04-06T02:15:10.119+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:15:10.177889485Z [2024-04-06T02:15:10.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T02:10:00+00:00 exited with status queued for try_number 1 2024-04-06T02:15:10.177951692Z [2024-04-06T02:15:10.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T02:10:00+00:00 exited with status success for try_number 1 2024-04-06T02:15:10.183663801Z [2024-04-06T02:15:10.183+0000] {scheduler_job.py:635} INFO - Setting external_id for to cad0a3e8-2aa3-48d6-80b8-dc738f2343e5 2024-04-06T02:15:10.183750582Z [2024-04-06T02:15:10.183+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=collect_metrics, run_id=scheduled__2024-04-06T02:10:00+00:00, map_index=0, run_start_date=2024-04-06 02:15:09.577173+00:00, run_end_date=2024-04-06 02:15:09.976796+00:00, run_duration=0.399623, state=success, executor_state=success, try_number=1, max_tries=1, job_id=157, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:15:07.760610+00:00, queued_by_job_id=2, pid=3604 2024-04-06T02:15:13.128165449Z [2024-04-06T02:15:13.126+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:15:13.129377365Z [2024-04-06T02:15:13.128+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:10:00+00:00, run_id=scheduled__2024-04-06T02:10:00+00:00, run_start_date=2024-04-06 02:15:00.753513+00:00, run_end_date=2024-04-06 02:15:13.128472+00:00, run_duration=12.374959, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:10:00+00:00, data_interval_end=2024-04-06 02:15:00+00:00, dag_hash=eecc559ff32fe9a7c4345875f113a0a9 2024-04-06T02:15:13.146805282Z [2024-04-06T02:15:13.146+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:15:00+00:00, run_after=2024-04-06T02:20:00+00:00 2024-04-06T02:15:13.198891422Z [2024-04-06T02:15:13.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T02:10:00+00:00 exited with status success for try_number 1 2024-04-06T02:15:13.210217028Z [2024-04-06T02:15:13.209+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=send_prometheus, run_id=scheduled__2024-04-06T02:10:00+00:00, map_index=-1, run_start_date=2024-04-06 02:15:12.137328+00:00, run_end_date=2024-04-06 02:15:12.460411+00:00, run_duration=0.323083, state=success, executor_state=success, try_number=1, max_tries=1, job_id=158, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:15:10.115752+00:00, queued_by_job_id=2, pid=3619 2024-04-06T02:15:19.623790537Z [2024-04-06T02:15:19.623+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-06T02:16:00.749001349Z [2024-04-06T02:16:00.748+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:16:00.760560242Z [2024-04-06T02:16:00.759+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:16:00.784556458Z [2024-04-06T02:16:00.783+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:16:00+00:00, run_after=2024-04-06T02:17:00+00:00 2024-04-06T02:16:00.972970411Z [2024-04-06T02:16:00.972+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T02:16:00.972993568Z 2024-04-06T02:16:00.973001978Z 2024-04-06T02:16:00.973005982Z 2024-04-06T02:16:00.973558859Z [2024-04-06T02:16:00.972+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T02:16:00.974083321Z [2024-04-06T02:16:00.973+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:16:00.974354423Z [2024-04-06T02:16:00.974+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:16:00.976115720Z [2024-04-06T02:16:00.975+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:16:00.976140157Z 2024-04-06T02:16:00.976144151Z 2024-04-06T02:16:00.976147362Z 2024-04-06T02:16:00.982392326Z [2024-04-06T02:16:00.982+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:16:00.982493826Z [2024-04-06T02:16:00.982+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:16:00.982810481Z [2024-04-06T02:16:00.982+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:16:00.982908161Z [2024-04-06T02:16:00.982+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:16:00.983182246Z [2024-04-06T02:16:00.983+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:16:00.983816290Z [2024-04-06T02:16:00.983+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:16:01.425878201Z [2024-04-06T02:16:01.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:14:00+00:00 exited with status queued for try_number 1 2024-04-06T02:16:01.426022796Z [2024-04-06T02:16:01.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:15:00+00:00 exited with status queued for try_number 1 2024-04-06T02:16:01.426080636Z [2024-04-06T02:16:01.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:15:00+00:00 exited with status queued for try_number 1 2024-04-06T02:16:01.434577606Z [2024-04-06T02:16:01.434+0000] {scheduler_job.py:635} INFO - Setting external_id for to 903c79b7-8103-4112-ba2c-3ec4acb3684b 2024-04-06T02:16:01.434700029Z [2024-04-06T02:16:01.434+0000] {scheduler_job.py:635} INFO - Setting external_id for to b0d6ec64-59d3-41c6-a7f7-a3fca6b4a8db 2024-04-06T02:16:01.434820123Z [2024-04-06T02:16:01.434+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3cf12961-d3ad-4d27-a685-d0b3b74069b3 2024-04-06T02:16:03.987451873Z [2024-04-06T02:16:03.987+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:16:03.988708807Z [2024-04-06T02:16:03.988+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 02:14:00+00:00, run_id=scheduled__2024-04-06T02:14:00+00:00, run_start_date=2024-04-06 02:16:00.810207+00:00, run_end_date=2024-04-06 02:16:03.987371+00:00, run_duration=3.177164, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:14:00+00:00, data_interval_end=2024-04-06 02:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T02:16:04.019397887Z [2024-04-06T02:16:04.019+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T02:16:00+00:00, run_after=2024-04-06T02:18:00+00:00 2024-04-06T02:16:04.201820606Z [2024-04-06T02:16:04.201+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:14:00+00:00 exited with status success for try_number 1 2024-04-06T02:16:04.212000539Z [2024-04-06T02:16:04.211+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T02:14:00+00:00, map_index=-1, run_start_date=2024-04-06 02:16:02.536170+00:00, run_end_date=2024-04-06 02:16:03.209703+00:00, run_duration=0.673533, state=success, executor_state=success, try_number=1, max_tries=1, job_id=159, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:16:00.978235+00:00, queued_by_job_id=2, pid=3623 2024-04-06T02:16:06.547730658Z [2024-04-06T02:16:06.547+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:16:06.548539737Z [2024-04-06T02:16:06.548+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:15:00+00:00, run_id=scheduled__2024-04-06T02:15:00+00:00, run_start_date=2024-04-06 02:16:00.817468+00:00, run_end_date=2024-04-06 02:16:06.547891+00:00, run_duration=5.730423, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:15:00+00:00, data_interval_end=2024-04-06 02:16:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:16:06.560648471Z [2024-04-06T02:16:06.560+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:16:00+00:00, run_after=2024-04-06T02:17:00+00:00 2024-04-06T02:16:06.615168915Z [2024-04-06T02:16:06.614+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:15:00+00:00 exited with status success for try_number 1 2024-04-06T02:16:06.620504167Z [2024-04-06T02:16:06.620+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:15:00+00:00, map_index=-1, run_start_date=2024-04-06 02:16:04.666916+00:00, run_end_date=2024-04-06 02:16:06.408847+00:00, run_duration=1.741931, state=success, executor_state=success, try_number=1, max_tries=1, job_id=161, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:16:00.978235+00:00, queued_by_job_id=2, pid=3654 2024-04-06T02:16:07.678677790Z [2024-04-06T02:16:07.677+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:16:07.678765603Z [2024-04-06T02:16:07.678+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:15:00+00:00, run_id=scheduled__2024-04-06T02:15:00+00:00, run_start_date=2024-04-06 02:16:00.812597+00:00, run_end_date=2024-04-06 02:16:07.678330+00:00, run_duration=6.865733, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:15:00+00:00, data_interval_end=2024-04-06 02:16:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:16:07.690879435Z [2024-04-06T02:16:07.690+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:16:00+00:00, run_after=2024-04-06T02:17:00+00:00 2024-04-06T02:16:07.734009732Z [2024-04-06T02:16:07.733+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:15:00+00:00 exited with status success for try_number 1 2024-04-06T02:16:07.742495587Z [2024-04-06T02:16:07.741+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:15:00+00:00, map_index=-1, run_start_date=2024-04-06 02:16:04.262337+00:00, run_end_date=2024-04-06 02:16:06.852698+00:00, run_duration=2.590361, state=success, executor_state=success, try_number=1, max_tries=1, job_id=160, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:16:00.978235+00:00, queued_by_job_id=2, pid=3653 2024-04-06T02:17:00.986182428Z [2024-04-06T02:17:00.985+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:17:01.002922185Z [2024-04-06T02:17:01.000+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:17:00+00:00, run_after=2024-04-06T02:18:00+00:00 2024-04-06T02:17:01.070466711Z [2024-04-06T02:17:01.070+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T02:17:01.070501521Z 2024-04-06T02:17:01.070505646Z 2024-04-06T02:17:01.070745992Z [2024-04-06T02:17:01.070+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:17:01.071579631Z [2024-04-06T02:17:01.071+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:17:01.072210259Z [2024-04-06T02:17:01.072+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:17:01.072222457Z 2024-04-06T02:17:01.072225946Z 2024-04-06T02:17:01.075802358Z [2024-04-06T02:17:01.075+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:17:01.076336034Z [2024-04-06T02:17:01.075+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:17:01.076351625Z [2024-04-06T02:17:01.076+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:17:01.076374911Z [2024-04-06T02:17:01.076+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:17:01.302004067Z [2024-04-06T02:17:01.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:16:00+00:00 exited with status queued for try_number 1 2024-04-06T02:17:01.304241172Z [2024-04-06T02:17:01.303+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:16:00+00:00 exited with status queued for try_number 1 2024-04-06T02:17:01.311188641Z [2024-04-06T02:17:01.310+0000] {scheduler_job.py:635} INFO - Setting external_id for to 499c9df8-c36b-4a40-b096-547c206d9b71 2024-04-06T02:17:01.311517579Z [2024-04-06T02:17:01.311+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f298871-b14e-4c03-8fbe-9dc40dde3c27 2024-04-06T02:17:05.786668462Z [2024-04-06T02:17:05.786+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:17:05.787793096Z [2024-04-06T02:17:05.787+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:16:00+00:00, run_id=scheduled__2024-04-06T02:16:00+00:00, run_start_date=2024-04-06 02:17:01.015652+00:00, run_end_date=2024-04-06 02:17:05.787181+00:00, run_duration=4.771529, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:16:00+00:00, data_interval_end=2024-04-06 02:17:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:17:05.797697594Z [2024-04-06T02:17:05.797+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:17:00+00:00, run_after=2024-04-06T02:18:00+00:00 2024-04-06T02:17:06.900594249Z [2024-04-06T02:17:06.899+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:17:06.900898658Z [2024-04-06T02:17:06.900+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:16:00+00:00, run_id=scheduled__2024-04-06T02:16:00+00:00, run_start_date=2024-04-06 02:17:01.014311+00:00, run_end_date=2024-04-06 02:17:06.900389+00:00, run_duration=5.886078, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:16:00+00:00, data_interval_end=2024-04-06 02:17:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:17:06.920140499Z [2024-04-06T02:17:06.919+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:17:00+00:00, run_after=2024-04-06T02:18:00+00:00 2024-04-06T02:17:06.966179878Z [2024-04-06T02:17:06.965+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:16:00+00:00 exited with status success for try_number 1 2024-04-06T02:17:06.966497235Z [2024-04-06T02:17:06.966+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:16:00+00:00 exited with status success for try_number 1 2024-04-06T02:17:06.979014932Z [2024-04-06T02:17:06.978+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:16:00+00:00, map_index=-1, run_start_date=2024-04-06 02:17:03.775956+00:00, run_end_date=2024-04-06 02:17:05.713597+00:00, run_duration=1.937641, state=success, executor_state=success, try_number=1, max_tries=1, job_id=163, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:17:01.073285+00:00, queued_by_job_id=2, pid=3709 2024-04-06T02:17:06.979420632Z [2024-04-06T02:17:06.978+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:16:00+00:00, map_index=-1, run_start_date=2024-04-06 02:17:03.306649+00:00, run_end_date=2024-04-06 02:17:05.772599+00:00, run_duration=2.46595, state=success, executor_state=success, try_number=1, max_tries=1, job_id=162, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:17:01.073285+00:00, queued_by_job_id=2, pid=3704 2024-04-06T02:18:00.909300839Z [2024-04-06T02:18:00.908+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:18:00.927363040Z [2024-04-06T02:18:00.927+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:18:00.950242697Z [2024-04-06T02:18:00.944+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:18:00+00:00, run_after=2024-04-06T02:19:00+00:00 2024-04-06T02:18:01.035735853Z [2024-04-06T02:18:01.035+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T02:18:01.035765841Z 2024-04-06T02:18:01.035771474Z 2024-04-06T02:18:01.035775729Z 2024-04-06T02:18:01.035786485Z [2024-04-06T02:18:01.035+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T02:18:01.035806900Z [2024-04-06T02:18:01.035+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:18:01.035927505Z [2024-04-06T02:18:01.035+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:18:01.036515366Z [2024-04-06T02:18:01.036+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:18:01.036527659Z 2024-04-06T02:18:01.036531521Z 2024-04-06T02:18:01.036534636Z 2024-04-06T02:18:01.039766404Z [2024-04-06T02:18:01.039+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:18:01.039799526Z [2024-04-06T02:18:01.039+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:18:01.040091742Z [2024-04-06T02:18:01.039+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:18:01.040239019Z [2024-04-06T02:18:01.040+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:18:01.040416715Z [2024-04-06T02:18:01.040+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:18:01.040488378Z [2024-04-06T02:18:01.040+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:18:01.382542201Z [2024-04-06T02:18:01.382+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:16:00+00:00 exited with status queued for try_number 1 2024-04-06T02:18:01.382749629Z [2024-04-06T02:18:01.382+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:17:00+00:00 exited with status queued for try_number 1 2024-04-06T02:18:01.382888473Z [2024-04-06T02:18:01.382+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:17:00+00:00 exited with status queued for try_number 1 2024-04-06T02:18:01.394975878Z [2024-04-06T02:18:01.394+0000] {scheduler_job.py:635} INFO - Setting external_id for to 116ee16d-2363-46a5-a8e7-a025d846760d 2024-04-06T02:18:01.395275838Z [2024-04-06T02:18:01.395+0000] {scheduler_job.py:635} INFO - Setting external_id for to d47234bd-2e18-4b40-a62a-04146f652916 2024-04-06T02:18:01.395442529Z [2024-04-06T02:18:01.395+0000] {scheduler_job.py:635} INFO - Setting external_id for to 060a1e27-ab2d-4445-90fa-dcb073cfa973 2024-04-06T02:18:03.431089794Z [2024-04-06T02:18:03.429+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:18:03.431379548Z [2024-04-06T02:18:03.431+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 02:16:00+00:00, run_id=scheduled__2024-04-06T02:16:00+00:00, run_start_date=2024-04-06 02:18:00.968034+00:00, run_end_date=2024-04-06 02:18:03.431019+00:00, run_duration=2.462985, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:16:00+00:00, data_interval_end=2024-04-06 02:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T02:18:03.449883330Z [2024-04-06T02:18:03.449+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T02:18:00+00:00, run_after=2024-04-06T02:20:00+00:00 2024-04-06T02:18:03.546489853Z [2024-04-06T02:18:03.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:16:00+00:00 exited with status success for try_number 1 2024-04-06T02:18:03.559160545Z [2024-04-06T02:18:03.558+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T02:16:00+00:00, map_index=-1, run_start_date=2024-04-06 02:18:02.158232+00:00, run_end_date=2024-04-06 02:18:03.095335+00:00, run_duration=0.937103, state=success, executor_state=success, try_number=1, max_tries=1, job_id=164, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:18:01.037230+00:00, queued_by_job_id=2, pid=3743 2024-04-06T02:18:07.184942928Z [2024-04-06T02:18:07.184+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:18:07.185890951Z [2024-04-06T02:18:07.185+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:17:00+00:00, run_id=scheduled__2024-04-06T02:17:00+00:00, run_start_date=2024-04-06 02:18:00.971358+00:00, run_end_date=2024-04-06 02:18:07.185287+00:00, run_duration=6.213929, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:17:00+00:00, data_interval_end=2024-04-06 02:18:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:18:07.199242320Z [2024-04-06T02:18:07.198+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:18:00+00:00, run_after=2024-04-06T02:19:00+00:00 2024-04-06T02:18:07.260097018Z [2024-04-06T02:18:07.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:17:00+00:00 exited with status success for try_number 1 2024-04-06T02:18:07.267986893Z [2024-04-06T02:18:07.267+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:17:00+00:00, map_index=-1, run_start_date=2024-04-06 02:18:04.524999+00:00, run_end_date=2024-04-06 02:18:06.653697+00:00, run_duration=2.128698, state=success, executor_state=success, try_number=1, max_tries=1, job_id=165, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:18:01.037230+00:00, queued_by_job_id=2, pid=3764 2024-04-06T02:18:08.309629373Z [2024-04-06T02:18:08.309+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:18:08.309671941Z [2024-04-06T02:18:08.309+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:17:00+00:00, run_id=scheduled__2024-04-06T02:17:00+00:00, run_start_date=2024-04-06 02:18:00.969956+00:00, run_end_date=2024-04-06 02:18:08.309419+00:00, run_duration=7.339463, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:17:00+00:00, data_interval_end=2024-04-06 02:18:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:18:08.318021534Z [2024-04-06T02:18:08.317+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:18:00+00:00, run_after=2024-04-06T02:19:00+00:00 2024-04-06T02:18:08.348504352Z [2024-04-06T02:18:08.348+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:17:00+00:00 exited with status success for try_number 1 2024-04-06T02:18:08.354714551Z [2024-04-06T02:18:08.354+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:17:00+00:00, map_index=-1, run_start_date=2024-04-06 02:18:05.583613+00:00, run_end_date=2024-04-06 02:18:07.506971+00:00, run_duration=1.923358, state=success, executor_state=success, try_number=1, max_tries=1, job_id=166, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:18:01.037230+00:00, queued_by_job_id=2, pid=3783 2024-04-06T02:19:00.827196737Z [2024-04-06T02:19:00.826+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:19:00.840750466Z [2024-04-06T02:19:00.840+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:19:00+00:00, run_after=2024-04-06T02:20:00+00:00 2024-04-06T02:19:00.903406333Z [2024-04-06T02:19:00.903+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T02:19:00.903435980Z 2024-04-06T02:19:00.903440259Z 2024-04-06T02:19:00.903473003Z [2024-04-06T02:19:00.903+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:19:00.903686255Z [2024-04-06T02:19:00.903+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:19:00.904222685Z [2024-04-06T02:19:00.903+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:19:00.904235403Z 2024-04-06T02:19:00.904259187Z 2024-04-06T02:19:00.906727964Z [2024-04-06T02:19:00.906+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:19:00.906806451Z [2024-04-06T02:19:00.906+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:19:00.907019126Z [2024-04-06T02:19:00.906+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:19:00.907129513Z [2024-04-06T02:19:00.906+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:19:01.143260284Z [2024-04-06T02:19:01.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:18:00+00:00 exited with status queued for try_number 1 2024-04-06T02:19:01.144464075Z [2024-04-06T02:19:01.144+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:18:00+00:00 exited with status queued for try_number 1 2024-04-06T02:19:01.171916846Z [2024-04-06T02:19:01.169+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b1c9ba4-641e-4cb7-b591-785153729ebf 2024-04-06T02:19:01.172235349Z [2024-04-06T02:19:01.172+0000] {scheduler_job.py:635} INFO - Setting external_id for to 138a14b6-eaf3-499d-b439-37a6d9248d56 2024-04-06T02:19:05.100240329Z [2024-04-06T02:19:05.099+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:19:05.100600619Z [2024-04-06T02:19:05.100+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:18:00+00:00, run_id=scheduled__2024-04-06T02:18:00+00:00, run_start_date=2024-04-06 02:19:00.852097+00:00, run_end_date=2024-04-06 02:19:05.100237+00:00, run_duration=4.24814, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:18:00+00:00, data_interval_end=2024-04-06 02:19:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:19:05.116272474Z [2024-04-06T02:19:05.115+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:19:00+00:00, run_after=2024-04-06T02:20:00+00:00 2024-04-06T02:19:05.208580561Z [2024-04-06T02:19:05.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:18:00+00:00 exited with status success for try_number 1 2024-04-06T02:19:05.214014600Z [2024-04-06T02:19:05.213+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:18:00+00:00, map_index=-1, run_start_date=2024-04-06 02:19:03.175380+00:00, run_end_date=2024-04-06 02:19:04.838937+00:00, run_duration=1.663557, state=success, executor_state=success, try_number=1, max_tries=1, job_id=168, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:19:00.904723+00:00, queued_by_job_id=2, pid=3828 2024-04-06T02:19:06.275338167Z [2024-04-06T02:19:06.274+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:19:06.275602351Z [2024-04-06T02:19:06.275+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:18:00+00:00, run_id=scheduled__2024-04-06T02:18:00+00:00, run_start_date=2024-04-06 02:19:00.854616+00:00, run_end_date=2024-04-06 02:19:06.275203+00:00, run_duration=5.420587, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:18:00+00:00, data_interval_end=2024-04-06 02:19:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:19:06.285160862Z [2024-04-06T02:19:06.284+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:19:00+00:00, run_after=2024-04-06T02:20:00+00:00 2024-04-06T02:19:06.323614617Z [2024-04-06T02:19:06.323+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:18:00+00:00 exited with status success for try_number 1 2024-04-06T02:19:06.331656845Z [2024-04-06T02:19:06.331+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:18:00+00:00, map_index=-1, run_start_date=2024-04-06 02:19:03.155602+00:00, run_end_date=2024-04-06 02:19:05.394507+00:00, run_duration=2.238905, state=success, executor_state=success, try_number=1, max_tries=1, job_id=167, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:19:00.904723+00:00, queued_by_job_id=2, pid=3829 2024-04-06T02:19:35.328497870Z [2024-04-06T02:19:35.328+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f to 2024-04-06T02:19:00+00:00, run_after=2024-04-06T02:20:00+00:00 2024-04-06T02:19:35.368489293Z [2024-04-06T02:19:35.368+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:19:35.368509837Z 2024-04-06T02:19:35.368520010Z [2024-04-06T02:19:35.368+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f has 0/16 running and queued tasks 2024-04-06T02:19:35.369080707Z [2024-04-06T02:19:35.368+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:19:35.369090643Z 2024-04-06T02:19:35.371041028Z [2024-04-06T02:19:35.370+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:19:35.371177061Z [2024-04-06T02:19:35.371+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:19:35.430185898Z [2024-04-06T02:19:35.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:18:00+00:00 exited with status queued for try_number 1 2024-04-06T02:19:35.434979446Z [2024-04-06T02:19:35.434+0000] {scheduler_job.py:635} INFO - Setting external_id for to 69afeeea-a2f8-42b3-92b3-877dec28bdaa 2024-04-06T02:19:36.834258816Z [2024-04-06T02:19:36.833+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:19:36.834707520Z [2024-04-06T02:19:36.834+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f, execution_date=2024-04-06 02:18:00+00:00, run_id=scheduled__2024-04-06T02:18:00+00:00, run_start_date=2024-04-06 02:19:35.339730+00:00, run_end_date=2024-04-06 02:19:36.834149+00:00, run_duration=1.494419, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:18:00+00:00, data_interval_end=2024-04-06 02:19:00+00:00, dag_hash=7cf6305fd41f05725eca646b1588f981 2024-04-06T02:19:36.849602953Z [2024-04-06T02:19:36.849+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f to 2024-04-06T02:19:00+00:00, run_after=2024-04-06T02:20:00+00:00 2024-04-06T02:19:36.885773697Z [2024-04-06T02:19:36.885+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:18:00+00:00 exited with status success for try_number 1 2024-04-06T02:19:36.898934681Z [2024-04-06T02:19:36.898+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:18:00+00:00, map_index=-1, run_start_date=2024-04-06 02:19:36.093876+00:00, run_end_date=2024-04-06 02:19:36.512116+00:00, run_duration=0.41824, state=success, executor_state=success, try_number=1, max_tries=1, job_id=169, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:19:35.369340+00:00, queued_by_job_id=2, pid=3871 2024-04-06T02:20:00.393112206Z [2024-04-06T02:20:00.392+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:20:00.405282998Z [2024-04-06T02:20:00.404+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:20:00.420231348Z [2024-04-06T02:20:00.419+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:20:00+00:00, run_after=2024-04-06T02:25:00+00:00 2024-04-06T02:20:00.434822696Z [2024-04-06T02:20:00.434+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:20:00+00:00, run_after=2024-04-06T02:21:00+00:00 2024-04-06T02:20:00.448074670Z [2024-04-06T02:20:00.447+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f to 2024-04-06T02:20:00+00:00, run_after=2024-04-06T02:21:00+00:00 2024-04-06T02:20:00.576578842Z [2024-04-06T02:20:00.575+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-06T02:20:00.576776590Z 2024-04-06T02:20:00.576788293Z 2024-04-06T02:20:00.576872585Z 2024-04-06T02:20:00.576883121Z 2024-04-06T02:20:00.576890804Z 2024-04-06T02:20:00.576898817Z [2024-04-06T02:20:00.576+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:20:00.576954803Z [2024-04-06T02:20:00.576+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T02:20:00.576964151Z [2024-04-06T02:20:00.576+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f has 0/16 running and queued tasks 2024-04-06T02:20:00.576990442Z [2024-04-06T02:20:00.576+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:20:00.576998909Z [2024-04-06T02:20:00.576+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:20:00.577916128Z [2024-04-06T02:20:00.577+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:20:00.577951058Z 2024-04-06T02:20:00.577957275Z 2024-04-06T02:20:00.577962388Z 2024-04-06T02:20:00.577967015Z 2024-04-06T02:20:00.577972385Z 2024-04-06T02:20:00.584520088Z [2024-04-06T02:20:00.583+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-06T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-06T02:20:00.584656655Z [2024-04-06T02:20:00.584+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:20:00.584844804Z [2024-04-06T02:20:00.584+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:20:00.584882992Z [2024-04-06T02:20:00.584+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:20:00.584989142Z [2024-04-06T02:20:00.584+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:20:00.585089673Z [2024-04-06T02:20:00.584+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:20:00.585226322Z [2024-04-06T02:20:00.585+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:20:00.585242137Z [2024-04-06T02:20:00.585+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:20:00.585478938Z [2024-04-06T02:20:00.585+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:20:00.585640627Z [2024-04-06T02:20:00.585+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:20:01.179946743Z [2024-04-06T02:20:01.179+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T02:15:00+00:00 exited with status queued for try_number 1 2024-04-06T02:20:01.179986234Z [2024-04-06T02:20:01.179+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:18:00+00:00 exited with status queued for try_number 1 2024-04-06T02:20:01.180042321Z [2024-04-06T02:20:01.179+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:19:00+00:00 exited with status queued for try_number 1 2024-04-06T02:20:01.180088162Z [2024-04-06T02:20:01.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:19:00+00:00 exited with status queued for try_number 1 2024-04-06T02:20:01.180159115Z [2024-04-06T02:20:01.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:19:00+00:00 exited with status queued for try_number 1 2024-04-06T02:20:01.204979574Z [2024-04-06T02:20:01.204+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9eef3e2e-e0e6-44e7-acd4-ab1b59c7f22b 2024-04-06T02:20:01.205017856Z [2024-04-06T02:20:01.204+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8eccbdba-0592-4d32-a7e6-180e4ebb38dc 2024-04-06T02:20:01.205153816Z [2024-04-06T02:20:01.205+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3764314c-8364-45b4-9355-46cbbbb86d36 2024-04-06T02:20:01.205239623Z [2024-04-06T02:20:01.205+0000] {scheduler_job.py:635} INFO - Setting external_id for to c20af6f4-f001-4eee-8cf2-70550d0a305d 2024-04-06T02:20:01.205352860Z [2024-04-06T02:20:01.205+0000] {scheduler_job.py:635} INFO - Setting external_id for to 796950ae-6aaa-48a2-a092-3c7e267b4c2d 2024-04-06T02:20:04.588442506Z [2024-04-06T02:20:04.587+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:20:04.588975605Z [2024-04-06T02:20:04.588+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f, execution_date=2024-04-06 02:19:00+00:00, run_id=scheduled__2024-04-06T02:19:00+00:00, run_start_date=2024-04-06 02:20:00.469020+00:00, run_end_date=2024-04-06 02:20:04.588372+00:00, run_duration=4.119352, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:19:00+00:00, data_interval_end=2024-04-06 02:20:00+00:00, dag_hash=7cf6305fd41f05725eca646b1588f981 2024-04-06T02:20:04.637667808Z [2024-04-06T02:20:04.637+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f to 2024-04-06T02:20:00+00:00, run_after=2024-04-06T02:21:00+00:00 2024-04-06T02:20:04.777142609Z [2024-04-06T02:20:04.776+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:20:04.777164919Z 2024-04-06T02:20:04.777174856Z [2024-04-06T02:20:04.777+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:20:04.777707755Z [2024-04-06T02:20:04.777+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:20:04.777717474Z 2024-04-06T02:20:04.781686713Z [2024-04-06T02:20:04.781+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='split_metrics', run_id='scheduled__2024-04-06T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-06T02:20:04.781772736Z [2024-04-06T02:20:04.781+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:20:04.886389748Z [2024-04-06T02:20:04.886+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T02:15:00+00:00 exited with status queued for try_number 1 2024-04-06T02:20:04.886453982Z [2024-04-06T02:20:04.886+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T02:15:00+00:00 exited with status success for try_number 1 2024-04-06T02:20:04.886557501Z [2024-04-06T02:20:04.886+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:19:00+00:00 exited with status success for try_number 1 2024-04-06T02:20:04.904655588Z [2024-04-06T02:20:04.902+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:19:00+00:00, map_index=-1, run_start_date=2024-04-06 02:20:02.945445+00:00, run_end_date=2024-04-06 02:20:04.223311+00:00, run_duration=1.277866, state=success, executor_state=success, try_number=1, max_tries=1, job_id=170, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:20:00.579478+00:00, queued_by_job_id=2, pid=3916 2024-04-06T02:20:04.904965004Z [2024-04-06T02:20:04.904+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-06T02:15:00+00:00, map_index=-1, run_start_date=2024-04-06 02:20:03.240116+00:00, run_end_date=2024-04-06 02:20:04.374905+00:00, run_duration=1.134789, state=success, executor_state=success, try_number=1, max_tries=1, job_id=171, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:20:00.579478+00:00, queued_by_job_id=2, pid=3918 2024-04-06T02:20:04.905198095Z [2024-04-06T02:20:04.905+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f77fd75-3994-43ea-b31b-63a504c2216a 2024-04-06T02:20:06.209297930Z [2024-04-06T02:20:06.208+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:20:06.209633613Z [2024-04-06T02:20:06.209+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 02:18:00+00:00, run_id=scheduled__2024-04-06T02:18:00+00:00, run_start_date=2024-04-06 02:20:00.467507+00:00, run_end_date=2024-04-06 02:20:06.209339+00:00, run_duration=5.741832, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:18:00+00:00, data_interval_end=2024-04-06 02:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T02:20:06.231454023Z [2024-04-06T02:20:06.227+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T02:20:00+00:00, run_after=2024-04-06T02:22:00+00:00 2024-04-06T02:20:06.318695217Z [2024-04-06T02:20:06.318+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:18:00+00:00 exited with status success for try_number 1 2024-04-06T02:20:06.326464932Z [2024-04-06T02:20:06.326+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T02:18:00+00:00, map_index=-1, run_start_date=2024-04-06 02:20:03.612326+00:00, run_end_date=2024-04-06 02:20:05.269103+00:00, run_duration=1.656777, state=success, executor_state=success, try_number=1, max_tries=1, job_id=173, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:20:00.579478+00:00, queued_by_job_id=2, pid=3921 2024-04-06T02:20:06.658826218Z [2024-04-06T02:20:06.658+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:20:06.674449144Z [2024-04-06T02:20:06.674+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:19:00+00:00, run_id=scheduled__2024-04-06T02:19:00+00:00, run_start_date=2024-04-06 02:20:00.470834+00:00, run_end_date=2024-04-06 02:20:06.673997+00:00, run_duration=6.203163, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:19:00+00:00, data_interval_end=2024-04-06 02:20:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:20:06.697676555Z [2024-04-06T02:20:06.697+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:20:00+00:00, run_after=2024-04-06T02:21:00+00:00 2024-04-06T02:20:06.794093563Z [2024-04-06T02:20:06.793+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:19:00+00:00 exited with status success for try_number 1 2024-04-06T02:20:06.802120120Z [2024-04-06T02:20:06.801+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:19:00+00:00, map_index=-1, run_start_date=2024-04-06 02:20:03.472347+00:00, run_end_date=2024-04-06 02:20:05.938043+00:00, run_duration=2.465696, state=success, executor_state=success, try_number=1, max_tries=1, job_id=172, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:20:00.579478+00:00, queued_by_job_id=2, pid=3917 2024-04-06T02:20:08.538941107Z [2024-04-06T02:20:08.538+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:20:08.538961853Z 2024-04-06T02:20:08.538970397Z [2024-04-06T02:20:08.538+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:20:08.539439326Z [2024-04-06T02:20:08.539+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:20:08.539445334Z 2024-04-06T02:20:08.541660088Z [2024-04-06T02:20:08.541+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='collect_metrics', run_id='scheduled__2024-04-06T02:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-06T02:20:08.541773967Z [2024-04-06T02:20:08.541+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T02:20:08.629115837Z [2024-04-06T02:20:08.627+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T02:15:00+00:00 exited with status queued for try_number 1 2024-04-06T02:20:08.629143092Z [2024-04-06T02:20:08.627+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T02:15:00+00:00 exited with status success for try_number 1 2024-04-06T02:20:08.660122260Z [2024-04-06T02:20:08.649+0000] {scheduler_job.py:635} INFO - Setting external_id for to 650ad183-4e0d-45db-bb3e-f7dc2a8ff0e4 2024-04-06T02:20:08.660148773Z [2024-04-06T02:20:08.655+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=split_metrics, run_id=scheduled__2024-04-06T02:15:00+00:00, map_index=-1, run_start_date=2024-04-06 02:20:07.327596+00:00, run_end_date=2024-04-06 02:20:07.692716+00:00, run_duration=0.36512, state=success, executor_state=success, try_number=1, max_tries=1, job_id=175, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:20:04.778121+00:00, queued_by_job_id=2, pid=3986 2024-04-06T02:20:08.737902819Z [2024-04-06T02:20:08.737+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:20:08.741904809Z [2024-04-06T02:20:08.738+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:19:00+00:00, run_id=scheduled__2024-04-06T02:19:00+00:00, run_start_date=2024-04-06 02:20:00.472742+00:00, run_end_date=2024-04-06 02:20:08.737900+00:00, run_duration=8.265158, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:19:00+00:00, data_interval_end=2024-04-06 02:20:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:20:08.749876194Z [2024-04-06T02:20:08.747+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:20:00+00:00, run_after=2024-04-06T02:21:00+00:00 2024-04-06T02:20:08.824861825Z [2024-04-06T02:20:08.824+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:19:00+00:00 exited with status success for try_number 1 2024-04-06T02:20:08.832697076Z [2024-04-06T02:20:08.832+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:19:00+00:00, map_index=-1, run_start_date=2024-04-06 02:20:06.105973+00:00, run_end_date=2024-04-06 02:20:08.535169+00:00, run_duration=2.429196, state=success, executor_state=success, try_number=1, max_tries=1, job_id=174, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:20:00.579478+00:00, queued_by_job_id=2, pid=3966 2024-04-06T02:20:10.987089978Z [2024-04-06T02:20:10.986+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:20:10.987117648Z 2024-04-06T02:20:10.988065888Z [2024-04-06T02:20:10.987+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:20:10.989660310Z [2024-04-06T02:20:10.989+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:20:10.989671968Z 2024-04-06T02:20:10.994386520Z [2024-04-06T02:20:10.994+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='send_prometheus', run_id='scheduled__2024-04-06T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:20:10.994763139Z [2024-04-06T02:20:10.994+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:20:11.082201521Z [2024-04-06T02:20:11.081+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T02:15:00+00:00 exited with status queued for try_number 1 2024-04-06T02:20:11.086515317Z [2024-04-06T02:20:11.086+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9dd81883-669f-48c9-999e-9444f6353f12 2024-04-06T02:20:11.157931331Z [2024-04-06T02:20:11.157+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T02:15:00+00:00 exited with status success for try_number 1 2024-04-06T02:20:11.167028475Z [2024-04-06T02:20:11.166+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=collect_metrics, run_id=scheduled__2024-04-06T02:15:00+00:00, map_index=0, run_start_date=2024-04-06 02:20:10.495761+00:00, run_end_date=2024-04-06 02:20:10.889698+00:00, run_duration=0.393937, state=success, executor_state=success, try_number=1, max_tries=1, job_id=176, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:20:08.539701+00:00, queued_by_job_id=2, pid=4008 2024-04-06T02:20:13.642509538Z [2024-04-06T02:20:13.641+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:20:13.642576736Z [2024-04-06T02:20:13.642+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:15:00+00:00, run_id=scheduled__2024-04-06T02:15:00+00:00, run_start_date=2024-04-06 02:20:00.465868+00:00, run_end_date=2024-04-06 02:20:13.642241+00:00, run_duration=13.176373, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:15:00+00:00, data_interval_end=2024-04-06 02:20:00+00:00, dag_hash=eecc559ff32fe9a7c4345875f113a0a9 2024-04-06T02:20:13.650256929Z [2024-04-06T02:20:13.649+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:20:00+00:00, run_after=2024-04-06T02:25:00+00:00 2024-04-06T02:20:13.693116087Z [2024-04-06T02:20:13.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T02:15:00+00:00 exited with status success for try_number 1 2024-04-06T02:20:13.702394599Z [2024-04-06T02:20:13.701+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=send_prometheus, run_id=scheduled__2024-04-06T02:15:00+00:00, map_index=-1, run_start_date=2024-04-06 02:20:12.765908+00:00, run_end_date=2024-04-06 02:20:13.167785+00:00, run_duration=0.401877, state=success, executor_state=success, try_number=1, max_tries=1, job_id=177, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:20:10.991055+00:00, queued_by_job_id=2, pid=4023 2024-04-06T02:20:19.706607402Z [2024-04-06T02:20:19.706+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-06T02:21:00.416959205Z [2024-04-06T02:21:00.416+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f to 2024-04-06T02:21:00+00:00, run_after=2024-04-06T02:22:00+00:00 2024-04-06T02:21:00.426699518Z [2024-04-06T02:21:00.426+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:21:00.440067688Z [2024-04-06T02:21:00.439+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:21:00+00:00, run_after=2024-04-06T02:22:00+00:00 2024-04-06T02:21:00.540065161Z [2024-04-06T02:21:00.532+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T02:21:00.540110438Z 2024-04-06T02:21:00.540120716Z 2024-04-06T02:21:00.540129351Z 2024-04-06T02:21:00.540511905Z [2024-04-06T02:21:00.540+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:21:00.540993388Z [2024-04-06T02:21:00.540+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:21:00.541230799Z [2024-04-06T02:21:00.541+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f has 0/16 running and queued tasks 2024-04-06T02:21:00.542207388Z [2024-04-06T02:21:00.541+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:21:00.542263289Z 2024-04-06T02:21:00.542273811Z 2024-04-06T02:21:00.542282235Z 2024-04-06T02:21:00.548742160Z [2024-04-06T02:21:00.548+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:21:00.549090985Z [2024-04-06T02:21:00.548+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:21:00.549617088Z [2024-04-06T02:21:00.549+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:21:00.552148917Z [2024-04-06T02:21:00.550+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:21:00.553714231Z [2024-04-06T02:21:00.552+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:21:00.554156444Z [2024-04-06T02:21:00.553+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:21:00.894304685Z [2024-04-06T02:21:00.893+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:20:00+00:00 exited with status queued for try_number 1 2024-04-06T02:21:00.894336829Z [2024-04-06T02:21:00.894+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:20:00+00:00 exited with status queued for try_number 1 2024-04-06T02:21:00.894407274Z [2024-04-06T02:21:00.894+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:20:00+00:00 exited with status queued for try_number 1 2024-04-06T02:21:00.902935780Z [2024-04-06T02:21:00.902+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a93e1ee-a2fb-45b7-87bc-d2fbfd0cecac 2024-04-06T02:21:00.902969857Z [2024-04-06T02:21:00.902+0000] {scheduler_job.py:635} INFO - Setting external_id for to cc6d93a2-7c81-40de-817c-2672cb1315ad 2024-04-06T02:21:00.903077709Z [2024-04-06T02:21:00.902+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e8b3761-fd8d-43ad-95df-cbdfe3c3c5d4 2024-04-06T02:21:02.244016101Z [2024-04-06T02:21:02.243+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:20:00+00:00 exited with status failed for try_number 1 2024-04-06T02:21:02.285089604Z [2024-04-06T02:21:02.284+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:20:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:21:00.543656+00:00, queued_by_job_id=2, pid=None 2024-04-06T02:21:02.285113738Z [2024-04-06T02:21:02.284+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T02:21:02.296544229Z [2024-04-06T02:21:02.295+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T02:21:02.355903767Z [2024-04-06T02:21:02.355+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f, task_id=get_sdnc_status_and_send_to_prometheus, execution_date=20240406T022000, start_date=, end_date=20240406T022102 2024-04-06T02:21:05.328972631Z [2024-04-06T02:21:05.328+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:21:05.329780107Z [2024-04-06T02:21:05.329+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:20:00+00:00, run_id=scheduled__2024-04-06T02:20:00+00:00, run_start_date=2024-04-06 02:21:00.455392+00:00, run_end_date=2024-04-06 02:21:05.329205+00:00, run_duration=4.873813, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:20:00+00:00, data_interval_end=2024-04-06 02:21:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:21:05.341179684Z [2024-04-06T02:21:05.340+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:21:00+00:00, run_after=2024-04-06T02:22:00+00:00 2024-04-06T02:21:05.386131745Z [2024-04-06T02:21:05.385+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:20:00+00:00 exited with status success for try_number 1 2024-04-06T02:21:05.394665722Z [2024-04-06T02:21:05.394+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:20:00+00:00, map_index=-1, run_start_date=2024-04-06 02:21:02.981620+00:00, run_end_date=2024-04-06 02:21:05.022754+00:00, run_duration=2.041134, state=success, executor_state=success, try_number=1, max_tries=1, job_id=179, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:21:00.543656+00:00, queued_by_job_id=2, pid=4065 2024-04-06T02:21:06.448874650Z [2024-04-06T02:21:06.448+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:21:06.449389801Z [2024-04-06T02:21:06.449+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:20:00+00:00, run_id=scheduled__2024-04-06T02:20:00+00:00, run_start_date=2024-04-06 02:21:00.456526+00:00, run_end_date=2024-04-06 02:21:06.448989+00:00, run_duration=5.992463, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:20:00+00:00, data_interval_end=2024-04-06 02:21:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:21:06.459722943Z [2024-04-06T02:21:06.459+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:21:00+00:00, run_after=2024-04-06T02:22:00+00:00 2024-04-06T02:21:06.514630399Z [2024-04-06T02:21:06.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:20:00+00:00 exited with status success for try_number 1 2024-04-06T02:21:06.522422946Z [2024-04-06T02:21:06.522+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:20:00+00:00, map_index=-1, run_start_date=2024-04-06 02:21:02.985748+00:00, run_end_date=2024-04-06 02:21:05.729872+00:00, run_duration=2.744124, state=success, executor_state=success, try_number=1, max_tries=1, job_id=178, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:21:00.543656+00:00, queued_by_job_id=2, pid=4066 2024-04-06T02:21:12.923287946Z [2024-04-06T02:21:12.922+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:21:12.923352105Z 2024-04-06T02:21:12.923574767Z [2024-04-06T02:21:12.923+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f has 0/16 running and queued tasks 2024-04-06T02:21:12.924367177Z [2024-04-06T02:21:12.924+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:21:12.924381665Z 2024-04-06T02:21:12.928984257Z [2024-04-06T02:21:12.928+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:20:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:21:12.929126525Z [2024-04-06T02:21:12.928+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-06T02:21:13.022489680Z [2024-04-06T02:21:13.021+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:20:00+00:00 exited with status queued for try_number 2 2024-04-06T02:21:13.036858398Z [2024-04-06T02:21:13.035+0000] {scheduler_job.py:635} INFO - Setting external_id for to a7679e49-4281-4499-8395-18f29a276bcf 2024-04-06T02:21:13.634769946Z [2024-04-06T02:21:13.634+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:20:00+00:00 exited with status failed for try_number 2 2024-04-06T02:21:13.643364235Z [2024-04-06T02:21:13.642+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:20:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-06 02:21:02.303858+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:21:12.926017+00:00, queued_by_job_id=2, pid=None 2024-04-06T02:21:13.644271868Z [2024-04-06T02:21:13.643+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T02:21:13.647477529Z [2024-04-06T02:21:13.647+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T02:21:13.664181247Z [2024-04-06T02:21:13.663+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f, task_id=get_sdnc_status_and_send_to_prometheus, execution_date=20240406T022000, start_date=, end_date=20240406T022113 2024-04-06T02:21:14.765828183Z [2024-04-06T02:21:14.765+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-06T02:21:14.766154427Z [2024-04-06T02:21:14.765+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f, execution_date=2024-04-06 02:20:00+00:00, run_id=scheduled__2024-04-06T02:20:00+00:00, run_start_date=2024-04-06 02:21:00.453509+00:00, run_end_date=2024-04-06 02:21:14.765724+00:00, run_duration=14.312215, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:20:00+00:00, data_interval_end=2024-04-06 02:21:00+00:00, dag_hash=7cf6305fd41f05725eca646b1588f981 2024-04-06T02:21:14.780582071Z [2024-04-06T02:21:14.777+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_905b1d54-6788-4825-83cc-9a9ec6b99c3f to 2024-04-06T02:21:00+00:00, run_after=2024-04-06T02:22:00+00:00 2024-04-06T02:22:00.416708043Z [2024-04-06T02:22:00.415+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:22:00.423503218Z [2024-04-06T02:22:00.423+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:22:00.443164118Z [2024-04-06T02:22:00.442+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:22:00+00:00, run_after=2024-04-06T02:23:00+00:00 2024-04-06T02:22:00.530514579Z [2024-04-06T02:22:00.529+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T02:22:00.530541227Z 2024-04-06T02:22:00.530545898Z 2024-04-06T02:22:00.530587573Z 2024-04-06T02:22:00.530921716Z [2024-04-06T02:22:00.530+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T02:22:00.531342871Z [2024-04-06T02:22:00.531+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:22:00.531859712Z [2024-04-06T02:22:00.531+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:22:00.533423226Z [2024-04-06T02:22:00.533+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:22:00.533434057Z 2024-04-06T02:22:00.533458334Z 2024-04-06T02:22:00.533462777Z 2024-04-06T02:22:00.538583463Z [2024-04-06T02:22:00.538+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:22:00.538867369Z [2024-04-06T02:22:00.538+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:22:00.539262092Z [2024-04-06T02:22:00.539+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:22:00.539526912Z [2024-04-06T02:22:00.539+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:22:00.539888883Z [2024-04-06T02:22:00.539+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:22:00.540132481Z [2024-04-06T02:22:00.539+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:22:00.871846428Z [2024-04-06T02:22:00.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:20:00+00:00 exited with status queued for try_number 1 2024-04-06T02:22:00.872596236Z [2024-04-06T02:22:00.872+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:21:00+00:00 exited with status queued for try_number 1 2024-04-06T02:22:00.873238495Z [2024-04-06T02:22:00.872+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:21:00+00:00 exited with status queued for try_number 1 2024-04-06T02:22:00.887939276Z [2024-04-06T02:22:00.887+0000] {scheduler_job.py:635} INFO - Setting external_id for to f119277b-3e5e-4f30-8f60-226f5b60a3fe 2024-04-06T02:22:00.888413650Z [2024-04-06T02:22:00.888+0000] {scheduler_job.py:635} INFO - Setting external_id for to 55056b9a-b948-4048-90fc-7c607f27a345 2024-04-06T02:22:00.888751639Z [2024-04-06T02:22:00.888+0000] {scheduler_job.py:635} INFO - Setting external_id for to ffe399b4-46cd-41c4-a3ae-cd4d1a3203ba 2024-04-06T02:22:02.240563945Z [2024-04-06T02:22:02.240+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:22:02.248301737Z [2024-04-06T02:22:02.246+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 02:20:00+00:00, run_id=scheduled__2024-04-06T02:20:00+00:00, run_start_date=2024-04-06 02:22:00.456601+00:00, run_end_date=2024-04-06 02:22:02.240491+00:00, run_duration=1.78389, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:20:00+00:00, data_interval_end=2024-04-06 02:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T02:22:02.273485837Z [2024-04-06T02:22:02.273+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T02:22:00+00:00, run_after=2024-04-06T02:24:00+00:00 2024-04-06T02:22:02.392827504Z [2024-04-06T02:22:02.392+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:20:00+00:00 exited with status success for try_number 1 2024-04-06T02:22:02.402924845Z [2024-04-06T02:22:02.402+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T02:20:00+00:00, map_index=-1, run_start_date=2024-04-06 02:22:01.438609+00:00, run_end_date=2024-04-06 02:22:01.979007+00:00, run_duration=0.540398, state=success, executor_state=success, try_number=1, max_tries=1, job_id=180, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:22:00.535216+00:00, queued_by_job_id=2, pid=4120 2024-04-06T02:22:05.506849046Z [2024-04-06T02:22:05.506+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:22:05.507177601Z [2024-04-06T02:22:05.506+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:21:00+00:00, run_id=scheduled__2024-04-06T02:21:00+00:00, run_start_date=2024-04-06 02:22:00.460219+00:00, run_end_date=2024-04-06 02:22:05.506814+00:00, run_duration=5.046595, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:21:00+00:00, data_interval_end=2024-04-06 02:22:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:22:05.520918948Z [2024-04-06T02:22:05.520+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:22:00+00:00, run_after=2024-04-06T02:23:00+00:00 2024-04-06T02:22:05.528269164Z [2024-04-06T02:22:05.527+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:22:05.528525573Z [2024-04-06T02:22:05.528+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:21:00+00:00, run_id=scheduled__2024-04-06T02:21:00+00:00, run_start_date=2024-04-06 02:22:00.459152+00:00, run_end_date=2024-04-06 02:22:05.528260+00:00, run_duration=5.069108, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:21:00+00:00, data_interval_end=2024-04-06 02:22:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:22:05.538598196Z [2024-04-06T02:22:05.538+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:22:00+00:00, run_after=2024-04-06T02:23:00+00:00 2024-04-06T02:22:05.577028216Z [2024-04-06T02:22:05.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:21:00+00:00 exited with status success for try_number 1 2024-04-06T02:22:05.577067774Z [2024-04-06T02:22:05.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:21:00+00:00 exited with status success for try_number 1 2024-04-06T02:22:05.587397250Z [2024-04-06T02:22:05.586+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:21:00+00:00, map_index=-1, run_start_date=2024-04-06 02:22:02.926486+00:00, run_end_date=2024-04-06 02:22:05.373550+00:00, run_duration=2.447064, state=success, executor_state=success, try_number=1, max_tries=1, job_id=181, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:22:00.535216+00:00, queued_by_job_id=2, pid=4141 2024-04-06T02:22:05.587750130Z [2024-04-06T02:22:05.587+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:21:00+00:00, map_index=-1, run_start_date=2024-04-06 02:22:03.462929+00:00, run_end_date=2024-04-06 02:22:05.026016+00:00, run_duration=1.563087, state=success, executor_state=success, try_number=1, max_tries=1, job_id=182, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:22:00.535216+00:00, queued_by_job_id=2, pid=4160 2024-04-06T02:23:00.247875068Z [2024-04-06T02:23:00.246+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:23:00.282165607Z [2024-04-06T02:23:00.281+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:23:00+00:00, run_after=2024-04-06T02:24:00+00:00 2024-04-06T02:23:00.369562847Z [2024-04-06T02:23:00.369+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T02:23:00.369600874Z 2024-04-06T02:23:00.369608653Z 2024-04-06T02:23:00.369708634Z [2024-04-06T02:23:00.369+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:23:00.370007326Z [2024-04-06T02:23:00.369+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:23:00.370980679Z [2024-04-06T02:23:00.370+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:23:00.370998753Z 2024-04-06T02:23:00.371005356Z 2024-04-06T02:23:00.375892951Z [2024-04-06T02:23:00.375+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:23:00.376300263Z [2024-04-06T02:23:00.375+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:23:00.376646670Z [2024-04-06T02:23:00.376+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:23:00.376801877Z [2024-04-06T02:23:00.376+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:23:00.514686248Z [2024-04-06T02:23:00.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:22:00+00:00 exited with status queued for try_number 1 2024-04-06T02:23:00.515012818Z [2024-04-06T02:23:00.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:22:00+00:00 exited with status queued for try_number 1 2024-04-06T02:23:00.521610746Z [2024-04-06T02:23:00.521+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9076464-e6a0-4147-bcc7-4da8af33ab1f 2024-04-06T02:23:00.521902255Z [2024-04-06T02:23:00.521+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d5106ae-1ca1-4c71-87ee-50e42f65c762 2024-04-06T02:23:05.153065040Z [2024-04-06T02:23:05.152+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:23:05.153537672Z [2024-04-06T02:23:05.153+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:22:00+00:00, run_id=scheduled__2024-04-06T02:22:00+00:00, run_start_date=2024-04-06 02:23:00.296727+00:00, run_end_date=2024-04-06 02:23:05.153029+00:00, run_duration=4.856302, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:22:00+00:00, data_interval_end=2024-04-06 02:23:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:23:05.184282332Z [2024-04-06T02:23:05.183+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:23:00+00:00, run_after=2024-04-06T02:24:00+00:00 2024-04-06T02:23:05.197478763Z [2024-04-06T02:23:05.197+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:23:05.197705458Z [2024-04-06T02:23:05.197+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:22:00+00:00, run_id=scheduled__2024-04-06T02:22:00+00:00, run_start_date=2024-04-06 02:23:00.298213+00:00, run_end_date=2024-04-06 02:23:05.197424+00:00, run_duration=4.899211, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:22:00+00:00, data_interval_end=2024-04-06 02:23:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:23:05.210543466Z [2024-04-06T02:23:05.210+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:23:00+00:00, run_after=2024-04-06T02:24:00+00:00 2024-04-06T02:23:05.240665780Z [2024-04-06T02:23:05.240+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:22:00+00:00 exited with status success for try_number 1 2024-04-06T02:23:05.242131311Z [2024-04-06T02:23:05.241+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:22:00+00:00 exited with status success for try_number 1 2024-04-06T02:23:05.261188451Z [2024-04-06T02:23:05.260+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:22:00+00:00, map_index=-1, run_start_date=2024-04-06 02:23:02.520932+00:00, run_end_date=2024-04-06 02:23:04.119973+00:00, run_duration=1.599041, state=success, executor_state=success, try_number=1, max_tries=1, job_id=183, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:23:00.371827+00:00, queued_by_job_id=2, pid=4205 2024-04-06T02:23:05.261565925Z [2024-04-06T02:23:05.261+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:22:00+00:00, map_index=-1, run_start_date=2024-04-06 02:23:02.629950+00:00, run_end_date=2024-04-06 02:23:04.466266+00:00, run_duration=1.836316, state=success, executor_state=success, try_number=1, max_tries=1, job_id=184, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:23:00.371827+00:00, queued_by_job_id=2, pid=4206 2024-04-06T02:24:00.911800051Z [2024-04-06T02:24:00.911+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:24:00.924229057Z [2024-04-06T02:24:00.923+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:24:00+00:00, run_after=2024-04-06T02:25:00+00:00 2024-04-06T02:24:00.931570197Z [2024-04-06T02:24:00.931+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:24:01.009225075Z [2024-04-06T02:24:01.008+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T02:24:01.009252480Z 2024-04-06T02:24:01.009261599Z 2024-04-06T02:24:01.009265038Z 2024-04-06T02:24:01.009556722Z [2024-04-06T02:24:01.009+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T02:24:01.009869633Z [2024-04-06T02:24:01.009+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:24:01.010040262Z [2024-04-06T02:24:01.009+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:24:01.010943605Z [2024-04-06T02:24:01.010+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:24:01.010951923Z 2024-04-06T02:24:01.010960660Z 2024-04-06T02:24:01.010964586Z 2024-04-06T02:24:01.015118675Z [2024-04-06T02:24:01.014+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:24:01.015363837Z [2024-04-06T02:24:01.015+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:24:01.015730931Z [2024-04-06T02:24:01.015+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:24:01.016028393Z [2024-04-06T02:24:01.015+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:24:01.016579621Z [2024-04-06T02:24:01.016+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:24:01.016737553Z [2024-04-06T02:24:01.016+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:24:01.311907332Z [2024-04-06T02:24:01.311+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:22:00+00:00 exited with status queued for try_number 1 2024-04-06T02:24:01.314435928Z [2024-04-06T02:24:01.314+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:23:00+00:00 exited with status queued for try_number 1 2024-04-06T02:24:01.314837110Z [2024-04-06T02:24:01.314+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:23:00+00:00 exited with status queued for try_number 1 2024-04-06T02:24:01.327732950Z [2024-04-06T02:24:01.327+0000] {scheduler_job.py:635} INFO - Setting external_id for to 02e87093-3054-4beb-b73c-21596f3b2d7e 2024-04-06T02:24:01.327911670Z [2024-04-06T02:24:01.327+0000] {scheduler_job.py:635} INFO - Setting external_id for to 150eff79-72e7-4882-8b82-17ea7cb77fb8 2024-04-06T02:24:01.328065906Z [2024-04-06T02:24:01.327+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30b6745c-4a90-4776-9515-6f7a974321f6 2024-04-06T02:24:03.671052278Z [2024-04-06T02:24:03.670+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:24:03.671330139Z [2024-04-06T02:24:03.671+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 02:22:00+00:00, run_id=scheduled__2024-04-06T02:22:00+00:00, run_start_date=2024-04-06 02:24:00.944394+00:00, run_end_date=2024-04-06 02:24:03.670982+00:00, run_duration=2.726588, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:22:00+00:00, data_interval_end=2024-04-06 02:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T02:24:03.703171342Z [2024-04-06T02:24:03.701+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T02:24:00+00:00, run_after=2024-04-06T02:26:00+00:00 2024-04-06T02:24:03.806603407Z [2024-04-06T02:24:03.806+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:22:00+00:00 exited with status success for try_number 1 2024-04-06T02:24:03.811856119Z [2024-04-06T02:24:03.811+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T02:22:00+00:00, map_index=-1, run_start_date=2024-04-06 02:24:02.077027+00:00, run_end_date=2024-04-06 02:24:02.719634+00:00, run_duration=0.642607, state=success, executor_state=success, try_number=1, max_tries=1, job_id=185, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:24:01.012139+00:00, queued_by_job_id=2, pid=4241 2024-04-06T02:24:05.991005617Z [2024-04-06T02:24:05.990+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:24:05.991733001Z [2024-04-06T02:24:05.991+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:23:00+00:00, run_id=scheduled__2024-04-06T02:23:00+00:00, run_start_date=2024-04-06 02:24:00.945903+00:00, run_end_date=2024-04-06 02:24:05.990836+00:00, run_duration=5.044933, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:23:00+00:00, data_interval_end=2024-04-06 02:24:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:24:06.014562235Z [2024-04-06T02:24:06.014+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:24:00+00:00, run_after=2024-04-06T02:25:00+00:00 2024-04-06T02:24:06.022613931Z [2024-04-06T02:24:06.022+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:24:06.022876928Z [2024-04-06T02:24:06.022+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:23:00+00:00, run_id=scheduled__2024-04-06T02:23:00+00:00, run_start_date=2024-04-06 02:24:00.947047+00:00, run_end_date=2024-04-06 02:24:06.022511+00:00, run_duration=5.075464, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:23:00+00:00, data_interval_end=2024-04-06 02:24:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:24:06.032472796Z [2024-04-06T02:24:06.032+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:24:00+00:00, run_after=2024-04-06T02:25:00+00:00 2024-04-06T02:24:06.099008780Z [2024-04-06T02:24:06.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:23:00+00:00 exited with status success for try_number 1 2024-04-06T02:24:06.099564715Z [2024-04-06T02:24:06.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:23:00+00:00 exited with status success for try_number 1 2024-04-06T02:24:06.111069248Z [2024-04-06T02:24:06.110+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:23:00+00:00, map_index=-1, run_start_date=2024-04-06 02:24:03.837311+00:00, run_end_date=2024-04-06 02:24:05.376448+00:00, run_duration=1.539137, state=success, executor_state=success, try_number=1, max_tries=1, job_id=187, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:24:01.012139+00:00, queued_by_job_id=2, pid=4272 2024-04-06T02:24:06.111324519Z [2024-04-06T02:24:06.111+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:23:00+00:00, map_index=-1, run_start_date=2024-04-06 02:24:03.526256+00:00, run_end_date=2024-04-06 02:24:05.492704+00:00, run_duration=1.966448, state=success, executor_state=success, try_number=1, max_tries=1, job_id=186, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:24:01.012139+00:00, queued_by_job_id=2, pid=4262 2024-04-06T02:25:00.403093262Z [2024-04-06T02:25:00.402+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:25:00+00:00, run_after=2024-04-06T02:30:00+00:00 2024-04-06T02:25:00.416753023Z [2024-04-06T02:25:00.416+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:25:00+00:00, run_after=2024-04-06T02:26:00+00:00 2024-04-06T02:25:00.424662370Z [2024-04-06T02:25:00.424+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:25:00.522890935Z [2024-04-06T02:25:00.522+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T02:25:00.522967698Z 2024-04-06T02:25:00.522980541Z 2024-04-06T02:25:00.522989630Z 2024-04-06T02:25:00.523131497Z [2024-04-06T02:25:00.522+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:25:00.523179433Z [2024-04-06T02:25:00.522+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:25:00.523254044Z [2024-04-06T02:25:00.523+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:25:00.524031733Z [2024-04-06T02:25:00.523+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:25:00.524069190Z 2024-04-06T02:25:00.524086900Z 2024-04-06T02:25:00.524099421Z 2024-04-06T02:25:00.528682920Z [2024-04-06T02:25:00.528+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-06T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-06T02:25:00.528826755Z [2024-04-06T02:25:00.528+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:25:00.529265569Z [2024-04-06T02:25:00.528+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:25:00.529426242Z [2024-04-06T02:25:00.529+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:25:00.529783585Z [2024-04-06T02:25:00.529+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:25:00.529914661Z [2024-04-06T02:25:00.529+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:25:00.919608635Z [2024-04-06T02:25:00.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T02:20:00+00:00 exited with status queued for try_number 1 2024-04-06T02:25:00.921741477Z [2024-04-06T02:25:00.919+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:24:00+00:00 exited with status queued for try_number 1 2024-04-06T02:25:00.921945135Z [2024-04-06T02:25:00.921+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:24:00+00:00 exited with status queued for try_number 1 2024-04-06T02:25:00.943481571Z [2024-04-06T02:25:00.943+0000] {scheduler_job.py:635} INFO - Setting external_id for to b0fd2767-fdc8-47d0-9158-e2f6ca5f42f9 2024-04-06T02:25:00.944123248Z [2024-04-06T02:25:00.943+0000] {scheduler_job.py:635} INFO - Setting external_id for to e3471dec-26ce-41ae-93bd-8a6aee6365e0 2024-04-06T02:25:00.944528310Z [2024-04-06T02:25:00.944+0000] {scheduler_job.py:635} INFO - Setting external_id for to 41489524-f73d-4600-bf21-0d412fe8704d 2024-04-06T02:25:04.727279941Z [2024-04-06T02:25:04.726+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:25:04.727311136Z 2024-04-06T02:25:04.727370838Z [2024-04-06T02:25:04.727+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:25:04.727933618Z [2024-04-06T02:25:04.727+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:25:04.727943648Z 2024-04-06T02:25:04.730311007Z [2024-04-06T02:25:04.730+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='split_metrics', run_id='scheduled__2024-04-06T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-06T02:25:04.730457383Z [2024-04-06T02:25:04.730+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:25:04.779553477Z [2024-04-06T02:25:04.779+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T02:20:00+00:00 exited with status queued for try_number 1 2024-04-06T02:25:04.779657618Z [2024-04-06T02:25:04.779+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T02:20:00+00:00 exited with status success for try_number 1 2024-04-06T02:25:04.784742576Z [2024-04-06T02:25:04.784+0000] {scheduler_job.py:635} INFO - Setting external_id for to e7957e11-1aec-4f6f-bb50-183db2d66d6d 2024-04-06T02:25:04.785012968Z [2024-04-06T02:25:04.784+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-06T02:20:00+00:00, map_index=-1, run_start_date=2024-04-06 02:25:03.663086+00:00, run_end_date=2024-04-06 02:25:04.203401+00:00, run_duration=0.540315, state=success, executor_state=success, try_number=1, max_tries=1, job_id=190, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:25:00.525113+00:00, queued_by_job_id=2, pid=4349 2024-04-06T02:25:06.064317431Z [2024-04-06T02:25:06.063+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:25:06.064582248Z [2024-04-06T02:25:06.064+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:24:00+00:00, run_id=scheduled__2024-04-06T02:24:00+00:00, run_start_date=2024-04-06 02:25:00.438846+00:00, run_end_date=2024-04-06 02:25:06.064108+00:00, run_duration=5.625262, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:24:00+00:00, data_interval_end=2024-04-06 02:25:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:25:06.072837332Z [2024-04-06T02:25:06.072+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:25:00+00:00, run_after=2024-04-06T02:26:00+00:00 2024-04-06T02:25:06.078445732Z [2024-04-06T02:25:06.078+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:25:06.078731857Z [2024-04-06T02:25:06.078+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:24:00+00:00, run_id=scheduled__2024-04-06T02:24:00+00:00, run_start_date=2024-04-06 02:25:00.440802+00:00, run_end_date=2024-04-06 02:25:06.078329+00:00, run_duration=5.637527, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:24:00+00:00, data_interval_end=2024-04-06 02:25:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:25:06.089167672Z [2024-04-06T02:25:06.088+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:25:00+00:00, run_after=2024-04-06T02:26:00+00:00 2024-04-06T02:25:06.146255956Z [2024-04-06T02:25:06.145+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:24:00+00:00 exited with status success for try_number 1 2024-04-06T02:25:06.146473553Z [2024-04-06T02:25:06.146+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:24:00+00:00 exited with status success for try_number 1 2024-04-06T02:25:06.152492129Z [2024-04-06T02:25:06.152+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:24:00+00:00, map_index=-1, run_start_date=2024-04-06 02:25:03.361047+00:00, run_end_date=2024-04-06 02:25:04.897556+00:00, run_duration=1.536509, state=success, executor_state=success, try_number=1, max_tries=1, job_id=189, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:25:00.525113+00:00, queued_by_job_id=2, pid=4348 2024-04-06T02:25:06.152830384Z [2024-04-06T02:25:06.152+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:24:00+00:00, map_index=-1, run_start_date=2024-04-06 02:25:02.845651+00:00, run_end_date=2024-04-06 02:25:05.675456+00:00, run_duration=2.829805, state=success, executor_state=success, try_number=1, max_tries=1, job_id=188, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:25:00.525113+00:00, queued_by_job_id=2, pid=4320 2024-04-06T02:25:07.161680662Z [2024-04-06T02:25:07.161+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:25:07.161735171Z 2024-04-06T02:25:07.161801220Z [2024-04-06T02:25:07.161+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:25:07.162794299Z [2024-04-06T02:25:07.162+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:25:07.162827663Z 2024-04-06T02:25:07.165546612Z [2024-04-06T02:25:07.165+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='collect_metrics', run_id='scheduled__2024-04-06T02:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-06T02:25:07.165672653Z [2024-04-06T02:25:07.165+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T02:25:07.236904001Z [2024-04-06T02:25:07.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T02:20:00+00:00 exited with status queued for try_number 1 2024-04-06T02:25:07.249606410Z [2024-04-06T02:25:07.243+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8d2093d9-2493-42c0-92cc-bb503ec2f205 2024-04-06T02:25:07.358482616Z [2024-04-06T02:25:07.355+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T02:20:00+00:00 exited with status success for try_number 1 2024-04-06T02:25:07.369465003Z [2024-04-06T02:25:07.368+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=split_metrics, run_id=scheduled__2024-04-06T02:20:00+00:00, map_index=-1, run_start_date=2024-04-06 02:25:06.632511+00:00, run_end_date=2024-04-06 02:25:07.025223+00:00, run_duration=0.392712, state=success, executor_state=success, try_number=1, max_tries=1, job_id=191, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:25:04.728284+00:00, queued_by_job_id=2, pid=4379 2024-04-06T02:25:09.280026928Z [2024-04-06T02:25:09.279+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:25:09.280059249Z 2024-04-06T02:25:09.280122918Z [2024-04-06T02:25:09.279+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:25:09.280753242Z [2024-04-06T02:25:09.280+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:25:09.280764779Z 2024-04-06T02:25:09.283914792Z [2024-04-06T02:25:09.283+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='send_prometheus', run_id='scheduled__2024-04-06T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:25:09.283998483Z [2024-04-06T02:25:09.283+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:25:09.373309085Z [2024-04-06T02:25:09.372+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T02:20:00+00:00 exited with status queued for try_number 1 2024-04-06T02:25:09.373441094Z [2024-04-06T02:25:09.373+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T02:20:00+00:00 exited with status success for try_number 1 2024-04-06T02:25:09.382964352Z [2024-04-06T02:25:09.382+0000] {scheduler_job.py:635} INFO - Setting external_id for to cefd9c43-884a-443e-9ac2-63921a7cdd12 2024-04-06T02:25:09.383072203Z [2024-04-06T02:25:09.382+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=collect_metrics, run_id=scheduled__2024-04-06T02:20:00+00:00, map_index=0, run_start_date=2024-04-06 02:25:08.816544+00:00, run_end_date=2024-04-06 02:25:09.229067+00:00, run_duration=0.412523, state=success, executor_state=success, try_number=1, max_tries=1, job_id=192, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:25:07.163103+00:00, queued_by_job_id=2, pid=4391 2024-04-06T02:25:11.666636839Z [2024-04-06T02:25:11.659+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:25:11.666663890Z [2024-04-06T02:25:11.660+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:20:00+00:00, run_id=scheduled__2024-04-06T02:20:00+00:00, run_start_date=2024-04-06 02:25:00.437225+00:00, run_end_date=2024-04-06 02:25:11.660013+00:00, run_duration=11.222788, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:20:00+00:00, data_interval_end=2024-04-06 02:25:00+00:00, dag_hash=eecc559ff32fe9a7c4345875f113a0a9 2024-04-06T02:25:11.668552469Z [2024-04-06T02:25:11.667+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:25:00+00:00, run_after=2024-04-06T02:30:00+00:00 2024-04-06T02:25:12.707937565Z [2024-04-06T02:25:12.707+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T02:20:00+00:00 exited with status success for try_number 1 2024-04-06T02:25:12.719849164Z [2024-04-06T02:25:12.719+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=send_prometheus, run_id=scheduled__2024-04-06T02:20:00+00:00, map_index=-1, run_start_date=2024-04-06 02:25:11.045913+00:00, run_end_date=2024-04-06 02:25:11.517476+00:00, run_duration=0.471563, state=success, executor_state=success, try_number=1, max_tries=1, job_id=193, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:25:09.281044+00:00, queued_by_job_id=2, pid=4412 2024-04-06T02:25:19.787669879Z [2024-04-06T02:25:19.787+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-06T02:26:00.585583411Z [2024-04-06T02:26:00.584+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:26:00.605216130Z [2024-04-06T02:26:00.604+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:26:00+00:00, run_after=2024-04-06T02:27:00+00:00 2024-04-06T02:26:00.615148110Z [2024-04-06T02:26:00.614+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:26:00.699512334Z [2024-04-06T02:26:00.699+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T02:26:00.699535618Z 2024-04-06T02:26:00.699544155Z 2024-04-06T02:26:00.699548789Z 2024-04-06T02:26:00.700016635Z [2024-04-06T02:26:00.699+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T02:26:00.703771620Z [2024-04-06T02:26:00.703+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:26:00.703783690Z [2024-04-06T02:26:00.703+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:26:00.704580008Z [2024-04-06T02:26:00.704+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:26:00.704599225Z 2024-04-06T02:26:00.704603247Z 2024-04-06T02:26:00.704606524Z 2024-04-06T02:26:00.708871602Z [2024-04-06T02:26:00.708+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:26:00.708884955Z [2024-04-06T02:26:00.708+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:26:00.709207855Z [2024-04-06T02:26:00.709+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:26:00.709433076Z [2024-04-06T02:26:00.709+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:26:00.709739261Z [2024-04-06T02:26:00.709+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:26:00.710089405Z [2024-04-06T02:26:00.709+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:26:01.187010115Z [2024-04-06T02:26:01.186+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:24:00+00:00 exited with status queued for try_number 1 2024-04-06T02:26:01.189782012Z [2024-04-06T02:26:01.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:25:00+00:00 exited with status queued for try_number 1 2024-04-06T02:26:01.189895755Z [2024-04-06T02:26:01.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:25:00+00:00 exited with status queued for try_number 1 2024-04-06T02:26:01.205937255Z [2024-04-06T02:26:01.205+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0802159-fea9-4f8b-ba44-33770a750406 2024-04-06T02:26:01.206167311Z [2024-04-06T02:26:01.206+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d304116-c09e-49b6-8a2c-6f086a3a88d6 2024-04-06T02:26:01.206415971Z [2024-04-06T02:26:01.206+0000] {scheduler_job.py:635} INFO - Setting external_id for to dfee7e42-1e72-4b9e-aef6-d3a0876bfd00 2024-04-06T02:26:03.551586798Z [2024-04-06T02:26:03.551+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:26:03.554453401Z [2024-04-06T02:26:03.551+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 02:24:00+00:00, run_id=scheduled__2024-04-06T02:24:00+00:00, run_start_date=2024-04-06 02:26:00.628720+00:00, run_end_date=2024-04-06 02:26:03.551530+00:00, run_duration=2.92281, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:24:00+00:00, data_interval_end=2024-04-06 02:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T02:26:03.570286843Z [2024-04-06T02:26:03.569+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T02:26:00+00:00, run_after=2024-04-06T02:28:00+00:00 2024-04-06T02:26:03.714159262Z [2024-04-06T02:26:03.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:24:00+00:00 exited with status success for try_number 1 2024-04-06T02:26:03.728908031Z [2024-04-06T02:26:03.728+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T02:24:00+00:00, map_index=-1, run_start_date=2024-04-06 02:26:01.814773+00:00, run_end_date=2024-04-06 02:26:02.591491+00:00, run_duration=0.776718, state=success, executor_state=success, try_number=1, max_tries=1, job_id=194, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:26:00.705606+00:00, queued_by_job_id=2, pid=4419 2024-04-06T02:26:05.906981739Z [2024-04-06T02:26:05.906+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:26:05.907259960Z [2024-04-06T02:26:05.906+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:25:00+00:00, run_id=scheduled__2024-04-06T02:25:00+00:00, run_start_date=2024-04-06 02:26:00.630436+00:00, run_end_date=2024-04-06 02:26:05.906787+00:00, run_duration=5.276351, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:25:00+00:00, data_interval_end=2024-04-06 02:26:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:26:05.920516139Z [2024-04-06T02:26:05.919+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:26:00+00:00, run_after=2024-04-06T02:27:00+00:00 2024-04-06T02:26:05.929064892Z [2024-04-06T02:26:05.928+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:26:05.929139053Z [2024-04-06T02:26:05.928+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:25:00+00:00, run_id=scheduled__2024-04-06T02:25:00+00:00, run_start_date=2024-04-06 02:26:00.631857+00:00, run_end_date=2024-04-06 02:26:05.928803+00:00, run_duration=5.296946, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:25:00+00:00, data_interval_end=2024-04-06 02:26:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:26:05.938537569Z [2024-04-06T02:26:05.938+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:26:00+00:00, run_after=2024-04-06T02:27:00+00:00 2024-04-06T02:26:05.975141833Z [2024-04-06T02:26:05.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:25:00+00:00 exited with status success for try_number 1 2024-04-06T02:26:05.975201144Z [2024-04-06T02:26:05.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:25:00+00:00 exited with status success for try_number 1 2024-04-06T02:26:05.985326797Z [2024-04-06T02:26:05.984+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:25:00+00:00, map_index=-1, run_start_date=2024-04-06 02:26:03.433034+00:00, run_end_date=2024-04-06 02:26:05.524768+00:00, run_duration=2.091734, state=success, executor_state=success, try_number=1, max_tries=1, job_id=196, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:26:00.705606+00:00, queued_by_job_id=2, pid=4450 2024-04-06T02:26:05.985889631Z [2024-04-06T02:26:05.985+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:25:00+00:00, map_index=-1, run_start_date=2024-04-06 02:26:03.129562+00:00, run_end_date=2024-04-06 02:26:05.262601+00:00, run_duration=2.133039, state=success, executor_state=success, try_number=1, max_tries=1, job_id=195, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:26:00.705606+00:00, queued_by_job_id=2, pid=4442 2024-04-06T02:27:00.713386086Z [2024-04-06T02:27:00.709+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:27:00+00:00, run_after=2024-04-06T02:28:00+00:00 2024-04-06T02:27:00.742544791Z [2024-04-06T02:27:00.728+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:27:00.785759500Z [2024-04-06T02:27:00.785+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T02:27:00.785807167Z 2024-04-06T02:27:00.785822939Z 2024-04-06T02:27:00.786675031Z [2024-04-06T02:27:00.786+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:27:00.787021455Z [2024-04-06T02:27:00.786+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:27:00.789423060Z [2024-04-06T02:27:00.789+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:27:00.789437782Z 2024-04-06T02:27:00.789443977Z 2024-04-06T02:27:00.796914360Z [2024-04-06T02:27:00.796+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:27:00.798178962Z [2024-04-06T02:27:00.797+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:27:00.799012001Z [2024-04-06T02:27:00.798+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:27:00.801348591Z [2024-04-06T02:27:00.801+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:27:01.142486320Z [2024-04-06T02:27:01.141+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:26:00+00:00 exited with status queued for try_number 1 2024-04-06T02:27:01.142685466Z [2024-04-06T02:27:01.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:26:00+00:00 exited with status queued for try_number 1 2024-04-06T02:27:01.162480393Z [2024-04-06T02:27:01.162+0000] {scheduler_job.py:635} INFO - Setting external_id for to a3c3fc24-511b-4ea7-9eb5-6db935345045 2024-04-06T02:27:01.162697891Z [2024-04-06T02:27:01.162+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6861d1d9-2ad3-473c-aa1c-bf54c3771940 2024-04-06T02:27:05.867680866Z [2024-04-06T02:27:05.866+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:27:05.868679325Z [2024-04-06T02:27:05.868+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:26:00+00:00, run_id=scheduled__2024-04-06T02:26:00+00:00, run_start_date=2024-04-06 02:27:00.738555+00:00, run_end_date=2024-04-06 02:27:05.867556+00:00, run_duration=5.129001, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:26:00+00:00, data_interval_end=2024-04-06 02:27:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:27:05.901729062Z [2024-04-06T02:27:05.901+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:27:00+00:00, run_after=2024-04-06T02:28:00+00:00 2024-04-06T02:27:05.961471584Z [2024-04-06T02:27:05.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:26:00+00:00 exited with status success for try_number 1 2024-04-06T02:27:05.968669134Z [2024-04-06T02:27:05.968+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:26:00+00:00, map_index=-1, run_start_date=2024-04-06 02:27:03.527354+00:00, run_end_date=2024-04-06 02:27:05.179469+00:00, run_duration=1.652115, state=success, executor_state=success, try_number=1, max_tries=1, job_id=198, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:27:00.792028+00:00, queued_by_job_id=2, pid=4505 2024-04-06T02:27:07.025687591Z [2024-04-06T02:27:07.025+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:27:07.026012931Z [2024-04-06T02:27:07.025+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:26:00+00:00, run_id=scheduled__2024-04-06T02:26:00+00:00, run_start_date=2024-04-06 02:27:00.739893+00:00, run_end_date=2024-04-06 02:27:07.025331+00:00, run_duration=6.285438, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:26:00+00:00, data_interval_end=2024-04-06 02:27:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:27:07.038292957Z [2024-04-06T02:27:07.037+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:27:00+00:00, run_after=2024-04-06T02:28:00+00:00 2024-04-06T02:27:07.083566557Z [2024-04-06T02:27:07.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:26:00+00:00 exited with status success for try_number 1 2024-04-06T02:27:07.090819836Z [2024-04-06T02:27:07.090+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:26:00+00:00, map_index=-1, run_start_date=2024-04-06 02:27:03.417218+00:00, run_end_date=2024-04-06 02:27:06.516970+00:00, run_duration=3.099752, state=success, executor_state=success, try_number=1, max_tries=1, job_id=197, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:27:00.792028+00:00, queued_by_job_id=2, pid=4504 2024-04-06T02:28:00.606627511Z [2024-04-06T02:28:00.606+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:28:00.622532106Z [2024-04-06T02:28:00.622+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:28:00+00:00, run_after=2024-04-06T02:29:00+00:00 2024-04-06T02:28:00.631617484Z [2024-04-06T02:28:00.631+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:28:00.717971449Z [2024-04-06T02:28:00.716+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T02:28:00.717994950Z 2024-04-06T02:28:00.718030429Z 2024-04-06T02:28:00.718034377Z 2024-04-06T02:28:00.718037815Z [2024-04-06T02:28:00.716+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T02:28:00.718040857Z [2024-04-06T02:28:00.716+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:28:00.718043864Z [2024-04-06T02:28:00.716+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:28:00.718046899Z [2024-04-06T02:28:00.716+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:28:00.718050169Z 2024-04-06T02:28:00.718053183Z 2024-04-06T02:28:00.718056119Z 2024-04-06T02:28:00.720988666Z [2024-04-06T02:28:00.720+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:28:00.721086541Z [2024-04-06T02:28:00.720+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:28:00.721254693Z [2024-04-06T02:28:00.721+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:28:00.721331727Z [2024-04-06T02:28:00.721+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:28:00.721502721Z [2024-04-06T02:28:00.721+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:28:00.721570061Z [2024-04-06T02:28:00.721+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:28:01.219007252Z [2024-04-06T02:28:01.218+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:26:00+00:00 exited with status queued for try_number 1 2024-04-06T02:28:01.219259384Z [2024-04-06T02:28:01.219+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:27:00+00:00 exited with status queued for try_number 1 2024-04-06T02:28:01.219412705Z [2024-04-06T02:28:01.219+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:27:00+00:00 exited with status queued for try_number 1 2024-04-06T02:28:01.235227667Z [2024-04-06T02:28:01.234+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ce52a19-0ba6-404e-97c4-1c3928063c35 2024-04-06T02:28:01.235477821Z [2024-04-06T02:28:01.235+0000] {scheduler_job.py:635} INFO - Setting external_id for to 65f8fa0f-8caa-44a7-aec5-1b4fcd0591bd 2024-04-06T02:28:01.235741800Z [2024-04-06T02:28:01.235+0000] {scheduler_job.py:635} INFO - Setting external_id for to 89a1dc71-4366-4c8e-9811-9542d0b6ce75 2024-04-06T02:28:04.151259636Z [2024-04-06T02:28:04.150+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:28:04.151497695Z [2024-04-06T02:28:04.151+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 02:26:00+00:00, run_id=scheduled__2024-04-06T02:26:00+00:00, run_start_date=2024-04-06 02:28:00.644679+00:00, run_end_date=2024-04-06 02:28:04.151208+00:00, run_duration=3.506529, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:26:00+00:00, data_interval_end=2024-04-06 02:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T02:28:04.188964963Z [2024-04-06T02:28:04.188+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T02:28:00+00:00, run_after=2024-04-06T02:30:00+00:00 2024-04-06T02:28:04.319228602Z [2024-04-06T02:28:04.318+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:26:00+00:00 exited with status success for try_number 1 2024-04-06T02:28:04.323671714Z [2024-04-06T02:28:04.323+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T02:26:00+00:00, map_index=-1, run_start_date=2024-04-06 02:28:02.088409+00:00, run_end_date=2024-04-06 02:28:03.296875+00:00, run_duration=1.208466, state=success, executor_state=success, try_number=1, max_tries=1, job_id=199, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:28:00.717794+00:00, queued_by_job_id=2, pid=4540 2024-04-06T02:28:05.383847144Z [2024-04-06T02:28:05.383+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:28:05.384380264Z [2024-04-06T02:28:05.384+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:27:00+00:00, run_id=scheduled__2024-04-06T02:27:00+00:00, run_start_date=2024-04-06 02:28:00.647239+00:00, run_end_date=2024-04-06 02:28:05.383960+00:00, run_duration=4.736721, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:27:00+00:00, data_interval_end=2024-04-06 02:28:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:28:05.394238677Z [2024-04-06T02:28:05.393+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:28:00+00:00, run_after=2024-04-06T02:29:00+00:00 2024-04-06T02:28:05.448649655Z [2024-04-06T02:28:05.448+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:27:00+00:00 exited with status success for try_number 1 2024-04-06T02:28:05.458385159Z [2024-04-06T02:28:05.458+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:27:00+00:00, map_index=-1, run_start_date=2024-04-06 02:28:03.227615+00:00, run_end_date=2024-04-06 02:28:05.240093+00:00, run_duration=2.012478, state=success, executor_state=success, try_number=1, max_tries=1, job_id=200, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:28:00.717794+00:00, queued_by_job_id=2, pid=4561 2024-04-06T02:28:06.331383777Z [2024-04-06T02:28:06.330+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:28:06.331789652Z [2024-04-06T02:28:06.331+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:27:00+00:00, run_id=scheduled__2024-04-06T02:27:00+00:00, run_start_date=2024-04-06 02:28:00.646098+00:00, run_end_date=2024-04-06 02:28:06.331238+00:00, run_duration=5.68514, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:27:00+00:00, data_interval_end=2024-04-06 02:28:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:28:06.340148290Z [2024-04-06T02:28:06.339+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:28:00+00:00, run_after=2024-04-06T02:29:00+00:00 2024-04-06T02:28:06.375174141Z [2024-04-06T02:28:06.374+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:27:00+00:00 exited with status success for try_number 1 2024-04-06T02:28:06.389119073Z [2024-04-06T02:28:06.388+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:27:00+00:00, map_index=-1, run_start_date=2024-04-06 02:28:03.822475+00:00, run_end_date=2024-04-06 02:28:05.627185+00:00, run_duration=1.80471, state=success, executor_state=success, try_number=1, max_tries=1, job_id=201, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:28:00.717794+00:00, queued_by_job_id=2, pid=4580 2024-04-06T02:29:01.098455650Z [2024-04-06T02:29:01.097+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:29:00+00:00, run_after=2024-04-06T02:30:00+00:00 2024-04-06T02:29:01.112131753Z [2024-04-06T02:29:01.111+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:29:01.232145240Z [2024-04-06T02:29:01.231+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T02:29:01.232191216Z 2024-04-06T02:29:01.232198409Z 2024-04-06T02:29:01.232349317Z [2024-04-06T02:29:01.232+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:29:01.232531869Z [2024-04-06T02:29:01.232+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:29:01.234113158Z [2024-04-06T02:29:01.233+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:29:01.234129034Z 2024-04-06T02:29:01.234141253Z 2024-04-06T02:29:01.242400926Z [2024-04-06T02:29:01.241+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:29:01.242701599Z [2024-04-06T02:29:01.242+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:29:01.243398920Z [2024-04-06T02:29:01.243+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:29:01.243635870Z [2024-04-06T02:29:01.243+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:29:01.494522454Z [2024-04-06T02:29:01.493+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:28:00+00:00 exited with status queued for try_number 1 2024-04-06T02:29:01.494557325Z [2024-04-06T02:29:01.494+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:28:00+00:00 exited with status queued for try_number 1 2024-04-06T02:29:01.508979334Z [2024-04-06T02:29:01.508+0000] {scheduler_job.py:635} INFO - Setting external_id for to 46176c3c-36f0-47e8-958b-dcec7cd40ab9 2024-04-06T02:29:01.509039207Z [2024-04-06T02:29:01.508+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc58718e-ca06-46c4-aed4-056203085a3c 2024-04-06T02:29:05.695934716Z [2024-04-06T02:29:05.695+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:29:05.698169581Z [2024-04-06T02:29:05.697+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:28:00+00:00, run_id=scheduled__2024-04-06T02:28:00+00:00, run_start_date=2024-04-06 02:29:01.132384+00:00, run_end_date=2024-04-06 02:29:05.695830+00:00, run_duration=4.563446, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:28:00+00:00, data_interval_end=2024-04-06 02:29:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:29:05.715161942Z [2024-04-06T02:29:05.713+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:29:00+00:00, run_after=2024-04-06T02:30:00+00:00 2024-04-06T02:29:05.725045900Z [2024-04-06T02:29:05.724+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:29:05.725482030Z [2024-04-06T02:29:05.725+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:28:00+00:00, run_id=scheduled__2024-04-06T02:28:00+00:00, run_start_date=2024-04-06 02:29:01.129923+00:00, run_end_date=2024-04-06 02:29:05.724945+00:00, run_duration=4.595022, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:28:00+00:00, data_interval_end=2024-04-06 02:29:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:29:05.740094729Z [2024-04-06T02:29:05.739+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:29:00+00:00, run_after=2024-04-06T02:30:00+00:00 2024-04-06T02:29:05.777101905Z [2024-04-06T02:29:05.776+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:28:00+00:00 exited with status success for try_number 1 2024-04-06T02:29:05.777507731Z [2024-04-06T02:29:05.777+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:28:00+00:00 exited with status success for try_number 1 2024-04-06T02:29:05.784491558Z [2024-04-06T02:29:05.784+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:28:00+00:00, map_index=-1, run_start_date=2024-04-06 02:29:03.807067+00:00, run_end_date=2024-04-06 02:29:05.451962+00:00, run_duration=1.644895, state=success, executor_state=success, try_number=1, max_tries=1, job_id=203, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:29:01.235785+00:00, queued_by_job_id=2, pid=4626 2024-04-06T02:29:05.784901069Z [2024-04-06T02:29:05.784+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:28:00+00:00, map_index=-1, run_start_date=2024-04-06 02:29:03.520872+00:00, run_end_date=2024-04-06 02:29:05.377429+00:00, run_duration=1.856557, state=success, executor_state=success, try_number=1, max_tries=1, job_id=202, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:29:01.235785+00:00, queued_by_job_id=2, pid=4616 2024-04-06T02:30:00.502450697Z [2024-04-06T02:30:00.501+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:30:00+00:00, run_after=2024-04-06T02:35:00+00:00 2024-04-06T02:30:00.521357767Z [2024-04-06T02:30:00.520+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:30:00+00:00, run_after=2024-04-06T02:31:00+00:00 2024-04-06T02:30:00.531473453Z [2024-04-06T02:30:00.530+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:30:00.554980964Z [2024-04-06T02:30:00.554+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:30:00.660823054Z [2024-04-06T02:30:00.660+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-06T02:30:00.660857688Z 2024-04-06T02:30:00.660862060Z 2024-04-06T02:30:00.660866500Z 2024-04-06T02:30:00.660870009Z 2024-04-06T02:30:00.661080161Z [2024-04-06T02:30:00.660+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:30:00.661279858Z [2024-04-06T02:30:00.661+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T02:30:00.661434721Z [2024-04-06T02:30:00.661+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:30:00.661617548Z [2024-04-06T02:30:00.661+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:30:00.662527880Z [2024-04-06T02:30:00.662+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:30:00.662537077Z 2024-04-06T02:30:00.662541424Z 2024-04-06T02:30:00.662552175Z 2024-04-06T02:30:00.662555750Z 2024-04-06T02:30:00.666537541Z [2024-04-06T02:30:00.666+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-06T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-06T02:30:00.666732506Z [2024-04-06T02:30:00.666+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:30:00.667014551Z [2024-04-06T02:30:00.666+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:30:00.667180090Z [2024-04-06T02:30:00.667+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:30:00.667458624Z [2024-04-06T02:30:00.667+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:30:00.667631121Z [2024-04-06T02:30:00.667+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:30:00.667900991Z [2024-04-06T02:30:00.667+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:30:00.668049813Z [2024-04-06T02:30:00.667+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:30:01.133332894Z [2024-04-06T02:30:01.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T02:25:00+00:00 exited with status queued for try_number 1 2024-04-06T02:30:01.133400325Z [2024-04-06T02:30:01.133+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:28:00+00:00 exited with status queued for try_number 1 2024-04-06T02:30:01.133405736Z [2024-04-06T02:30:01.133+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:29:00+00:00 exited with status queued for try_number 1 2024-04-06T02:30:01.133475302Z [2024-04-06T02:30:01.133+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:29:00+00:00 exited with status queued for try_number 1 2024-04-06T02:30:01.142735166Z [2024-04-06T02:30:01.142+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8eeb62c3-c1e6-4902-be25-57e79d5773e4 2024-04-06T02:30:01.143243156Z [2024-04-06T02:30:01.142+0000] {scheduler_job.py:635} INFO - Setting external_id for to c840025b-3cc7-411d-a36f-c78e17495989 2024-04-06T02:30:01.143369562Z [2024-04-06T02:30:01.143+0000] {scheduler_job.py:635} INFO - Setting external_id for to e1c5f2da-5f4f-4271-9fcd-0b18129ec1ea 2024-04-06T02:30:01.143453812Z [2024-04-06T02:30:01.143+0000] {scheduler_job.py:635} INFO - Setting external_id for to c4942b9a-1d86-4d00-8c7f-f7a77141869a 2024-04-06T02:30:04.994453186Z [2024-04-06T02:30:04.993+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:30:04.998398448Z [2024-04-06T02:30:04.998+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 02:28:00+00:00, run_id=scheduled__2024-04-06T02:28:00+00:00, run_start_date=2024-04-06 02:30:00.581153+00:00, run_end_date=2024-04-06 02:30:04.997949+00:00, run_duration=4.416796, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:28:00+00:00, data_interval_end=2024-04-06 02:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T02:30:05.027723412Z [2024-04-06T02:30:05.027+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T02:30:00+00:00, run_after=2024-04-06T02:32:00+00:00 2024-04-06T02:30:05.214799050Z [2024-04-06T02:30:05.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:28:00+00:00 exited with status success for try_number 1 2024-04-06T02:30:05.242927251Z [2024-04-06T02:30:05.242+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T02:28:00+00:00, map_index=-1, run_start_date=2024-04-06 02:30:02.512108+00:00, run_end_date=2024-04-06 02:30:03.733291+00:00, run_duration=1.221183, state=success, executor_state=success, try_number=1, max_tries=1, job_id=204, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:30:00.663449+00:00, queued_by_job_id=2, pid=4664 2024-04-06T02:30:06.286713594Z [2024-04-06T02:30:06.285+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:30:06.287007460Z [2024-04-06T02:30:06.286+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:29:00+00:00, run_id=scheduled__2024-04-06T02:29:00+00:00, run_start_date=2024-04-06 02:30:00.586404+00:00, run_end_date=2024-04-06 02:30:06.286459+00:00, run_duration=5.700055, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:29:00+00:00, data_interval_end=2024-04-06 02:30:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:30:06.296290805Z [2024-04-06T02:30:06.295+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:30:00+00:00, run_after=2024-04-06T02:31:00+00:00 2024-04-06T02:30:06.303784679Z [2024-04-06T02:30:06.303+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:30:06.304030270Z [2024-04-06T02:30:06.303+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:29:00+00:00, run_id=scheduled__2024-04-06T02:29:00+00:00, run_start_date=2024-04-06 02:30:00.583496+00:00, run_end_date=2024-04-06 02:30:06.303569+00:00, run_duration=5.720073, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:29:00+00:00, data_interval_end=2024-04-06 02:30:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:30:06.314649055Z [2024-04-06T02:30:06.314+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:30:00+00:00, run_after=2024-04-06T02:31:00+00:00 2024-04-06T02:30:06.352316562Z [2024-04-06T02:30:06.351+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:30:06.352357375Z 2024-04-06T02:30:06.352491097Z [2024-04-06T02:30:06.352+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:30:06.353543713Z [2024-04-06T02:30:06.353+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:30:06.353550158Z 2024-04-06T02:30:06.357661380Z [2024-04-06T02:30:06.357+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='split_metrics', run_id='scheduled__2024-04-06T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-06T02:30:06.357876077Z [2024-04-06T02:30:06.357+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:30:06.429723039Z [2024-04-06T02:30:06.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T02:25:00+00:00 exited with status queued for try_number 1 2024-04-06T02:30:06.430132185Z [2024-04-06T02:30:06.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T02:25:00+00:00 exited with status success for try_number 1 2024-04-06T02:30:06.430462463Z [2024-04-06T02:30:06.430+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:29:00+00:00 exited with status success for try_number 1 2024-04-06T02:30:06.430815478Z [2024-04-06T02:30:06.430+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:29:00+00:00 exited with status success for try_number 1 2024-04-06T02:30:06.446918718Z [2024-04-06T02:30:06.446+0000] {scheduler_job.py:635} INFO - Setting external_id for to e857b597-5f4f-477b-a163-3c547e3d663c 2024-04-06T02:30:06.447096923Z [2024-04-06T02:30:06.446+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-06T02:25:00+00:00, map_index=-1, run_start_date=2024-04-06 02:30:05.018591+00:00, run_end_date=2024-04-06 02:30:05.461003+00:00, run_duration=0.442412, state=success, executor_state=success, try_number=1, max_tries=1, job_id=207, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:30:00.663449+00:00, queued_by_job_id=2, pid=4720 2024-04-06T02:30:06.447298602Z [2024-04-06T02:30:06.447+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:29:00+00:00, map_index=-1, run_start_date=2024-04-06 02:30:03.824577+00:00, run_end_date=2024-04-06 02:30:05.690736+00:00, run_duration=1.866159, state=success, executor_state=success, try_number=1, max_tries=1, job_id=205, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:30:00.663449+00:00, queued_by_job_id=2, pid=4691 2024-04-06T02:30:06.447486956Z [2024-04-06T02:30:06.447+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:29:00+00:00, map_index=-1, run_start_date=2024-04-06 02:30:04.173418+00:00, run_end_date=2024-04-06 02:30:05.696493+00:00, run_duration=1.523075, state=success, executor_state=success, try_number=1, max_tries=1, job_id=206, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:30:00.663449+00:00, queued_by_job_id=2, pid=4692 2024-04-06T02:30:08.706485687Z [2024-04-06T02:30:08.706+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:30:08.706516743Z 2024-04-06T02:30:08.706638302Z [2024-04-06T02:30:08.706+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:30:08.707161966Z [2024-04-06T02:30:08.706+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:30:08.707173871Z 2024-04-06T02:30:08.709094790Z [2024-04-06T02:30:08.708+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='collect_metrics', run_id='scheduled__2024-04-06T02:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-06T02:30:08.709254391Z [2024-04-06T02:30:08.709+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T02:30:08.757588503Z [2024-04-06T02:30:08.757+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T02:25:00+00:00 exited with status queued for try_number 1 2024-04-06T02:30:08.757787466Z [2024-04-06T02:30:08.757+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T02:25:00+00:00 exited with status success for try_number 1 2024-04-06T02:30:08.765770695Z [2024-04-06T02:30:08.765+0000] {scheduler_job.py:635} INFO - Setting external_id for to 57b416f0-a324-423b-8be2-b8085d4439d1 2024-04-06T02:30:08.766132428Z [2024-04-06T02:30:08.765+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=split_metrics, run_id=scheduled__2024-04-06T02:25:00+00:00, map_index=-1, run_start_date=2024-04-06 02:30:07.928509+00:00, run_end_date=2024-04-06 02:30:08.416534+00:00, run_duration=0.488025, state=success, executor_state=success, try_number=1, max_tries=1, job_id=208, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:30:06.354121+00:00, queued_by_job_id=2, pid=4741 2024-04-06T02:30:11.764946003Z [2024-04-06T02:30:11.764+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:30:11.764977185Z 2024-04-06T02:30:11.765049581Z [2024-04-06T02:30:11.764+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:30:11.765684484Z [2024-04-06T02:30:11.765+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:30:11.765697830Z 2024-04-06T02:30:11.767748698Z [2024-04-06T02:30:11.767+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='send_prometheus', run_id='scheduled__2024-04-06T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:30:11.767946634Z [2024-04-06T02:30:11.767+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:30:11.817364884Z [2024-04-06T02:30:11.817+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T02:25:00+00:00 exited with status queued for try_number 1 2024-04-06T02:30:11.817551711Z [2024-04-06T02:30:11.817+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T02:25:00+00:00 exited with status success for try_number 1 2024-04-06T02:30:11.822109325Z [2024-04-06T02:30:11.821+0000] {scheduler_job.py:635} INFO - Setting external_id for to f5384848-0a7b-40d3-88cc-ede63b05eb6f 2024-04-06T02:30:11.822359148Z [2024-04-06T02:30:11.822+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=collect_metrics, run_id=scheduled__2024-04-06T02:25:00+00:00, map_index=0, run_start_date=2024-04-06 02:30:10.392366+00:00, run_end_date=2024-04-06 02:30:10.673054+00:00, run_duration=0.280688, state=success, executor_state=success, try_number=1, max_tries=1, job_id=209, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:30:08.707446+00:00, queued_by_job_id=2, pid=4763 2024-04-06T02:30:14.065132590Z [2024-04-06T02:30:14.064+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:30:14.066105263Z [2024-04-06T02:30:14.065+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:25:00+00:00, run_id=scheduled__2024-04-06T02:25:00+00:00, run_start_date=2024-04-06 02:30:00.578112+00:00, run_end_date=2024-04-06 02:30:14.064908+00:00, run_duration=13.486796, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:25:00+00:00, data_interval_end=2024-04-06 02:30:00+00:00, dag_hash=eecc559ff32fe9a7c4345875f113a0a9 2024-04-06T02:30:14.083910720Z [2024-04-06T02:30:14.083+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:30:00+00:00, run_after=2024-04-06T02:35:00+00:00 2024-04-06T02:30:14.131807469Z [2024-04-06T02:30:14.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T02:25:00+00:00 exited with status success for try_number 1 2024-04-06T02:30:14.140648674Z [2024-04-06T02:30:14.140+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=send_prometheus, run_id=scheduled__2024-04-06T02:25:00+00:00, map_index=-1, run_start_date=2024-04-06 02:30:13.439751+00:00, run_end_date=2024-04-06 02:30:13.797323+00:00, run_duration=0.357572, state=success, executor_state=success, try_number=1, max_tries=1, job_id=210, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:30:11.766124+00:00, queued_by_job_id=2, pid=4778 2024-04-06T02:30:19.872374236Z [2024-04-06T02:30:19.871+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-06T02:31:00.927681820Z [2024-04-06T02:31:00.926+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:31:00+00:00, run_after=2024-04-06T02:32:00+00:00 2024-04-06T02:31:00.944976159Z [2024-04-06T02:31:00.944+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:31:01.002497205Z [2024-04-06T02:31:01.002+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T02:31:01.002524146Z 2024-04-06T02:31:01.002538902Z 2024-04-06T02:31:01.002548441Z [2024-04-06T02:31:01.002+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:31:01.002769290Z [2024-04-06T02:31:01.002+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:31:01.003340129Z [2024-04-06T02:31:01.003+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:31:01.003349871Z 2024-04-06T02:31:01.003353168Z 2024-04-06T02:31:01.007367767Z [2024-04-06T02:31:01.007+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:31:01.007536356Z [2024-04-06T02:31:01.007+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:31:01.007769138Z [2024-04-06T02:31:01.007+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:31:01.007892668Z [2024-04-06T02:31:01.007+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:31:01.276245942Z [2024-04-06T02:31:01.275+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:30:00+00:00 exited with status queued for try_number 1 2024-04-06T02:31:01.276422454Z [2024-04-06T02:31:01.276+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:30:00+00:00 exited with status queued for try_number 1 2024-04-06T02:31:01.283244667Z [2024-04-06T02:31:01.282+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f78d602-dfc4-473e-8c77-17858a9298da 2024-04-06T02:31:01.283395091Z [2024-04-06T02:31:01.283+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb1d66a3-a47e-442e-8048-37cae11a595f 2024-04-06T02:31:06.210888582Z [2024-04-06T02:31:06.210+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:31:06.211164488Z [2024-04-06T02:31:06.210+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:30:00+00:00, run_id=scheduled__2024-04-06T02:30:00+00:00, run_start_date=2024-04-06 02:31:00.958010+00:00, run_end_date=2024-04-06 02:31:06.210707+00:00, run_duration=5.252697, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:30:00+00:00, data_interval_end=2024-04-06 02:31:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:31:06.220272476Z [2024-04-06T02:31:06.219+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:31:00+00:00, run_after=2024-04-06T02:32:00+00:00 2024-04-06T02:31:06.254822247Z [2024-04-06T02:31:06.254+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:30:00+00:00 exited with status success for try_number 1 2024-04-06T02:31:06.260155670Z [2024-04-06T02:31:06.259+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:30:00+00:00, map_index=-1, run_start_date=2024-04-06 02:31:03.295420+00:00, run_end_date=2024-04-06 02:31:05.577471+00:00, run_duration=2.282051, state=success, executor_state=success, try_number=1, max_tries=1, job_id=212, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:31:01.004620+00:00, queued_by_job_id=2, pid=4802 2024-04-06T02:31:07.320937101Z [2024-04-06T02:31:07.320+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:31:07.321691139Z [2024-04-06T02:31:07.321+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:30:00+00:00, run_id=scheduled__2024-04-06T02:30:00+00:00, run_start_date=2024-04-06 02:31:00.959238+00:00, run_end_date=2024-04-06 02:31:07.321120+00:00, run_duration=6.361882, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:30:00+00:00, data_interval_end=2024-04-06 02:31:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:31:07.339924931Z [2024-04-06T02:31:07.339+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:31:00+00:00, run_after=2024-04-06T02:32:00+00:00 2024-04-06T02:31:07.381903187Z [2024-04-06T02:31:07.381+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:30:00+00:00 exited with status success for try_number 1 2024-04-06T02:31:07.390992457Z [2024-04-06T02:31:07.390+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:30:00+00:00, map_index=-1, run_start_date=2024-04-06 02:31:03.271705+00:00, run_end_date=2024-04-06 02:31:06.703017+00:00, run_duration=3.431312, state=success, executor_state=success, try_number=1, max_tries=1, job_id=211, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:31:01.004620+00:00, queued_by_job_id=2, pid=4801 2024-04-06T02:32:00.093510703Z [2024-04-06T02:32:00.092+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:32:00.103500030Z [2024-04-06T02:32:00.103+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:32:00.120451549Z [2024-04-06T02:32:00.119+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:32:00+00:00, run_after=2024-04-06T02:33:00+00:00 2024-04-06T02:32:00.227323862Z [2024-04-06T02:32:00.226+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T02:32:00.227369245Z 2024-04-06T02:32:00.227377451Z 2024-04-06T02:32:00.227384412Z 2024-04-06T02:32:00.227812993Z [2024-04-06T02:32:00.227+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T02:32:00.228181606Z [2024-04-06T02:32:00.227+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:32:00.228510552Z [2024-04-06T02:32:00.228+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:32:00.229668188Z [2024-04-06T02:32:00.229+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:32:00.229693801Z 2024-04-06T02:32:00.229733892Z 2024-04-06T02:32:00.229741632Z 2024-04-06T02:32:00.236464790Z [2024-04-06T02:32:00.236+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:32:00.236718941Z [2024-04-06T02:32:00.236+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:32:00.237157575Z [2024-04-06T02:32:00.236+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:32:00.237459168Z [2024-04-06T02:32:00.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:32:00.238150332Z [2024-04-06T02:32:00.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:32:00.238465978Z [2024-04-06T02:32:00.238+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:32:00.480143052Z [2024-04-06T02:32:00.479+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:30:00+00:00 exited with status queued for try_number 1 2024-04-06T02:32:00.480275830Z [2024-04-06T02:32:00.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:31:00+00:00 exited with status queued for try_number 1 2024-04-06T02:32:00.480412154Z [2024-04-06T02:32:00.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:31:00+00:00 exited with status queued for try_number 1 2024-04-06T02:32:00.487602071Z [2024-04-06T02:32:00.487+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5bdb8531-ef8b-4e44-8cd6-345f08b6ac8d 2024-04-06T02:32:00.487735860Z [2024-04-06T02:32:00.487+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c1f0933-1b9e-423a-afd8-3982bdfaf445 2024-04-06T02:32:00.487893799Z [2024-04-06T02:32:00.487+0000] {scheduler_job.py:635} INFO - Setting external_id for to b7521802-c0c3-4005-859b-adf35969105e 2024-04-06T02:32:02.232061816Z [2024-04-06T02:32:02.215+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:32:02.232106827Z [2024-04-06T02:32:02.218+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 02:30:00+00:00, run_id=scheduled__2024-04-06T02:30:00+00:00, run_start_date=2024-04-06 02:32:00.135070+00:00, run_end_date=2024-04-06 02:32:02.217881+00:00, run_duration=2.082811, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:30:00+00:00, data_interval_end=2024-04-06 02:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T02:32:02.273909473Z [2024-04-06T02:32:02.262+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T02:32:00+00:00, run_after=2024-04-06T02:34:00+00:00 2024-04-06T02:32:02.428852376Z [2024-04-06T02:32:02.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:30:00+00:00 exited with status success for try_number 1 2024-04-06T02:32:02.445229448Z [2024-04-06T02:32:02.444+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T02:30:00+00:00, map_index=-1, run_start_date=2024-04-06 02:32:01.075448+00:00, run_end_date=2024-04-06 02:32:01.604753+00:00, run_duration=0.529305, state=success, executor_state=success, try_number=1, max_tries=1, job_id=213, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:32:00.231231+00:00, queued_by_job_id=2, pid=4837 2024-04-06T02:32:05.760567019Z [2024-04-06T02:32:05.760+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:32:05.760661132Z [2024-04-06T02:32:05.760+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:31:00+00:00, run_id=scheduled__2024-04-06T02:31:00+00:00, run_start_date=2024-04-06 02:32:00.137591+00:00, run_end_date=2024-04-06 02:32:05.760428+00:00, run_duration=5.622837, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:31:00+00:00, data_interval_end=2024-04-06 02:32:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:32:05.770382425Z [2024-04-06T02:32:05.770+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:32:00+00:00, run_after=2024-04-06T02:33:00+00:00 2024-04-06T02:32:05.779302678Z [2024-04-06T02:32:05.778+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:32:05.779447051Z [2024-04-06T02:32:05.779+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:31:00+00:00, run_id=scheduled__2024-04-06T02:31:00+00:00, run_start_date=2024-04-06 02:32:00.139758+00:00, run_end_date=2024-04-06 02:32:05.779163+00:00, run_duration=5.639405, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:31:00+00:00, data_interval_end=2024-04-06 02:32:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:32:05.790548792Z [2024-04-06T02:32:05.790+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:32:00+00:00, run_after=2024-04-06T02:33:00+00:00 2024-04-06T02:32:05.840912638Z [2024-04-06T02:32:05.840+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:31:00+00:00 exited with status success for try_number 1 2024-04-06T02:32:05.841341088Z [2024-04-06T02:32:05.840+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:31:00+00:00 exited with status success for try_number 1 2024-04-06T02:32:05.852439417Z [2024-04-06T02:32:05.851+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:31:00+00:00, map_index=-1, run_start_date=2024-04-06 02:32:03.325848+00:00, run_end_date=2024-04-06 02:32:05.131412+00:00, run_duration=1.805564, state=success, executor_state=success, try_number=1, max_tries=1, job_id=215, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:32:00.231231+00:00, queued_by_job_id=2, pid=4868 2024-04-06T02:32:05.852845256Z [2024-04-06T02:32:05.852+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:31:00+00:00, map_index=-1, run_start_date=2024-04-06 02:32:02.985222+00:00, run_end_date=2024-04-06 02:32:05.555219+00:00, run_duration=2.569997, state=success, executor_state=success, try_number=1, max_tries=1, job_id=214, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:32:00.231231+00:00, queued_by_job_id=2, pid=4867 2024-04-06T02:33:00.125481271Z [2024-04-06T02:33:00.124+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:33:00+00:00, run_after=2024-04-06T02:34:00+00:00 2024-04-06T02:33:00.135546431Z [2024-04-06T02:33:00.135+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:33:00.197406727Z [2024-04-06T02:33:00.197+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T02:33:00.197437967Z 2024-04-06T02:33:00.197444734Z 2024-04-06T02:33:00.197540970Z [2024-04-06T02:33:00.197+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:33:00.197731398Z [2024-04-06T02:33:00.197+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:33:00.198576763Z [2024-04-06T02:33:00.198+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:33:00.198593691Z 2024-04-06T02:33:00.198600056Z 2024-04-06T02:33:00.201744261Z [2024-04-06T02:33:00.201+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:33:00.201980570Z [2024-04-06T02:33:00.201+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:33:00.202295076Z [2024-04-06T02:33:00.202+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:33:00.202475476Z [2024-04-06T02:33:00.202+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:33:00.362601237Z [2024-04-06T02:33:00.362+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:32:00+00:00 exited with status queued for try_number 1 2024-04-06T02:33:00.362896482Z [2024-04-06T02:33:00.362+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:32:00+00:00 exited with status queued for try_number 1 2024-04-06T02:33:00.370531767Z [2024-04-06T02:33:00.370+0000] {scheduler_job.py:635} INFO - Setting external_id for to b8e9d818-6ee9-4d95-8a4d-48bbed2ddd05 2024-04-06T02:33:00.370810626Z [2024-04-06T02:33:00.370+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e1a0f4d-6982-4422-83ae-72f2be2a55c3 2024-04-06T02:33:04.287452901Z [2024-04-06T02:33:04.283+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:33:04.287478161Z [2024-04-06T02:33:04.283+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:32:00+00:00, run_id=scheduled__2024-04-06T02:32:00+00:00, run_start_date=2024-04-06 02:33:00.148700+00:00, run_end_date=2024-04-06 02:33:04.283629+00:00, run_duration=4.134929, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:32:00+00:00, data_interval_end=2024-04-06 02:33:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:33:04.300690301Z [2024-04-06T02:33:04.299+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:33:00+00:00, run_after=2024-04-06T02:34:00+00:00 2024-04-06T02:33:04.355373015Z [2024-04-06T02:33:04.355+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:32:00+00:00 exited with status success for try_number 1 2024-04-06T02:33:04.359770562Z [2024-04-06T02:33:04.359+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:32:00+00:00, map_index=-1, run_start_date=2024-04-06 02:33:02.145538+00:00, run_end_date=2024-04-06 02:33:03.673272+00:00, run_duration=1.527734, state=success, executor_state=success, try_number=1, max_tries=1, job_id=216, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:33:00.199165+00:00, queued_by_job_id=2, pid=4923 2024-04-06T02:33:06.524955876Z [2024-04-06T02:33:06.524+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:33:06.525143566Z [2024-04-06T02:33:06.524+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:32:00+00:00, run_id=scheduled__2024-04-06T02:32:00+00:00, run_start_date=2024-04-06 02:33:00.150201+00:00, run_end_date=2024-04-06 02:33:06.524722+00:00, run_duration=6.374521, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:32:00+00:00, data_interval_end=2024-04-06 02:33:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:33:06.535935045Z [2024-04-06T02:33:06.535+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:33:00+00:00, run_after=2024-04-06T02:34:00+00:00 2024-04-06T02:33:06.571298956Z [2024-04-06T02:33:06.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:32:00+00:00 exited with status success for try_number 1 2024-04-06T02:33:06.577044593Z [2024-04-06T02:33:06.576+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:32:00+00:00, map_index=-1, run_start_date=2024-04-06 02:33:02.153624+00:00, run_end_date=2024-04-06 02:33:05.752706+00:00, run_duration=3.599082, state=success, executor_state=success, try_number=1, max_tries=1, job_id=217, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:33:00.199165+00:00, queued_by_job_id=2, pid=4924 2024-04-06T02:34:00.181946544Z [2024-04-06T02:34:00.181+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:34:00+00:00, run_after=2024-04-06T02:35:00+00:00 2024-04-06T02:34:00.191201556Z [2024-04-06T02:34:00.190+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:34:00.204851778Z [2024-04-06T02:34:00.204+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:34:00.307565822Z [2024-04-06T02:34:00.306+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T02:34:00.307606426Z 2024-04-06T02:34:00.307618282Z 2024-04-06T02:34:00.307627353Z 2024-04-06T02:34:00.307920515Z [2024-04-06T02:34:00.307+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T02:34:00.308424745Z [2024-04-06T02:34:00.307+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:34:00.308991949Z [2024-04-06T02:34:00.308+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:34:00.310662820Z [2024-04-06T02:34:00.310+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:34:00.310689720Z 2024-04-06T02:34:00.310705720Z 2024-04-06T02:34:00.310714707Z 2024-04-06T02:34:00.318310367Z [2024-04-06T02:34:00.317+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:34:00.318863779Z [2024-04-06T02:34:00.318+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:34:00.319733148Z [2024-04-06T02:34:00.319+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:34:00.320353505Z [2024-04-06T02:34:00.319+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:34:00.320913989Z [2024-04-06T02:34:00.320+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:34:00.321482055Z [2024-04-06T02:34:00.320+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:34:00.546644785Z [2024-04-06T02:34:00.545+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:32:00+00:00 exited with status queued for try_number 1 2024-04-06T02:34:00.547072593Z [2024-04-06T02:34:00.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:33:00+00:00 exited with status queued for try_number 1 2024-04-06T02:34:00.547328662Z [2024-04-06T02:34:00.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:33:00+00:00 exited with status queued for try_number 1 2024-04-06T02:34:00.561898224Z [2024-04-06T02:34:00.561+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a9e02d5-ffa4-4709-8a60-dbaccbcd9d10 2024-04-06T02:34:00.562235579Z [2024-04-06T02:34:00.562+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f41db8b-987d-435a-91ac-342261f1f9b7 2024-04-06T02:34:00.562515703Z [2024-04-06T02:34:00.562+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ab44cc4-3c07-4ec8-8f1d-cd0d31be3e11 2024-04-06T02:34:02.607202386Z [2024-04-06T02:34:02.606+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:34:02.610415373Z [2024-04-06T02:34:02.609+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 02:32:00+00:00, run_id=scheduled__2024-04-06T02:32:00+00:00, run_start_date=2024-04-06 02:34:00.219706+00:00, run_end_date=2024-04-06 02:34:02.607139+00:00, run_duration=2.387433, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:32:00+00:00, data_interval_end=2024-04-06 02:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T02:34:02.636152943Z [2024-04-06T02:34:02.635+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T02:34:00+00:00, run_after=2024-04-06T02:36:00+00:00 2024-04-06T02:34:02.744540865Z [2024-04-06T02:34:02.744+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:32:00+00:00 exited with status success for try_number 1 2024-04-06T02:34:02.766138447Z [2024-04-06T02:34:02.765+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T02:32:00+00:00, map_index=-1, run_start_date=2024-04-06 02:34:01.086399+00:00, run_end_date=2024-04-06 02:34:01.509284+00:00, run_duration=0.422885, state=success, executor_state=success, try_number=1, max_tries=1, job_id=218, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:34:00.313060+00:00, queued_by_job_id=2, pid=4959 2024-04-06T02:34:05.338850419Z [2024-04-06T02:34:05.338+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:34:05.339072047Z [2024-04-06T02:34:05.338+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:33:00+00:00, run_id=scheduled__2024-04-06T02:33:00+00:00, run_start_date=2024-04-06 02:34:00.221495+00:00, run_end_date=2024-04-06 02:34:05.338743+00:00, run_duration=5.117248, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:33:00+00:00, data_interval_end=2024-04-06 02:34:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:34:05.347563249Z [2024-04-06T02:34:05.347+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:34:00+00:00, run_after=2024-04-06T02:35:00+00:00 2024-04-06T02:34:05.380308022Z [2024-04-06T02:34:05.379+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:33:00+00:00 exited with status success for try_number 1 2024-04-06T02:34:05.384865842Z [2024-04-06T02:34:05.384+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:33:00+00:00, map_index=-1, run_start_date=2024-04-06 02:34:03.058573+00:00, run_end_date=2024-04-06 02:34:04.905646+00:00, run_duration=1.847073, state=success, executor_state=success, try_number=1, max_tries=1, job_id=219, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:34:00.313060+00:00, queued_by_job_id=2, pid=4989 2024-04-06T02:34:06.452286364Z [2024-04-06T02:34:06.451+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:34:06.452799606Z [2024-04-06T02:34:06.452+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:33:00+00:00, run_id=scheduled__2024-04-06T02:33:00+00:00, run_start_date=2024-04-06 02:34:00.223128+00:00, run_end_date=2024-04-06 02:34:06.452072+00:00, run_duration=6.228944, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:33:00+00:00, data_interval_end=2024-04-06 02:34:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:34:06.465576559Z [2024-04-06T02:34:06.465+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:34:00+00:00, run_after=2024-04-06T02:35:00+00:00 2024-04-06T02:34:06.515441334Z [2024-04-06T02:34:06.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:33:00+00:00 exited with status success for try_number 1 2024-04-06T02:34:06.524938464Z [2024-04-06T02:34:06.524+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:33:00+00:00, map_index=-1, run_start_date=2024-04-06 02:34:03.223658+00:00, run_end_date=2024-04-06 02:34:05.850476+00:00, run_duration=2.626818, state=success, executor_state=success, try_number=1, max_tries=1, job_id=220, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:34:00.313060+00:00, queued_by_job_id=2, pid=4990 2024-04-06T02:35:00.097263783Z [2024-04-06T02:35:00.096+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:35:00+00:00, run_after=2024-04-06T02:40:00+00:00 2024-04-06T02:35:00.106447110Z [2024-04-06T02:35:00.106+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:35:00.119971259Z [2024-04-06T02:35:00.119+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:35:00+00:00, run_after=2024-04-06T02:36:00+00:00 2024-04-06T02:35:00.200082436Z [2024-04-06T02:35:00.199+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T02:35:00.200154279Z 2024-04-06T02:35:00.200159242Z 2024-04-06T02:35:00.200162652Z 2024-04-06T02:35:00.200173683Z [2024-04-06T02:35:00.199+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:35:00.200332801Z [2024-04-06T02:35:00.200+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:35:00.200617290Z [2024-04-06T02:35:00.200+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:35:00.201456060Z [2024-04-06T02:35:00.201+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:35:00.201466568Z 2024-04-06T02:35:00.201471596Z 2024-04-06T02:35:00.201475754Z 2024-04-06T02:35:00.205423800Z [2024-04-06T02:35:00.204+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-06T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-06T02:35:00.205497226Z [2024-04-06T02:35:00.205+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:35:00.205611995Z [2024-04-06T02:35:00.205+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:35:00.205860320Z [2024-04-06T02:35:00.205+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:35:00.206215162Z [2024-04-06T02:35:00.206+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:35:00.206402207Z [2024-04-06T02:35:00.206+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:35:00.503501324Z [2024-04-06T02:35:00.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T02:30:00+00:00 exited with status queued for try_number 1 2024-04-06T02:35:00.503996617Z [2024-04-06T02:35:00.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:34:00+00:00 exited with status queued for try_number 1 2024-04-06T02:35:00.504250364Z [2024-04-06T02:35:00.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:34:00+00:00 exited with status queued for try_number 1 2024-04-06T02:35:00.516022675Z [2024-04-06T02:35:00.515+0000] {scheduler_job.py:635} INFO - Setting external_id for to b46682c0-87c9-4400-8289-6a2380780a45 2024-04-06T02:35:00.516384047Z [2024-04-06T02:35:00.516+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b8efeb9-8feb-4d95-8614-59ab9cf22793 2024-04-06T02:35:00.516654844Z [2024-04-06T02:35:00.516+0000] {scheduler_job.py:635} INFO - Setting external_id for to a7cc35c1-14fb-4090-a186-ddcf2857eca0 2024-04-06T02:35:04.195019747Z [2024-04-06T02:35:04.194+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:35:04.195050176Z 2024-04-06T02:35:04.195661920Z [2024-04-06T02:35:04.194+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:35:04.198685473Z [2024-04-06T02:35:04.198+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:35:04.198760120Z 2024-04-06T02:35:04.206861181Z [2024-04-06T02:35:04.206+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='split_metrics', run_id='scheduled__2024-04-06T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-06T02:35:04.207051056Z [2024-04-06T02:35:04.206+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:35:04.372381252Z [2024-04-06T02:35:04.372+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T02:30:00+00:00 exited with status queued for try_number 1 2024-04-06T02:35:04.372641605Z [2024-04-06T02:35:04.372+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T02:30:00+00:00 exited with status success for try_number 1 2024-04-06T02:35:04.378970186Z [2024-04-06T02:35:04.378+0000] {scheduler_job.py:635} INFO - Setting external_id for to d7d32276-5bbb-4512-b59e-321ee0418050 2024-04-06T02:35:04.379283206Z [2024-04-06T02:35:04.379+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-06T02:30:00+00:00, map_index=-1, run_start_date=2024-04-06 02:35:03.294542+00:00, run_end_date=2024-04-06 02:35:03.796755+00:00, run_duration=0.502213, state=success, executor_state=success, try_number=1, max_tries=1, job_id=222, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:35:00.202235+00:00, queued_by_job_id=2, pid=5055 2024-04-06T02:35:05.670321659Z [2024-04-06T02:35:05.667+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:35:05.670551484Z [2024-04-06T02:35:05.670+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:34:00+00:00, run_id=scheduled__2024-04-06T02:34:00+00:00, run_start_date=2024-04-06 02:35:00.134633+00:00, run_end_date=2024-04-06 02:35:05.670227+00:00, run_duration=5.535594, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:34:00+00:00, data_interval_end=2024-04-06 02:35:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:35:05.703197115Z [2024-04-06T02:35:05.702+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:35:00+00:00, run_after=2024-04-06T02:36:00+00:00 2024-04-06T02:35:05.726664475Z [2024-04-06T02:35:05.726+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:35:05.727228523Z [2024-04-06T02:35:05.727+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:34:00+00:00, run_id=scheduled__2024-04-06T02:34:00+00:00, run_start_date=2024-04-06 02:35:00.135669+00:00, run_end_date=2024-04-06 02:35:05.726884+00:00, run_duration=5.591215, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:34:00+00:00, data_interval_end=2024-04-06 02:35:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:35:05.751426597Z [2024-04-06T02:35:05.751+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:35:00+00:00, run_after=2024-04-06T02:36:00+00:00 2024-04-06T02:35:05.815611687Z [2024-04-06T02:35:05.814+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:34:00+00:00 exited with status success for try_number 1 2024-04-06T02:35:05.815634008Z [2024-04-06T02:35:05.815+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:34:00+00:00 exited with status success for try_number 1 2024-04-06T02:35:05.822497259Z [2024-04-06T02:35:05.822+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:34:00+00:00, map_index=-1, run_start_date=2024-04-06 02:35:03.410929+00:00, run_end_date=2024-04-06 02:35:04.902164+00:00, run_duration=1.491235, state=success, executor_state=success, try_number=1, max_tries=1, job_id=223, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:35:00.202235+00:00, queued_by_job_id=2, pid=5059 2024-04-06T02:35:05.822830600Z [2024-04-06T02:35:05.822+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:34:00+00:00, map_index=-1, run_start_date=2024-04-06 02:35:02.826919+00:00, run_end_date=2024-04-06 02:35:04.963126+00:00, run_duration=2.136207, state=success, executor_state=success, try_number=1, max_tries=1, job_id=221, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:35:00.202235+00:00, queued_by_job_id=2, pid=5037 2024-04-06T02:35:07.994321520Z [2024-04-06T02:35:07.993+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:35:07.994410509Z 2024-04-06T02:35:07.995197231Z [2024-04-06T02:35:07.994+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:35:07.997418400Z [2024-04-06T02:35:07.996+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:35:07.997456381Z 2024-04-06T02:35:08.005362853Z [2024-04-06T02:35:08.004+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='collect_metrics', run_id='scheduled__2024-04-06T02:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-06T02:35:08.005827541Z [2024-04-06T02:35:08.005+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T02:35:08.086562668Z [2024-04-06T02:35:08.086+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T02:30:00+00:00 exited with status queued for try_number 1 2024-04-06T02:35:08.086602399Z [2024-04-06T02:35:08.086+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T02:30:00+00:00 exited with status success for try_number 1 2024-04-06T02:35:08.093333493Z [2024-04-06T02:35:08.092+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22915c3c-3903-4843-b7d7-2ec643f6ea42 2024-04-06T02:35:08.093577627Z [2024-04-06T02:35:08.093+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=split_metrics, run_id=scheduled__2024-04-06T02:30:00+00:00, map_index=-1, run_start_date=2024-04-06 02:35:06.366819+00:00, run_end_date=2024-04-06 02:35:06.729315+00:00, run_duration=0.362496, state=success, executor_state=success, try_number=1, max_tries=1, job_id=224, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:35:04.199061+00:00, queued_by_job_id=2, pid=5095 2024-04-06T02:35:10.587305719Z [2024-04-06T02:35:10.586+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:35:10.587359978Z 2024-04-06T02:35:10.587815295Z [2024-04-06T02:35:10.587+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:35:10.589261031Z [2024-04-06T02:35:10.588+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:35:10.589276312Z 2024-04-06T02:35:10.593912971Z [2024-04-06T02:35:10.593+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='send_prometheus', run_id='scheduled__2024-04-06T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:35:10.594107361Z [2024-04-06T02:35:10.593+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:35:10.667699641Z [2024-04-06T02:35:10.667+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T02:30:00+00:00 exited with status queued for try_number 1 2024-04-06T02:35:10.668069164Z [2024-04-06T02:35:10.667+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T02:30:00+00:00 exited with status success for try_number 1 2024-04-06T02:35:10.674308928Z [2024-04-06T02:35:10.674+0000] {scheduler_job.py:635} INFO - Setting external_id for to 883b46ce-2ef6-454c-988b-bbbd0987f975 2024-04-06T02:35:10.674605199Z [2024-04-06T02:35:10.674+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=collect_metrics, run_id=scheduled__2024-04-06T02:30:00+00:00, map_index=0, run_start_date=2024-04-06 02:35:09.804907+00:00, run_end_date=2024-04-06 02:35:10.178061+00:00, run_duration=0.373154, state=success, executor_state=success, try_number=1, max_tries=1, job_id=225, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:35:07.998576+00:00, queued_by_job_id=2, pid=5117 2024-04-06T02:35:13.080271397Z [2024-04-06T02:35:13.079+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:35:13.080702178Z [2024-04-06T02:35:13.080+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:30:00+00:00, run_id=scheduled__2024-04-06T02:30:00+00:00, run_start_date=2024-04-06 02:35:00.133202+00:00, run_end_date=2024-04-06 02:35:13.080364+00:00, run_duration=12.947162, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:30:00+00:00, data_interval_end=2024-04-06 02:35:00+00:00, dag_hash=eecc559ff32fe9a7c4345875f113a0a9 2024-04-06T02:35:13.087410740Z [2024-04-06T02:35:13.087+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:35:00+00:00, run_after=2024-04-06T02:40:00+00:00 2024-04-06T02:35:14.202580802Z [2024-04-06T02:35:14.202+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T02:30:00+00:00 exited with status success for try_number 1 2024-04-06T02:35:14.207191788Z [2024-04-06T02:35:14.206+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=send_prometheus, run_id=scheduled__2024-04-06T02:30:00+00:00, map_index=-1, run_start_date=2024-04-06 02:35:12.536870+00:00, run_end_date=2024-04-06 02:35:13.034108+00:00, run_duration=0.497238, state=success, executor_state=success, try_number=1, max_tries=1, job_id=226, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:35:10.590061+00:00, queued_by_job_id=2, pid=5132 2024-04-06T02:35:19.947603963Z [2024-04-06T02:35:19.947+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-06T02:36:00.299781048Z [2024-04-06T02:36:00.299+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:36:00.306339905Z [2024-04-06T02:36:00.306+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:36:00.318906911Z [2024-04-06T02:36:00.318+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:36:00+00:00, run_after=2024-04-06T02:37:00+00:00 2024-04-06T02:36:00.371489262Z [2024-04-06T02:36:00.371+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T02:36:00.371531690Z 2024-04-06T02:36:00.371539897Z 2024-04-06T02:36:00.371543093Z 2024-04-06T02:36:00.371742002Z [2024-04-06T02:36:00.371+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T02:36:00.371934364Z [2024-04-06T02:36:00.371+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:36:00.372156227Z [2024-04-06T02:36:00.371+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:36:00.372785494Z [2024-04-06T02:36:00.372+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:36:00.372794361Z 2024-04-06T02:36:00.372798374Z 2024-04-06T02:36:00.372801644Z 2024-04-06T02:36:00.375814954Z [2024-04-06T02:36:00.375+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:36:00.376057489Z [2024-04-06T02:36:00.375+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:36:00.376334928Z [2024-04-06T02:36:00.376+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:36:00.376465320Z [2024-04-06T02:36:00.376+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:36:00.376695292Z [2024-04-06T02:36:00.376+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:36:00.376900856Z [2024-04-06T02:36:00.376+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:36:00.774286660Z [2024-04-06T02:36:00.773+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:34:00+00:00 exited with status queued for try_number 1 2024-04-06T02:36:00.774378862Z [2024-04-06T02:36:00.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:35:00+00:00 exited with status queued for try_number 1 2024-04-06T02:36:00.774552227Z [2024-04-06T02:36:00.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:35:00+00:00 exited with status queued for try_number 1 2024-04-06T02:36:00.787976593Z [2024-04-06T02:36:00.787+0000] {scheduler_job.py:635} INFO - Setting external_id for to 062e7991-1e80-4ff3-9388-7a53e5d3b775 2024-04-06T02:36:00.788429049Z [2024-04-06T02:36:00.787+0000] {scheduler_job.py:635} INFO - Setting external_id for to 89873863-eb42-40d5-a8c3-b521f570db53 2024-04-06T02:36:00.788920361Z [2024-04-06T02:36:00.788+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3eff0725-615e-4b49-b495-c54be6c042ee 2024-04-06T02:36:02.285023527Z [2024-04-06T02:36:02.284+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:34:00+00:00 exited with status success for try_number 1 2024-04-06T02:36:02.293760259Z [2024-04-06T02:36:02.293+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T02:34:00+00:00, map_index=-1, run_start_date=2024-04-06 02:36:01.276658+00:00, run_end_date=2024-04-06 02:36:01.962386+00:00, run_duration=0.685728, state=success, executor_state=success, try_number=1, max_tries=1, job_id=227, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:36:00.373450+00:00, queued_by_job_id=2, pid=5136 2024-04-06T02:36:03.498502524Z [2024-04-06T02:36:03.498+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:36:03.499115339Z [2024-04-06T02:36:03.498+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 02:34:00+00:00, run_id=scheduled__2024-04-06T02:34:00+00:00, run_start_date=2024-04-06 02:36:00.328259+00:00, run_end_date=2024-04-06 02:36:03.498674+00:00, run_duration=3.170415, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:34:00+00:00, data_interval_end=2024-04-06 02:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T02:36:03.519613620Z [2024-04-06T02:36:03.513+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T02:36:00+00:00, run_after=2024-04-06T02:38:00+00:00 2024-04-06T02:36:05.821031159Z [2024-04-06T02:36:05.820+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:36:05.821778716Z [2024-04-06T02:36:05.821+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:35:00+00:00, run_id=scheduled__2024-04-06T02:35:00+00:00, run_start_date=2024-04-06 02:36:00.329394+00:00, run_end_date=2024-04-06 02:36:05.821401+00:00, run_duration=5.492007, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:35:00+00:00, data_interval_end=2024-04-06 02:36:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:36:05.834706590Z [2024-04-06T02:36:05.834+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:36:00+00:00, run_after=2024-04-06T02:37:00+00:00 2024-04-06T02:36:05.879940516Z [2024-04-06T02:36:05.879+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:35:00+00:00 exited with status success for try_number 1 2024-04-06T02:36:05.884195795Z [2024-04-06T02:36:05.883+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:35:00+00:00, map_index=-1, run_start_date=2024-04-06 02:36:04.023648+00:00, run_end_date=2024-04-06 02:36:05.705750+00:00, run_duration=1.682102, state=success, executor_state=success, try_number=1, max_tries=1, job_id=229, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:36:00.373450+00:00, queued_by_job_id=2, pid=5176 2024-04-06T02:36:06.959610331Z [2024-04-06T02:36:06.959+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:36:06.959889988Z [2024-04-06T02:36:06.959+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:35:00+00:00, run_id=scheduled__2024-04-06T02:35:00+00:00, run_start_date=2024-04-06 02:36:00.330455+00:00, run_end_date=2024-04-06 02:36:06.959435+00:00, run_duration=6.62898, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:35:00+00:00, data_interval_end=2024-04-06 02:36:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:36:06.972895318Z [2024-04-06T02:36:06.972+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:36:00+00:00, run_after=2024-04-06T02:37:00+00:00 2024-04-06T02:36:07.013518450Z [2024-04-06T02:36:07.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:35:00+00:00 exited with status success for try_number 1 2024-04-06T02:36:07.020887094Z [2024-04-06T02:36:07.020+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:35:00+00:00, map_index=-1, run_start_date=2024-04-06 02:36:03.314476+00:00, run_end_date=2024-04-06 02:36:05.797647+00:00, run_duration=2.483171, state=success, executor_state=success, try_number=1, max_tries=1, job_id=228, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:36:00.373450+00:00, queued_by_job_id=2, pid=5157 2024-04-06T02:37:00.892440844Z [2024-04-06T02:37:00.891+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:37:00.905375176Z [2024-04-06T02:37:00.904+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:37:00+00:00, run_after=2024-04-06T02:38:00+00:00 2024-04-06T02:37:00.959116050Z [2024-04-06T02:37:00.958+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T02:37:00.959140376Z 2024-04-06T02:37:00.959144214Z 2024-04-06T02:37:00.959154122Z [2024-04-06T02:37:00.959+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:37:00.959333725Z [2024-04-06T02:37:00.959+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:37:00.959861649Z [2024-04-06T02:37:00.959+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:37:00.959872376Z 2024-04-06T02:37:00.959875620Z 2024-04-06T02:37:00.962421871Z [2024-04-06T02:37:00.962+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:37:00.962557306Z [2024-04-06T02:37:00.962+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:37:00.962884539Z [2024-04-06T02:37:00.962+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:37:00.962901596Z [2024-04-06T02:37:00.962+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:37:01.169605562Z [2024-04-06T02:37:01.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:36:00+00:00 exited with status queued for try_number 1 2024-04-06T02:37:01.169888581Z [2024-04-06T02:37:01.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:36:00+00:00 exited with status queued for try_number 1 2024-04-06T02:37:01.179000858Z [2024-04-06T02:37:01.178+0000] {scheduler_job.py:635} INFO - Setting external_id for to f668b757-c1de-430b-92da-dcc4e7431f24 2024-04-06T02:37:01.181784261Z [2024-04-06T02:37:01.178+0000] {scheduler_job.py:635} INFO - Setting external_id for to 04bbb2b8-9869-4590-b241-699a0ee177db 2024-04-06T02:37:06.147971624Z [2024-04-06T02:37:06.147+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:37:06.148373893Z [2024-04-06T02:37:06.148+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:36:00+00:00, run_id=scheduled__2024-04-06T02:36:00+00:00, run_start_date=2024-04-06 02:37:00.916698+00:00, run_end_date=2024-04-06 02:37:06.147796+00:00, run_duration=5.231098, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:36:00+00:00, data_interval_end=2024-04-06 02:37:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:37:06.163556952Z [2024-04-06T02:37:06.158+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:37:00+00:00, run_after=2024-04-06T02:38:00+00:00 2024-04-06T02:37:06.194352089Z [2024-04-06T02:37:06.193+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:36:00+00:00 exited with status success for try_number 1 2024-04-06T02:37:06.198645041Z [2024-04-06T02:37:06.198+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:36:00+00:00, map_index=-1, run_start_date=2024-04-06 02:37:03.730214+00:00, run_end_date=2024-04-06 02:37:05.529251+00:00, run_duration=1.799037, state=success, executor_state=success, try_number=1, max_tries=1, job_id=230, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:37:00.960339+00:00, queued_by_job_id=2, pid=5221 2024-04-06T02:37:06.876697000Z [2024-04-06T02:37:06.876+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:37:06.876858767Z [2024-04-06T02:37:06.876+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:36:00+00:00, run_id=scheduled__2024-04-06T02:36:00+00:00, run_start_date=2024-04-06 02:37:00.918190+00:00, run_end_date=2024-04-06 02:37:06.876571+00:00, run_duration=5.958381, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:36:00+00:00, data_interval_end=2024-04-06 02:37:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:37:06.884888099Z [2024-04-06T02:37:06.884+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:37:00+00:00, run_after=2024-04-06T02:38:00+00:00 2024-04-06T02:37:06.912106311Z [2024-04-06T02:37:06.911+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:36:00+00:00 exited with status success for try_number 1 2024-04-06T02:37:06.915970943Z [2024-04-06T02:37:06.915+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:36:00+00:00, map_index=-1, run_start_date=2024-04-06 02:37:04.089014+00:00, run_end_date=2024-04-06 02:37:06.395025+00:00, run_duration=2.306011, state=success, executor_state=success, try_number=1, max_tries=1, job_id=231, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:37:00.960339+00:00, queued_by_job_id=2, pid=5222 2024-04-06T02:38:00.961242841Z [2024-04-06T02:38:00.960+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:38:00.969555726Z [2024-04-06T02:38:00.969+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:38:00.982547551Z [2024-04-06T02:38:00.982+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:38:00+00:00, run_after=2024-04-06T02:39:00+00:00 2024-04-06T02:38:01.065240662Z [2024-04-06T02:38:01.064+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T02:38:01.065267257Z 2024-04-06T02:38:01.065271572Z 2024-04-06T02:38:01.065274746Z 2024-04-06T02:38:01.065558638Z [2024-04-06T02:38:01.065+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T02:38:01.065762254Z [2024-04-06T02:38:01.065+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:38:01.065954220Z [2024-04-06T02:38:01.065+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:38:01.066706015Z [2024-04-06T02:38:01.066+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:38:01.066718161Z 2024-04-06T02:38:01.066727546Z 2024-04-06T02:38:01.066730819Z 2024-04-06T02:38:01.070243435Z [2024-04-06T02:38:01.070+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:38:01.070439702Z [2024-04-06T02:38:01.070+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:38:01.070737636Z [2024-04-06T02:38:01.070+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:38:01.070898242Z [2024-04-06T02:38:01.070+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:38:01.071179401Z [2024-04-06T02:38:01.071+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:38:01.071386190Z [2024-04-06T02:38:01.071+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:38:01.412349990Z [2024-04-06T02:38:01.411+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:36:00+00:00 exited with status queued for try_number 1 2024-04-06T02:38:01.412536508Z [2024-04-06T02:38:01.412+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:37:00+00:00 exited with status queued for try_number 1 2024-04-06T02:38:01.412707267Z [2024-04-06T02:38:01.412+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:37:00+00:00 exited with status queued for try_number 1 2024-04-06T02:38:01.422745444Z [2024-04-06T02:38:01.422+0000] {scheduler_job.py:635} INFO - Setting external_id for to 019bb342-b941-4b07-9507-af7ccba6b7a0 2024-04-06T02:38:01.424043602Z [2024-04-06T02:38:01.423+0000] {scheduler_job.py:635} INFO - Setting external_id for to e192a1cc-8b8c-469e-968b-a0e0d25e01ce 2024-04-06T02:38:01.424319896Z [2024-04-06T02:38:01.424+0000] {scheduler_job.py:635} INFO - Setting external_id for to f5669c1b-6d7d-4b7d-93dd-218de7768571 2024-04-06T02:38:02.842923325Z [2024-04-06T02:38:02.842+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:38:02.843251612Z [2024-04-06T02:38:02.843+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 02:36:00+00:00, run_id=scheduled__2024-04-06T02:36:00+00:00, run_start_date=2024-04-06 02:38:00.993511+00:00, run_end_date=2024-04-06 02:38:02.842845+00:00, run_duration=1.849334, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:36:00+00:00, data_interval_end=2024-04-06 02:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T02:38:02.850329610Z [2024-04-06T02:38:02.850+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T02:38:00+00:00, run_after=2024-04-06T02:40:00+00:00 2024-04-06T02:38:02.901391345Z [2024-04-06T02:38:02.901+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:36:00+00:00 exited with status success for try_number 1 2024-04-06T02:38:02.906913837Z [2024-04-06T02:38:02.906+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T02:36:00+00:00, map_index=-1, run_start_date=2024-04-06 02:38:02.111215+00:00, run_end_date=2024-04-06 02:38:02.676436+00:00, run_duration=0.565221, state=success, executor_state=success, try_number=1, max_tries=1, job_id=232, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:38:01.067462+00:00, queued_by_job_id=2, pid=5258 2024-04-06T02:38:06.564030298Z [2024-04-06T02:38:06.563+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:38:06.564567283Z [2024-04-06T02:38:06.564+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:37:00+00:00, run_id=scheduled__2024-04-06T02:37:00+00:00, run_start_date=2024-04-06 02:38:00.995211+00:00, run_end_date=2024-04-06 02:38:06.564233+00:00, run_duration=5.569022, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:37:00+00:00, data_interval_end=2024-04-06 02:38:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:38:06.574718854Z [2024-04-06T02:38:06.574+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:38:00+00:00, run_after=2024-04-06T02:39:00+00:00 2024-04-06T02:38:06.627397937Z [2024-04-06T02:38:06.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:37:00+00:00 exited with status success for try_number 1 2024-04-06T02:38:06.642861263Z [2024-04-06T02:38:06.642+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:37:00+00:00, map_index=-1, run_start_date=2024-04-06 02:38:03.843840+00:00, run_end_date=2024-04-06 02:38:05.935432+00:00, run_duration=2.091592, state=success, executor_state=success, try_number=1, max_tries=1, job_id=233, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:38:01.067462+00:00, queued_by_job_id=2, pid=5287 2024-04-06T02:38:09.080510317Z [2024-04-06T02:38:09.079+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:38:09.080949160Z [2024-04-06T02:38:09.080+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:37:00+00:00, run_id=scheduled__2024-04-06T02:37:00+00:00, run_start_date=2024-04-06 02:38:00.997355+00:00, run_end_date=2024-04-06 02:38:09.080380+00:00, run_duration=8.083025, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:37:00+00:00, data_interval_end=2024-04-06 02:38:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:38:09.090447979Z [2024-04-06T02:38:09.090+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:38:00+00:00, run_after=2024-04-06T02:39:00+00:00 2024-04-06T02:38:09.136559239Z [2024-04-06T02:38:09.135+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:37:00+00:00 exited with status success for try_number 1 2024-04-06T02:38:09.144306957Z [2024-04-06T02:38:09.143+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:37:00+00:00, map_index=-1, run_start_date=2024-04-06 02:38:04.095817+00:00, run_end_date=2024-04-06 02:38:08.129097+00:00, run_duration=4.03328, state=success, executor_state=success, try_number=1, max_tries=1, job_id=234, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:38:01.067462+00:00, queued_by_job_id=2, pid=5288 2024-04-06T02:39:01.016622363Z [2024-04-06T02:39:01.016+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:39:00+00:00, run_after=2024-04-06T02:40:00+00:00 2024-04-06T02:39:01.035365046Z [2024-04-06T02:39:01.034+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:39:01.119100041Z [2024-04-06T02:39:01.117+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T02:39:01.119123801Z 2024-04-06T02:39:01.119127345Z 2024-04-06T02:39:01.119411149Z [2024-04-06T02:39:01.119+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:39:01.119833892Z [2024-04-06T02:39:01.119+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:39:01.124991485Z [2024-04-06T02:39:01.124+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:39:01.125009985Z 2024-04-06T02:39:01.125014384Z 2024-04-06T02:39:01.128552819Z [2024-04-06T02:39:01.128+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:39:01.128715010Z [2024-04-06T02:39:01.128+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:39:01.128834056Z [2024-04-06T02:39:01.128+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:39:01.128891221Z [2024-04-06T02:39:01.128+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:39:01.534095356Z [2024-04-06T02:39:01.533+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:38:00+00:00 exited with status queued for try_number 1 2024-04-06T02:39:01.534276651Z [2024-04-06T02:39:01.534+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:38:00+00:00 exited with status queued for try_number 1 2024-04-06T02:39:01.542677838Z [2024-04-06T02:39:01.542+0000] {scheduler_job.py:635} INFO - Setting external_id for to b2475341-ccb4-4376-a99c-8065754afff2 2024-04-06T02:39:01.543113692Z [2024-04-06T02:39:01.542+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9118ac96-ce3e-42c5-bbb3-f56fe96f409b 2024-04-06T02:39:06.219423539Z [2024-04-06T02:39:06.218+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:39:06.219937802Z [2024-04-06T02:39:06.219+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:38:00+00:00, run_id=scheduled__2024-04-06T02:38:00+00:00, run_start_date=2024-04-06 02:39:01.051749+00:00, run_end_date=2024-04-06 02:39:06.219329+00:00, run_duration=5.16758, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:38:00+00:00, data_interval_end=2024-04-06 02:39:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:39:06.232300460Z [2024-04-06T02:39:06.231+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:39:00+00:00, run_after=2024-04-06T02:40:00+00:00 2024-04-06T02:39:06.240025370Z [2024-04-06T02:39:06.239+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:39:06.240462114Z [2024-04-06T02:39:06.240+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:38:00+00:00, run_id=scheduled__2024-04-06T02:38:00+00:00, run_start_date=2024-04-06 02:39:01.053887+00:00, run_end_date=2024-04-06 02:39:06.240097+00:00, run_duration=5.18621, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:38:00+00:00, data_interval_end=2024-04-06 02:39:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:39:06.251186817Z [2024-04-06T02:39:06.250+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:39:00+00:00, run_after=2024-04-06T02:40:00+00:00 2024-04-06T02:39:06.284692962Z [2024-04-06T02:39:06.284+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:38:00+00:00 exited with status success for try_number 1 2024-04-06T02:39:06.285280117Z [2024-04-06T02:39:06.284+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:38:00+00:00 exited with status success for try_number 1 2024-04-06T02:39:06.295099266Z [2024-04-06T02:39:06.294+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:38:00+00:00, map_index=-1, run_start_date=2024-04-06 02:39:03.686137+00:00, run_end_date=2024-04-06 02:39:05.402254+00:00, run_duration=1.716117, state=success, executor_state=success, try_number=1, max_tries=1, job_id=235, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:39:01.125537+00:00, queued_by_job_id=2, pid=5341 2024-04-06T02:39:06.296375742Z [2024-04-06T02:39:06.295+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:38:00+00:00, map_index=-1, run_start_date=2024-04-06 02:39:03.788431+00:00, run_end_date=2024-04-06 02:39:05.996840+00:00, run_duration=2.208409, state=success, executor_state=success, try_number=1, max_tries=1, job_id=236, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:39:01.125537+00:00, queued_by_job_id=2, pid=5342 2024-04-06T02:40:00.773890221Z [2024-04-06T02:40:00.772+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:40:00+00:00, run_after=2024-04-06T02:41:00+00:00 2024-04-06T02:40:00.785309537Z [2024-04-06T02:40:00.784+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:40:00.794215409Z [2024-04-06T02:40:00.793+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:40:00.814512260Z [2024-04-06T02:40:00.813+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:40:00+00:00, run_after=2024-04-06T02:45:00+00:00 2024-04-06T02:40:00.917908806Z [2024-04-06T02:40:00.917+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-06T02:40:00.917943606Z 2024-04-06T02:40:00.917947571Z 2024-04-06T02:40:00.917951355Z 2024-04-06T02:40:00.917954538Z 2024-04-06T02:40:00.918046111Z [2024-04-06T02:40:00.917+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:40:00.918211828Z [2024-04-06T02:40:00.918+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T02:40:00.918368883Z [2024-04-06T02:40:00.918+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:40:00.918479815Z [2024-04-06T02:40:00.918+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:40:00.919202542Z [2024-04-06T02:40:00.919+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:40:00.919214885Z 2024-04-06T02:40:00.919218930Z 2024-04-06T02:40:00.919222270Z 2024-04-06T02:40:00.919225525Z 2024-04-06T02:40:00.923634912Z [2024-04-06T02:40:00.923+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-06T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-06T02:40:00.923966834Z [2024-04-06T02:40:00.923+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:40:00.924295420Z [2024-04-06T02:40:00.924+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:40:00.924450826Z [2024-04-06T02:40:00.924+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:40:00.924728542Z [2024-04-06T02:40:00.924+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:40:00.924894174Z [2024-04-06T02:40:00.924+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:40:00.925134875Z [2024-04-06T02:40:00.925+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:40:00.925293494Z [2024-04-06T02:40:00.925+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:40:01.287133855Z [2024-04-06T02:40:01.286+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T02:35:00+00:00 exited with status queued for try_number 1 2024-04-06T02:40:01.287297047Z [2024-04-06T02:40:01.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:38:00+00:00 exited with status queued for try_number 1 2024-04-06T02:40:01.287464417Z [2024-04-06T02:40:01.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:39:00+00:00 exited with status queued for try_number 1 2024-04-06T02:40:01.287627751Z [2024-04-06T02:40:01.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:39:00+00:00 exited with status queued for try_number 1 2024-04-06T02:40:01.299383067Z [2024-04-06T02:40:01.298+0000] {scheduler_job.py:635} INFO - Setting external_id for to c21974c7-ada8-4345-936c-398698955dac 2024-04-06T02:40:01.299696861Z [2024-04-06T02:40:01.299+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ef0411b-7721-4f6d-af8a-461e5a8d00db 2024-04-06T02:40:01.300004489Z [2024-04-06T02:40:01.299+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7dccbc89-7a4a-406b-82d0-0fb6f4d1b467 2024-04-06T02:40:01.300325001Z [2024-04-06T02:40:01.300+0000] {scheduler_job.py:635} INFO - Setting external_id for to 00ec24d0-9389-42a3-9c78-ff00566f8a58 2024-04-06T02:40:04.338864693Z [2024-04-06T02:40:04.335+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:40:04.338877556Z [2024-04-06T02:40:04.335+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 02:38:00+00:00, run_id=scheduled__2024-04-06T02:38:00+00:00, run_start_date=2024-04-06 02:40:00.830330+00:00, run_end_date=2024-04-06 02:40:04.335681+00:00, run_duration=3.505351, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:38:00+00:00, data_interval_end=2024-04-06 02:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T02:40:04.374934749Z [2024-04-06T02:40:04.374+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T02:40:00+00:00, run_after=2024-04-06T02:42:00+00:00 2024-04-06T02:40:04.574735196Z [2024-04-06T02:40:04.574+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:38:00+00:00 exited with status success for try_number 1 2024-04-06T02:40:04.594891471Z [2024-04-06T02:40:04.594+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T02:38:00+00:00, map_index=-1, run_start_date=2024-04-06 02:40:03.560619+00:00, run_end_date=2024-04-06 02:40:04.034775+00:00, run_duration=0.474156, state=success, executor_state=success, try_number=1, max_tries=1, job_id=237, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:40:00.920697+00:00, queued_by_job_id=2, pid=5381 2024-04-06T02:40:06.112379648Z [2024-04-06T02:40:06.111+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:40:06.112417283Z 2024-04-06T02:40:06.114010655Z [2024-04-06T02:40:06.112+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:40:06.114583388Z [2024-04-06T02:40:06.114+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:40:06.114598114Z 2024-04-06T02:40:06.118730792Z [2024-04-06T02:40:06.118+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='split_metrics', run_id='scheduled__2024-04-06T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-06T02:40:06.119038347Z [2024-04-06T02:40:06.118+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:40:06.176263711Z [2024-04-06T02:40:06.175+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T02:35:00+00:00 exited with status queued for try_number 1 2024-04-06T02:40:06.176553467Z [2024-04-06T02:40:06.176+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T02:35:00+00:00 exited with status success for try_number 1 2024-04-06T02:40:06.188033965Z [2024-04-06T02:40:06.187+0000] {scheduler_job.py:635} INFO - Setting external_id for to edc02d93-77d3-4777-84a9-40ca3c4572c8 2024-04-06T02:40:06.188946002Z [2024-04-06T02:40:06.188+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-06T02:35:00+00:00, map_index=-1, run_start_date=2024-04-06 02:40:04.609091+00:00, run_end_date=2024-04-06 02:40:05.480225+00:00, run_duration=0.871134, state=success, executor_state=success, try_number=1, max_tries=1, job_id=238, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:40:00.920697+00:00, queued_by_job_id=2, pid=5410 2024-04-06T02:40:07.394326839Z [2024-04-06T02:40:07.393+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:40:07.394845276Z [2024-04-06T02:40:07.394+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:39:00+00:00, run_id=scheduled__2024-04-06T02:39:00+00:00, run_start_date=2024-04-06 02:40:00.834896+00:00, run_end_date=2024-04-06 02:40:07.394184+00:00, run_duration=6.559288, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:39:00+00:00, data_interval_end=2024-04-06 02:40:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:40:07.406850331Z [2024-04-06T02:40:07.406+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:40:00+00:00, run_after=2024-04-06T02:41:00+00:00 2024-04-06T02:40:07.474384587Z [2024-04-06T02:40:07.474+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:39:00+00:00 exited with status success for try_number 1 2024-04-06T02:40:07.478934380Z [2024-04-06T02:40:07.478+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:39:00+00:00, map_index=-1, run_start_date=2024-04-06 02:40:04.552717+00:00, run_end_date=2024-04-06 02:40:06.325432+00:00, run_duration=1.772715, state=success, executor_state=success, try_number=1, max_tries=1, job_id=239, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:40:00.920697+00:00, queued_by_job_id=2, pid=5409 2024-04-06T02:40:08.526319158Z [2024-04-06T02:40:08.525+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:40:08.526522409Z [2024-04-06T02:40:08.526+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:39:00+00:00, run_id=scheduled__2024-04-06T02:39:00+00:00, run_start_date=2024-04-06 02:40:00.831491+00:00, run_end_date=2024-04-06 02:40:08.526138+00:00, run_duration=7.694647, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:39:00+00:00, data_interval_end=2024-04-06 02:40:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:40:08.543600960Z [2024-04-06T02:40:08.543+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:40:00+00:00, run_after=2024-04-06T02:41:00+00:00 2024-04-06T02:40:08.579520300Z [2024-04-06T02:40:08.579+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:40:08.579566702Z 2024-04-06T02:40:08.579780505Z [2024-04-06T02:40:08.579+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:40:08.580493934Z [2024-04-06T02:40:08.580+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:40:08.580508720Z 2024-04-06T02:40:08.582620702Z [2024-04-06T02:40:08.582+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='collect_metrics', run_id='scheduled__2024-04-06T02:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-06T02:40:08.582876801Z [2024-04-06T02:40:08.582+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T02:40:08.693057159Z [2024-04-06T02:40:08.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T02:35:00+00:00 exited with status queued for try_number 1 2024-04-06T02:40:08.693854132Z [2024-04-06T02:40:08.693+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:39:00+00:00 exited with status success for try_number 1 2024-04-06T02:40:08.694268631Z [2024-04-06T02:40:08.694+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T02:35:00+00:00 exited with status success for try_number 1 2024-04-06T02:40:08.704273912Z [2024-04-06T02:40:08.703+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=split_metrics, run_id=scheduled__2024-04-06T02:35:00+00:00, map_index=-1, run_start_date=2024-04-06 02:40:07.834565+00:00, run_end_date=2024-04-06 02:40:08.299582+00:00, run_duration=0.465017, state=success, executor_state=success, try_number=1, max_tries=1, job_id=241, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:40:06.116135+00:00, queued_by_job_id=2, pid=5459 2024-04-06T02:40:08.704428868Z [2024-04-06T02:40:08.704+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:39:00+00:00, map_index=-1, run_start_date=2024-04-06 02:40:05.329746+00:00, run_end_date=2024-04-06 02:40:07.429958+00:00, run_duration=2.100212, state=success, executor_state=success, try_number=1, max_tries=1, job_id=240, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:40:00.920697+00:00, queued_by_job_id=2, pid=5432 2024-04-06T02:40:08.704584754Z [2024-04-06T02:40:08.704+0000] {scheduler_job.py:635} INFO - Setting external_id for to 09a92d38-5e8f-4a1b-bcb6-5f2b1e301cc9 2024-04-06T02:40:11.138179103Z [2024-04-06T02:40:11.137+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:40:11.138207188Z 2024-04-06T02:40:11.138466506Z [2024-04-06T02:40:11.138+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:40:11.139203331Z [2024-04-06T02:40:11.139+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:40:11.139215524Z 2024-04-06T02:40:11.142112288Z [2024-04-06T02:40:11.141+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='send_prometheus', run_id='scheduled__2024-04-06T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:40:11.142406233Z [2024-04-06T02:40:11.142+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:40:11.261090192Z [2024-04-06T02:40:11.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T02:35:00+00:00 exited with status queued for try_number 1 2024-04-06T02:40:11.262217213Z [2024-04-06T02:40:11.261+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T02:35:00+00:00 exited with status success for try_number 1 2024-04-06T02:40:11.282907082Z [2024-04-06T02:40:11.282+0000] {scheduler_job.py:635} INFO - Setting external_id for to 355b4905-956c-43ba-b474-9e27c0a42396 2024-04-06T02:40:11.283172985Z [2024-04-06T02:40:11.282+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=collect_metrics, run_id=scheduled__2024-04-06T02:35:00+00:00, map_index=0, run_start_date=2024-04-06 02:40:10.267771+00:00, run_end_date=2024-04-06 02:40:10.607692+00:00, run_duration=0.339921, state=success, executor_state=success, try_number=1, max_tries=1, job_id=242, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:40:08.580895+00:00, queued_by_job_id=2, pid=5481 2024-04-06T02:40:14.484981403Z [2024-04-06T02:40:14.484+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:40:14.485354184Z [2024-04-06T02:40:14.485+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:35:00+00:00, run_id=scheduled__2024-04-06T02:35:00+00:00, run_start_date=2024-04-06 02:40:00.828601+00:00, run_end_date=2024-04-06 02:40:14.484897+00:00, run_duration=13.656296, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:35:00+00:00, data_interval_end=2024-04-06 02:40:00+00:00, dag_hash=eecc559ff32fe9a7c4345875f113a0a9 2024-04-06T02:40:14.493356158Z [2024-04-06T02:40:14.493+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:40:00+00:00, run_after=2024-04-06T02:45:00+00:00 2024-04-06T02:40:14.534372318Z [2024-04-06T02:40:14.534+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T02:35:00+00:00 exited with status success for try_number 1 2024-04-06T02:40:14.541706741Z [2024-04-06T02:40:14.541+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=send_prometheus, run_id=scheduled__2024-04-06T02:35:00+00:00, map_index=-1, run_start_date=2024-04-06 02:40:13.010256+00:00, run_end_date=2024-04-06 02:40:13.388054+00:00, run_duration=0.377798, state=success, executor_state=success, try_number=1, max_tries=1, job_id=243, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:40:11.139632+00:00, queued_by_job_id=2, pid=5496 2024-04-06T02:40:20.038168599Z [2024-04-06T02:40:20.037+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-06T02:41:00.736741804Z [2024-04-06T02:41:00.735+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:41:00.750837328Z [2024-04-06T02:41:00.750+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:41:00+00:00, run_after=2024-04-06T02:42:00+00:00 2024-04-06T02:41:00.816738363Z [2024-04-06T02:41:00.816+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T02:41:00.816781469Z 2024-04-06T02:41:00.816791138Z 2024-04-06T02:41:00.817393015Z [2024-04-06T02:41:00.817+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:41:00.817543511Z [2024-04-06T02:41:00.817+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:41:00.818220673Z [2024-04-06T02:41:00.817+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:41:00.818244660Z 2024-04-06T02:41:00.818254435Z 2024-04-06T02:41:00.821437415Z [2024-04-06T02:41:00.821+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:41:00.821670140Z [2024-04-06T02:41:00.821+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:41:00.822127491Z [2024-04-06T02:41:00.821+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:41:00.822354335Z [2024-04-06T02:41:00.822+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:41:01.142062942Z [2024-04-06T02:41:01.141+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:40:00+00:00 exited with status queued for try_number 1 2024-04-06T02:41:01.143457551Z [2024-04-06T02:41:01.143+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:40:00+00:00 exited with status queued for try_number 1 2024-04-06T02:41:01.159643577Z [2024-04-06T02:41:01.159+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d637781-636b-4e9b-b929-0c01b4298ed8 2024-04-06T02:41:01.160174231Z [2024-04-06T02:41:01.159+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b0e43ea-9130-4cf3-8ff5-fc4e988d4707 2024-04-06T02:41:06.033217685Z [2024-04-06T02:41:06.032+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:41:06.033607160Z [2024-04-06T02:41:06.033+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:40:00+00:00, run_id=scheduled__2024-04-06T02:40:00+00:00, run_start_date=2024-04-06 02:41:00.770229+00:00, run_end_date=2024-04-06 02:41:06.033022+00:00, run_duration=5.262793, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:40:00+00:00, data_interval_end=2024-04-06 02:41:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:41:06.041934244Z [2024-04-06T02:41:06.041+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:41:00+00:00, run_after=2024-04-06T02:42:00+00:00 2024-04-06T02:41:06.088134665Z [2024-04-06T02:41:06.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:40:00+00:00 exited with status success for try_number 1 2024-04-06T02:41:06.096312313Z [2024-04-06T02:41:06.095+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:40:00+00:00, map_index=-1, run_start_date=2024-04-06 02:41:03.325301+00:00, run_end_date=2024-04-06 02:41:05.255687+00:00, run_duration=1.930386, state=success, executor_state=success, try_number=1, max_tries=1, job_id=244, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:41:00.818732+00:00, queued_by_job_id=2, pid=5519 2024-04-06T02:41:06.256368456Z [2024-04-06T02:41:06.256+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:41:06.257543222Z [2024-04-06T02:41:06.257+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:40:00+00:00, run_id=scheduled__2024-04-06T02:40:00+00:00, run_start_date=2024-04-06 02:41:00.771861+00:00, run_end_date=2024-04-06 02:41:06.257146+00:00, run_duration=5.485285, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:40:00+00:00, data_interval_end=2024-04-06 02:41:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:41:06.269543407Z [2024-04-06T02:41:06.269+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:41:00+00:00, run_after=2024-04-06T02:42:00+00:00 2024-04-06T02:41:06.315596389Z [2024-04-06T02:41:06.314+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:40:00+00:00 exited with status success for try_number 1 2024-04-06T02:41:06.327243497Z [2024-04-06T02:41:06.326+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:40:00+00:00, map_index=-1, run_start_date=2024-04-06 02:41:03.582215+00:00, run_end_date=2024-04-06 02:41:06.082721+00:00, run_duration=2.500506, state=success, executor_state=success, try_number=1, max_tries=1, job_id=245, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:41:00.818732+00:00, queued_by_job_id=2, pid=5520 2024-04-06T02:42:01.027671207Z [2024-04-06T02:42:01.027+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:42:01.040252873Z [2024-04-06T02:42:01.039+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:42:00+00:00, run_after=2024-04-06T02:43:00+00:00 2024-04-06T02:42:01.047164545Z [2024-04-06T02:42:01.046+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:42:01.109775518Z [2024-04-06T02:42:01.108+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T02:42:01.109802556Z 2024-04-06T02:42:01.109826051Z 2024-04-06T02:42:01.109830994Z 2024-04-06T02:42:01.110722026Z [2024-04-06T02:42:01.109+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T02:42:01.111102832Z [2024-04-06T02:42:01.110+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:42:01.111548688Z [2024-04-06T02:42:01.111+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:42:01.113190866Z [2024-04-06T02:42:01.112+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:42:01.113209341Z 2024-04-06T02:42:01.113241565Z 2024-04-06T02:42:01.113246863Z 2024-04-06T02:42:01.122601098Z [2024-04-06T02:42:01.120+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:42:01.122956053Z [2024-04-06T02:42:01.122+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:42:01.123408467Z [2024-04-06T02:42:01.123+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:42:01.123719059Z [2024-04-06T02:42:01.123+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:42:01.124223347Z [2024-04-06T02:42:01.123+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:42:01.124528809Z [2024-04-06T02:42:01.124+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:42:01.559915269Z [2024-04-06T02:42:01.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:40:00+00:00 exited with status queued for try_number 1 2024-04-06T02:42:01.560270446Z [2024-04-06T02:42:01.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:41:00+00:00 exited with status queued for try_number 1 2024-04-06T02:42:01.560544783Z [2024-04-06T02:42:01.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:41:00+00:00 exited with status queued for try_number 1 2024-04-06T02:42:01.583330881Z [2024-04-06T02:42:01.582+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97bf6215-4927-4380-98a9-ecd7d179f602 2024-04-06T02:42:01.583865052Z [2024-04-06T02:42:01.583+0000] {scheduler_job.py:635} INFO - Setting external_id for to d2f8d500-5988-4f4d-a81d-c35115ce0b95 2024-04-06T02:42:01.584136216Z [2024-04-06T02:42:01.583+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7a4c3608-1b07-4201-a8a5-95a4b6dba2d2 2024-04-06T02:42:03.605473741Z [2024-04-06T02:42:03.605+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:42:03.614108974Z [2024-04-06T02:42:03.613+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 02:40:00+00:00, run_id=scheduled__2024-04-06T02:40:00+00:00, run_start_date=2024-04-06 02:42:01.055930+00:00, run_end_date=2024-04-06 02:42:03.613541+00:00, run_duration=2.557611, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:40:00+00:00, data_interval_end=2024-04-06 02:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T02:42:03.645481671Z [2024-04-06T02:42:03.645+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T02:42:00+00:00, run_after=2024-04-06T02:44:00+00:00 2024-04-06T02:42:03.800544509Z [2024-04-06T02:42:03.800+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:40:00+00:00 exited with status success for try_number 1 2024-04-06T02:42:03.806712175Z [2024-04-06T02:42:03.806+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T02:40:00+00:00, map_index=-1, run_start_date=2024-04-06 02:42:02.039183+00:00, run_end_date=2024-04-06 02:42:02.767831+00:00, run_duration=0.728648, state=success, executor_state=success, try_number=1, max_tries=1, job_id=246, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:42:01.115050+00:00, queued_by_job_id=2, pid=5555 2024-04-06T02:42:07.541003473Z [2024-04-06T02:42:07.540+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:42:07.541377743Z [2024-04-06T02:42:07.541+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:41:00+00:00, run_id=scheduled__2024-04-06T02:41:00+00:00, run_start_date=2024-04-06 02:42:01.057129+00:00, run_end_date=2024-04-06 02:42:07.540859+00:00, run_duration=6.48373, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:41:00+00:00, data_interval_end=2024-04-06 02:42:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:42:07.553186099Z [2024-04-06T02:42:07.552+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:42:00+00:00, run_after=2024-04-06T02:43:00+00:00 2024-04-06T02:42:07.560803447Z [2024-04-06T02:42:07.560+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:42:07.561139068Z [2024-04-06T02:42:07.560+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:41:00+00:00, run_id=scheduled__2024-04-06T02:41:00+00:00, run_start_date=2024-04-06 02:42:01.058085+00:00, run_end_date=2024-04-06 02:42:07.560633+00:00, run_duration=6.502548, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:41:00+00:00, data_interval_end=2024-04-06 02:42:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:42:07.571026797Z [2024-04-06T02:42:07.570+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:42:00+00:00, run_after=2024-04-06T02:43:00+00:00 2024-04-06T02:42:07.625198738Z [2024-04-06T02:42:07.624+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:41:00+00:00 exited with status success for try_number 1 2024-04-06T02:42:07.625641026Z [2024-04-06T02:42:07.625+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:41:00+00:00 exited with status success for try_number 1 2024-04-06T02:42:07.638462013Z [2024-04-06T02:42:07.637+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:41:00+00:00, map_index=-1, run_start_date=2024-04-06 02:42:04.943576+00:00, run_end_date=2024-04-06 02:42:06.565991+00:00, run_duration=1.622415, state=success, executor_state=success, try_number=1, max_tries=1, job_id=248, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:42:01.115050+00:00, queued_by_job_id=2, pid=5589 2024-04-06T02:42:07.639018779Z [2024-04-06T02:42:07.638+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:41:00+00:00, map_index=-1, run_start_date=2024-04-06 02:42:04.613762+00:00, run_end_date=2024-04-06 02:42:06.561346+00:00, run_duration=1.947584, state=success, executor_state=success, try_number=1, max_tries=1, job_id=247, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:42:01.115050+00:00, queued_by_job_id=2, pid=5585 2024-04-06T02:43:00.554478186Z [2024-04-06T02:43:00.553+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:43:00+00:00, run_after=2024-04-06T02:44:00+00:00 2024-04-06T02:43:00.565191263Z [2024-04-06T02:43:00.564+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:43:00.647419887Z [2024-04-06T02:43:00.647+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T02:43:00.647476102Z 2024-04-06T02:43:00.647484527Z 2024-04-06T02:43:00.647687717Z [2024-04-06T02:43:00.647+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:43:00.647893259Z [2024-04-06T02:43:00.647+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:43:00.648690512Z [2024-04-06T02:43:00.648+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:43:00.648714549Z 2024-04-06T02:43:00.648722230Z 2024-04-06T02:43:00.652481375Z [2024-04-06T02:43:00.652+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:43:00.652761929Z [2024-04-06T02:43:00.652+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:43:00.653216325Z [2024-04-06T02:43:00.652+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:43:00.653400022Z [2024-04-06T02:43:00.653+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:43:00.856085633Z [2024-04-06T02:43:00.855+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:42:00+00:00 exited with status queued for try_number 1 2024-04-06T02:43:00.856354100Z [2024-04-06T02:43:00.855+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:42:00+00:00 exited with status queued for try_number 1 2024-04-06T02:43:00.866584720Z [2024-04-06T02:43:00.866+0000] {scheduler_job.py:635} INFO - Setting external_id for to e26fb92f-917c-43b6-b32c-281660424149 2024-04-06T02:43:00.866898667Z [2024-04-06T02:43:00.866+0000] {scheduler_job.py:635} INFO - Setting external_id for to 535b999b-d488-43db-a462-4ae89773928c 2024-04-06T02:43:05.766913182Z [2024-04-06T02:43:05.766+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:43:05.767915599Z [2024-04-06T02:43:05.767+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:42:00+00:00, run_id=scheduled__2024-04-06T02:42:00+00:00, run_start_date=2024-04-06 02:43:00.590677+00:00, run_end_date=2024-04-06 02:43:05.767022+00:00, run_duration=5.176345, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:42:00+00:00, data_interval_end=2024-04-06 02:43:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:43:05.785238317Z [2024-04-06T02:43:05.784+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:43:00+00:00, run_after=2024-04-06T02:44:00+00:00 2024-04-06T02:43:05.792482285Z [2024-04-06T02:43:05.791+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:43:05.792835194Z [2024-04-06T02:43:05.792+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:42:00+00:00, run_id=scheduled__2024-04-06T02:42:00+00:00, run_start_date=2024-04-06 02:43:00.593294+00:00, run_end_date=2024-04-06 02:43:05.792315+00:00, run_duration=5.199021, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:42:00+00:00, data_interval_end=2024-04-06 02:43:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:43:05.801739840Z [2024-04-06T02:43:05.801+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:43:00+00:00, run_after=2024-04-06T02:44:00+00:00 2024-04-06T02:43:05.839481819Z [2024-04-06T02:43:05.839+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:42:00+00:00 exited with status success for try_number 1 2024-04-06T02:43:05.846625792Z [2024-04-06T02:43:05.845+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:42:00+00:00, map_index=-1, run_start_date=2024-04-06 02:43:02.935099+00:00, run_end_date=2024-04-06 02:43:04.933146+00:00, run_duration=1.998047, state=success, executor_state=success, try_number=1, max_tries=1, job_id=250, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:43:00.649427+00:00, queued_by_job_id=2, pid=5641 2024-04-06T02:43:06.963758029Z [2024-04-06T02:43:06.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:42:00+00:00 exited with status success for try_number 1 2024-04-06T02:43:06.978190764Z [2024-04-06T02:43:06.977+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:42:00+00:00, map_index=-1, run_start_date=2024-04-06 02:43:02.798771+00:00, run_end_date=2024-04-06 02:43:05.658122+00:00, run_duration=2.859351, state=success, executor_state=success, try_number=1, max_tries=1, job_id=249, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:43:00.649427+00:00, queued_by_job_id=2, pid=5640 2024-04-06T02:44:00.498610430Z [2024-04-06T02:44:00.498+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:44:00+00:00, run_after=2024-04-06T02:45:00+00:00 2024-04-06T02:44:00.505981025Z [2024-04-06T02:44:00.505+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:44:00.513009267Z [2024-04-06T02:44:00.512+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:44:00.592670478Z [2024-04-06T02:44:00.592+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T02:44:00.592715554Z 2024-04-06T02:44:00.592726445Z 2024-04-06T02:44:00.592735056Z 2024-04-06T02:44:00.593054026Z [2024-04-06T02:44:00.592+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T02:44:00.593534126Z [2024-04-06T02:44:00.593+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:44:00.594033902Z [2024-04-06T02:44:00.593+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:44:00.595446490Z [2024-04-06T02:44:00.594+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:44:00.595471337Z 2024-04-06T02:44:00.595480915Z 2024-04-06T02:44:00.595489447Z 2024-04-06T02:44:00.601173884Z [2024-04-06T02:44:00.600+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:44:00.601590516Z [2024-04-06T02:44:00.601+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:44:00.602140920Z [2024-04-06T02:44:00.601+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:44:00.602437780Z [2024-04-06T02:44:00.602+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:44:00.602874662Z [2024-04-06T02:44:00.602+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:44:00.603159554Z [2024-04-06T02:44:00.602+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:44:00.957272507Z [2024-04-06T02:44:00.956+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:42:00+00:00 exited with status queued for try_number 1 2024-04-06T02:44:00.957316940Z [2024-04-06T02:44:00.957+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:43:00+00:00 exited with status queued for try_number 1 2024-04-06T02:44:00.957384997Z [2024-04-06T02:44:00.957+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:43:00+00:00 exited with status queued for try_number 1 2024-04-06T02:44:00.966280193Z [2024-04-06T02:44:00.965+0000] {scheduler_job.py:635} INFO - Setting external_id for to 53da7902-1ead-4012-b18a-47eb9f5056ab 2024-04-06T02:44:00.966988046Z [2024-04-06T02:44:00.966+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc5e10d4-365c-421b-92c5-f601a2a18a7b 2024-04-06T02:44:00.967223232Z [2024-04-06T02:44:00.966+0000] {scheduler_job.py:635} INFO - Setting external_id for to adf5953c-9a69-452e-8feb-843ebcc12ed9 2024-04-06T02:44:03.218122870Z [2024-04-06T02:44:03.217+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:44:03.218568141Z [2024-04-06T02:44:03.218+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 02:42:00+00:00, run_id=scheduled__2024-04-06T02:42:00+00:00, run_start_date=2024-04-06 02:44:00.524949+00:00, run_end_date=2024-04-06 02:44:03.218125+00:00, run_duration=2.693176, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:42:00+00:00, data_interval_end=2024-04-06 02:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T02:44:03.233980818Z [2024-04-06T02:44:03.233+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T02:44:00+00:00, run_after=2024-04-06T02:46:00+00:00 2024-04-06T02:44:03.431209741Z [2024-04-06T02:44:03.430+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:42:00+00:00 exited with status success for try_number 1 2024-04-06T02:44:03.446764945Z [2024-04-06T02:44:03.446+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T02:42:00+00:00, map_index=-1, run_start_date=2024-04-06 02:44:01.868052+00:00, run_end_date=2024-04-06 02:44:02.559397+00:00, run_duration=0.691345, state=success, executor_state=success, try_number=1, max_tries=1, job_id=251, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:44:00.597200+00:00, queued_by_job_id=2, pid=5676 2024-04-06T02:44:05.670205595Z [2024-04-06T02:44:05.669+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:44:05.670669587Z [2024-04-06T02:44:05.670+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:43:00+00:00, run_id=scheduled__2024-04-06T02:43:00+00:00, run_start_date=2024-04-06 02:44:00.526230+00:00, run_end_date=2024-04-06 02:44:05.670198+00:00, run_duration=5.143968, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:43:00+00:00, data_interval_end=2024-04-06 02:44:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:44:05.682341919Z [2024-04-06T02:44:05.682+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:44:00+00:00, run_after=2024-04-06T02:45:00+00:00 2024-04-06T02:44:05.689727921Z [2024-04-06T02:44:05.689+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:44:05.690152226Z [2024-04-06T02:44:05.689+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:43:00+00:00, run_id=scheduled__2024-04-06T02:43:00+00:00, run_start_date=2024-04-06 02:44:00.527305+00:00, run_end_date=2024-04-06 02:44:05.689684+00:00, run_duration=5.162379, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:43:00+00:00, data_interval_end=2024-04-06 02:44:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:44:05.701198488Z [2024-04-06T02:44:05.700+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:44:00+00:00, run_after=2024-04-06T02:45:00+00:00 2024-04-06T02:44:05.770692147Z [2024-04-06T02:44:05.770+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:43:00+00:00 exited with status success for try_number 1 2024-04-06T02:44:05.786927219Z [2024-04-06T02:44:05.786+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:43:00+00:00, map_index=-1, run_start_date=2024-04-06 02:44:03.624116+00:00, run_end_date=2024-04-06 02:44:05.180216+00:00, run_duration=1.5561, state=success, executor_state=success, try_number=1, max_tries=1, job_id=253, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:44:00.597200+00:00, queued_by_job_id=2, pid=5706 2024-04-06T02:44:06.239614577Z [2024-04-06T02:44:06.238+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:43:00+00:00 exited with status success for try_number 1 2024-04-06T02:44:06.245943989Z [2024-04-06T02:44:06.245+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:43:00+00:00, map_index=-1, run_start_date=2024-04-06 02:44:03.507358+00:00, run_end_date=2024-04-06 02:44:05.610534+00:00, run_duration=2.103176, state=success, executor_state=success, try_number=1, max_tries=1, job_id=252, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:44:00.597200+00:00, queued_by_job_id=2, pid=5705 2024-04-06T02:45:00.478653586Z [2024-04-06T02:45:00.478+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:45:00+00:00, run_after=2024-04-06T02:46:00+00:00 2024-04-06T02:45:00.494781353Z [2024-04-06T02:45:00.494+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:45:00+00:00, run_after=2024-04-06T02:50:00+00:00 2024-04-06T02:45:00.502934159Z [2024-04-06T02:45:00.502+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:45:00.572495174Z [2024-04-06T02:45:00.572+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T02:45:00.572521638Z 2024-04-06T02:45:00.572539780Z 2024-04-06T02:45:00.572543436Z 2024-04-06T02:45:00.572684311Z [2024-04-06T02:45:00.572+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:45:00.572943633Z [2024-04-06T02:45:00.572+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:45:00.573137091Z [2024-04-06T02:45:00.572+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:45:00.573780273Z [2024-04-06T02:45:00.573+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:45:00.573792115Z 2024-04-06T02:45:00.573795797Z 2024-04-06T02:45:00.573798754Z 2024-04-06T02:45:00.576665489Z [2024-04-06T02:45:00.576+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-06T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-06T02:45:00.576888530Z [2024-04-06T02:45:00.576+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:45:00.577282336Z [2024-04-06T02:45:00.577+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:45:00.578174643Z [2024-04-06T02:45:00.577+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:45:00.578836185Z [2024-04-06T02:45:00.578+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:45:00.579121335Z [2024-04-06T02:45:00.578+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:45:00.957014495Z [2024-04-06T02:45:00.956+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T02:40:00+00:00 exited with status queued for try_number 1 2024-04-06T02:45:00.957065524Z [2024-04-06T02:45:00.956+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:44:00+00:00 exited with status queued for try_number 1 2024-04-06T02:45:00.957083468Z [2024-04-06T02:45:00.957+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:44:00+00:00 exited with status queued for try_number 1 2024-04-06T02:45:00.975222578Z [2024-04-06T02:45:00.974+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a470aba-a5bb-4686-887a-81527bf5c0bc 2024-04-06T02:45:00.975287729Z [2024-04-06T02:45:00.975+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f2a3d3a-8ace-4536-bc31-ecccaeb7e9cd 2024-04-06T02:45:00.975302908Z [2024-04-06T02:45:00.975+0000] {scheduler_job.py:635} INFO - Setting external_id for to 68fefee3-79b7-410b-8aed-6c782e493ede 2024-04-06T02:45:04.989281941Z [2024-04-06T02:45:04.988+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:45:04.989304144Z 2024-04-06T02:45:04.989576701Z [2024-04-06T02:45:04.989+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:45:04.990223269Z [2024-04-06T02:45:04.990+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:45:04.990234780Z 2024-04-06T02:45:04.992392507Z [2024-04-06T02:45:04.992+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='split_metrics', run_id='scheduled__2024-04-06T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-06T02:45:04.992666814Z [2024-04-06T02:45:04.992+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:45:05.054780989Z [2024-04-06T02:45:05.054+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T02:40:00+00:00 exited with status queued for try_number 1 2024-04-06T02:45:05.064651619Z [2024-04-06T02:45:05.064+0000] {scheduler_job.py:635} INFO - Setting external_id for to 083bf361-89de-4f8f-beac-61a2b19613f3 2024-04-06T02:45:05.388435208Z [2024-04-06T02:45:05.388+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T02:40:00+00:00 exited with status success for try_number 1 2024-04-06T02:45:05.395034612Z [2024-04-06T02:45:05.394+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-06T02:40:00+00:00, map_index=-1, run_start_date=2024-04-06 02:45:03.697885+00:00, run_end_date=2024-04-06 02:45:04.770801+00:00, run_duration=1.072916, state=success, executor_state=success, try_number=1, max_tries=1, job_id=254, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:45:00.574468+00:00, queued_by_job_id=2, pid=5762 2024-04-06T02:45:06.064940718Z [2024-04-06T02:45:06.064+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:45:06.065411352Z [2024-04-06T02:45:06.065+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:44:00+00:00, run_id=scheduled__2024-04-06T02:44:00+00:00, run_start_date=2024-04-06 02:45:00.517881+00:00, run_end_date=2024-04-06 02:45:06.065050+00:00, run_duration=5.547169, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:44:00+00:00, data_interval_end=2024-04-06 02:45:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:45:06.079582248Z [2024-04-06T02:45:06.079+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:45:00+00:00, run_after=2024-04-06T02:46:00+00:00 2024-04-06T02:45:06.126252218Z [2024-04-06T02:45:06.125+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:44:00+00:00 exited with status success for try_number 1 2024-04-06T02:45:06.132016473Z [2024-04-06T02:45:06.131+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:44:00+00:00, map_index=-1, run_start_date=2024-04-06 02:45:03.761722+00:00, run_end_date=2024-04-06 02:45:05.906233+00:00, run_duration=2.144511, state=success, executor_state=success, try_number=1, max_tries=1, job_id=255, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:45:00.574468+00:00, queued_by_job_id=2, pid=5763 2024-04-06T02:45:07.691319619Z [2024-04-06T02:45:07.690+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:45:07.691686309Z [2024-04-06T02:45:07.691+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:44:00+00:00, run_id=scheduled__2024-04-06T02:44:00+00:00, run_start_date=2024-04-06 02:45:00.519010+00:00, run_end_date=2024-04-06 02:45:07.691336+00:00, run_duration=7.172326, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:44:00+00:00, data_interval_end=2024-04-06 02:45:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:45:07.701437035Z [2024-04-06T02:45:07.701+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:45:00+00:00, run_after=2024-04-06T02:46:00+00:00 2024-04-06T02:45:07.732172815Z [2024-04-06T02:45:07.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:44:00+00:00 exited with status success for try_number 1 2024-04-06T02:45:07.736935667Z [2024-04-06T02:45:07.736+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:44:00+00:00, map_index=-1, run_start_date=2024-04-06 02:45:04.577390+00:00, run_end_date=2024-04-06 02:45:07.522086+00:00, run_duration=2.944696, state=success, executor_state=success, try_number=1, max_tries=1, job_id=256, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:45:00.574468+00:00, queued_by_job_id=2, pid=5791 2024-04-06T02:45:08.802457907Z [2024-04-06T02:45:08.802+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:45:08.802481429Z 2024-04-06T02:45:08.802858549Z [2024-04-06T02:45:08.802+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:45:08.803480012Z [2024-04-06T02:45:08.803+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:45:08.803491488Z 2024-04-06T02:45:08.806044071Z [2024-04-06T02:45:08.805+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='collect_metrics', run_id='scheduled__2024-04-06T02:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-06T02:45:08.806352304Z [2024-04-06T02:45:08.806+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T02:45:08.881187380Z [2024-04-06T02:45:08.880+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T02:40:00+00:00 exited with status queued for try_number 1 2024-04-06T02:45:08.883220496Z [2024-04-06T02:45:08.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T02:40:00+00:00 exited with status success for try_number 1 2024-04-06T02:45:08.891622058Z [2024-04-06T02:45:08.891+0000] {scheduler_job.py:635} INFO - Setting external_id for to a53d3b5e-a749-4ba4-ac40-f076fa8dd06b 2024-04-06T02:45:08.892233314Z [2024-04-06T02:45:08.891+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=split_metrics, run_id=scheduled__2024-04-06T02:40:00+00:00, map_index=-1, run_start_date=2024-04-06 02:45:07.190270+00:00, run_end_date=2024-04-06 02:45:07.562278+00:00, run_duration=0.372008, state=success, executor_state=success, try_number=1, max_tries=1, job_id=257, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:45:04.990620+00:00, queued_by_job_id=2, pid=5812 2024-04-06T02:45:11.179587788Z [2024-04-06T02:45:11.179+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:45:11.179615284Z 2024-04-06T02:45:11.179729676Z [2024-04-06T02:45:11.179+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:45:11.180713714Z [2024-04-06T02:45:11.180+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:45:11.180720579Z 2024-04-06T02:45:11.183143409Z [2024-04-06T02:45:11.182+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='send_prometheus', run_id='scheduled__2024-04-06T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:45:11.183378078Z [2024-04-06T02:45:11.183+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:45:11.229478451Z [2024-04-06T02:45:11.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T02:40:00+00:00 exited with status queued for try_number 1 2024-04-06T02:45:11.229575542Z [2024-04-06T02:45:11.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T02:40:00+00:00 exited with status success for try_number 1 2024-04-06T02:45:11.234982176Z [2024-04-06T02:45:11.234+0000] {scheduler_job.py:635} INFO - Setting external_id for to c765af4f-2347-403d-a0b3-86a016f456d4 2024-04-06T02:45:11.235188020Z [2024-04-06T02:45:11.234+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=collect_metrics, run_id=scheduled__2024-04-06T02:40:00+00:00, map_index=0, run_start_date=2024-04-06 02:45:10.320895+00:00, run_end_date=2024-04-06 02:45:10.649981+00:00, run_duration=0.329086, state=success, executor_state=success, try_number=1, max_tries=1, job_id=258, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:45:08.804050+00:00, queued_by_job_id=2, pid=5834 2024-04-06T02:45:13.567538869Z [2024-04-06T02:45:13.566+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:45:13.568161527Z [2024-04-06T02:45:13.567+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:40:00+00:00, run_id=scheduled__2024-04-06T02:40:00+00:00, run_start_date=2024-04-06 02:45:00.516019+00:00, run_end_date=2024-04-06 02:45:13.567377+00:00, run_duration=13.051358, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:40:00+00:00, data_interval_end=2024-04-06 02:45:00+00:00, dag_hash=eecc559ff32fe9a7c4345875f113a0a9 2024-04-06T02:45:13.578169924Z [2024-04-06T02:45:13.577+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:45:00+00:00, run_after=2024-04-06T02:50:00+00:00 2024-04-06T02:45:13.619247970Z [2024-04-06T02:45:13.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T02:40:00+00:00 exited with status success for try_number 1 2024-04-06T02:45:13.631883624Z [2024-04-06T02:45:13.631+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=send_prometheus, run_id=scheduled__2024-04-06T02:40:00+00:00, map_index=-1, run_start_date=2024-04-06 02:45:12.957725+00:00, run_end_date=2024-04-06 02:45:13.338377+00:00, run_duration=0.380652, state=success, executor_state=success, try_number=1, max_tries=1, job_id=259, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:45:11.181190+00:00, queued_by_job_id=2, pid=5849 2024-04-06T02:45:20.114237562Z [2024-04-06T02:45:20.113+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-06T02:46:01.041523510Z [2024-04-06T02:46:01.040+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:46:01.048725621Z [2024-04-06T02:46:01.048+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:46:01.061182969Z [2024-04-06T02:46:01.060+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:46:00+00:00, run_after=2024-04-06T02:47:00+00:00 2024-04-06T02:46:01.144319402Z [2024-04-06T02:46:01.143+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T02:46:01.144356515Z 2024-04-06T02:46:01.144367125Z 2024-04-06T02:46:01.144376367Z 2024-04-06T02:46:01.144468320Z [2024-04-06T02:46:01.144+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T02:46:01.144600028Z [2024-04-06T02:46:01.144+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:46:01.144685921Z [2024-04-06T02:46:01.144+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:46:01.145313242Z [2024-04-06T02:46:01.145+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:46:01.145322628Z 2024-04-06T02:46:01.145326118Z 2024-04-06T02:46:01.145329370Z 2024-04-06T02:46:01.149184291Z [2024-04-06T02:46:01.148+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:46:01.149377289Z [2024-04-06T02:46:01.149+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:46:01.149729439Z [2024-04-06T02:46:01.149+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:46:01.149924516Z [2024-04-06T02:46:01.149+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:46:01.150172036Z [2024-04-06T02:46:01.149+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:46:01.150184843Z [2024-04-06T02:46:01.150+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:46:01.571192542Z [2024-04-06T02:46:01.567+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:44:00+00:00 exited with status queued for try_number 1 2024-04-06T02:46:01.571432835Z [2024-04-06T02:46:01.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:45:00+00:00 exited with status queued for try_number 1 2024-04-06T02:46:01.571690888Z [2024-04-06T02:46:01.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:45:00+00:00 exited with status queued for try_number 1 2024-04-06T02:46:01.587768768Z [2024-04-06T02:46:01.585+0000] {scheduler_job.py:635} INFO - Setting external_id for to 494f919e-eeea-4762-a153-c1afee6613d8 2024-04-06T02:46:01.588219537Z [2024-04-06T02:46:01.587+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0046be7-ae79-4dde-af1c-d63d7b970f81 2024-04-06T02:46:01.588549581Z [2024-04-06T02:46:01.588+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c70f733-43a9-4adc-b7f3-51ded0e83ef1 2024-04-06T02:46:03.247254084Z [2024-04-06T02:46:03.243+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:46:03.247714638Z [2024-04-06T02:46:03.247+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 02:44:00+00:00, run_id=scheduled__2024-04-06T02:44:00+00:00, run_start_date=2024-04-06 02:46:01.074265+00:00, run_end_date=2024-04-06 02:46:03.247180+00:00, run_duration=2.172915, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:44:00+00:00, data_interval_end=2024-04-06 02:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T02:46:03.274648481Z [2024-04-06T02:46:03.274+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T02:46:00+00:00, run_after=2024-04-06T02:48:00+00:00 2024-04-06T02:46:03.373463386Z [2024-04-06T02:46:03.373+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:44:00+00:00 exited with status success for try_number 1 2024-04-06T02:46:03.389827663Z [2024-04-06T02:46:03.389+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T02:44:00+00:00, map_index=-1, run_start_date=2024-04-06 02:46:02.275208+00:00, run_end_date=2024-04-06 02:46:02.922722+00:00, run_duration=0.647514, state=success, executor_state=success, try_number=1, max_tries=1, job_id=260, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:46:01.146342+00:00, queued_by_job_id=2, pid=5853 2024-04-06T02:46:06.848821661Z [2024-04-06T02:46:06.848+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:46:06.849106178Z [2024-04-06T02:46:06.848+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:45:00+00:00, run_id=scheduled__2024-04-06T02:45:00+00:00, run_start_date=2024-04-06 02:46:01.076836+00:00, run_end_date=2024-04-06 02:46:06.848705+00:00, run_duration=5.771869, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:45:00+00:00, data_interval_end=2024-04-06 02:46:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:46:06.862258870Z [2024-04-06T02:46:06.861+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:46:00+00:00, run_after=2024-04-06T02:47:00+00:00 2024-04-06T02:46:06.916558408Z [2024-04-06T02:46:06.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:45:00+00:00 exited with status success for try_number 1 2024-04-06T02:46:06.926135793Z [2024-04-06T02:46:06.925+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:45:00+00:00, map_index=-1, run_start_date=2024-04-06 02:46:04.207405+00:00, run_end_date=2024-04-06 02:46:06.392992+00:00, run_duration=2.185587, state=success, executor_state=success, try_number=1, max_tries=1, job_id=261, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:46:01.146342+00:00, queued_by_job_id=2, pid=5874 2024-04-06T02:46:08.323483016Z [2024-04-06T02:46:08.323+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:46:08.323753839Z [2024-04-06T02:46:08.323+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:45:00+00:00, run_id=scheduled__2024-04-06T02:45:00+00:00, run_start_date=2024-04-06 02:46:01.075681+00:00, run_end_date=2024-04-06 02:46:08.323421+00:00, run_duration=7.24774, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:45:00+00:00, data_interval_end=2024-04-06 02:46:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:46:08.332533124Z [2024-04-06T02:46:08.332+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:46:00+00:00, run_after=2024-04-06T02:47:00+00:00 2024-04-06T02:46:08.360670466Z [2024-04-06T02:46:08.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:45:00+00:00 exited with status success for try_number 1 2024-04-06T02:46:08.366019562Z [2024-04-06T02:46:08.365+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:45:00+00:00, map_index=-1, run_start_date=2024-04-06 02:46:05.040547+00:00, run_end_date=2024-04-06 02:46:07.659353+00:00, run_duration=2.618806, state=success, executor_state=success, try_number=1, max_tries=1, job_id=262, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:46:01.146342+00:00, queued_by_job_id=2, pid=5893 2024-04-06T02:47:00.277268197Z [2024-04-06T02:47:00.276+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:47:00+00:00, run_after=2024-04-06T02:48:00+00:00 2024-04-06T02:47:00.284466716Z [2024-04-06T02:47:00.284+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:47:00.327313097Z [2024-04-06T02:47:00.326+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T02:47:00.327352021Z 2024-04-06T02:47:00.327361317Z 2024-04-06T02:47:00.327369231Z [2024-04-06T02:47:00.327+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:47:00.327376802Z [2024-04-06T02:47:00.327+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:47:00.327846912Z [2024-04-06T02:47:00.327+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:47:00.327870722Z 2024-04-06T02:47:00.327877694Z 2024-04-06T02:47:00.330485344Z [2024-04-06T02:47:00.330+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:47:00.330718906Z [2024-04-06T02:47:00.330+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:47:00.330970463Z [2024-04-06T02:47:00.330+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:47:00.331103769Z [2024-04-06T02:47:00.330+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:47:00.491359043Z [2024-04-06T02:47:00.490+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:46:00+00:00 exited with status queued for try_number 1 2024-04-06T02:47:00.491715507Z [2024-04-06T02:47:00.491+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:46:00+00:00 exited with status queued for try_number 1 2024-04-06T02:47:00.498731610Z [2024-04-06T02:47:00.498+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97fcbf64-2047-4267-b56d-90dea39fdc9c 2024-04-06T02:47:00.498963693Z [2024-04-06T02:47:00.498+0000] {scheduler_job.py:635} INFO - Setting external_id for to b237b3fe-54ab-4411-9480-1dc8f7b0d8b3 2024-04-06T02:47:04.350753980Z [2024-04-06T02:47:04.350+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:47:04.351179107Z [2024-04-06T02:47:04.350+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:46:00+00:00, run_id=scheduled__2024-04-06T02:46:00+00:00, run_start_date=2024-04-06 02:47:00.292340+00:00, run_end_date=2024-04-06 02:47:04.350805+00:00, run_duration=4.058465, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:46:00+00:00, data_interval_end=2024-04-06 02:47:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:47:04.365777973Z [2024-04-06T02:47:04.365+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:47:00+00:00, run_after=2024-04-06T02:48:00+00:00 2024-04-06T02:47:04.408008428Z [2024-04-06T02:47:04.407+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:46:00+00:00 exited with status success for try_number 1 2024-04-06T02:47:04.415047715Z [2024-04-06T02:47:04.414+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:46:00+00:00, map_index=-1, run_start_date=2024-04-06 02:47:02.484822+00:00, run_end_date=2024-04-06 02:47:03.875036+00:00, run_duration=1.390214, state=success, executor_state=success, try_number=1, max_tries=1, job_id=263, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:47:00.328235+00:00, queued_by_job_id=2, pid=5938 2024-04-06T02:47:05.456848117Z [2024-04-06T02:47:05.456+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:47:05.457331556Z [2024-04-06T02:47:05.457+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:46:00+00:00, run_id=scheduled__2024-04-06T02:46:00+00:00, run_start_date=2024-04-06 02:47:00.293637+00:00, run_end_date=2024-04-06 02:47:05.457037+00:00, run_duration=5.1634, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:46:00+00:00, data_interval_end=2024-04-06 02:47:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:47:05.465979338Z [2024-04-06T02:47:05.465+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:47:00+00:00, run_after=2024-04-06T02:48:00+00:00 2024-04-06T02:47:05.493979005Z [2024-04-06T02:47:05.493+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:46:00+00:00 exited with status success for try_number 1 2024-04-06T02:47:05.498965002Z [2024-04-06T02:47:05.498+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:46:00+00:00, map_index=-1, run_start_date=2024-04-06 02:47:02.573984+00:00, run_end_date=2024-04-06 02:47:04.442842+00:00, run_duration=1.868858, state=success, executor_state=success, try_number=1, max_tries=1, job_id=264, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:47:00.328235+00:00, queued_by_job_id=2, pid=5939 2024-04-06T02:48:00.554853995Z [2024-04-06T02:48:00.554+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:48:00+00:00, run_after=2024-04-06T02:49:00+00:00 2024-04-06T02:48:00.564937481Z [2024-04-06T02:48:00.564+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:48:00.572909064Z [2024-04-06T02:48:00.572+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:48:00.677407725Z [2024-04-06T02:48:00.677+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T02:48:00.677440717Z 2024-04-06T02:48:00.677444460Z 2024-04-06T02:48:00.677447494Z 2024-04-06T02:48:00.677576077Z [2024-04-06T02:48:00.677+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T02:48:00.677698066Z [2024-04-06T02:48:00.677+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:48:00.677783277Z [2024-04-06T02:48:00.677+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:48:00.678359729Z [2024-04-06T02:48:00.678+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:48:00.678373238Z 2024-04-06T02:48:00.678377346Z 2024-04-06T02:48:00.678380374Z 2024-04-06T02:48:00.681614242Z [2024-04-06T02:48:00.681+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:48:00.681626785Z [2024-04-06T02:48:00.681+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:48:00.681973576Z [2024-04-06T02:48:00.681+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:48:00.681984057Z [2024-04-06T02:48:00.681+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:48:00.682300432Z [2024-04-06T02:48:00.682+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:48:00.682450101Z [2024-04-06T02:48:00.682+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:48:00.897862253Z [2024-04-06T02:48:00.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:46:00+00:00 exited with status queued for try_number 1 2024-04-06T02:48:00.897971176Z [2024-04-06T02:48:00.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:47:00+00:00 exited with status queued for try_number 1 2024-04-06T02:48:00.897977444Z [2024-04-06T02:48:00.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:47:00+00:00 exited with status queued for try_number 1 2024-04-06T02:48:00.907008333Z [2024-04-06T02:48:00.906+0000] {scheduler_job.py:635} INFO - Setting external_id for to eefede07-8b9a-47d2-a3de-991c94586e32 2024-04-06T02:48:00.907150990Z [2024-04-06T02:48:00.906+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1fea760a-013f-4fcc-bd7d-2cf95cf53355 2024-04-06T02:48:00.907176186Z [2024-04-06T02:48:00.907+0000] {scheduler_job.py:635} INFO - Setting external_id for to 329c06ab-0916-49a9-a44d-4039bd1c217b 2024-04-06T02:48:03.158743343Z [2024-04-06T02:48:03.158+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:48:03.159608769Z [2024-04-06T02:48:03.159+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 02:46:00+00:00, run_id=scheduled__2024-04-06T02:46:00+00:00, run_start_date=2024-04-06 02:48:00.586598+00:00, run_end_date=2024-04-06 02:48:03.158722+00:00, run_duration=2.572124, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:46:00+00:00, data_interval_end=2024-04-06 02:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T02:48:03.174191566Z [2024-04-06T02:48:03.173+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T02:48:00+00:00, run_after=2024-04-06T02:50:00+00:00 2024-04-06T02:48:03.267759467Z [2024-04-06T02:48:03.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:46:00+00:00 exited with status success for try_number 1 2024-04-06T02:48:03.274341531Z [2024-04-06T02:48:03.273+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T02:46:00+00:00, map_index=-1, run_start_date=2024-04-06 02:48:02.047083+00:00, run_end_date=2024-04-06 02:48:02.599235+00:00, run_duration=0.552152, state=success, executor_state=success, try_number=1, max_tries=1, job_id=265, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:48:00.679134+00:00, queued_by_job_id=2, pid=5973 2024-04-06T02:48:06.525187607Z [2024-04-06T02:48:06.524+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:48:06.525803595Z [2024-04-06T02:48:06.525+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:47:00+00:00, run_id=scheduled__2024-04-06T02:47:00+00:00, run_start_date=2024-04-06 02:48:00.588050+00:00, run_end_date=2024-04-06 02:48:06.525116+00:00, run_duration=5.937066, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:47:00+00:00, data_interval_end=2024-04-06 02:48:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:48:06.544686311Z [2024-04-06T02:48:06.544+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:48:00+00:00, run_after=2024-04-06T02:49:00+00:00 2024-04-06T02:48:06.555399782Z [2024-04-06T02:48:06.554+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:48:06.555859106Z [2024-04-06T02:48:06.555+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:47:00+00:00, run_id=scheduled__2024-04-06T02:47:00+00:00, run_start_date=2024-04-06 02:48:00.589319+00:00, run_end_date=2024-04-06 02:48:06.555381+00:00, run_duration=5.966062, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:47:00+00:00, data_interval_end=2024-04-06 02:48:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:48:06.567128951Z [2024-04-06T02:48:06.566+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:48:00+00:00, run_after=2024-04-06T02:49:00+00:00 2024-04-06T02:48:06.618260445Z [2024-04-06T02:48:06.616+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:47:00+00:00 exited with status success for try_number 1 2024-04-06T02:48:06.618660776Z [2024-04-06T02:48:06.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:47:00+00:00 exited with status success for try_number 1 2024-04-06T02:48:06.630006861Z [2024-04-06T02:48:06.629+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:47:00+00:00, map_index=-1, run_start_date=2024-04-06 02:48:03.495328+00:00, run_end_date=2024-04-06 02:48:05.632374+00:00, run_duration=2.137046, state=success, executor_state=success, try_number=1, max_tries=1, job_id=267, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:48:00.679134+00:00, queued_by_job_id=2, pid=6004 2024-04-06T02:48:06.630574325Z [2024-04-06T02:48:06.630+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:47:00+00:00, map_index=-1, run_start_date=2024-04-06 02:48:03.399770+00:00, run_end_date=2024-04-06 02:48:06.134662+00:00, run_duration=2.734892, state=success, executor_state=success, try_number=1, max_tries=1, job_id=266, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:48:00.679134+00:00, queued_by_job_id=2, pid=6003 2024-04-06T02:49:00.109717584Z [2024-04-06T02:49:00.109+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:49:00.123519006Z [2024-04-06T02:49:00.123+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:49:00+00:00, run_after=2024-04-06T02:50:00+00:00 2024-04-06T02:49:00.169870184Z [2024-04-06T02:49:00.169+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T02:49:00.169914772Z 2024-04-06T02:49:00.169919081Z 2024-04-06T02:49:00.169922408Z [2024-04-06T02:49:00.169+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:49:00.170232031Z [2024-04-06T02:49:00.170+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:49:00.170843275Z [2024-04-06T02:49:00.170+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:49:00.170863631Z 2024-04-06T02:49:00.170869788Z 2024-04-06T02:49:00.173367879Z [2024-04-06T02:49:00.173+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:49:00.173415296Z [2024-04-06T02:49:00.173+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:49:00.173780045Z [2024-04-06T02:49:00.173+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:49:00.173888488Z [2024-04-06T02:49:00.173+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:49:00.399058610Z [2024-04-06T02:49:00.398+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:48:00+00:00 exited with status queued for try_number 1 2024-04-06T02:49:00.399548299Z [2024-04-06T02:49:00.399+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:48:00+00:00 exited with status queued for try_number 1 2024-04-06T02:49:00.408890382Z [2024-04-06T02:49:00.408+0000] {scheduler_job.py:635} INFO - Setting external_id for to dbc47bc8-d2a0-4440-a165-7cd8319ee0d0 2024-04-06T02:49:00.409582144Z [2024-04-06T02:49:00.409+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d54a6b9-ab5d-4162-b38c-3e8fe6f0f11f 2024-04-06T02:49:04.967321152Z [2024-04-06T02:49:04.966+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:49:04.967617273Z [2024-04-06T02:49:04.967+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:48:00+00:00, run_id=scheduled__2024-04-06T02:48:00+00:00, run_start_date=2024-04-06 02:49:00.133088+00:00, run_end_date=2024-04-06 02:49:04.967226+00:00, run_duration=4.834138, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:48:00+00:00, data_interval_end=2024-04-06 02:49:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:49:04.979004048Z [2024-04-06T02:49:04.978+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:49:00+00:00, run_after=2024-04-06T02:50:00+00:00 2024-04-06T02:49:05.041463446Z [2024-04-06T02:49:05.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:48:00+00:00 exited with status success for try_number 1 2024-04-06T02:49:05.061120701Z [2024-04-06T02:49:05.060+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:48:00+00:00, map_index=-1, run_start_date=2024-04-06 02:49:02.637660+00:00, run_end_date=2024-04-06 02:49:04.344525+00:00, run_duration=1.706865, state=success, executor_state=success, try_number=1, max_tries=1, job_id=268, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:49:00.171266+00:00, queued_by_job_id=2, pid=6058 2024-04-06T02:49:05.486870820Z [2024-04-06T02:49:05.486+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:49:05.488087687Z [2024-04-06T02:49:05.487+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:48:00+00:00, run_id=scheduled__2024-04-06T02:48:00+00:00, run_start_date=2024-04-06 02:49:00.134363+00:00, run_end_date=2024-04-06 02:49:05.487675+00:00, run_duration=5.353312, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:48:00+00:00, data_interval_end=2024-04-06 02:49:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:49:05.497241392Z [2024-04-06T02:49:05.496+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:49:00+00:00, run_after=2024-04-06T02:50:00+00:00 2024-04-06T02:49:05.534101752Z [2024-04-06T02:49:05.533+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:48:00+00:00 exited with status success for try_number 1 2024-04-06T02:49:05.538144351Z [2024-04-06T02:49:05.537+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:48:00+00:00, map_index=-1, run_start_date=2024-04-06 02:49:02.740057+00:00, run_end_date=2024-04-06 02:49:05.096702+00:00, run_duration=2.356645, state=success, executor_state=success, try_number=1, max_tries=1, job_id=269, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:49:00.171266+00:00, queued_by_job_id=2, pid=6059 2024-04-06T02:50:01.031797400Z [2024-04-06T02:50:01.031+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:50:00+00:00, run_after=2024-04-06T02:51:00+00:00 2024-04-06T02:50:01.041500481Z [2024-04-06T02:50:01.041+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:50:01.053291775Z [2024-04-06T02:50:01.053+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:50:00+00:00, run_after=2024-04-06T02:55:00+00:00 2024-04-06T02:50:01.059516929Z [2024-04-06T02:50:01.059+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:50:01.137432033Z [2024-04-06T02:50:01.137+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-06T02:50:01.137464906Z 2024-04-06T02:50:01.137468254Z 2024-04-06T02:50:01.137471677Z 2024-04-06T02:50:01.137474473Z 2024-04-06T02:50:01.137533443Z [2024-04-06T02:50:01.137+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:50:01.137678011Z [2024-04-06T02:50:01.137+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T02:50:01.138200436Z [2024-04-06T02:50:01.137+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:50:01.138295426Z [2024-04-06T02:50:01.138+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:50:01.139606267Z [2024-04-06T02:50:01.139+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:50:01.139619973Z 2024-04-06T02:50:01.139624281Z 2024-04-06T02:50:01.139627535Z 2024-04-06T02:50:01.139635954Z 2024-04-06T02:50:01.144281422Z [2024-04-06T02:50:01.144+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-06T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-06T02:50:01.144386614Z [2024-04-06T02:50:01.144+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:50:01.144743244Z [2024-04-06T02:50:01.144+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:50:01.144835875Z [2024-04-06T02:50:01.144+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:50:01.145003190Z [2024-04-06T02:50:01.144+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:50:01.145081561Z [2024-04-06T02:50:01.144+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:50:01.145252511Z [2024-04-06T02:50:01.145+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:50:01.145332035Z [2024-04-06T02:50:01.145+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:50:01.598282792Z [2024-04-06T02:50:01.597+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T02:45:00+00:00 exited with status queued for try_number 1 2024-04-06T02:50:01.598372986Z [2024-04-06T02:50:01.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:48:00+00:00 exited with status queued for try_number 1 2024-04-06T02:50:01.598380380Z [2024-04-06T02:50:01.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:49:00+00:00 exited with status queued for try_number 1 2024-04-06T02:50:01.598415959Z [2024-04-06T02:50:01.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:49:00+00:00 exited with status queued for try_number 1 2024-04-06T02:50:01.611923105Z [2024-04-06T02:50:01.611+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75148a00-1ddb-41ad-9392-ed8df5b93c34 2024-04-06T02:50:01.612025140Z [2024-04-06T02:50:01.611+0000] {scheduler_job.py:635} INFO - Setting external_id for to a2bb829f-7dea-442d-9797-ae6accc7218c 2024-04-06T02:50:01.612162823Z [2024-04-06T02:50:01.611+0000] {scheduler_job.py:635} INFO - Setting external_id for to 428f9d32-3946-4945-b5a0-33df21ab42b9 2024-04-06T02:50:01.612232841Z [2024-04-06T02:50:01.612+0000] {scheduler_job.py:635} INFO - Setting external_id for to b1017161-333b-409a-aabd-88b852f65267 2024-04-06T02:50:02.969630499Z [2024-04-06T02:50:02.969+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:50:02.970004008Z [2024-04-06T02:50:02.969+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 02:48:00+00:00, run_id=scheduled__2024-04-06T02:48:00+00:00, run_start_date=2024-04-06 02:50:01.071197+00:00, run_end_date=2024-04-06 02:50:02.969584+00:00, run_duration=1.898387, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:48:00+00:00, data_interval_end=2024-04-06 02:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T02:50:02.990546248Z [2024-04-06T02:50:02.990+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T02:50:00+00:00, run_after=2024-04-06T02:52:00+00:00 2024-04-06T02:50:04.245393345Z [2024-04-06T02:50:04.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:48:00+00:00 exited with status success for try_number 1 2024-04-06T02:50:04.277900984Z [2024-04-06T02:50:04.270+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T02:48:00+00:00, map_index=-1, run_start_date=2024-04-06 02:50:02.204300+00:00, run_end_date=2024-04-06 02:50:02.907487+00:00, run_duration=0.703187, state=success, executor_state=success, try_number=1, max_tries=1, job_id=270, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:50:01.140828+00:00, queued_by_job_id=2, pid=6096 2024-04-06T02:50:06.595470242Z [2024-04-06T02:50:06.594+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:50:06.595521633Z 2024-04-06T02:50:06.595533275Z [2024-04-06T02:50:06.595+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:50:06.596308961Z [2024-04-06T02:50:06.595+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:50:06.596345310Z 2024-04-06T02:50:06.599447979Z [2024-04-06T02:50:06.598+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='split_metrics', run_id='scheduled__2024-04-06T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-06T02:50:06.599484273Z [2024-04-06T02:50:06.599+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:50:06.666932588Z [2024-04-06T02:50:06.666+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T02:45:00+00:00 exited with status queued for try_number 1 2024-04-06T02:50:06.666997792Z [2024-04-06T02:50:06.666+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T02:45:00+00:00 exited with status success for try_number 1 2024-04-06T02:50:06.671594950Z [2024-04-06T02:50:06.671+0000] {scheduler_job.py:635} INFO - Setting external_id for to a556c990-995f-4e52-b43a-5b774f78ebb2 2024-04-06T02:50:06.671685640Z [2024-04-06T02:50:06.671+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-06T02:45:00+00:00, map_index=-1, run_start_date=2024-04-06 02:50:05.202908+00:00, run_end_date=2024-04-06 02:50:05.728081+00:00, run_duration=0.525173, state=success, executor_state=success, try_number=1, max_tries=1, job_id=271, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:50:01.140828+00:00, queued_by_job_id=2, pid=6127 2024-04-06T02:50:07.865399522Z [2024-04-06T02:50:07.864+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:50:07.865946218Z [2024-04-06T02:50:07.865+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:49:00+00:00, run_id=scheduled__2024-04-06T02:49:00+00:00, run_start_date=2024-04-06 02:50:01.072225+00:00, run_end_date=2024-04-06 02:50:07.865260+00:00, run_duration=6.793035, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:49:00+00:00, data_interval_end=2024-04-06 02:50:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:50:07.878806298Z [2024-04-06T02:50:07.878+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:50:00+00:00, run_after=2024-04-06T02:51:00+00:00 2024-04-06T02:50:07.886445327Z [2024-04-06T02:50:07.886+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:50:07.886774393Z [2024-04-06T02:50:07.886+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:49:00+00:00, run_id=scheduled__2024-04-06T02:49:00+00:00, run_start_date=2024-04-06 02:50:01.073574+00:00, run_end_date=2024-04-06 02:50:07.886347+00:00, run_duration=6.812773, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:49:00+00:00, data_interval_end=2024-04-06 02:50:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:50:07.896006299Z [2024-04-06T02:50:07.895+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:50:00+00:00, run_after=2024-04-06T02:51:00+00:00 2024-04-06T02:50:07.956875913Z [2024-04-06T02:50:07.956+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:49:00+00:00 exited with status success for try_number 1 2024-04-06T02:50:07.957147790Z [2024-04-06T02:50:07.956+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:49:00+00:00 exited with status success for try_number 1 2024-04-06T02:50:07.968235340Z [2024-04-06T02:50:07.967+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:49:00+00:00, map_index=-1, run_start_date=2024-04-06 02:50:05.353278+00:00, run_end_date=2024-04-06 02:50:06.851496+00:00, run_duration=1.498218, state=success, executor_state=success, try_number=1, max_tries=1, job_id=272, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:50:01.140828+00:00, queued_by_job_id=2, pid=6128 2024-04-06T02:50:07.968727758Z [2024-04-06T02:50:07.968+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:49:00+00:00, map_index=-1, run_start_date=2024-04-06 02:50:05.913856+00:00, run_end_date=2024-04-06 02:50:07.568627+00:00, run_duration=1.654771, state=success, executor_state=success, try_number=1, max_tries=1, job_id=273, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:50:01.140828+00:00, queued_by_job_id=2, pid=6156 2024-04-06T02:50:08.721945070Z [2024-04-06T02:50:08.721+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:50:08.721984650Z 2024-04-06T02:50:08.722293542Z [2024-04-06T02:50:08.722+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:50:08.722946567Z [2024-04-06T02:50:08.722+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:50:08.722959533Z 2024-04-06T02:50:08.725188967Z [2024-04-06T02:50:08.724+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='collect_metrics', run_id='scheduled__2024-04-06T02:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-06T02:50:08.725429073Z [2024-04-06T02:50:08.725+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T02:50:08.790378208Z [2024-04-06T02:50:08.789+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T02:45:00+00:00 exited with status queued for try_number 1 2024-04-06T02:50:08.790458253Z [2024-04-06T02:50:08.790+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T02:45:00+00:00 exited with status success for try_number 1 2024-04-06T02:50:08.795620216Z [2024-04-06T02:50:08.795+0000] {scheduler_job.py:635} INFO - Setting external_id for to e1a3da90-b666-483d-a6b1-53a862df0de6 2024-04-06T02:50:08.795793922Z [2024-04-06T02:50:08.795+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=split_metrics, run_id=scheduled__2024-04-06T02:45:00+00:00, map_index=-1, run_start_date=2024-04-06 02:50:08.195816+00:00, run_end_date=2024-04-06 02:50:08.590609+00:00, run_duration=0.394793, state=success, executor_state=success, try_number=1, max_tries=1, job_id=274, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:50:06.596552+00:00, queued_by_job_id=2, pid=6177 2024-04-06T02:50:11.062986692Z [2024-04-06T02:50:11.062+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:50:11.063029042Z 2024-04-06T02:50:11.063551582Z [2024-04-06T02:50:11.063+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:50:11.065781433Z [2024-04-06T02:50:11.065+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:50:11.065833148Z 2024-04-06T02:50:11.071437177Z [2024-04-06T02:50:11.071+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='send_prometheus', run_id='scheduled__2024-04-06T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:50:11.072150612Z [2024-04-06T02:50:11.071+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:50:11.131578197Z [2024-04-06T02:50:11.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T02:45:00+00:00 exited with status queued for try_number 1 2024-04-06T02:50:11.131760740Z [2024-04-06T02:50:11.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T02:45:00+00:00 exited with status success for try_number 1 2024-04-06T02:50:11.138580994Z [2024-04-06T02:50:11.138+0000] {scheduler_job.py:635} INFO - Setting external_id for to b2b8ab77-d39d-42e9-aa68-9a85f3d84587 2024-04-06T02:50:11.138798235Z [2024-04-06T02:50:11.138+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=collect_metrics, run_id=scheduled__2024-04-06T02:45:00+00:00, map_index=0, run_start_date=2024-04-06 02:50:10.215010+00:00, run_end_date=2024-04-06 02:50:10.608665+00:00, run_duration=0.393655, state=success, executor_state=success, try_number=1, max_tries=1, job_id=275, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:50:08.723432+00:00, queued_by_job_id=2, pid=6199 2024-04-06T02:50:14.045683641Z [2024-04-06T02:50:14.045+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:50:14.046120816Z [2024-04-06T02:50:14.045+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:45:00+00:00, run_id=scheduled__2024-04-06T02:45:00+00:00, run_start_date=2024-04-06 02:50:01.069886+00:00, run_end_date=2024-04-06 02:50:14.045474+00:00, run_duration=12.975588, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:45:00+00:00, data_interval_end=2024-04-06 02:50:00+00:00, dag_hash=eecc559ff32fe9a7c4345875f113a0a9 2024-04-06T02:50:14.055958893Z [2024-04-06T02:50:14.055+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:50:00+00:00, run_after=2024-04-06T02:55:00+00:00 2024-04-06T02:50:14.102725771Z [2024-04-06T02:50:14.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T02:45:00+00:00 exited with status success for try_number 1 2024-04-06T02:50:14.109928726Z [2024-04-06T02:50:14.109+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=send_prometheus, run_id=scheduled__2024-04-06T02:45:00+00:00, map_index=-1, run_start_date=2024-04-06 02:50:12.619299+00:00, run_end_date=2024-04-06 02:50:12.987139+00:00, run_duration=0.36784, state=success, executor_state=success, try_number=1, max_tries=1, job_id=276, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:50:11.067155+00:00, queued_by_job_id=2, pid=6214 2024-04-06T02:50:20.183420956Z [2024-04-06T02:50:20.182+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-06T02:51:00.190495091Z [2024-04-06T02:51:00.190+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:51:00+00:00, run_after=2024-04-06T02:52:00+00:00 2024-04-06T02:51:00.197487898Z [2024-04-06T02:51:00.197+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:51:00.264263293Z [2024-04-06T02:51:00.263+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T02:51:00.264307581Z 2024-04-06T02:51:00.264317648Z 2024-04-06T02:51:00.264469574Z [2024-04-06T02:51:00.264+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:51:00.264702349Z [2024-04-06T02:51:00.264+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:51:00.265588718Z [2024-04-06T02:51:00.265+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:51:00.265600445Z 2024-04-06T02:51:00.265605308Z 2024-04-06T02:51:00.269460697Z [2024-04-06T02:51:00.269+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:51:00.269777632Z [2024-04-06T02:51:00.269+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:51:00.270191274Z [2024-04-06T02:51:00.269+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:51:00.270438051Z [2024-04-06T02:51:00.270+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:51:00.429867032Z [2024-04-06T02:51:00.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:50:00+00:00 exited with status queued for try_number 1 2024-04-06T02:51:00.430065012Z [2024-04-06T02:51:00.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:50:00+00:00 exited with status queued for try_number 1 2024-04-06T02:51:00.436929651Z [2024-04-06T02:51:00.436+0000] {scheduler_job.py:635} INFO - Setting external_id for to aff01834-7bca-4e4e-9886-fd197d5a1b10 2024-04-06T02:51:00.437115489Z [2024-04-06T02:51:00.436+0000] {scheduler_job.py:635} INFO - Setting external_id for to 456654c5-cbe5-4d83-bb44-d7b701f399a5 2024-04-06T02:51:04.765955243Z [2024-04-06T02:51:04.765+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:51:04.766215072Z [2024-04-06T02:51:04.766+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:50:00+00:00, run_id=scheduled__2024-04-06T02:50:00+00:00, run_start_date=2024-04-06 02:51:00.206998+00:00, run_end_date=2024-04-06 02:51:04.765929+00:00, run_duration=4.558931, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:50:00+00:00, data_interval_end=2024-04-06 02:51:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:51:04.774324208Z [2024-04-06T02:51:04.774+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:51:00+00:00, run_after=2024-04-06T02:52:00+00:00 2024-04-06T02:51:04.780674941Z [2024-04-06T02:51:04.780+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:51:04.780831463Z [2024-04-06T02:51:04.780+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:50:00+00:00, run_id=scheduled__2024-04-06T02:50:00+00:00, run_start_date=2024-04-06 02:51:00.208212+00:00, run_end_date=2024-04-06 02:51:04.780595+00:00, run_duration=4.572383, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:50:00+00:00, data_interval_end=2024-04-06 02:51:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:51:04.789457674Z [2024-04-06T02:51:04.789+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:51:00+00:00, run_after=2024-04-06T02:52:00+00:00 2024-04-06T02:51:04.820100867Z [2024-04-06T02:51:04.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:50:00+00:00 exited with status success for try_number 1 2024-04-06T02:51:04.820175017Z [2024-04-06T02:51:04.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:50:00+00:00 exited with status success for try_number 1 2024-04-06T02:51:04.826701789Z [2024-04-06T02:51:04.825+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:50:00+00:00, map_index=-1, run_start_date=2024-04-06 02:51:02.358718+00:00, run_end_date=2024-04-06 02:51:03.791119+00:00, run_duration=1.432401, state=success, executor_state=success, try_number=1, max_tries=1, job_id=278, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:51:00.266564+00:00, queued_by_job_id=2, pid=6238 2024-04-06T02:51:04.826719245Z [2024-04-06T02:51:04.826+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:50:00+00:00, map_index=-1, run_start_date=2024-04-06 02:51:02.263116+00:00, run_end_date=2024-04-06 02:51:04.066731+00:00, run_duration=1.803615, state=success, executor_state=success, try_number=1, max_tries=1, job_id=277, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:51:00.266564+00:00, queued_by_job_id=2, pid=6237 2024-04-06T02:52:00.657222178Z [2024-04-06T02:52:00.656+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:52:00.674886388Z [2024-04-06T02:52:00.674+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:52:00+00:00, run_after=2024-04-06T02:53:00+00:00 2024-04-06T02:52:00.687654979Z [2024-04-06T02:52:00.687+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:52:00.778113893Z [2024-04-06T02:52:00.777+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T02:52:00.778136143Z 2024-04-06T02:52:00.778140821Z 2024-04-06T02:52:00.778144723Z 2024-04-06T02:52:00.778278902Z [2024-04-06T02:52:00.778+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T02:52:00.778399303Z [2024-04-06T02:52:00.778+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:52:00.778517050Z [2024-04-06T02:52:00.778+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:52:00.779011336Z [2024-04-06T02:52:00.778+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:52:00.779022000Z 2024-04-06T02:52:00.779038395Z 2024-04-06T02:52:00.779042700Z 2024-04-06T02:52:00.782002860Z [2024-04-06T02:52:00.781+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:52:00.782149849Z [2024-04-06T02:52:00.781+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:52:00.782465396Z [2024-04-06T02:52:00.782+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:52:00.782617832Z [2024-04-06T02:52:00.782+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:52:00.782822655Z [2024-04-06T02:52:00.782+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:52:00.782954685Z [2024-04-06T02:52:00.782+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:52:01.040099578Z [2024-04-06T02:52:01.039+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:50:00+00:00 exited with status queued for try_number 1 2024-04-06T02:52:01.040193225Z [2024-04-06T02:52:01.040+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:51:00+00:00 exited with status queued for try_number 1 2024-04-06T02:52:01.040318909Z [2024-04-06T02:52:01.040+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:51:00+00:00 exited with status queued for try_number 1 2024-04-06T02:52:01.050411206Z [2024-04-06T02:52:01.050+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e11b81c-2852-427f-af91-56d6f5d28466 2024-04-06T02:52:01.050596560Z [2024-04-06T02:52:01.050+0000] {scheduler_job.py:635} INFO - Setting external_id for to 36a9fbe3-63d0-4e06-9c4b-ede3f3065383 2024-04-06T02:52:01.050758846Z [2024-04-06T02:52:01.050+0000] {scheduler_job.py:635} INFO - Setting external_id for to eded5528-1f5f-4707-b253-38047abaf721 2024-04-06T02:52:03.493147725Z [2024-04-06T02:52:03.492+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:52:03.493717127Z [2024-04-06T02:52:03.493+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 02:50:00+00:00, run_id=scheduled__2024-04-06T02:50:00+00:00, run_start_date=2024-04-06 02:52:00.707235+00:00, run_end_date=2024-04-06 02:52:03.493232+00:00, run_duration=2.785997, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:50:00+00:00, data_interval_end=2024-04-06 02:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T02:52:03.502138865Z [2024-04-06T02:52:03.501+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T02:52:00+00:00, run_after=2024-04-06T02:54:00+00:00 2024-04-06T02:52:03.559592252Z [2024-04-06T02:52:03.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:50:00+00:00 exited with status success for try_number 1 2024-04-06T02:52:03.564365120Z [2024-04-06T02:52:03.564+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T02:50:00+00:00, map_index=-1, run_start_date=2024-04-06 02:52:02.049147+00:00, run_end_date=2024-04-06 02:52:02.734733+00:00, run_duration=0.685586, state=success, executor_state=success, try_number=1, max_tries=1, job_id=279, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:52:00.779652+00:00, queued_by_job_id=2, pid=6275 2024-04-06T02:52:05.752471758Z [2024-04-06T02:52:05.751+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:52:05.752625434Z [2024-04-06T02:52:05.752+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:51:00+00:00, run_id=scheduled__2024-04-06T02:51:00+00:00, run_start_date=2024-04-06 02:52:00.708551+00:00, run_end_date=2024-04-06 02:52:05.752289+00:00, run_duration=5.043738, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:51:00+00:00, data_interval_end=2024-04-06 02:52:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:52:05.762099193Z [2024-04-06T02:52:05.761+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:52:00+00:00, run_after=2024-04-06T02:53:00+00:00 2024-04-06T02:52:05.768873098Z [2024-04-06T02:52:05.768+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:52:05.768929106Z [2024-04-06T02:52:05.768+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:51:00+00:00, run_id=scheduled__2024-04-06T02:51:00+00:00, run_start_date=2024-04-06 02:52:00.709640+00:00, run_end_date=2024-04-06 02:52:05.768679+00:00, run_duration=5.059039, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:51:00+00:00, data_interval_end=2024-04-06 02:52:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:52:05.778329184Z [2024-04-06T02:52:05.778+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:52:00+00:00, run_after=2024-04-06T02:53:00+00:00 2024-04-06T02:52:05.816591720Z [2024-04-06T02:52:05.816+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:51:00+00:00 exited with status success for try_number 1 2024-04-06T02:52:05.822564897Z [2024-04-06T02:52:05.822+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:51:00+00:00, map_index=-1, run_start_date=2024-04-06 02:52:03.559026+00:00, run_end_date=2024-04-06 02:52:05.199140+00:00, run_duration=1.640114, state=success, executor_state=success, try_number=1, max_tries=1, job_id=280, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:52:00.779652+00:00, queued_by_job_id=2, pid=6305 2024-04-06T02:52:06.908828924Z [2024-04-06T02:52:06.907+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:51:00+00:00 exited with status success for try_number 1 2024-04-06T02:52:06.919865898Z [2024-04-06T02:52:06.919+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:51:00+00:00, map_index=-1, run_start_date=2024-04-06 02:52:03.525909+00:00, run_end_date=2024-04-06 02:52:05.689095+00:00, run_duration=2.163186, state=success, executor_state=success, try_number=1, max_tries=1, job_id=281, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:52:00.779652+00:00, queued_by_job_id=2, pid=6304 2024-04-06T02:52:54.274042999Z [2024-04-06T02:52:54.273+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:52:54.274078374Z 2024-04-06T02:52:54.274163404Z [2024-04-06T02:52:54.273+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-04-06T02:52:54.274873039Z [2024-04-06T02:52:54.274+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:52:54.274884357Z 2024-04-06T02:52:54.276405366Z [2024-04-06T02:52:54.276+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240406025253_219393', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:52:54.276504097Z [2024-04-06T02:52:54.276+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240406025253_219393', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-04-06T02:52:54.366452698Z [2024-04-06T02:52:54.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240406025253_219393 exited with status queued for try_number 1 2024-04-06T02:52:54.374159498Z [2024-04-06T02:52:54.373+0000] {scheduler_job.py:635} INFO - Setting external_id for to eca4a2e6-dd6b-44ea-827e-e1d9f9649ec7 2024-04-06T02:52:56.591051471Z [2024-04-06T02:52:56.590+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:52:56.591477047Z [2024-04-06T02:52:56.591+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-04-06 02:52:53.823990+00:00, run_id=vdu_down_20240406025253_219393, run_start_date=2024-04-06 02:52:54.224858+00:00, run_end_date=2024-04-06 02:52:56.591156+00:00, run_duration=2.366298, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-06 02:52:53.823990+00:00, data_interval_end=2024-04-06 02:52:53.823990+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-04-06T02:52:56.594651517Z [2024-04-06T02:52:56.594+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-04-06T02:52:56.628998973Z [2024-04-06T02:52:56.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240406025253_219393 exited with status success for try_number 1 2024-04-06T02:52:56.637587477Z [2024-04-06T02:52:56.637+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240406025253_219393, map_index=-1, run_start_date=2024-04-06 02:52:54.960395+00:00, run_end_date=2024-04-06 02:52:55.415129+00:00, run_duration=0.454734, state=success, executor_state=success, try_number=1, max_tries=1, job_id=282, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:52:54.274696+00:00, queued_by_job_id=2, pid=6338 2024-04-06T02:53:01.074801408Z [2024-04-06T02:53:01.074+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:53:01.090005089Z [2024-04-06T02:53:01.089+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:53:00+00:00, run_after=2024-04-06T02:54:00+00:00 2024-04-06T02:53:01.142856633Z [2024-04-06T02:53:01.142+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T02:53:01.142884024Z 2024-04-06T02:53:01.142888588Z 2024-04-06T02:53:01.142900181Z [2024-04-06T02:53:01.142+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:53:01.143095353Z [2024-04-06T02:53:01.142+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:53:01.143605107Z [2024-04-06T02:53:01.143+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:53:01.143615559Z 2024-04-06T02:53:01.143619693Z 2024-04-06T02:53:01.146128257Z [2024-04-06T02:53:01.145+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:53:01.146232696Z [2024-04-06T02:53:01.146+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:53:01.146521587Z [2024-04-06T02:53:01.146+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:53:01.146697677Z [2024-04-06T02:53:01.146+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:53:01.405570837Z [2024-04-06T02:53:01.405+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:52:00+00:00 exited with status queued for try_number 1 2024-04-06T02:53:01.405599250Z [2024-04-06T02:53:01.405+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:52:00+00:00 exited with status queued for try_number 1 2024-04-06T02:53:01.416975068Z [2024-04-06T02:53:01.416+0000] {scheduler_job.py:635} INFO - Setting external_id for to ec461e3d-6f25-4429-8ef5-bcdaf08e45b5 2024-04-06T02:53:01.418120830Z [2024-04-06T02:53:01.416+0000] {scheduler_job.py:635} INFO - Setting external_id for to 403e3f12-84cb-4cca-b1be-3396c470ee31 2024-04-06T02:53:05.628886596Z [2024-04-06T02:53:05.628+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:53:05.629154812Z [2024-04-06T02:53:05.628+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:52:00+00:00, run_id=scheduled__2024-04-06T02:52:00+00:00, run_start_date=2024-04-06 02:53:01.101200+00:00, run_end_date=2024-04-06 02:53:05.628705+00:00, run_duration=4.527505, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:52:00+00:00, data_interval_end=2024-04-06 02:53:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:53:05.640313627Z [2024-04-06T02:53:05.639+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:53:00+00:00, run_after=2024-04-06T02:54:00+00:00 2024-04-06T02:53:05.648124168Z [2024-04-06T02:53:05.647+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:53:05.648256657Z [2024-04-06T02:53:05.648+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:52:00+00:00, run_id=scheduled__2024-04-06T02:52:00+00:00, run_start_date=2024-04-06 02:53:01.102430+00:00, run_end_date=2024-04-06 02:53:05.647967+00:00, run_duration=4.545537, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:52:00+00:00, data_interval_end=2024-04-06 02:53:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:53:05.658135502Z [2024-04-06T02:53:05.657+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:53:00+00:00, run_after=2024-04-06T02:54:00+00:00 2024-04-06T02:53:05.722972447Z [2024-04-06T02:53:05.722+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:52:00+00:00 exited with status success for try_number 1 2024-04-06T02:53:05.723468944Z [2024-04-06T02:53:05.722+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:52:00+00:00 exited with status success for try_number 1 2024-04-06T02:53:05.735547319Z [2024-04-06T02:53:05.734+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:52:00+00:00, map_index=-1, run_start_date=2024-04-06 02:53:03.438568+00:00, run_end_date=2024-04-06 02:53:05.121178+00:00, run_duration=1.68261, state=success, executor_state=success, try_number=1, max_tries=1, job_id=284, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:53:01.144159+00:00, queued_by_job_id=2, pid=6372 2024-04-06T02:53:05.735842015Z [2024-04-06T02:53:05.735+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:52:00+00:00, map_index=-1, run_start_date=2024-04-06 02:53:03.278852+00:00, run_end_date=2024-04-06 02:53:05.292908+00:00, run_duration=2.014056, state=success, executor_state=success, try_number=1, max_tries=1, job_id=283, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:53:01.144159+00:00, queued_by_job_id=2, pid=6371 2024-04-06T02:54:00.393329856Z [2024-04-06T02:54:00.392+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:54:00.407500054Z [2024-04-06T02:54:00.407+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:54:00+00:00, run_after=2024-04-06T02:55:00+00:00 2024-04-06T02:54:00.413874937Z [2024-04-06T02:54:00.413+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:54:00.488759502Z [2024-04-06T02:54:00.488+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T02:54:00.488791273Z 2024-04-06T02:54:00.488839517Z 2024-04-06T02:54:00.488848860Z 2024-04-06T02:54:00.488859939Z [2024-04-06T02:54:00.488+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T02:54:00.488967485Z [2024-04-06T02:54:00.488+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:54:00.488994699Z [2024-04-06T02:54:00.488+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:54:00.490160825Z [2024-04-06T02:54:00.489+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:54:00.490181557Z 2024-04-06T02:54:00.490187044Z 2024-04-06T02:54:00.490213008Z 2024-04-06T02:54:00.494421791Z [2024-04-06T02:54:00.494+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:54:00.494720710Z [2024-04-06T02:54:00.494+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:54:00.495102818Z [2024-04-06T02:54:00.494+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:54:00.495285766Z [2024-04-06T02:54:00.495+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:54:00.495572727Z [2024-04-06T02:54:00.495+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:54:00.495778875Z [2024-04-06T02:54:00.495+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:54:00.761639556Z [2024-04-06T02:54:00.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:52:00+00:00 exited with status queued for try_number 1 2024-04-06T02:54:00.761669933Z [2024-04-06T02:54:00.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:53:00+00:00 exited with status queued for try_number 1 2024-04-06T02:54:00.761750036Z [2024-04-06T02:54:00.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:53:00+00:00 exited with status queued for try_number 1 2024-04-06T02:54:00.776081546Z [2024-04-06T02:54:00.775+0000] {scheduler_job.py:635} INFO - Setting external_id for to 93a548ad-579a-45c1-b654-266668641360 2024-04-06T02:54:00.776169516Z [2024-04-06T02:54:00.776+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6aee4d9-cf15-48c0-bc30-6d3cd3342cde 2024-04-06T02:54:00.776248766Z [2024-04-06T02:54:00.776+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f552ff3-15ab-4821-ae81-cd61449245f7 2024-04-06T02:54:01.779609773Z [2024-04-06T02:54:01.779+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:54:01.779957490Z [2024-04-06T02:54:01.779+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 02:52:00+00:00, run_id=scheduled__2024-04-06T02:52:00+00:00, run_start_date=2024-04-06 02:54:00.433297+00:00, run_end_date=2024-04-06 02:54:01.779548+00:00, run_duration=1.346251, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:52:00+00:00, data_interval_end=2024-04-06 02:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T02:54:01.788044755Z [2024-04-06T02:54:01.787+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T02:54:00+00:00, run_after=2024-04-06T02:56:00+00:00 2024-04-06T02:54:03.041362035Z [2024-04-06T02:54:03.040+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:52:00+00:00 exited with status success for try_number 1 2024-04-06T02:54:03.049419672Z [2024-04-06T02:54:03.049+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T02:52:00+00:00, map_index=-1, run_start_date=2024-04-06 02:54:01.304845+00:00, run_end_date=2024-04-06 02:54:01.726427+00:00, run_duration=0.421582, state=success, executor_state=success, try_number=1, max_tries=1, job_id=285, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:54:00.492089+00:00, queued_by_job_id=2, pid=6407 2024-04-06T02:54:05.244581217Z [2024-04-06T02:54:05.242+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:54:05.245541532Z [2024-04-06T02:54:05.245+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:53:00+00:00, run_id=scheduled__2024-04-06T02:53:00+00:00, run_start_date=2024-04-06 02:54:00.438424+00:00, run_end_date=2024-04-06 02:54:05.245224+00:00, run_duration=4.8068, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:53:00+00:00, data_interval_end=2024-04-06 02:54:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:54:05.267350757Z [2024-04-06T02:54:05.267+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:54:00+00:00, run_after=2024-04-06T02:55:00+00:00 2024-04-06T02:54:05.915831096Z [2024-04-06T02:54:05.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:53:00+00:00 exited with status success for try_number 1 2024-04-06T02:54:05.924678000Z [2024-04-06T02:54:05.924+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:53:00+00:00, map_index=-1, run_start_date=2024-04-06 02:54:03.075644+00:00, run_end_date=2024-04-06 02:54:05.190194+00:00, run_duration=2.11455, state=success, executor_state=success, try_number=1, max_tries=1, job_id=286, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:54:00.492089+00:00, queued_by_job_id=2, pid=6428 2024-04-06T02:54:07.008598399Z [2024-04-06T02:54:07.008+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:54:07.010348733Z [2024-04-06T02:54:07.009+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:53:00+00:00, run_id=scheduled__2024-04-06T02:53:00+00:00, run_start_date=2024-04-06 02:54:00.436913+00:00, run_end_date=2024-04-06 02:54:07.008425+00:00, run_duration=6.571512, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:53:00+00:00, data_interval_end=2024-04-06 02:54:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:54:07.020407260Z [2024-04-06T02:54:07.020+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:54:00+00:00, run_after=2024-04-06T02:55:00+00:00 2024-04-06T02:54:07.070826499Z [2024-04-06T02:54:07.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:53:00+00:00 exited with status success for try_number 1 2024-04-06T02:54:07.080215018Z [2024-04-06T02:54:07.079+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:53:00+00:00, map_index=-1, run_start_date=2024-04-06 02:54:03.904571+00:00, run_end_date=2024-04-06 02:54:06.354773+00:00, run_duration=2.450202, state=success, executor_state=success, try_number=1, max_tries=1, job_id=287, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:54:00.492089+00:00, queued_by_job_id=2, pid=6447 2024-04-06T02:54:20.143649097Z [2024-04-06T02:54:20.142+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:54:20.202469282Z [2024-04-06T02:54:20.201+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:54:20.202525665Z 2024-04-06T02:54:20.203039486Z [2024-04-06T02:54:20.202+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a has 0/16 running and queued tasks 2024-04-06T02:54:20.205187804Z [2024-04-06T02:54:20.204+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:54:20.205222088Z 2024-04-06T02:54:20.211644893Z [2024-04-06T02:54:20.211+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:54:20.212092302Z [2024-04-06T02:54:20.211+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:54:20.284236189Z [2024-04-06T02:54:20.283+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:53:00+00:00 exited with status queued for try_number 1 2024-04-06T02:54:20.289940980Z [2024-04-06T02:54:20.289+0000] {scheduler_job.py:635} INFO - Setting external_id for to fd4a6849-b279-4da5-b105-d2401876f117 2024-04-06T02:54:24.422412917Z [2024-04-06T02:54:24.421+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:54:24.422636725Z [2024-04-06T02:54:24.422+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a, execution_date=2024-04-06 02:53:00+00:00, run_id=scheduled__2024-04-06T02:53:00+00:00, run_start_date=2024-04-06 02:54:20.153139+00:00, run_end_date=2024-04-06 02:54:24.422330+00:00, run_duration=4.269191, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:53:00+00:00, data_interval_end=2024-04-06 02:54:00+00:00, dag_hash=4b6fa6873d9e64982fdb9ebc1f75b89f 2024-04-06T02:54:24.432044378Z [2024-04-06T02:54:24.431+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a to 2024-04-06T02:54:00+00:00, run_after=2024-04-06T02:55:00+00:00 2024-04-06T02:54:24.471604709Z [2024-04-06T02:54:24.471+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:53:00+00:00 exited with status success for try_number 1 2024-04-06T02:54:24.482251080Z [2024-04-06T02:54:24.481+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:53:00+00:00, map_index=-1, run_start_date=2024-04-06 02:54:22.103405+00:00, run_end_date=2024-04-06 02:54:23.866005+00:00, run_duration=1.7626, state=success, executor_state=success, try_number=1, max_tries=1, job_id=288, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:54:20.206810+00:00, queued_by_job_id=2, pid=6481 2024-04-06T02:54:34.165647358Z [2024-04-06T02:54:34.165+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_bb497dd3-763c-402a-9bfa-42b2035b7b2a to 2024-04-06T02:54:00+00:00, run_after=2024-04-06T02:55:00+00:00 2024-04-06T02:54:34.225995125Z [2024-04-06T02:54:34.223+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:54:34.226019033Z 2024-04-06T02:54:34.226022799Z [2024-04-06T02:54:34.224+0000] {scheduler_job.py:425} INFO - DAG vim_status_bb497dd3-763c-402a-9bfa-42b2035b7b2a has 0/16 running and queued tasks 2024-04-06T02:54:34.226026315Z [2024-04-06T02:54:34.224+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:54:34.226029308Z 2024-04-06T02:54:34.227152578Z [2024-04-06T02:54:34.226+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_bb497dd3-763c-402a-9bfa-42b2035b7b2a', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:54:34.227264052Z [2024-04-06T02:54:34.227+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_bb497dd3-763c-402a-9bfa-42b2035b7b2a', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:54:34.330307713Z [2024-04-06T02:54:34.326+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_bb497dd3-763c-402a-9bfa-42b2035b7b2a.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:53:00+00:00 exited with status queued for try_number 1 2024-04-06T02:54:34.332761575Z [2024-04-06T02:54:34.332+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab1a8133-bf9b-49cb-8be2-7aa7883512d8 2024-04-06T02:54:37.527436312Z [2024-04-06T02:54:37.526+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a to 2024-04-06T02:50:00+00:00, run_after=2024-04-06T02:55:00+00:00 2024-04-06T02:54:37.577153178Z [2024-04-06T02:54:37.576+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:54:37.577586198Z [2024-04-06T02:54:37.577+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_bb497dd3-763c-402a-9bfa-42b2035b7b2a, execution_date=2024-04-06 02:53:00+00:00, run_id=scheduled__2024-04-06T02:53:00+00:00, run_start_date=2024-04-06 02:54:34.176812+00:00, run_end_date=2024-04-06 02:54:37.577012+00:00, run_duration=3.4002, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:53:00+00:00, data_interval_end=2024-04-06 02:54:00+00:00, dag_hash=e6d7525064c98f07885d96de7a948ce9 2024-04-06T02:54:37.593342395Z [2024-04-06T02:54:37.592+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_bb497dd3-763c-402a-9bfa-42b2035b7b2a to 2024-04-06T02:54:00+00:00, run_after=2024-04-06T02:55:00+00:00 2024-04-06T02:54:37.615205470Z [2024-04-06T02:54:37.614+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:54:37.615236980Z 2024-04-06T02:54:37.615622101Z [2024-04-06T02:54:37.615+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a has 0/16 running and queued tasks 2024-04-06T02:54:37.616278111Z [2024-04-06T02:54:37.615+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:54:37.616295647Z 2024-04-06T02:54:37.619250644Z [2024-04-06T02:54:37.618+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-06T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-06T02:54:37.619470599Z [2024-04-06T02:54:37.619+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:54:37.677917907Z [2024-04-06T02:54:37.677+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T02:45:00+00:00 exited with status queued for try_number 1 2024-04-06T02:54:37.678308969Z [2024-04-06T02:54:37.677+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_bb497dd3-763c-402a-9bfa-42b2035b7b2a.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:53:00+00:00 exited with status success for try_number 1 2024-04-06T02:54:37.690410493Z [2024-04-06T02:54:37.689+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_bb497dd3-763c-402a-9bfa-42b2035b7b2a, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:53:00+00:00, map_index=-1, run_start_date=2024-04-06 02:54:35.873419+00:00, run_end_date=2024-04-06 02:54:37.112996+00:00, run_duration=1.239577, state=success, executor_state=success, try_number=1, max_tries=1, job_id=289, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:54:34.225141+00:00, queued_by_job_id=2, pid=6502 2024-04-06T02:54:37.690870885Z [2024-04-06T02:54:37.690+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f562012-ce6a-42de-a82c-418f654eecfb 2024-04-06T02:54:39.948095325Z [2024-04-06T02:54:39.947+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:54:39.948127022Z 2024-04-06T02:54:39.948135185Z [2024-04-06T02:54:39.947+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a has 0/16 running and queued tasks 2024-04-06T02:54:39.949023373Z [2024-04-06T02:54:39.948+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:54:39.949038735Z 2024-04-06T02:54:39.951819741Z [2024-04-06T02:54:39.951+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a', task_id='split_metrics', run_id='scheduled__2024-04-06T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-06T02:54:39.952085091Z [2024-04-06T02:54:39.951+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a', 'split_metrics', 'scheduled__2024-04-06T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:54:40.014551476Z [2024-04-06T02:54:40.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a.split_metrics run_id=scheduled__2024-04-06T02:45:00+00:00 exited with status queued for try_number 1 2024-04-06T02:54:40.014809512Z [2024-04-06T02:54:40.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T02:45:00+00:00 exited with status success for try_number 1 2024-04-06T02:54:40.023131367Z [2024-04-06T02:54:40.022+0000] {scheduler_job.py:635} INFO - Setting external_id for to c35cf825-1402-496b-ab7b-5601936d9e1b 2024-04-06T02:54:40.023621207Z [2024-04-06T02:54:40.023+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-06T02:45:00+00:00, map_index=-1, run_start_date=2024-04-06 02:54:39.236842+00:00, run_end_date=2024-04-06 02:54:39.574251+00:00, run_duration=0.337409, state=success, executor_state=success, try_number=1, max_tries=1, job_id=290, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:54:37.616781+00:00, queued_by_job_id=2, pid=6523 2024-04-06T02:54:42.662058397Z [2024-04-06T02:54:42.660+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:54:42.662104761Z 2024-04-06T02:54:42.662828919Z [2024-04-06T02:54:42.662+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a has 0/16 running and queued tasks 2024-04-06T02:54:42.664899563Z [2024-04-06T02:54:42.664+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:54:42.664915114Z 2024-04-06T02:54:42.669450885Z [2024-04-06T02:54:42.669+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a', task_id='collect_metrics', run_id='scheduled__2024-04-06T02:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-06T02:54:42.670047860Z [2024-04-06T02:54:42.669+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a', 'collect_metrics', 'scheduled__2024-04-06T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T02:54:42.756046763Z [2024-04-06T02:54:42.755+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a.collect_metrics run_id=scheduled__2024-04-06T02:45:00+00:00 exited with status queued for try_number 1 2024-04-06T02:54:42.756407462Z [2024-04-06T02:54:42.755+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a.split_metrics run_id=scheduled__2024-04-06T02:45:00+00:00 exited with status success for try_number 1 2024-04-06T02:54:42.762795416Z [2024-04-06T02:54:42.762+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3984a50-d712-4b2e-b4e8-e327462410e5 2024-04-06T02:54:42.763061492Z [2024-04-06T02:54:42.762+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a, task_id=split_metrics, run_id=scheduled__2024-04-06T02:45:00+00:00, map_index=-1, run_start_date=2024-04-06 02:54:41.692077+00:00, run_end_date=2024-04-06 02:54:42.023686+00:00, run_duration=0.331609, state=success, executor_state=success, try_number=1, max_tries=1, job_id=291, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:54:39.949498+00:00, queued_by_job_id=2, pid=6544 2024-04-06T02:54:45.047680380Z [2024-04-06T02:54:45.047+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:54:45.047717713Z 2024-04-06T02:54:45.047727961Z [2024-04-06T02:54:45.047+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a has 0/16 running and queued tasks 2024-04-06T02:54:45.048409729Z [2024-04-06T02:54:45.048+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:54:45.048433058Z 2024-04-06T02:54:45.050968989Z [2024-04-06T02:54:45.050+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a', task_id='send_prometheus', run_id='scheduled__2024-04-06T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:54:45.051010120Z [2024-04-06T02:54:45.050+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a', 'send_prometheus', 'scheduled__2024-04-06T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:54:45.101097844Z [2024-04-06T02:54:45.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a.send_prometheus run_id=scheduled__2024-04-06T02:45:00+00:00 exited with status queued for try_number 1 2024-04-06T02:54:45.101135495Z [2024-04-06T02:54:45.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a.collect_metrics run_id=scheduled__2024-04-06T02:45:00+00:00 exited with status success for try_number 1 2024-04-06T02:54:45.106139521Z [2024-04-06T02:54:45.105+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7017e677-f5ee-4f57-95fa-f9abdf0cfead 2024-04-06T02:54:45.106251292Z [2024-04-06T02:54:45.106+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a, task_id=collect_metrics, run_id=scheduled__2024-04-06T02:45:00+00:00, map_index=0, run_start_date=2024-04-06 02:54:44.219901+00:00, run_end_date=2024-04-06 02:54:44.595651+00:00, run_duration=0.37575, state=success, executor_state=success, try_number=1, max_tries=1, job_id=292, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:54:42.665967+00:00, queued_by_job_id=2, pid=6556 2024-04-06T02:54:47.089271502Z [2024-04-06T02:54:47.088+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:54:47.089736863Z [2024-04-06T02:54:47.089+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a, execution_date=2024-04-06 02:45:00+00:00, run_id=scheduled__2024-04-06T02:45:00+00:00, run_start_date=2024-04-06 02:54:37.539901+00:00, run_end_date=2024-04-06 02:54:47.089336+00:00, run_duration=9.549435, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:45:00+00:00, data_interval_end=2024-04-06 02:50:00+00:00, dag_hash=b34f12e1021ac5a4cb1145298addae8e 2024-04-06T02:54:47.095575371Z [2024-04-06T02:54:47.095+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a to 2024-04-06T02:50:00+00:00, run_after=2024-04-06T02:55:00+00:00 2024-04-06T02:54:47.127923033Z [2024-04-06T02:54:47.127+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a.send_prometheus run_id=scheduled__2024-04-06T02:45:00+00:00 exited with status success for try_number 1 2024-04-06T02:54:47.135212210Z [2024-04-06T02:54:47.134+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a, task_id=send_prometheus, run_id=scheduled__2024-04-06T02:45:00+00:00, map_index=-1, run_start_date=2024-04-06 02:54:46.520766+00:00, run_end_date=2024-04-06 02:54:46.895758+00:00, run_duration=0.374992, state=success, executor_state=success, try_number=1, max_tries=1, job_id=293, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:54:45.048694+00:00, queued_by_job_id=2, pid=6568 2024-04-06T02:55:00.058198710Z [2024-04-06T02:55:00.057+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a to 2024-04-06T02:55:00+00:00, run_after=2024-04-06T03:00:00+00:00 2024-04-06T02:55:00.075175908Z [2024-04-06T02:55:00.074+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:55:00+00:00, run_after=2024-04-06T03:00:00+00:00 2024-04-06T02:55:00.084039146Z [2024-04-06T02:55:00.083+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:55:00.097419431Z [2024-04-06T02:55:00.097+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_bb497dd3-763c-402a-9bfa-42b2035b7b2a to 2024-04-06T02:55:00+00:00, run_after=2024-04-06T02:56:00+00:00 2024-04-06T02:55:00.109422651Z [2024-04-06T02:55:00.109+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:55:00+00:00, run_after=2024-04-06T02:56:00+00:00 2024-04-06T02:55:00.116232243Z [2024-04-06T02:55:00.115+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:55:00.254401218Z [2024-04-06T02:55:00.253+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-04-06T02:55:00.254450844Z 2024-04-06T02:55:00.254455939Z 2024-04-06T02:55:00.254464258Z 2024-04-06T02:55:00.254468341Z 2024-04-06T02:55:00.254472171Z 2024-04-06T02:55:00.254476419Z 2024-04-06T02:55:00.254687783Z [2024-04-06T02:55:00.254+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a has 0/16 running and queued tasks 2024-04-06T02:55:00.254961867Z [2024-04-06T02:55:00.254+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:55:00.255188284Z [2024-04-06T02:55:00.254+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:55:00.255372955Z [2024-04-06T02:55:00.255+0000] {scheduler_job.py:425} INFO - DAG vim_status_bb497dd3-763c-402a-9bfa-42b2035b7b2a has 0/16 running and queued tasks 2024-04-06T02:55:00.255590802Z [2024-04-06T02:55:00.255+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:55:00.255850304Z [2024-04-06T02:55:00.255+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a has 0/16 running and queued tasks 2024-04-06T02:55:00.257239392Z [2024-04-06T02:55:00.256+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:55:00.257256991Z 2024-04-06T02:55:00.257263700Z 2024-04-06T02:55:00.257269919Z 2024-04-06T02:55:00.257276725Z 2024-04-06T02:55:00.257324061Z 2024-04-06T02:55:00.257331343Z 2024-04-06T02:55:00.268853154Z [2024-04-06T02:55:00.268+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-06T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-06T02:55:00.268989216Z [2024-04-06T02:55:00.268+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:55:00.269291853Z [2024-04-06T02:55:00.269+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-06T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-06T02:55:00.269453026Z [2024-04-06T02:55:00.269+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:55:00.269748287Z [2024-04-06T02:55:00.269+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:55:00.269947165Z [2024-04-06T02:55:00.269+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:55:00.270295204Z [2024-04-06T02:55:00.270+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_bb497dd3-763c-402a-9bfa-42b2035b7b2a', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:55:00.270312645Z [2024-04-06T02:55:00.270+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_bb497dd3-763c-402a-9bfa-42b2035b7b2a', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:55:00.270490462Z [2024-04-06T02:55:00.270+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:55:00.270597503Z [2024-04-06T02:55:00.270+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:55:00.270805841Z [2024-04-06T02:55:00.270+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:55:00.270962835Z [2024-04-06T02:55:00.270+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:55:00.907982910Z [2024-04-06T02:55:00.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T02:50:00+00:00 exited with status queued for try_number 1 2024-04-06T02:55:00.908117664Z [2024-04-06T02:55:00.907+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T02:50:00+00:00 exited with status queued for try_number 1 2024-04-06T02:55:00.908287826Z [2024-04-06T02:55:00.908+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:54:00+00:00 exited with status queued for try_number 1 2024-04-06T02:55:00.908342446Z [2024-04-06T02:55:00.908+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_bb497dd3-763c-402a-9bfa-42b2035b7b2a.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:54:00+00:00 exited with status queued for try_number 1 2024-04-06T02:55:00.908405245Z [2024-04-06T02:55:00.908+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:54:00+00:00 exited with status queued for try_number 1 2024-04-06T02:55:00.908522940Z [2024-04-06T02:55:00.908+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:54:00+00:00 exited with status queued for try_number 1 2024-04-06T02:55:00.923968553Z [2024-04-06T02:55:00.923+0000] {scheduler_job.py:635} INFO - Setting external_id for to c506630c-b6e4-4bcf-b280-49a8eb1f5880 2024-04-06T02:55:00.924050127Z [2024-04-06T02:55:00.923+0000] {scheduler_job.py:635} INFO - Setting external_id for to 36ae83f9-5f67-4d01-92e8-c36ee271624c 2024-04-06T02:55:00.924141289Z [2024-04-06T02:55:00.924+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3acf9e9a-6695-45ed-9d1f-1266f2e9d3d8 2024-04-06T02:55:00.924252485Z [2024-04-06T02:55:00.924+0000] {scheduler_job.py:635} INFO - Setting external_id for to eadec9f0-03ea-442e-bba6-1c06e966cb74 2024-04-06T02:55:00.924338861Z [2024-04-06T02:55:00.924+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e57ec08-2bd0-461e-9089-6986d6bd0885 2024-04-06T02:55:00.924428554Z [2024-04-06T02:55:00.924+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed7c982a-84b7-4f3b-ad27-aa85cee1998a 2024-04-06T02:55:06.040669344Z [2024-04-06T02:55:06.040+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:55:06.040896977Z [2024-04-06T02:55:06.040+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:54:00+00:00, run_id=scheduled__2024-04-06T02:54:00+00:00, run_start_date=2024-04-06 02:55:00.134440+00:00, run_end_date=2024-04-06 02:55:06.040620+00:00, run_duration=5.90618, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:54:00+00:00, data_interval_end=2024-04-06 02:55:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:55:06.124581891Z [2024-04-06T02:55:06.118+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:55:00+00:00, run_after=2024-04-06T02:56:00+00:00 2024-04-06T02:55:06.464716671Z [2024-04-06T02:55:06.464+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:54:00+00:00 exited with status success for try_number 1 2024-04-06T02:55:06.486838402Z [2024-04-06T02:55:06.486+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:54:00+00:00, map_index=-1, run_start_date=2024-04-06 02:55:03.719528+00:00, run_end_date=2024-04-06 02:55:05.716942+00:00, run_duration=1.997414, state=success, executor_state=success, try_number=1, max_tries=1, job_id=294, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:55:00.260542+00:00, queued_by_job_id=2, pid=6589 2024-04-06T02:55:07.250998794Z [2024-04-06T02:55:07.250+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T02:50:00+00:00 exited with status failed for try_number 1 2024-04-06T02:55:07.251174198Z [2024-04-06T02:55:07.250+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_bb497dd3-763c-402a-9bfa-42b2035b7b2a.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:54:00+00:00 exited with status success for try_number 1 2024-04-06T02:55:07.251562069Z [2024-04-06T02:55:07.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:54:00+00:00 exited with status failed for try_number 1 2024-04-06T02:55:07.260595557Z [2024-04-06T02:55:07.260+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-06T02:50:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:55:00.260542+00:00, queued_by_job_id=2, pid=None 2024-04-06T02:55:07.261856971Z [2024-04-06T02:55:07.261+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T02:55:07.265191673Z [2024-04-06T02:55:07.264+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T02:55:07.276209822Z [2024-04-06T02:55:07.275+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a, task_id=extract_metrics_from_vnfrs, execution_date=20240406T025000, start_date=, end_date=20240406T025507 2024-04-06T02:55:07.283940444Z [2024-04-06T02:55:07.283+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:54:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:55:00.260542+00:00, queued_by_job_id=2, pid=None 2024-04-06T02:55:07.284431363Z [2024-04-06T02:55:07.284+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T02:55:07.286633036Z [2024-04-06T02:55:07.286+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T02:55:07.299213763Z [2024-04-06T02:55:07.298+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240406T025400, start_date=, end_date=20240406T025507 2024-04-06T02:55:07.306265544Z [2024-04-06T02:55:07.305+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_bb497dd3-763c-402a-9bfa-42b2035b7b2a, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:54:00+00:00, map_index=-1, run_start_date=2024-04-06 02:55:05.637650+00:00, run_end_date=2024-04-06 02:55:06.350492+00:00, run_duration=0.712842, state=up_for_retry, executor_state=success, try_number=1, max_tries=1, job_id=295, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:55:00.260542+00:00, queued_by_job_id=2, pid=6609 2024-04-06T02:55:08.458043035Z [2024-04-06T02:55:08.457+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:55:08.458076309Z 2024-04-06T02:55:08.458088800Z [2024-04-06T02:55:08.457+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:55:08.458096301Z [2024-04-06T02:55:08.457+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:55:08.458102275Z 2024-04-06T02:55:08.460755702Z [2024-04-06T02:55:08.459+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='split_metrics', run_id='scheduled__2024-04-06T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-06T02:55:08.460811420Z [2024-04-06T02:55:08.460+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:55:08.549342729Z [2024-04-06T02:55:08.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T02:50:00+00:00 exited with status queued for try_number 1 2024-04-06T02:55:08.549528913Z [2024-04-06T02:55:08.549+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T02:50:00+00:00 exited with status success for try_number 1 2024-04-06T02:55:08.562021415Z [2024-04-06T02:55:08.561+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8bad8fc-4e0c-4eef-94bf-5c18210c2ddc 2024-04-06T02:55:08.564507884Z [2024-04-06T02:55:08.561+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-06T02:50:00+00:00, map_index=-1, run_start_date=2024-04-06 02:55:07.174873+00:00, run_end_date=2024-04-06 02:55:07.516395+00:00, run_duration=0.341522, state=success, executor_state=success, try_number=1, max_tries=1, job_id=296, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:55:00.260542+00:00, queued_by_job_id=2, pid=6673 2024-04-06T02:55:09.894850142Z [2024-04-06T02:55:09.894+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:55:09.895253995Z [2024-04-06T02:55:09.895+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:54:00+00:00, run_id=scheduled__2024-04-06T02:54:00+00:00, run_start_date=2024-04-06 02:55:00.132102+00:00, run_end_date=2024-04-06 02:55:09.894933+00:00, run_duration=9.762831, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:54:00+00:00, data_interval_end=2024-04-06 02:55:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:55:09.907879222Z [2024-04-06T02:55:09.907+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:55:00+00:00, run_after=2024-04-06T02:56:00+00:00 2024-04-06T02:55:09.981234661Z [2024-04-06T02:55:09.980+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:54:00+00:00 exited with status success for try_number 1 2024-04-06T02:55:09.987789931Z [2024-04-06T02:55:09.987+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:54:00+00:00, map_index=-1, run_start_date=2024-04-06 02:55:07.223654+00:00, run_end_date=2024-04-06 02:55:08.624416+00:00, run_duration=1.400762, state=success, executor_state=success, try_number=1, max_tries=1, job_id=297, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:55:00.260542+00:00, queued_by_job_id=2, pid=6674 2024-04-06T02:55:11.111881207Z [2024-04-06T02:55:11.111+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:55:11.111923221Z 2024-04-06T02:55:11.112165738Z [2024-04-06T02:55:11.111+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:55:11.112917043Z [2024-04-06T02:55:11.112+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:55:11.112930886Z 2024-04-06T02:55:11.115641000Z [2024-04-06T02:55:11.115+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='collect_metrics', run_id='scheduled__2024-04-06T02:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-06T02:55:11.115980806Z [2024-04-06T02:55:11.115+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T02:55:11.201506723Z [2024-04-06T02:55:11.201+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T02:50:00+00:00 exited with status queued for try_number 1 2024-04-06T02:55:11.201724867Z [2024-04-06T02:55:11.201+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T02:50:00+00:00 exited with status success for try_number 1 2024-04-06T02:55:11.215207053Z [2024-04-06T02:55:11.214+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b157bc4-8b4f-464a-9e81-ef44ce95b29d 2024-04-06T02:55:11.215638690Z [2024-04-06T02:55:11.215+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=split_metrics, run_id=scheduled__2024-04-06T02:50:00+00:00, map_index=-1, run_start_date=2024-04-06 02:55:10.173930+00:00, run_end_date=2024-04-06 02:55:10.548359+00:00, run_duration=0.374429, state=success, executor_state=success, try_number=1, max_tries=1, job_id=298, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:55:08.458156+00:00, queued_by_job_id=2, pid=6714 2024-04-06T02:55:13.625015810Z [2024-04-06T02:55:13.624+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:55:13.625041975Z 2024-04-06T02:55:13.625495148Z [2024-04-06T02:55:13.625+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:55:13.626530938Z [2024-04-06T02:55:13.626+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:55:13.626539228Z 2024-04-06T02:55:13.629566197Z [2024-04-06T02:55:13.629+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='send_prometheus', run_id='scheduled__2024-04-06T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:55:13.629892395Z [2024-04-06T02:55:13.629+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:55:13.716472864Z [2024-04-06T02:55:13.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T02:50:00+00:00 exited with status queued for try_number 1 2024-04-06T02:55:13.718441822Z [2024-04-06T02:55:13.718+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T02:50:00+00:00 exited with status success for try_number 1 2024-04-06T02:55:13.734215120Z [2024-04-06T02:55:13.733+0000] {scheduler_job.py:635} INFO - Setting external_id for to 447b789b-fd39-4836-9e5d-ad019449e7f0 2024-04-06T02:55:13.734579143Z [2024-04-06T02:55:13.734+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=collect_metrics, run_id=scheduled__2024-04-06T02:50:00+00:00, map_index=0, run_start_date=2024-04-06 02:55:13.013034+00:00, run_end_date=2024-04-06 02:55:13.459444+00:00, run_duration=0.44641, state=success, executor_state=success, try_number=1, max_tries=1, job_id=299, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:55:11.113357+00:00, queued_by_job_id=2, pid=6729 2024-04-06T02:55:16.140635071Z [2024-04-06T02:55:16.140+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:55:16.140819803Z [2024-04-06T02:55:16.140+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:50:00+00:00, run_id=scheduled__2024-04-06T02:50:00+00:00, run_start_date=2024-04-06 02:55:00.129678+00:00, run_end_date=2024-04-06 02:55:16.140498+00:00, run_duration=16.01082, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:50:00+00:00, data_interval_end=2024-04-06 02:55:00+00:00, dag_hash=eecc559ff32fe9a7c4345875f113a0a9 2024-04-06T02:55:16.146834400Z [2024-04-06T02:55:16.146+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:55:00+00:00, run_after=2024-04-06T03:00:00+00:00 2024-04-06T02:55:16.248612995Z [2024-04-06T02:55:16.248+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T02:50:00+00:00 exited with status success for try_number 1 2024-04-06T02:55:16.254376795Z [2024-04-06T02:55:16.254+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=send_prometheus, run_id=scheduled__2024-04-06T02:50:00+00:00, map_index=-1, run_start_date=2024-04-06 02:55:15.530710+00:00, run_end_date=2024-04-06 02:55:15.964927+00:00, run_duration=0.434217, state=success, executor_state=success, try_number=1, max_tries=1, job_id=300, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:55:13.627595+00:00, queued_by_job_id=2, pid=6741 2024-04-06T02:55:17.370832443Z [2024-04-06T02:55:17.370+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T02:55:17.370860742Z 2024-04-06T02:55:17.370888415Z 2024-04-06T02:55:17.370891381Z 2024-04-06T02:55:17.371242559Z [2024-04-06T02:55:17.370+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a has 0/16 running and queued tasks 2024-04-06T02:55:17.371951620Z [2024-04-06T02:55:17.371+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a has 0/16 running and queued tasks 2024-04-06T02:55:17.372293190Z [2024-04-06T02:55:17.372+0000] {scheduler_job.py:425} INFO - DAG vim_status_bb497dd3-763c-402a-9bfa-42b2035b7b2a has 0/16 running and queued tasks 2024-04-06T02:55:17.373284291Z [2024-04-06T02:55:17.373+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:55:17.373298642Z 2024-04-06T02:55:17.373303231Z 2024-04-06T02:55:17.373307307Z 2024-04-06T02:55:17.376882619Z [2024-04-06T02:55:17.376+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-06T02:50:00+00:00', try_number=2, map_index=-1) to executor with priority 4 and queue default 2024-04-06T02:55:17.377360926Z [2024-04-06T02:55:17.377+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T02:55:17.377747795Z [2024-04-06T02:55:17.377+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:54:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:55:17.378031995Z [2024-04-06T02:55:17.377+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:55:17.378361579Z [2024-04-06T02:55:17.378+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_bb497dd3-763c-402a-9bfa-42b2035b7b2a', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:54:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:55:17.378576776Z [2024-04-06T02:55:17.378+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_bb497dd3-763c-402a-9bfa-42b2035b7b2a', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:55:17.810269578Z [2024-04-06T02:55:17.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T02:50:00+00:00 exited with status queued for try_number 2 2024-04-06T02:55:17.810337019Z [2024-04-06T02:55:17.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:54:00+00:00 exited with status queued for try_number 2 2024-04-06T02:55:17.810354113Z [2024-04-06T02:55:17.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_bb497dd3-763c-402a-9bfa-42b2035b7b2a.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:54:00+00:00 exited with status queued for try_number 2 2024-04-06T02:55:17.821132383Z [2024-04-06T02:55:17.820+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0759fee8-f69b-497d-b0af-1b105f92565e 2024-04-06T02:55:17.821157444Z [2024-04-06T02:55:17.821+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c810752-28b5-4eb4-9326-6130ec8a0d03 2024-04-06T02:55:17.821248113Z [2024-04-06T02:55:17.821+0000] {scheduler_job.py:635} INFO - Setting external_id for to 645f821b-79a2-4591-b20f-5a3f34aa65fd 2024-04-06T02:55:20.181614616Z [2024-04-06T02:55:20.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T02:50:00+00:00 exited with status failed for try_number 2 2024-04-06T02:55:20.181690861Z [2024-04-06T02:55:20.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:54:00+00:00 exited with status failed for try_number 2 2024-04-06T02:55:20.181708362Z [2024-04-06T02:55:20.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_bb497dd3-763c-402a-9bfa-42b2035b7b2a.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:54:00+00:00 exited with status failed for try_number 2 2024-04-06T02:55:20.191683187Z [2024-04-06T02:55:20.191+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-06T02:50:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-06 02:55:07.267543+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:55:17.374333+00:00, queued_by_job_id=2, pid=None 2024-04-06T02:55:20.192298967Z [2024-04-06T02:55:20.191+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T02:55:20.195401984Z [2024-04-06T02:55:20.194+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T02:55:20.208113725Z [2024-04-06T02:55:20.207+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a, task_id=extract_metrics_from_vnfrs, execution_date=20240406T025000, start_date=, end_date=20240406T025520 2024-04-06T02:55:20.218596854Z [2024-04-06T02:55:20.218+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_bb497dd3-763c-402a-9bfa-42b2035b7b2a, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:54:00+00:00, map_index=-1, run_start_date=2024-04-06 02:55:05.637650+00:00, run_end_date=2024-04-06 02:55:06.350492+00:00, run_duration=0.712842, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=295, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:55:17.374333+00:00, queued_by_job_id=2, pid=6609 2024-04-06T02:55:20.218954511Z [2024-04-06T02:55:20.218+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T02:55:20.221480949Z [2024-04-06T02:55:20.221+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T02:55:20.241674260Z [2024-04-06T02:55:20.238+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_bb497dd3-763c-402a-9bfa-42b2035b7b2a, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240406T025400, start_date=20240406T025505, end_date=20240406T025520 2024-04-06T02:55:20.249066176Z [2024-04-06T02:55:20.248+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:54:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-06 02:55:07.288840+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:55:17.374333+00:00, queued_by_job_id=2, pid=None 2024-04-06T02:55:20.249534500Z [2024-04-06T02:55:20.249+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T02:55:20.257942597Z [2024-04-06T02:55:20.256+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T02:55:20.280107328Z [2024-04-06T02:55:20.279+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240406T025400, start_date=, end_date=20240406T025520 2024-04-06T02:55:20.303391395Z [2024-04-06T02:55:20.302+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-06T02:55:21.388500521Z [2024-04-06T02:55:21.388+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-06T02:55:21.389952645Z [2024-04-06T02:55:21.389+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_bb497dd3-763c-402a-9bfa-42b2035b7b2a, execution_date=2024-04-06 02:54:00+00:00, run_id=scheduled__2024-04-06T02:54:00+00:00, run_start_date=2024-04-06 02:55:00.133220+00:00, run_end_date=2024-04-06 02:55:21.389541+00:00, run_duration=21.256321, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:54:00+00:00, data_interval_end=2024-04-06 02:55:00+00:00, dag_hash=e6d7525064c98f07885d96de7a948ce9 2024-04-06T02:55:21.412535520Z [2024-04-06T02:55:21.412+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_bb497dd3-763c-402a-9bfa-42b2035b7b2a to 2024-04-06T02:55:00+00:00, run_after=2024-04-06T02:56:00+00:00 2024-04-06T02:55:21.422838583Z [2024-04-06T02:55:21.422+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-06T02:55:21.423233474Z [2024-04-06T02:55:21.423+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a, execution_date=2024-04-06 02:54:00+00:00, run_id=scheduled__2024-04-06T02:54:00+00:00, run_start_date=2024-04-06 02:55:00.135582+00:00, run_end_date=2024-04-06 02:55:21.422945+00:00, run_duration=21.287363, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:54:00+00:00, data_interval_end=2024-04-06 02:55:00+00:00, dag_hash=4b6fa6873d9e64982fdb9ebc1f75b89f 2024-04-06T02:55:21.443747682Z [2024-04-06T02:55:21.443+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a to 2024-04-06T02:55:00+00:00, run_after=2024-04-06T02:56:00+00:00 2024-04-06T02:55:23.992363345Z [2024-04-06T02:55:23.991+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-06T02:55:23.992643412Z [2024-04-06T02:55:23.992+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a, execution_date=2024-04-06 02:50:00+00:00, run_id=scheduled__2024-04-06T02:50:00+00:00, run_start_date=2024-04-06 02:55:00.130980+00:00, run_end_date=2024-04-06 02:55:23.992137+00:00, run_duration=23.861157, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:50:00+00:00, data_interval_end=2024-04-06 02:55:00+00:00, dag_hash=b34f12e1021ac5a4cb1145298addae8e 2024-04-06T02:55:24.000861522Z [2024-04-06T02:55:24.000+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a to 2024-04-06T02:55:00+00:00, run_after=2024-04-06T03:00:00+00:00 2024-04-06T02:56:00.556031573Z [2024-04-06T02:56:00.555+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:56:00.563608426Z [2024-04-06T02:56:00.563+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:56:00.574182467Z [2024-04-06T02:56:00.573+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:56:00+00:00, run_after=2024-04-06T02:57:00+00:00 2024-04-06T02:56:00.580317133Z [2024-04-06T02:56:00.580+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:56:00.640398962Z [2024-04-06T02:56:00.640+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-06T02:56:00.640421827Z 2024-04-06T02:56:00.640426163Z 2024-04-06T02:56:00.640443067Z 2024-04-06T02:56:00.640446256Z 2024-04-06T02:56:00.640724448Z [2024-04-06T02:56:00.640+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T02:56:00.640891641Z [2024-04-06T02:56:00.640+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a has 0/16 running and queued tasks 2024-04-06T02:56:00.641017738Z [2024-04-06T02:56:00.640+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:56:00.641111602Z [2024-04-06T02:56:00.641+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:56:00.641631570Z [2024-04-06T02:56:00.641+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:56:00.641647900Z 2024-04-06T02:56:00.641657365Z 2024-04-06T02:56:00.641665815Z 2024-04-06T02:56:00.641683447Z 2024-04-06T02:56:00.644832330Z [2024-04-06T02:56:00.644+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:56:00.644953899Z [2024-04-06T02:56:00.644+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:56:00.645206919Z [2024-04-06T02:56:00.645+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:56:00.645340263Z [2024-04-06T02:56:00.645+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:56:00.645539238Z [2024-04-06T02:56:00.645+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:56:00.645633485Z [2024-04-06T02:56:00.645+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:56:00.645878418Z [2024-04-06T02:56:00.645+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:56:00.645973281Z [2024-04-06T02:56:00.645+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:56:01.048837542Z [2024-04-06T02:56:01.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:54:00+00:00 exited with status queued for try_number 1 2024-04-06T02:56:01.049549570Z [2024-04-06T02:56:01.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:55:00+00:00 exited with status queued for try_number 1 2024-04-06T02:56:01.050392974Z [2024-04-06T02:56:01.049+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:55:00+00:00 exited with status queued for try_number 1 2024-04-06T02:56:01.050744138Z [2024-04-06T02:56:01.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:55:00+00:00 exited with status queued for try_number 1 2024-04-06T02:56:01.070572964Z [2024-04-06T02:56:01.070+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d3980a2-89c1-4518-b87f-85e76f2359f5 2024-04-06T02:56:01.071378772Z [2024-04-06T02:56:01.070+0000] {scheduler_job.py:635} INFO - Setting external_id for to 01cf6bd8-4200-4c02-bcba-17b5918fc8e9 2024-04-06T02:56:01.072009141Z [2024-04-06T02:56:01.071+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7cf00169-68de-4e1e-9bbd-c6b229b8b38a 2024-04-06T02:56:01.072422604Z [2024-04-06T02:56:01.072+0000] {scheduler_job.py:635} INFO - Setting external_id for to c01d63a1-87ab-4367-bb5c-d7644b37a818 2024-04-06T02:56:04.747229268Z [2024-04-06T02:56:04.746+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:56:04.751504359Z [2024-04-06T02:56:04.751+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 02:54:00+00:00, run_id=scheduled__2024-04-06T02:54:00+00:00, run_start_date=2024-04-06 02:56:00.590032+00:00, run_end_date=2024-04-06 02:56:04.747161+00:00, run_duration=4.157129, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:54:00+00:00, data_interval_end=2024-04-06 02:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T02:56:04.786632938Z [2024-04-06T02:56:04.786+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T02:56:00+00:00, run_after=2024-04-06T02:58:00+00:00 2024-04-06T02:56:04.894465970Z [2024-04-06T02:56:04.894+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:54:00+00:00 exited with status success for try_number 1 2024-04-06T02:56:04.905726891Z [2024-04-06T02:56:04.905+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T02:54:00+00:00, map_index=-1, run_start_date=2024-04-06 02:56:02.553966+00:00, run_end_date=2024-04-06 02:56:03.645285+00:00, run_duration=1.091319, state=success, executor_state=success, try_number=1, max_tries=1, job_id=301, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:56:00.642371+00:00, queued_by_job_id=2, pid=6805 2024-04-06T02:56:05.996577290Z [2024-04-06T02:56:05.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:55:00+00:00 exited with status failed for try_number 1 2024-04-06T02:56:06.014707140Z [2024-04-06T02:56:06.014+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:55:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:56:00.642371+00:00, queued_by_job_id=2, pid=None 2024-04-06T02:56:06.018048642Z [2024-04-06T02:56:06.017+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T02:56:06.022009126Z [2024-04-06T02:56:06.020+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T02:56:06.036082889Z [2024-04-06T02:56:06.035+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240406T025500, start_date=, end_date=20240406T025606 2024-04-06T02:56:07.100144271Z [2024-04-06T02:56:07.099+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:56:07.100539159Z [2024-04-06T02:56:07.100+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:55:00+00:00, run_id=scheduled__2024-04-06T02:55:00+00:00, run_start_date=2024-04-06 02:56:00.592017+00:00, run_end_date=2024-04-06 02:56:07.100028+00:00, run_duration=6.508011, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:55:00+00:00, data_interval_end=2024-04-06 02:56:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:56:07.116572127Z [2024-04-06T02:56:07.116+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:56:00+00:00, run_after=2024-04-06T02:57:00+00:00 2024-04-06T02:56:07.125876619Z [2024-04-06T02:56:07.125+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:56:07.126040422Z [2024-04-06T02:56:07.125+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:55:00+00:00, run_id=scheduled__2024-04-06T02:55:00+00:00, run_start_date=2024-04-06 02:56:00.591066+00:00, run_end_date=2024-04-06 02:56:07.125603+00:00, run_duration=6.534537, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:55:00+00:00, data_interval_end=2024-04-06 02:56:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:56:07.136780324Z [2024-04-06T02:56:07.136+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:56:00+00:00, run_after=2024-04-06T02:57:00+00:00 2024-04-06T02:56:07.184215563Z [2024-04-06T02:56:07.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:55:00+00:00 exited with status success for try_number 1 2024-04-06T02:56:07.184580021Z [2024-04-06T02:56:07.184+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:55:00+00:00 exited with status success for try_number 1 2024-04-06T02:56:07.192437256Z [2024-04-06T02:56:07.191+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:55:00+00:00, map_index=-1, run_start_date=2024-04-06 02:56:04.370829+00:00, run_end_date=2024-04-06 02:56:06.291977+00:00, run_duration=1.921148, state=success, executor_state=success, try_number=1, max_tries=1, job_id=302, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:56:00.642371+00:00, queued_by_job_id=2, pid=6827 2024-04-06T02:56:07.192942976Z [2024-04-06T02:56:07.192+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:55:00+00:00, map_index=-1, run_start_date=2024-04-06 02:56:05.131594+00:00, run_end_date=2024-04-06 02:56:06.450502+00:00, run_duration=1.318908, state=success, executor_state=success, try_number=1, max_tries=1, job_id=303, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:56:00.642371+00:00, queued_by_job_id=2, pid=6861 2024-04-06T02:56:17.028578042Z [2024-04-06T02:56:17.027+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:56:17.028647961Z 2024-04-06T02:56:17.029467639Z [2024-04-06T02:56:17.029+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a has 0/16 running and queued tasks 2024-04-06T02:56:17.032140386Z [2024-04-06T02:56:17.031+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:56:17.032161388Z 2024-04-06T02:56:17.038563092Z [2024-04-06T02:56:17.038+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:55:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:56:17.039111972Z [2024-04-06T02:56:17.038+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:56:17.098355513Z [2024-04-06T02:56:17.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:55:00+00:00 exited with status queued for try_number 2 2024-04-06T02:56:17.105317232Z [2024-04-06T02:56:17.105+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1889e1a5-e296-4e4c-b69c-ab92b1de3b05 2024-04-06T02:56:18.925908117Z [2024-04-06T02:56:18.925+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:55:00+00:00 exited with status failed for try_number 2 2024-04-06T02:56:18.933026969Z [2024-04-06T02:56:18.932+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:55:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-06 02:56:06.024673+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:56:17.033286+00:00, queued_by_job_id=2, pid=None 2024-04-06T02:56:18.933502962Z [2024-04-06T02:56:18.933+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T02:56:18.936337300Z [2024-04-06T02:56:18.935+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-06T02:56:18.951216453Z [2024-04-06T02:56:18.950+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240406T025500, start_date=, end_date=20240406T025618 2024-04-06T02:56:20.034675964Z [2024-04-06T02:56:20.034+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-06T02:56:20.035175827Z [2024-04-06T02:56:20.034+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a, execution_date=2024-04-06 02:55:00+00:00, run_id=scheduled__2024-04-06T02:55:00+00:00, run_start_date=2024-04-06 02:56:00.592968+00:00, run_end_date=2024-04-06 02:56:20.034810+00:00, run_duration=19.441842, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:55:00+00:00, data_interval_end=2024-04-06 02:56:00+00:00, dag_hash=4b6fa6873d9e64982fdb9ebc1f75b89f 2024-04-06T02:56:20.044456037Z [2024-04-06T02:56:20.044+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_bb497dd3-763c-402a-9bfa-42b2035b7b2a to 2024-04-06T02:56:00+00:00, run_after=2024-04-06T02:57:00+00:00 2024-04-06T02:56:54.625487712Z [2024-04-06T02:56:54.624+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T02:56:54.625553056Z 2024-04-06T02:56:54.625770323Z [2024-04-06T02:56:54.625+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-04-06T02:56:54.626569618Z [2024-04-06T02:56:54.626+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:56:54.626583813Z 2024-04-06T02:56:54.628547933Z [2024-04-06T02:56:54.628+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240406025653_157521', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:56:54.628760662Z [2024-04-06T02:56:54.628+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240406025653_157521', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-04-06T02:56:54.724598086Z [2024-04-06T02:56:54.722+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240406025653_157521 exited with status queued for try_number 1 2024-04-06T02:56:54.729029009Z [2024-04-06T02:56:54.728+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc90366b-31b2-430e-895a-0c54b4783176 2024-04-06T02:56:55.854551676Z [2024-04-06T02:56:55.854+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:56:55.854792127Z [2024-04-06T02:56:55.854+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-04-06 02:56:53.839032+00:00, run_id=vdu_down_20240406025653_157521, run_start_date=2024-04-06 02:56:54.597075+00:00, run_end_date=2024-04-06 02:56:55.854472+00:00, run_duration=1.257397, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-06 02:56:53.839032+00:00, data_interval_end=2024-04-06 02:56:53.839032+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-04-06T02:56:55.857701030Z [2024-04-06T02:56:55.857+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-04-06T02:56:56.959234993Z [2024-04-06T02:56:56.958+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240406025653_157521 exited with status success for try_number 1 2024-04-06T02:56:56.965737367Z [2024-04-06T02:56:56.965+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240406025653_157521, map_index=-1, run_start_date=2024-04-06 02:56:55.433692+00:00, run_end_date=2024-04-06 02:56:55.804885+00:00, run_duration=0.371193, state=success, executor_state=success, try_number=1, max_tries=1, job_id=304, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:56:54.626906+00:00, queued_by_job_id=2, pid=6905 2024-04-06T02:57:00.889952279Z [2024-04-06T02:57:00.889+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:57:00.902688126Z [2024-04-06T02:57:00.902+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:57:00+00:00, run_after=2024-04-06T02:58:00+00:00 2024-04-06T02:57:00.954944174Z [2024-04-06T02:57:00.954+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T02:57:00.954980115Z 2024-04-06T02:57:00.955002311Z 2024-04-06T02:57:00.955075684Z [2024-04-06T02:57:00.954+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:57:00.955644665Z [2024-04-06T02:57:00.955+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:57:00.956228149Z [2024-04-06T02:57:00.956+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:57:00.956238589Z 2024-04-06T02:57:00.956242568Z 2024-04-06T02:57:00.958551198Z [2024-04-06T02:57:00.958+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:57:00.958639611Z [2024-04-06T02:57:00.958+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:57:00.958895583Z [2024-04-06T02:57:00.958+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:57:00.958994769Z [2024-04-06T02:57:00.958+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:57:01.175700375Z [2024-04-06T02:57:01.175+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:56:00+00:00 exited with status queued for try_number 1 2024-04-06T02:57:01.175788209Z [2024-04-06T02:57:01.175+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:56:00+00:00 exited with status queued for try_number 1 2024-04-06T02:57:01.186501088Z [2024-04-06T02:57:01.185+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1ca70705-d09c-4cfe-b474-973f3b9b3cdb 2024-04-06T02:57:01.186613448Z [2024-04-06T02:57:01.186+0000] {scheduler_job.py:635} INFO - Setting external_id for to da999717-9caf-4978-846c-7cd1f6a1a369 2024-04-06T02:57:05.995737562Z [2024-04-06T02:57:05.995+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:57:05.997140734Z [2024-04-06T02:57:05.996+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:56:00+00:00, run_id=scheduled__2024-04-06T02:56:00+00:00, run_start_date=2024-04-06 02:57:00.912580+00:00, run_end_date=2024-04-06 02:57:05.995623+00:00, run_duration=5.083043, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:56:00+00:00, data_interval_end=2024-04-06 02:57:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:57:06.010558756Z [2024-04-06T02:57:06.010+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:57:00+00:00, run_after=2024-04-06T02:58:00+00:00 2024-04-06T02:57:06.017501307Z [2024-04-06T02:57:06.017+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:57:06.017948164Z [2024-04-06T02:57:06.017+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:56:00+00:00, run_id=scheduled__2024-04-06T02:56:00+00:00, run_start_date=2024-04-06 02:57:00.913741+00:00, run_end_date=2024-04-06 02:57:06.017412+00:00, run_duration=5.103671, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:56:00+00:00, data_interval_end=2024-04-06 02:57:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:57:06.027228553Z [2024-04-06T02:57:06.027+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:57:00+00:00, run_after=2024-04-06T02:58:00+00:00 2024-04-06T02:57:06.067931471Z [2024-04-06T02:57:06.067+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:56:00+00:00 exited with status success for try_number 1 2024-04-06T02:57:06.068297723Z [2024-04-06T02:57:06.067+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:56:00+00:00 exited with status success for try_number 1 2024-04-06T02:57:06.081273580Z [2024-04-06T02:57:06.080+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:56:00+00:00, map_index=-1, run_start_date=2024-04-06 02:57:03.681384+00:00, run_end_date=2024-04-06 02:57:05.150939+00:00, run_duration=1.469555, state=success, executor_state=success, try_number=1, max_tries=1, job_id=306, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:57:00.956705+00:00, queued_by_job_id=2, pid=6940 2024-04-06T02:57:06.081841878Z [2024-04-06T02:57:06.081+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:56:00+00:00, map_index=-1, run_start_date=2024-04-06 02:57:03.306535+00:00, run_end_date=2024-04-06 02:57:05.118474+00:00, run_duration=1.811939, state=success, executor_state=success, try_number=1, max_tries=1, job_id=305, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:57:00.956705+00:00, queued_by_job_id=2, pid=6928 2024-04-06T02:58:00.768229637Z [2024-04-06T02:58:00.767+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:58:00.774481566Z [2024-04-06T02:58:00.774+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:58:00.785961433Z [2024-04-06T02:58:00.785+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:58:00+00:00, run_after=2024-04-06T02:59:00+00:00 2024-04-06T02:58:00.841182677Z [2024-04-06T02:58:00.840+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T02:58:00.841203303Z 2024-04-06T02:58:00.841209085Z 2024-04-06T02:58:00.841212299Z 2024-04-06T02:58:00.842111449Z [2024-04-06T02:58:00.841+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T02:58:00.842401825Z [2024-04-06T02:58:00.842+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:58:00.842594863Z [2024-04-06T02:58:00.842+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:58:00.843271026Z [2024-04-06T02:58:00.843+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:58:00.843279476Z 2024-04-06T02:58:00.843282692Z 2024-04-06T02:58:00.843285650Z 2024-04-06T02:58:00.849190502Z [2024-04-06T02:58:00.849+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:58:00.849333288Z [2024-04-06T02:58:00.849+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T02:58:00.850220987Z [2024-04-06T02:58:00.849+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:58:00.850529862Z [2024-04-06T02:58:00.850+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:58:00.850846910Z [2024-04-06T02:58:00.850+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:58:00.851497464Z [2024-04-06T02:58:00.851+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:58:01.188243225Z [2024-04-06T02:58:01.187+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:56:00+00:00 exited with status queued for try_number 1 2024-04-06T02:58:01.192076693Z [2024-04-06T02:58:01.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:57:00+00:00 exited with status queued for try_number 1 2024-04-06T02:58:01.192195484Z [2024-04-06T02:58:01.192+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:57:00+00:00 exited with status queued for try_number 1 2024-04-06T02:58:01.208546657Z [2024-04-06T02:58:01.208+0000] {scheduler_job.py:635} INFO - Setting external_id for to da3f100b-71ba-4726-aec3-95900f1c1ce8 2024-04-06T02:58:01.208701638Z [2024-04-06T02:58:01.208+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca6d0d6f-01c8-4511-8450-5381e1b073c2 2024-04-06T02:58:01.208849994Z [2024-04-06T02:58:01.208+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0c9e20b4-d1d4-47c0-8145-3de5f96fe41a 2024-04-06T02:58:03.391280816Z [2024-04-06T02:58:03.390+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:58:03.394417240Z [2024-04-06T02:58:03.394+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 02:56:00+00:00, run_id=scheduled__2024-04-06T02:56:00+00:00, run_start_date=2024-04-06 02:58:00.794266+00:00, run_end_date=2024-04-06 02:58:03.393942+00:00, run_duration=2.599676, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:56:00+00:00, data_interval_end=2024-04-06 02:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T02:58:03.413252144Z [2024-04-06T02:58:03.412+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T02:58:00+00:00, run_after=2024-04-06T03:00:00+00:00 2024-04-06T02:58:03.513382389Z [2024-04-06T02:58:03.513+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:56:00+00:00 exited with status success for try_number 1 2024-04-06T02:58:03.518825089Z [2024-04-06T02:58:03.518+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T02:56:00+00:00, map_index=-1, run_start_date=2024-04-06 02:58:01.952043+00:00, run_end_date=2024-04-06 02:58:02.850744+00:00, run_duration=0.898701, state=success, executor_state=success, try_number=1, max_tries=1, job_id=307, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:58:00.844928+00:00, queued_by_job_id=2, pid=6973 2024-04-06T02:58:06.187788738Z [2024-04-06T02:58:06.187+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:58:06.188174040Z [2024-04-06T02:58:06.187+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:57:00+00:00, run_id=scheduled__2024-04-06T02:57:00+00:00, run_start_date=2024-04-06 02:58:00.795313+00:00, run_end_date=2024-04-06 02:58:06.187656+00:00, run_duration=5.392343, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:57:00+00:00, data_interval_end=2024-04-06 02:58:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:58:06.199461583Z [2024-04-06T02:58:06.199+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:58:00+00:00, run_after=2024-04-06T02:59:00+00:00 2024-04-06T02:58:06.208295178Z [2024-04-06T02:58:06.207+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:58:06.208637144Z [2024-04-06T02:58:06.208+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:57:00+00:00, run_id=scheduled__2024-04-06T02:57:00+00:00, run_start_date=2024-04-06 02:58:00.796307+00:00, run_end_date=2024-04-06 02:58:06.208302+00:00, run_duration=5.411995, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:57:00+00:00, data_interval_end=2024-04-06 02:58:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:58:06.218992118Z [2024-04-06T02:58:06.218+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:58:00+00:00, run_after=2024-04-06T02:59:00+00:00 2024-04-06T02:58:06.272887932Z [2024-04-06T02:58:06.272+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:57:00+00:00 exited with status success for try_number 1 2024-04-06T02:58:06.273486407Z [2024-04-06T02:58:06.273+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:57:00+00:00 exited with status success for try_number 1 2024-04-06T02:58:06.280605870Z [2024-04-06T02:58:06.280+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:57:00+00:00, map_index=-1, run_start_date=2024-04-06 02:58:03.480224+00:00, run_end_date=2024-04-06 02:58:05.706561+00:00, run_duration=2.226337, state=success, executor_state=success, try_number=1, max_tries=1, job_id=309, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:58:00.844928+00:00, queued_by_job_id=2, pid=7012 2024-04-06T02:58:06.280908393Z [2024-04-06T02:58:06.280+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:57:00+00:00, map_index=-1, run_start_date=2024-04-06 02:58:03.099597+00:00, run_end_date=2024-04-06 02:58:05.194374+00:00, run_duration=2.094777, state=success, executor_state=success, try_number=1, max_tries=1, job_id=308, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:58:00.844928+00:00, queued_by_job_id=2, pid=6993 2024-04-06T02:59:00.255934960Z [2024-04-06T02:59:00.255+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T02:59:00.277312777Z [2024-04-06T02:59:00.276+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:59:00+00:00, run_after=2024-04-06T03:00:00+00:00 2024-04-06T02:59:00.353003202Z [2024-04-06T02:59:00.352+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T02:59:00.353043557Z 2024-04-06T02:59:00.353059510Z 2024-04-06T02:59:00.353337133Z [2024-04-06T02:59:00.352+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:59:00.353727831Z [2024-04-06T02:59:00.353+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T02:59:00.355082374Z [2024-04-06T02:59:00.354+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T02:59:00.355138736Z 2024-04-06T02:59:00.355149111Z 2024-04-06T02:59:00.360753417Z [2024-04-06T02:59:00.360+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:59:00.360967462Z [2024-04-06T02:59:00.360+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T02:59:00.361592338Z [2024-04-06T02:59:00.361+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T02:59:00.362023580Z [2024-04-06T02:59:00.361+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T02:59:00.505677936Z [2024-04-06T02:59:00.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:58:00+00:00 exited with status queued for try_number 1 2024-04-06T02:59:00.505718430Z [2024-04-06T02:59:00.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:58:00+00:00 exited with status queued for try_number 1 2024-04-06T02:59:00.512744520Z [2024-04-06T02:59:00.512+0000] {scheduler_job.py:635} INFO - Setting external_id for to b1e8af75-951c-4044-a7be-528e23e8076b 2024-04-06T02:59:00.512804023Z [2024-04-06T02:59:00.512+0000] {scheduler_job.py:635} INFO - Setting external_id for to 280c3070-d79f-47c0-bb8f-1676a4d14266 2024-04-06T02:59:05.495034239Z [2024-04-06T02:59:05.494+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:59:05.495352295Z [2024-04-06T02:59:05.495+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:58:00+00:00, run_id=scheduled__2024-04-06T02:58:00+00:00, run_start_date=2024-04-06 02:59:00.297580+00:00, run_end_date=2024-04-06 02:59:05.494977+00:00, run_duration=5.197397, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:58:00+00:00, data_interval_end=2024-04-06 02:59:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T02:59:05.563230459Z [2024-04-06T02:59:05.562+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:59:00+00:00, run_after=2024-04-06T03:00:00+00:00 2024-04-06T02:59:05.654894682Z [2024-04-06T02:59:05.654+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:58:00+00:00 exited with status success for try_number 1 2024-04-06T02:59:05.664469453Z [2024-04-06T02:59:05.664+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:58:00+00:00, map_index=-1, run_start_date=2024-04-06 02:59:02.198230+00:00, run_end_date=2024-04-06 02:59:04.370345+00:00, run_duration=2.172115, state=success, executor_state=success, try_number=1, max_tries=1, job_id=310, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:59:00.356302+00:00, queued_by_job_id=2, pid=7057 2024-04-06T02:59:06.744762679Z [2024-04-06T02:59:06.744+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T02:59:06.745195834Z [2024-04-06T02:59:06.744+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:58:00+00:00, run_id=scheduled__2024-04-06T02:58:00+00:00, run_start_date=2024-04-06 02:59:00.299375+00:00, run_end_date=2024-04-06 02:59:06.744829+00:00, run_duration=6.445454, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:58:00+00:00, data_interval_end=2024-04-06 02:59:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T02:59:06.756709268Z [2024-04-06T02:59:06.756+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T02:59:00+00:00, run_after=2024-04-06T03:00:00+00:00 2024-04-06T02:59:06.785041835Z [2024-04-06T02:59:06.784+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:58:00+00:00 exited with status success for try_number 1 2024-04-06T02:59:06.789619582Z [2024-04-06T02:59:06.789+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:58:00+00:00, map_index=-1, run_start_date=2024-04-06 02:59:02.381572+00:00, run_end_date=2024-04-06 02:59:06.023047+00:00, run_duration=3.641475, state=success, executor_state=success, try_number=1, max_tries=1, job_id=311, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 02:59:00.356302+00:00, queued_by_job_id=2, pid=7058 2024-04-06T03:00:00.439508860Z [2024-04-06T03:00:00.438+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:00:00.466803055Z [2024-04-06T03:00:00.465+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:00:00+00:00, run_after=2024-04-06T03:05:00+00:00 2024-04-06T03:00:00.478381893Z [2024-04-06T03:00:00.477+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:00:00.505433360Z [2024-04-06T03:00:00.505+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:00:00+00:00, run_after=2024-04-06T03:01:00+00:00 2024-04-06T03:00:00.598268022Z [2024-04-06T03:00:00.597+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-06T03:00:00.598292455Z 2024-04-06T03:00:00.598295905Z 2024-04-06T03:00:00.598307209Z 2024-04-06T03:00:00.598310274Z 2024-04-06T03:00:00.598313236Z [2024-04-06T03:00:00.597+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:00:00.598397380Z [2024-04-06T03:00:00.598+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T03:00:00.598589957Z [2024-04-06T03:00:00.598+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:00:00.598754281Z [2024-04-06T03:00:00.598+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:00:00.599308656Z [2024-04-06T03:00:00.599+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:00:00.599320579Z 2024-04-06T03:00:00.599325074Z 2024-04-06T03:00:00.599329119Z 2024-04-06T03:00:00.599332665Z 2024-04-06T03:00:00.603525729Z [2024-04-06T03:00:00.603+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-06T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-06T03:00:00.603831092Z [2024-04-06T03:00:00.603+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:00:00.604258657Z [2024-04-06T03:00:00.604+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:00:00.604496028Z [2024-04-06T03:00:00.604+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:00:00.604938377Z [2024-04-06T03:00:00.604+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:00:00.605130313Z [2024-04-06T03:00:00.604+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:00:00.605471856Z [2024-04-06T03:00:00.605+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T02:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:00:00.605638381Z [2024-04-06T03:00:00.605+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:00:01.067043445Z [2024-04-06T03:00:01.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T02:55:00+00:00 exited with status queued for try_number 1 2024-04-06T03:00:01.067087922Z [2024-04-06T03:00:01.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:58:00+00:00 exited with status queued for try_number 1 2024-04-06T03:00:01.069968962Z [2024-04-06T03:00:01.069+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:59:00+00:00 exited with status queued for try_number 1 2024-04-06T03:00:01.070176967Z [2024-04-06T03:00:01.069+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:59:00+00:00 exited with status queued for try_number 1 2024-04-06T03:00:01.078756350Z [2024-04-06T03:00:01.078+0000] {scheduler_job.py:635} INFO - Setting external_id for to 85c055cc-fa85-485c-84bf-a947ff3bc7e0 2024-04-06T03:00:01.082174113Z [2024-04-06T03:00:01.078+0000] {scheduler_job.py:635} INFO - Setting external_id for to eeb8b56d-229a-47f1-bb34-8fe3e84db780 2024-04-06T03:00:01.082436038Z [2024-04-06T03:00:01.082+0000] {scheduler_job.py:635} INFO - Setting external_id for to d8905a0f-313e-451e-bc02-68e4589f26ea 2024-04-06T03:00:01.082609229Z [2024-04-06T03:00:01.082+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a01b34a-5e4d-48de-944c-f40f893158c3 2024-04-06T03:00:03.374725567Z [2024-04-06T03:00:03.374+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:00:03.375401709Z [2024-04-06T03:00:03.375+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 02:58:00+00:00, run_id=scheduled__2024-04-06T02:58:00+00:00, run_start_date=2024-04-06 03:00:00.517552+00:00, run_end_date=2024-04-06 03:00:03.375036+00:00, run_duration=2.857484, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:58:00+00:00, data_interval_end=2024-04-06 03:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T03:00:03.383249687Z [2024-04-06T03:00:03.382+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T03:00:00+00:00, run_after=2024-04-06T03:02:00+00:00 2024-04-06T03:00:04.633745275Z [2024-04-06T03:00:04.633+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:00:04.633771925Z 2024-04-06T03:00:04.638181355Z [2024-04-06T03:00:04.637+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:00:04.638889188Z [2024-04-06T03:00:04.638+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:00:04.638896996Z 2024-04-06T03:00:04.642502183Z [2024-04-06T03:00:04.642+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='split_metrics', run_id='scheduled__2024-04-06T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-06T03:00:04.647960358Z [2024-04-06T03:00:04.647+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:00:04.787649198Z [2024-04-06T03:00:04.787+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T02:55:00+00:00 exited with status queued for try_number 1 2024-04-06T03:00:04.787938509Z [2024-04-06T03:00:04.787+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T02:55:00+00:00 exited with status success for try_number 1 2024-04-06T03:00:04.788151214Z [2024-04-06T03:00:04.787+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T02:58:00+00:00 exited with status success for try_number 1 2024-04-06T03:00:04.798963472Z [2024-04-06T03:00:04.798+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-06T02:55:00+00:00, map_index=-1, run_start_date=2024-04-06 03:00:03.776609+00:00, run_end_date=2024-04-06 03:00:04.321629+00:00, run_duration=0.54502, state=success, executor_state=success, try_number=1, max_tries=1, job_id=313, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:00:00.600135+00:00, queued_by_job_id=2, pid=7125 2024-04-06T03:00:04.799437021Z [2024-04-06T03:00:04.799+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T02:58:00+00:00, map_index=-1, run_start_date=2024-04-06 03:00:02.070368+00:00, run_end_date=2024-04-06 03:00:03.313250+00:00, run_duration=1.242882, state=success, executor_state=success, try_number=1, max_tries=1, job_id=312, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:00:00.600135+00:00, queued_by_job_id=2, pid=7095 2024-04-06T03:00:04.807640713Z [2024-04-06T03:00:04.807+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e596708-dc72-42eb-8ce0-4cfe221d3a79 2024-04-06T03:00:06.058286931Z [2024-04-06T03:00:06.057+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:00:06.058697835Z [2024-04-06T03:00:06.058+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:59:00+00:00, run_id=scheduled__2024-04-06T02:59:00+00:00, run_start_date=2024-04-06 03:00:00.518913+00:00, run_end_date=2024-04-06 03:00:06.058389+00:00, run_duration=5.539476, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:59:00+00:00, data_interval_end=2024-04-06 03:00:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:00:06.072307117Z [2024-04-06T03:00:06.072+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:00:00+00:00, run_after=2024-04-06T03:01:00+00:00 2024-04-06T03:00:07.204335623Z [2024-04-06T03:00:07.203+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:00:07.204655489Z [2024-04-06T03:00:07.204+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:59:00+00:00, run_id=scheduled__2024-04-06T02:59:00+00:00, run_start_date=2024-04-06 03:00:00.519842+00:00, run_end_date=2024-04-06 03:00:07.204203+00:00, run_duration=6.684361, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:59:00+00:00, data_interval_end=2024-04-06 03:00:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:00:07.214560814Z [2024-04-06T03:00:07.214+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:00:00+00:00, run_after=2024-04-06T03:01:00+00:00 2024-04-06T03:00:07.249249341Z [2024-04-06T03:00:07.248+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:00:07.249292093Z 2024-04-06T03:00:07.249406197Z [2024-04-06T03:00:07.249+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:00:07.250696199Z [2024-04-06T03:00:07.250+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:00:07.250711018Z 2024-04-06T03:00:07.254609653Z [2024-04-06T03:00:07.254+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='collect_metrics', run_id='scheduled__2024-04-06T02:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-06T03:00:07.254837433Z [2024-04-06T03:00:07.254+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T03:00:07.304401461Z [2024-04-06T03:00:07.304+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T02:55:00+00:00 exited with status queued for try_number 1 2024-04-06T03:00:07.304448191Z [2024-04-06T03:00:07.304+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:59:00+00:00 exited with status success for try_number 1 2024-04-06T03:00:07.304576573Z [2024-04-06T03:00:07.304+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T02:59:00+00:00 exited with status success for try_number 1 2024-04-06T03:00:07.304647353Z [2024-04-06T03:00:07.304+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T02:55:00+00:00 exited with status success for try_number 1 2024-04-06T03:00:07.313573929Z [2024-04-06T03:00:07.313+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:59:00+00:00, map_index=-1, run_start_date=2024-04-06 03:00:04.093135+00:00, run_end_date=2024-04-06 03:00:06.056630+00:00, run_duration=1.963495, state=success, executor_state=success, try_number=1, max_tries=1, job_id=314, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:00:00.600135+00:00, queued_by_job_id=2, pid=7132 2024-04-06T03:00:07.313827885Z [2024-04-06T03:00:07.313+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T02:59:00+00:00, map_index=-1, run_start_date=2024-04-06 03:00:04.579970+00:00, run_end_date=2024-04-06 03:00:05.989647+00:00, run_duration=1.409677, state=success, executor_state=success, try_number=1, max_tries=1, job_id=315, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:00:00.600135+00:00, queued_by_job_id=2, pid=7145 2024-04-06T03:00:07.314147124Z [2024-04-06T03:00:07.313+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=split_metrics, run_id=scheduled__2024-04-06T02:55:00+00:00, map_index=-1, run_start_date=2024-04-06 03:00:06.594396+00:00, run_end_date=2024-04-06 03:00:06.968036+00:00, run_duration=0.37364, state=success, executor_state=success, try_number=1, max_tries=1, job_id=316, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:00:04.639323+00:00, queued_by_job_id=2, pid=7175 2024-04-06T03:00:07.314336637Z [2024-04-06T03:00:07.314+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a53038d-6965-4c2f-8150-ebd16c32e566 2024-04-06T03:00:09.702142642Z [2024-04-06T03:00:09.701+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:00:09.702167865Z 2024-04-06T03:00:09.702358266Z [2024-04-06T03:00:09.702+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:00:09.703296679Z [2024-04-06T03:00:09.703+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:00:09.703308675Z 2024-04-06T03:00:09.706457690Z [2024-04-06T03:00:09.706+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='send_prometheus', run_id='scheduled__2024-04-06T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:00:09.706646231Z [2024-04-06T03:00:09.706+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:00:09.771360975Z [2024-04-06T03:00:09.770+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T02:55:00+00:00 exited with status queued for try_number 1 2024-04-06T03:00:09.771434435Z [2024-04-06T03:00:09.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T02:55:00+00:00 exited with status success for try_number 1 2024-04-06T03:00:09.781727642Z [2024-04-06T03:00:09.781+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f35eaf7-700d-4aa9-a705-c1106321df3e 2024-04-06T03:00:09.781800940Z [2024-04-06T03:00:09.781+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=collect_metrics, run_id=scheduled__2024-04-06T02:55:00+00:00, map_index=0, run_start_date=2024-04-06 03:00:09.106712+00:00, run_end_date=2024-04-06 03:00:09.453126+00:00, run_duration=0.346414, state=success, executor_state=success, try_number=1, max_tries=1, job_id=317, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:00:07.251337+00:00, queued_by_job_id=2, pid=7187 2024-04-06T03:00:11.981928253Z [2024-04-06T03:00:11.981+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:00:11.982531798Z [2024-04-06T03:00:11.982+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 02:55:00+00:00, run_id=scheduled__2024-04-06T02:55:00+00:00, run_start_date=2024-04-06 03:00:00.516255+00:00, run_end_date=2024-04-06 03:00:11.981845+00:00, run_duration=11.46559, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 02:55:00+00:00, data_interval_end=2024-04-06 03:00:00+00:00, dag_hash=eecc559ff32fe9a7c4345875f113a0a9 2024-04-06T03:00:11.991953939Z [2024-04-06T03:00:11.991+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:00:00+00:00, run_after=2024-04-06T03:05:00+00:00 2024-04-06T03:00:12.048064861Z [2024-04-06T03:00:12.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T02:55:00+00:00 exited with status success for try_number 1 2024-04-06T03:00:12.058433034Z [2024-04-06T03:00:12.058+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=send_prometheus, run_id=scheduled__2024-04-06T02:55:00+00:00, map_index=-1, run_start_date=2024-04-06 03:00:11.431967+00:00, run_end_date=2024-04-06 03:00:11.776472+00:00, run_duration=0.344505, state=success, executor_state=success, try_number=1, max_tries=1, job_id=318, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:00:09.703867+00:00, queued_by_job_id=2, pid=7212 2024-04-06T03:00:20.367418169Z [2024-04-06T03:00:20.366+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-06T03:01:00.432738954Z [2024-04-06T03:01:00.432+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:01:00.452072878Z [2024-04-06T03:01:00.451+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:01:00+00:00, run_after=2024-04-06T03:02:00+00:00 2024-04-06T03:01:00.512348682Z [2024-04-06T03:01:00.511+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T03:01:00.512385960Z 2024-04-06T03:01:00.512398782Z 2024-04-06T03:01:00.512623589Z [2024-04-06T03:01:00.512+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:01:00.512768187Z [2024-04-06T03:01:00.512+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:01:00.514360338Z [2024-04-06T03:01:00.514+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:01:00.514375954Z 2024-04-06T03:01:00.514381253Z 2024-04-06T03:01:00.517749400Z [2024-04-06T03:01:00.517+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:01:00.518101412Z [2024-04-06T03:01:00.517+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:01:00.518597274Z [2024-04-06T03:01:00.518+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:01:00.519274981Z [2024-04-06T03:01:00.519+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:01:00.744982679Z [2024-04-06T03:01:00.742+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:00:00+00:00 exited with status queued for try_number 1 2024-04-06T03:01:00.745013680Z [2024-04-06T03:01:00.743+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:00:00+00:00 exited with status queued for try_number 1 2024-04-06T03:01:00.754022352Z [2024-04-06T03:01:00.753+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77a3896c-f95b-4bb2-9c1e-70a99aa96be9 2024-04-06T03:01:00.754048466Z [2024-04-06T03:01:00.753+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2e4d8aa9-b7e8-4339-847f-703a8a1ceb12 2024-04-06T03:01:05.106355257Z [2024-04-06T03:01:05.105+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:01:05.106799990Z [2024-04-06T03:01:05.106+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:00:00+00:00, run_id=scheduled__2024-04-06T03:00:00+00:00, run_start_date=2024-04-06 03:01:00.462669+00:00, run_end_date=2024-04-06 03:01:05.106460+00:00, run_duration=4.643791, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:00:00+00:00, data_interval_end=2024-04-06 03:01:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:01:05.115632241Z [2024-04-06T03:01:05.115+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:01:00+00:00, run_after=2024-04-06T03:02:00+00:00 2024-04-06T03:01:05.173448568Z [2024-04-06T03:01:05.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:00:00+00:00 exited with status success for try_number 1 2024-04-06T03:01:05.190541575Z [2024-04-06T03:01:05.190+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:00:00+00:00, map_index=-1, run_start_date=2024-04-06 03:01:02.592228+00:00, run_end_date=2024-04-06 03:01:04.431719+00:00, run_duration=1.839491, state=success, executor_state=success, try_number=1, max_tries=1, job_id=319, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:01:00.515106+00:00, queued_by_job_id=2, pid=7226 2024-04-06T03:01:06.265388252Z [2024-04-06T03:01:06.264+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:01:06.265640200Z [2024-04-06T03:01:06.265+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:00:00+00:00, run_id=scheduled__2024-04-06T03:00:00+00:00, run_start_date=2024-04-06 03:01:00.464198+00:00, run_end_date=2024-04-06 03:01:06.265162+00:00, run_duration=5.800964, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:00:00+00:00, data_interval_end=2024-04-06 03:01:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:01:06.278176269Z [2024-04-06T03:01:06.277+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:01:00+00:00, run_after=2024-04-06T03:02:00+00:00 2024-04-06T03:01:06.323563328Z [2024-04-06T03:01:06.323+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:00:00+00:00 exited with status success for try_number 1 2024-04-06T03:01:06.331516146Z [2024-04-06T03:01:06.330+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:00:00+00:00, map_index=-1, run_start_date=2024-04-06 03:01:03.323545+00:00, run_end_date=2024-04-06 03:01:05.460843+00:00, run_duration=2.137298, state=success, executor_state=success, try_number=1, max_tries=1, job_id=320, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:01:00.515106+00:00, queued_by_job_id=2, pid=7245 2024-04-06T03:02:00.180230164Z [2024-04-06T03:02:00.179+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:02:00.208714601Z [2024-04-06T03:02:00.208+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:02:00+00:00, run_after=2024-04-06T03:03:00+00:00 2024-04-06T03:02:00.217613697Z [2024-04-06T03:02:00.217+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:02:00.296923037Z [2024-04-06T03:02:00.296+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T03:02:00.296955853Z 2024-04-06T03:02:00.296964940Z 2024-04-06T03:02:00.296980667Z 2024-04-06T03:02:00.297199274Z [2024-04-06T03:02:00.297+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T03:02:00.297364637Z [2024-04-06T03:02:00.297+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:02:00.297475333Z [2024-04-06T03:02:00.297+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:02:00.298108050Z [2024-04-06T03:02:00.297+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:02:00.298145660Z 2024-04-06T03:02:00.298154455Z 2024-04-06T03:02:00.298161588Z 2024-04-06T03:02:00.301060477Z [2024-04-06T03:02:00.300+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:02:00.301282775Z [2024-04-06T03:02:00.301+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:02:00.301539471Z [2024-04-06T03:02:00.301+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:02:00.301742734Z [2024-04-06T03:02:00.301+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:02:00.302046166Z [2024-04-06T03:02:00.301+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:02:00.302228457Z [2024-04-06T03:02:00.302+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:02:00.530831026Z [2024-04-06T03:02:00.530+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:00:00+00:00 exited with status queued for try_number 1 2024-04-06T03:02:00.530861874Z [2024-04-06T03:02:00.530+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:01:00+00:00 exited with status queued for try_number 1 2024-04-06T03:02:00.530937199Z [2024-04-06T03:02:00.530+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:01:00+00:00 exited with status queued for try_number 1 2024-04-06T03:02:00.538615587Z [2024-04-06T03:02:00.538+0000] {scheduler_job.py:635} INFO - Setting external_id for to cdd08952-a471-4f4d-9cae-c11107bea7ae 2024-04-06T03:02:00.538702924Z [2024-04-06T03:02:00.538+0000] {scheduler_job.py:635} INFO - Setting external_id for to 08f612fc-28e1-4bee-be12-145f99757b5f 2024-04-06T03:02:00.538797930Z [2024-04-06T03:02:00.538+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3127751-8679-4be0-b276-71e2b022015e 2024-04-06T03:02:03.115112641Z [2024-04-06T03:02:03.114+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:02:03.115513660Z [2024-04-06T03:02:03.115+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 03:00:00+00:00, run_id=scheduled__2024-04-06T03:00:00+00:00, run_start_date=2024-04-06 03:02:00.231408+00:00, run_end_date=2024-04-06 03:02:03.115156+00:00, run_duration=2.883748, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:00:00+00:00, data_interval_end=2024-04-06 03:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T03:02:03.146679146Z [2024-04-06T03:02:03.146+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T03:02:00+00:00, run_after=2024-04-06T03:04:00+00:00 2024-04-06T03:02:03.268377567Z [2024-04-06T03:02:03.265+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:00:00+00:00 exited with status success for try_number 1 2024-04-06T03:02:03.273513068Z [2024-04-06T03:02:03.273+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T03:00:00+00:00, map_index=-1, run_start_date=2024-04-06 03:02:01.112996+00:00, run_end_date=2024-04-06 03:02:01.638263+00:00, run_duration=0.525267, state=success, executor_state=success, try_number=1, max_tries=1, job_id=321, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:02:00.298792+00:00, queued_by_job_id=2, pid=7270 2024-04-06T03:02:05.422252717Z [2024-04-06T03:02:05.421+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:02:05.422526420Z [2024-04-06T03:02:05.422+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:01:00+00:00, run_id=scheduled__2024-04-06T03:01:00+00:00, run_start_date=2024-04-06 03:02:00.237354+00:00, run_end_date=2024-04-06 03:02:05.422184+00:00, run_duration=5.18483, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:01:00+00:00, data_interval_end=2024-04-06 03:02:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:02:05.431249071Z [2024-04-06T03:02:05.430+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:02:00+00:00, run_after=2024-04-06T03:03:00+00:00 2024-04-06T03:02:05.440353345Z [2024-04-06T03:02:05.438+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:02:05.440369067Z [2024-04-06T03:02:05.440+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:01:00+00:00, run_id=scheduled__2024-04-06T03:01:00+00:00, run_start_date=2024-04-06 03:02:00.239859+00:00, run_end_date=2024-04-06 03:02:05.439910+00:00, run_duration=5.200051, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:01:00+00:00, data_interval_end=2024-04-06 03:02:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:02:05.450230796Z [2024-04-06T03:02:05.449+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:02:00+00:00, run_after=2024-04-06T03:03:00+00:00 2024-04-06T03:02:05.488610318Z [2024-04-06T03:02:05.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:01:00+00:00 exited with status success for try_number 1 2024-04-06T03:02:05.488638662Z [2024-04-06T03:02:05.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:01:00+00:00 exited with status success for try_number 1 2024-04-06T03:02:05.497803140Z [2024-04-06T03:02:05.497+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:01:00+00:00, map_index=-1, run_start_date=2024-04-06 03:02:02.983913+00:00, run_end_date=2024-04-06 03:02:04.579444+00:00, run_duration=1.595531, state=success, executor_state=success, try_number=1, max_tries=1, job_id=322, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:02:00.298792+00:00, queued_by_job_id=2, pid=7301 2024-04-06T03:02:05.497994142Z [2024-04-06T03:02:05.497+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:01:00+00:00, map_index=-1, run_start_date=2024-04-06 03:02:02.983765+00:00, run_end_date=2024-04-06 03:02:04.769406+00:00, run_duration=1.785641, state=success, executor_state=success, try_number=1, max_tries=1, job_id=323, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:02:00.298792+00:00, queued_by_job_id=2, pid=7300 2024-04-06T03:03:00.637359559Z [2024-04-06T03:03:00.636+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:03:00.658726601Z [2024-04-06T03:03:00.658+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:03:00+00:00, run_after=2024-04-06T03:04:00+00:00 2024-04-06T03:03:00.742735374Z [2024-04-06T03:03:00.738+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T03:03:00.742771448Z 2024-04-06T03:03:00.742775564Z 2024-04-06T03:03:00.742779029Z [2024-04-06T03:03:00.738+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:03:00.742782799Z [2024-04-06T03:03:00.738+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:03:00.742786779Z [2024-04-06T03:03:00.739+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:03:00.742789746Z 2024-04-06T03:03:00.742792681Z 2024-04-06T03:03:00.743322288Z [2024-04-06T03:03:00.743+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:03:00.743546749Z [2024-04-06T03:03:00.743+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:03:00.743876469Z [2024-04-06T03:03:00.743+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:03:00.744031542Z [2024-04-06T03:03:00.743+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:03:00.939374085Z [2024-04-06T03:03:00.938+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:02:00+00:00 exited with status queued for try_number 1 2024-04-06T03:03:00.939619551Z [2024-04-06T03:03:00.939+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:02:00+00:00 exited with status queued for try_number 1 2024-04-06T03:03:00.951388248Z [2024-04-06T03:03:00.951+0000] {scheduler_job.py:635} INFO - Setting external_id for to 188c1ac9-4713-46e6-bf23-924726cf919a 2024-04-06T03:03:00.951616150Z [2024-04-06T03:03:00.951+0000] {scheduler_job.py:635} INFO - Setting external_id for to d7a7542e-e8b7-4026-a780-05bf5f5add29 2024-04-06T03:03:06.574016098Z [2024-04-06T03:03:06.573+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:03:06.574344572Z [2024-04-06T03:03:06.574+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:02:00+00:00, run_id=scheduled__2024-04-06T03:02:00+00:00, run_start_date=2024-04-06 03:03:00.672526+00:00, run_end_date=2024-04-06 03:03:06.573893+00:00, run_duration=5.901367, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:02:00+00:00, data_interval_end=2024-04-06 03:03:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:03:06.584999927Z [2024-04-06T03:03:06.584+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:03:00+00:00, run_after=2024-04-06T03:04:00+00:00 2024-04-06T03:03:06.639245197Z [2024-04-06T03:03:06.638+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:02:00+00:00 exited with status success for try_number 1 2024-04-06T03:03:06.646341654Z [2024-04-06T03:03:06.645+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:02:00+00:00, map_index=-1, run_start_date=2024-04-06 03:03:04.877456+00:00, run_end_date=2024-04-06 03:03:06.414627+00:00, run_duration=1.537171, state=success, executor_state=success, try_number=1, max_tries=1, job_id=325, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:03:00.740452+00:00, queued_by_job_id=2, pid=7365 2024-04-06T03:03:07.716346669Z [2024-04-06T03:03:07.715+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:03:07.717020463Z [2024-04-06T03:03:07.716+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:02:00+00:00, run_id=scheduled__2024-04-06T03:02:00+00:00, run_start_date=2024-04-06 03:03:00.674481+00:00, run_end_date=2024-04-06 03:03:07.716463+00:00, run_duration=7.041982, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:02:00+00:00, data_interval_end=2024-04-06 03:03:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:03:07.732602274Z [2024-04-06T03:03:07.732+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:03:00+00:00, run_after=2024-04-06T03:04:00+00:00 2024-04-06T03:03:07.762286190Z [2024-04-06T03:03:07.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:02:00+00:00 exited with status success for try_number 1 2024-04-06T03:03:07.767668573Z [2024-04-06T03:03:07.767+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:02:00+00:00, map_index=-1, run_start_date=2024-04-06 03:03:03.856298+00:00, run_end_date=2024-04-06 03:03:06.661259+00:00, run_duration=2.804961, state=success, executor_state=success, try_number=1, max_tries=1, job_id=324, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:03:00.740452+00:00, queued_by_job_id=2, pid=7346 2024-04-06T03:04:00.610878068Z [2024-04-06T03:04:00.610+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:04:00+00:00, run_after=2024-04-06T03:05:00+00:00 2024-04-06T03:04:00.627771001Z [2024-04-06T03:04:00.627+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:04:00.635418326Z [2024-04-06T03:04:00.635+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:04:00.754983279Z [2024-04-06T03:04:00.754+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T03:04:00.755003217Z 2024-04-06T03:04:00.755010784Z 2024-04-06T03:04:00.755013980Z 2024-04-06T03:04:00.755046343Z [2024-04-06T03:04:00.754+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T03:04:00.755135707Z [2024-04-06T03:04:00.755+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:04:00.755232097Z [2024-04-06T03:04:00.755+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:04:00.755829574Z [2024-04-06T03:04:00.755+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:04:00.755835010Z 2024-04-06T03:04:00.755847682Z 2024-04-06T03:04:00.755850629Z 2024-04-06T03:04:00.760542491Z [2024-04-06T03:04:00.760+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:04:00.760645833Z [2024-04-06T03:04:00.760+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:04:00.760936712Z [2024-04-06T03:04:00.760+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:04:00.761020433Z [2024-04-06T03:04:00.760+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:04:00.761198880Z [2024-04-06T03:04:00.761+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:04:00.761268442Z [2024-04-06T03:04:00.761+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:04:01.208220312Z [2024-04-06T03:04:01.207+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:02:00+00:00 exited with status queued for try_number 1 2024-04-06T03:04:01.208441704Z [2024-04-06T03:04:01.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:03:00+00:00 exited with status queued for try_number 1 2024-04-06T03:04:01.208595399Z [2024-04-06T03:04:01.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:03:00+00:00 exited with status queued for try_number 1 2024-04-06T03:04:01.219084349Z [2024-04-06T03:04:01.218+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84eae578-6f15-443e-85db-7bfba9f3f285 2024-04-06T03:04:01.219364939Z [2024-04-06T03:04:01.219+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64396135-65d0-4a8f-98e7-27f914a065fb 2024-04-06T03:04:01.219534464Z [2024-04-06T03:04:01.219+0000] {scheduler_job.py:635} INFO - Setting external_id for to f9243c29-9c8c-4a2d-8eb3-cea0c764c8b9 2024-04-06T03:04:03.714372261Z [2024-04-06T03:04:03.714+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:04:03.718124702Z [2024-04-06T03:04:03.717+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 03:02:00+00:00, run_id=scheduled__2024-04-06T03:02:00+00:00, run_start_date=2024-04-06 03:04:00.646547+00:00, run_end_date=2024-04-06 03:04:03.717568+00:00, run_duration=3.071021, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:02:00+00:00, data_interval_end=2024-04-06 03:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T03:04:03.752056994Z [2024-04-06T03:04:03.751+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T03:04:00+00:00, run_after=2024-04-06T03:06:00+00:00 2024-04-06T03:04:03.831814032Z [2024-04-06T03:04:03.831+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:02:00+00:00 exited with status success for try_number 1 2024-04-06T03:04:03.845388414Z [2024-04-06T03:04:03.844+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T03:02:00+00:00, map_index=-1, run_start_date=2024-04-06 03:04:02.018994+00:00, run_end_date=2024-04-06 03:04:02.516856+00:00, run_duration=0.497862, state=success, executor_state=success, try_number=1, max_tries=1, job_id=326, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:04:00.756609+00:00, queued_by_job_id=2, pid=7391 2024-04-06T03:04:07.317064836Z [2024-04-06T03:04:07.316+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:04:07.317316686Z [2024-04-06T03:04:07.317+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:03:00+00:00, run_id=scheduled__2024-04-06T03:03:00+00:00, run_start_date=2024-04-06 03:04:00.647785+00:00, run_end_date=2024-04-06 03:04:07.316922+00:00, run_duration=6.669137, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:03:00+00:00, data_interval_end=2024-04-06 03:04:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:04:07.327850029Z [2024-04-06T03:04:07.327+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:04:00+00:00, run_after=2024-04-06T03:05:00+00:00 2024-04-06T03:04:07.334108096Z [2024-04-06T03:04:07.333+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:04:07.334369265Z [2024-04-06T03:04:07.334+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:03:00+00:00, run_id=scheduled__2024-04-06T03:03:00+00:00, run_start_date=2024-04-06 03:04:00.648952+00:00, run_end_date=2024-04-06 03:04:07.334024+00:00, run_duration=6.685072, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:03:00+00:00, data_interval_end=2024-04-06 03:04:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:04:07.343925171Z [2024-04-06T03:04:07.343+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:04:00+00:00, run_after=2024-04-06T03:05:00+00:00 2024-04-06T03:04:07.380391904Z [2024-04-06T03:04:07.380+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:03:00+00:00 exited with status success for try_number 1 2024-04-06T03:04:07.380675332Z [2024-04-06T03:04:07.380+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:03:00+00:00 exited with status success for try_number 1 2024-04-06T03:04:07.391801342Z [2024-04-06T03:04:07.391+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:03:00+00:00, map_index=-1, run_start_date=2024-04-06 03:04:04.476664+00:00, run_end_date=2024-04-06 03:04:06.430447+00:00, run_duration=1.953783, state=success, executor_state=success, try_number=1, max_tries=1, job_id=327, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:04:00.756609+00:00, queued_by_job_id=2, pid=7422 2024-04-06T03:04:07.392101751Z [2024-04-06T03:04:07.391+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:03:00+00:00, map_index=-1, run_start_date=2024-04-06 03:04:04.427332+00:00, run_end_date=2024-04-06 03:04:06.738072+00:00, run_duration=2.31074, state=success, executor_state=success, try_number=1, max_tries=1, job_id=328, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:04:00.756609+00:00, queued_by_job_id=2, pid=7421 2024-04-06T03:05:00.738138462Z [2024-04-06T03:05:00.737+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:05:00+00:00, run_after=2024-04-06T03:10:00+00:00 2024-04-06T03:05:00.760305680Z [2024-04-06T03:05:00.758+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:05:00+00:00, run_after=2024-04-06T03:06:00+00:00 2024-04-06T03:05:00.769519004Z [2024-04-06T03:05:00.769+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:05:00.866934279Z [2024-04-06T03:05:00.866+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T03:05:00.866974469Z 2024-04-06T03:05:00.866979045Z 2024-04-06T03:05:00.867000102Z 2024-04-06T03:05:00.867713439Z [2024-04-06T03:05:00.867+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:05:00.867931694Z [2024-04-06T03:05:00.867+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:05:00.868074447Z [2024-04-06T03:05:00.867+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:05:00.868827602Z [2024-04-06T03:05:00.868+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:05:00.868841246Z 2024-04-06T03:05:00.868864062Z 2024-04-06T03:05:00.868867532Z 2024-04-06T03:05:00.873527364Z [2024-04-06T03:05:00.873+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-06T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-06T03:05:00.875077032Z [2024-04-06T03:05:00.874+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:05:00.875515872Z [2024-04-06T03:05:00.875+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:05:00.875701372Z [2024-04-06T03:05:00.875+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:05:00.876027017Z [2024-04-06T03:05:00.875+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:05:00.876202151Z [2024-04-06T03:05:00.876+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:05:01.240703866Z [2024-04-06T03:05:01.239+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T03:00:00+00:00 exited with status queued for try_number 1 2024-04-06T03:05:01.240855254Z [2024-04-06T03:05:01.240+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:04:00+00:00 exited with status queued for try_number 1 2024-04-06T03:05:01.241037720Z [2024-04-06T03:05:01.240+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:04:00+00:00 exited with status queued for try_number 1 2024-04-06T03:05:01.261799695Z [2024-04-06T03:05:01.261+0000] {scheduler_job.py:635} INFO - Setting external_id for to f4d5b3f2-4763-472b-a671-568e61532eb6 2024-04-06T03:05:01.262092271Z [2024-04-06T03:05:01.261+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6da035e4-b3fc-4755-ae42-ab23e107c8a9 2024-04-06T03:05:01.262283074Z [2024-04-06T03:05:01.262+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75ea33cf-8113-4a5a-ac95-cc164e9b1475 2024-04-06T03:05:05.150509701Z [2024-04-06T03:05:05.150+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:05:05.150533612Z 2024-04-06T03:05:05.150543472Z [2024-04-06T03:05:05.150+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:05:05.151153414Z [2024-04-06T03:05:05.150+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:05:05.151163747Z 2024-04-06T03:05:05.154982279Z [2024-04-06T03:05:05.154+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='split_metrics', run_id='scheduled__2024-04-06T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-06T03:05:05.155245053Z [2024-04-06T03:05:05.155+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:05:05.227718007Z [2024-04-06T03:05:05.227+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T03:00:00+00:00 exited with status queued for try_number 1 2024-04-06T03:05:05.229841449Z [2024-04-06T03:05:05.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T03:00:00+00:00 exited with status success for try_number 1 2024-04-06T03:05:05.236901195Z [2024-04-06T03:05:05.236+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37cbeb9a-609a-49dd-b17d-4ad34a6c2c71 2024-04-06T03:05:05.237324625Z [2024-04-06T03:05:05.237+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-06T03:00:00+00:00, map_index=-1, run_start_date=2024-04-06 03:05:04.080784+00:00, run_end_date=2024-04-06 03:05:04.824065+00:00, run_duration=0.743281, state=success, executor_state=success, try_number=1, max_tries=1, job_id=329, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:05:00.869803+00:00, queued_by_job_id=2, pid=7478 2024-04-06T03:05:07.817023287Z [2024-04-06T03:05:07.816+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:05:07.817342972Z [2024-04-06T03:05:07.816+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:04:00+00:00, run_id=scheduled__2024-04-06T03:04:00+00:00, run_start_date=2024-04-06 03:05:00.788399+00:00, run_end_date=2024-04-06 03:05:07.816692+00:00, run_duration=7.028293, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:04:00+00:00, data_interval_end=2024-04-06 03:05:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:05:07.831634898Z [2024-04-06T03:05:07.831+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:05:00+00:00, run_after=2024-04-06T03:06:00+00:00 2024-04-06T03:05:07.839945915Z [2024-04-06T03:05:07.839+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:05:07.846598915Z [2024-04-06T03:05:07.839+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:04:00+00:00, run_id=scheduled__2024-04-06T03:04:00+00:00, run_start_date=2024-04-06 03:05:00.790280+00:00, run_end_date=2024-04-06 03:05:07.839783+00:00, run_duration=7.049503, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:04:00+00:00, data_interval_end=2024-04-06 03:05:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:05:07.868383881Z [2024-04-06T03:05:07.867+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:05:00+00:00, run_after=2024-04-06T03:06:00+00:00 2024-04-06T03:05:07.954843919Z [2024-04-06T03:05:07.943+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:05:07.954874491Z 2024-04-06T03:05:07.955312811Z [2024-04-06T03:05:07.954+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:05:07.957315406Z [2024-04-06T03:05:07.956+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:05:07.957344495Z 2024-04-06T03:05:07.961596416Z [2024-04-06T03:05:07.961+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='collect_metrics', run_id='scheduled__2024-04-06T03:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-06T03:05:07.962017007Z [2024-04-06T03:05:07.961+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T03:05:08.017447891Z [2024-04-06T03:05:08.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T03:00:00+00:00 exited with status queued for try_number 1 2024-04-06T03:05:08.017543315Z [2024-04-06T03:05:08.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:04:00+00:00 exited with status success for try_number 1 2024-04-06T03:05:08.017597905Z [2024-04-06T03:05:08.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:04:00+00:00 exited with status success for try_number 1 2024-04-06T03:05:08.027537858Z [2024-04-06T03:05:08.026+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:04:00+00:00, map_index=-1, run_start_date=2024-04-06 03:05:04.334256+00:00, run_end_date=2024-04-06 03:05:06.904335+00:00, run_duration=2.570079, state=success, executor_state=success, try_number=1, max_tries=1, job_id=330, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:05:00.869803+00:00, queued_by_job_id=2, pid=7479 2024-04-06T03:05:08.027930317Z [2024-04-06T03:05:08.027+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:04:00+00:00, map_index=-1, run_start_date=2024-04-06 03:05:05.225812+00:00, run_end_date=2024-04-06 03:05:06.936582+00:00, run_duration=1.71077, state=success, executor_state=success, try_number=1, max_tries=1, job_id=331, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:05:00.869803+00:00, queued_by_job_id=2, pid=7508 2024-04-06T03:05:08.028772145Z [2024-04-06T03:05:08.028+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22242e56-d352-4b06-a018-047ce28c2c90 2024-04-06T03:05:08.218316998Z [2024-04-06T03:05:08.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T03:00:00+00:00 exited with status success for try_number 1 2024-04-06T03:05:08.237056792Z [2024-04-06T03:05:08.236+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=split_metrics, run_id=scheduled__2024-04-06T03:00:00+00:00, map_index=-1, run_start_date=2024-04-06 03:05:07.388045+00:00, run_end_date=2024-04-06 03:05:07.748359+00:00, run_duration=0.360314, state=success, executor_state=success, try_number=1, max_tries=1, job_id=332, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:05:05.151454+00:00, queued_by_job_id=2, pid=7528 2024-04-06T03:05:10.136834986Z [2024-04-06T03:05:10.136+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:05:10.136870740Z 2024-04-06T03:05:10.137111466Z [2024-04-06T03:05:10.136+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:05:10.137805379Z [2024-04-06T03:05:10.137+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:05:10.137854638Z 2024-04-06T03:05:10.140560576Z [2024-04-06T03:05:10.140+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='send_prometheus', run_id='scheduled__2024-04-06T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:05:10.140884002Z [2024-04-06T03:05:10.140+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:05:10.197794151Z [2024-04-06T03:05:10.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T03:00:00+00:00 exited with status queued for try_number 1 2024-04-06T03:05:10.198081771Z [2024-04-06T03:05:10.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T03:00:00+00:00 exited with status success for try_number 1 2024-04-06T03:05:10.206776364Z [2024-04-06T03:05:10.206+0000] {scheduler_job.py:635} INFO - Setting external_id for to 689d6ea8-3321-4178-a8c0-bffd77ef4749 2024-04-06T03:05:10.207124777Z [2024-04-06T03:05:10.206+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=collect_metrics, run_id=scheduled__2024-04-06T03:00:00+00:00, map_index=0, run_start_date=2024-04-06 03:05:09.704442+00:00, run_end_date=2024-04-06 03:05:10.059868+00:00, run_duration=0.355426, state=success, executor_state=success, try_number=1, max_tries=1, job_id=333, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:05:07.958370+00:00, queued_by_job_id=2, pid=7550 2024-04-06T03:05:13.542957761Z [2024-04-06T03:05:13.542+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:05:13.543829803Z [2024-04-06T03:05:13.543+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:00:00+00:00, run_id=scheduled__2024-04-06T03:00:00+00:00, run_start_date=2024-04-06 03:05:00.786238+00:00, run_end_date=2024-04-06 03:05:13.543309+00:00, run_duration=12.757071, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:00:00+00:00, data_interval_end=2024-04-06 03:05:00+00:00, dag_hash=eecc559ff32fe9a7c4345875f113a0a9 2024-04-06T03:05:13.554133065Z [2024-04-06T03:05:13.553+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:05:00+00:00, run_after=2024-04-06T03:10:00+00:00 2024-04-06T03:05:13.602834568Z [2024-04-06T03:05:13.602+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T03:00:00+00:00 exited with status success for try_number 1 2024-04-06T03:05:13.612068973Z [2024-04-06T03:05:13.611+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=send_prometheus, run_id=scheduled__2024-04-06T03:00:00+00:00, map_index=-1, run_start_date=2024-04-06 03:05:12.095864+00:00, run_end_date=2024-04-06 03:05:12.480900+00:00, run_duration=0.385036, state=success, executor_state=success, try_number=1, max_tries=1, job_id=334, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:05:10.138308+00:00, queued_by_job_id=2, pid=7565 2024-04-06T03:05:20.442777591Z [2024-04-06T03:05:20.442+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-06T03:06:00.818737357Z [2024-04-06T03:06:00.818+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:06:00.835554455Z [2024-04-06T03:06:00.835+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:06:00+00:00, run_after=2024-04-06T03:07:00+00:00 2024-04-06T03:06:00.848595268Z [2024-04-06T03:06:00.847+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:06:00.930779762Z [2024-04-06T03:06:00.930+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T03:06:00.930806128Z 2024-04-06T03:06:00.930810311Z 2024-04-06T03:06:00.930814314Z 2024-04-06T03:06:00.930878539Z [2024-04-06T03:06:00.930+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T03:06:00.931052622Z [2024-04-06T03:06:00.930+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:06:00.931219567Z [2024-04-06T03:06:00.931+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:06:00.931959754Z [2024-04-06T03:06:00.931+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:06:00.931973080Z 2024-04-06T03:06:00.931976829Z 2024-04-06T03:06:00.931980034Z 2024-04-06T03:06:00.936637919Z [2024-04-06T03:06:00.936+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T03:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:06:00.936743077Z [2024-04-06T03:06:00.936+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:06:00.937004240Z [2024-04-06T03:06:00.936+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:06:00.937102357Z [2024-04-06T03:06:00.936+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:06:00.937297564Z [2024-04-06T03:06:00.937+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:06:00.937401630Z [2024-04-06T03:06:00.937+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:06:01.319978021Z [2024-04-06T03:06:01.319+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:04:00+00:00 exited with status queued for try_number 1 2024-04-06T03:06:01.320230760Z [2024-04-06T03:06:01.319+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:05:00+00:00 exited with status queued for try_number 1 2024-04-06T03:06:01.320473985Z [2024-04-06T03:06:01.320+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:05:00+00:00 exited with status queued for try_number 1 2024-04-06T03:06:01.331105527Z [2024-04-06T03:06:01.330+0000] {scheduler_job.py:635} INFO - Setting external_id for to 752fdffd-1ff3-4280-9f3a-1ec2253a97bb 2024-04-06T03:06:01.331310381Z [2024-04-06T03:06:01.331+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23e0217f-e16f-4a36-bdb7-01e6436a7f85 2024-04-06T03:06:01.331529294Z [2024-04-06T03:06:01.331+0000] {scheduler_job.py:635} INFO - Setting external_id for to d82f70b5-fc58-4af3-b5c7-cdce7a5a374e 2024-04-06T03:06:03.684464044Z [2024-04-06T03:06:03.684+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:06:03.686530410Z [2024-04-06T03:06:03.686+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 03:04:00+00:00, run_id=scheduled__2024-04-06T03:04:00+00:00, run_start_date=2024-04-06 03:06:00.871185+00:00, run_end_date=2024-04-06 03:06:03.684396+00:00, run_duration=2.813211, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:04:00+00:00, data_interval_end=2024-04-06 03:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T03:06:03.706612214Z [2024-04-06T03:06:03.706+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T03:06:00+00:00, run_after=2024-04-06T03:08:00+00:00 2024-04-06T03:06:03.799058218Z [2024-04-06T03:06:03.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:04:00+00:00 exited with status success for try_number 1 2024-04-06T03:06:03.806612970Z [2024-04-06T03:06:03.805+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T03:04:00+00:00, map_index=-1, run_start_date=2024-04-06 03:06:01.933742+00:00, run_end_date=2024-04-06 03:06:02.830645+00:00, run_duration=0.896903, state=success, executor_state=success, try_number=1, max_tries=1, job_id=335, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:06:00.932955+00:00, queued_by_job_id=2, pid=7569 2024-04-06T03:06:05.953503916Z [2024-04-06T03:06:05.953+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:06:05.953785774Z [2024-04-06T03:06:05.953+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:05:00+00:00, run_id=scheduled__2024-04-06T03:05:00+00:00, run_start_date=2024-04-06 03:06:00.873954+00:00, run_end_date=2024-04-06 03:06:05.953409+00:00, run_duration=5.079455, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:05:00+00:00, data_interval_end=2024-04-06 03:06:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:06:05.962538718Z [2024-04-06T03:06:05.962+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:06:00+00:00, run_after=2024-04-06T03:07:00+00:00 2024-04-06T03:06:05.968289194Z [2024-04-06T03:06:05.967+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:06:05.968406777Z [2024-04-06T03:06:05.968+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:05:00+00:00, run_id=scheduled__2024-04-06T03:05:00+00:00, run_start_date=2024-04-06 03:06:00.875324+00:00, run_end_date=2024-04-06 03:06:05.968055+00:00, run_duration=5.092731, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:05:00+00:00, data_interval_end=2024-04-06 03:06:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:06:05.983265714Z [2024-04-06T03:06:05.982+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:06:00+00:00, run_after=2024-04-06T03:07:00+00:00 2024-04-06T03:06:06.022189301Z [2024-04-06T03:06:06.021+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:05:00+00:00 exited with status success for try_number 1 2024-04-06T03:06:06.022285432Z [2024-04-06T03:06:06.022+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:05:00+00:00 exited with status success for try_number 1 2024-04-06T03:06:06.028497882Z [2024-04-06T03:06:06.028+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:05:00+00:00, map_index=-1, run_start_date=2024-04-06 03:06:03.420488+00:00, run_end_date=2024-04-06 03:06:05.452808+00:00, run_duration=2.03232, state=success, executor_state=success, try_number=1, max_tries=1, job_id=337, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:06:00.932955+00:00, queued_by_job_id=2, pid=7599 2024-04-06T03:06:06.029270429Z [2024-04-06T03:06:06.029+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:05:00+00:00, map_index=-1, run_start_date=2024-04-06 03:06:03.419512+00:00, run_end_date=2024-04-06 03:06:05.109109+00:00, run_duration=1.689597, state=success, executor_state=success, try_number=1, max_tries=1, job_id=336, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:06:00.932955+00:00, queued_by_job_id=2, pid=7600 2024-04-06T03:07:00.741699356Z [2024-04-06T03:07:00.737+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:07:00.760444813Z [2024-04-06T03:07:00.760+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:07:00+00:00, run_after=2024-04-06T03:08:00+00:00 2024-04-06T03:07:00.814085541Z [2024-04-06T03:07:00.813+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T03:07:00.814109898Z 2024-04-06T03:07:00.814125529Z 2024-04-06T03:07:00.814134414Z [2024-04-06T03:07:00.813+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:07:00.814452641Z [2024-04-06T03:07:00.814+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:07:00.815014454Z [2024-04-06T03:07:00.814+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:07:00.815024442Z 2024-04-06T03:07:00.815027763Z 2024-04-06T03:07:00.819609154Z [2024-04-06T03:07:00.819+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:07:00.819711623Z [2024-04-06T03:07:00.819+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:07:00.820131818Z [2024-04-06T03:07:00.819+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:07:00.820433420Z [2024-04-06T03:07:00.820+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:07:01.068432285Z [2024-04-06T03:07:01.067+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:06:00+00:00 exited with status queued for try_number 1 2024-04-06T03:07:01.068791611Z [2024-04-06T03:07:01.068+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:06:00+00:00 exited with status queued for try_number 1 2024-04-06T03:07:01.087391247Z [2024-04-06T03:07:01.087+0000] {scheduler_job.py:635} INFO - Setting external_id for to c4ae1c68-c708-40f4-8118-43995e6a7e62 2024-04-06T03:07:01.087658367Z [2024-04-06T03:07:01.087+0000] {scheduler_job.py:635} INFO - Setting external_id for to aef509c4-dda5-48ab-a75b-f8f69fccbd6b 2024-04-06T03:07:05.612279644Z [2024-04-06T03:07:05.611+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:07:05.613059917Z [2024-04-06T03:07:05.612+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:06:00+00:00, run_id=scheduled__2024-04-06T03:06:00+00:00, run_start_date=2024-04-06 03:07:00.774720+00:00, run_end_date=2024-04-06 03:07:05.612566+00:00, run_duration=4.837846, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:06:00+00:00, data_interval_end=2024-04-06 03:07:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:07:05.621640794Z [2024-04-06T03:07:05.621+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:07:00+00:00, run_after=2024-04-06T03:08:00+00:00 2024-04-06T03:07:05.627545128Z [2024-04-06T03:07:05.627+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:07:05.627838301Z [2024-04-06T03:07:05.627+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:06:00+00:00, run_id=scheduled__2024-04-06T03:06:00+00:00, run_start_date=2024-04-06 03:07:00.776136+00:00, run_end_date=2024-04-06 03:07:05.627566+00:00, run_duration=4.85143, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:06:00+00:00, data_interval_end=2024-04-06 03:07:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:07:05.636163764Z [2024-04-06T03:07:05.635+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:07:00+00:00, run_after=2024-04-06T03:08:00+00:00 2024-04-06T03:07:05.667775652Z [2024-04-06T03:07:05.667+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:06:00+00:00 exited with status success for try_number 1 2024-04-06T03:07:05.668018446Z [2024-04-06T03:07:05.667+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:06:00+00:00 exited with status success for try_number 1 2024-04-06T03:07:05.674794078Z [2024-04-06T03:07:05.674+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:06:00+00:00, map_index=-1, run_start_date=2024-04-06 03:07:03.029362+00:00, run_end_date=2024-04-06 03:07:04.861038+00:00, run_duration=1.831676, state=success, executor_state=success, try_number=1, max_tries=1, job_id=338, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:07:00.816887+00:00, queued_by_job_id=2, pid=7654 2024-04-06T03:07:05.675180422Z [2024-04-06T03:07:05.674+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:06:00+00:00, map_index=-1, run_start_date=2024-04-06 03:07:03.078824+00:00, run_end_date=2024-04-06 03:07:05.528010+00:00, run_duration=2.449186, state=success, executor_state=success, try_number=1, max_tries=1, job_id=339, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:07:00.816887+00:00, queued_by_job_id=2, pid=7655 2024-04-06T03:08:00.146958459Z [2024-04-06T03:08:00.145+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:08:00.170579613Z [2024-04-06T03:08:00.170+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:08:00+00:00, run_after=2024-04-06T03:09:00+00:00 2024-04-06T03:08:00.180008345Z [2024-04-06T03:08:00.179+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:08:00.255547267Z [2024-04-06T03:08:00.255+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T03:08:00.255578481Z 2024-04-06T03:08:00.255585835Z 2024-04-06T03:08:00.255592007Z 2024-04-06T03:08:00.255789748Z [2024-04-06T03:08:00.255+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T03:08:00.255950194Z [2024-04-06T03:08:00.255+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:08:00.256110421Z [2024-04-06T03:08:00.255+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:08:00.257436023Z [2024-04-06T03:08:00.257+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:08:00.257467249Z 2024-04-06T03:08:00.257481972Z 2024-04-06T03:08:00.257488126Z 2024-04-06T03:08:00.260924125Z [2024-04-06T03:08:00.260+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T03:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:08:00.261109175Z [2024-04-06T03:08:00.260+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:08:00.261390138Z [2024-04-06T03:08:00.261+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:08:00.261564326Z [2024-04-06T03:08:00.261+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:08:00.262020347Z [2024-04-06T03:08:00.261+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:08:00.262298103Z [2024-04-06T03:08:00.262+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:08:00.528511001Z [2024-04-06T03:08:00.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:06:00+00:00 exited with status queued for try_number 1 2024-04-06T03:08:00.528756312Z [2024-04-06T03:08:00.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:07:00+00:00 exited with status queued for try_number 1 2024-04-06T03:08:00.528991556Z [2024-04-06T03:08:00.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:07:00+00:00 exited with status queued for try_number 1 2024-04-06T03:08:00.538859892Z [2024-04-06T03:08:00.538+0000] {scheduler_job.py:635} INFO - Setting external_id for to 425c5d9f-6873-4d85-b6a5-cc8a3ec6e1ea 2024-04-06T03:08:00.539096837Z [2024-04-06T03:08:00.538+0000] {scheduler_job.py:635} INFO - Setting external_id for to f5685b03-7b01-4d10-8561-52389ab80701 2024-04-06T03:08:00.539376866Z [2024-04-06T03:08:00.539+0000] {scheduler_job.py:635} INFO - Setting external_id for to adba5137-4167-4af6-a346-420b0c8f0592 2024-04-06T03:08:01.677956601Z [2024-04-06T03:08:01.669+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:08:01.677986026Z [2024-04-06T03:08:01.669+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 03:06:00+00:00, run_id=scheduled__2024-04-06T03:06:00+00:00, run_start_date=2024-04-06 03:08:00.191637+00:00, run_end_date=2024-04-06 03:08:01.669527+00:00, run_duration=1.47789, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:06:00+00:00, data_interval_end=2024-04-06 03:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T03:08:01.682638237Z [2024-04-06T03:08:01.682+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T03:08:00+00:00, run_after=2024-04-06T03:10:00+00:00 2024-04-06T03:08:02.142766215Z [2024-04-06T03:08:02.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:06:00+00:00 exited with status success for try_number 1 2024-04-06T03:08:02.151099075Z [2024-04-06T03:08:02.150+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T03:06:00+00:00, map_index=-1, run_start_date=2024-04-06 03:08:01.087599+00:00, run_end_date=2024-04-06 03:08:01.639966+00:00, run_duration=0.552367, state=success, executor_state=success, try_number=1, max_tries=1, job_id=340, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:08:00.258145+00:00, queued_by_job_id=2, pid=7691 2024-04-06T03:08:05.412629068Z [2024-04-06T03:08:05.412+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:08:05.413178374Z [2024-04-06T03:08:05.412+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:07:00+00:00, run_id=scheduled__2024-04-06T03:07:00+00:00, run_start_date=2024-04-06 03:08:00.193136+00:00, run_end_date=2024-04-06 03:08:05.412709+00:00, run_duration=5.219573, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:07:00+00:00, data_interval_end=2024-04-06 03:08:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:08:05.431544808Z [2024-04-06T03:08:05.431+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:08:00+00:00, run_after=2024-04-06T03:09:00+00:00 2024-04-06T03:08:05.449154642Z [2024-04-06T03:08:05.448+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:08:05.450316049Z [2024-04-06T03:08:05.449+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:07:00+00:00, run_id=scheduled__2024-04-06T03:07:00+00:00, run_start_date=2024-04-06 03:08:00.194763+00:00, run_end_date=2024-04-06 03:08:05.449732+00:00, run_duration=5.254969, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:07:00+00:00, data_interval_end=2024-04-06 03:08:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:08:05.489363606Z [2024-04-06T03:08:05.488+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:08:00+00:00, run_after=2024-04-06T03:09:00+00:00 2024-04-06T03:08:05.526078863Z [2024-04-06T03:08:05.525+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:07:00+00:00 exited with status success for try_number 1 2024-04-06T03:08:05.526321739Z [2024-04-06T03:08:05.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:07:00+00:00 exited with status success for try_number 1 2024-04-06T03:08:05.535811491Z [2024-04-06T03:08:05.535+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:07:00+00:00, map_index=-1, run_start_date=2024-04-06 03:08:02.957370+00:00, run_end_date=2024-04-06 03:08:04.688005+00:00, run_duration=1.730635, state=success, executor_state=success, try_number=1, max_tries=1, job_id=342, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:08:00.258145+00:00, queued_by_job_id=2, pid=7722 2024-04-06T03:08:05.536183995Z [2024-04-06T03:08:05.535+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:07:00+00:00, map_index=-1, run_start_date=2024-04-06 03:08:02.444977+00:00, run_end_date=2024-04-06 03:08:04.700288+00:00, run_duration=2.255311, state=success, executor_state=success, try_number=1, max_tries=1, job_id=341, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:08:00.258145+00:00, queued_by_job_id=2, pid=7712 2024-04-06T03:09:00.609875567Z [2024-04-06T03:09:00.609+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:09:00+00:00, run_after=2024-04-06T03:10:00+00:00 2024-04-06T03:09:00.620087858Z [2024-04-06T03:09:00.619+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:09:00.694290859Z [2024-04-06T03:09:00.693+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T03:09:00.694346628Z 2024-04-06T03:09:00.694356638Z 2024-04-06T03:09:00.694365193Z [2024-04-06T03:09:00.693+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:09:00.697219372Z [2024-04-06T03:09:00.694+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:09:00.697262754Z [2024-04-06T03:09:00.694+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:09:00.697272071Z 2024-04-06T03:09:00.697280846Z 2024-04-06T03:09:00.699716792Z [2024-04-06T03:09:00.698+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:09:00.699754177Z [2024-04-06T03:09:00.699+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:09:00.699761645Z [2024-04-06T03:09:00.699+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:09:00.699767586Z [2024-04-06T03:09:00.699+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:09:00.974949122Z [2024-04-06T03:09:00.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:08:00+00:00 exited with status queued for try_number 1 2024-04-06T03:09:00.975145099Z [2024-04-06T03:09:00.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:08:00+00:00 exited with status queued for try_number 1 2024-04-06T03:09:00.986443701Z [2024-04-06T03:09:00.986+0000] {scheduler_job.py:635} INFO - Setting external_id for to fd60f16a-1d10-4b81-b4f2-6602434dcef0 2024-04-06T03:09:00.986634474Z [2024-04-06T03:09:00.986+0000] {scheduler_job.py:635} INFO - Setting external_id for to 09a37309-b6a9-460f-8cc4-ee4ee60acfd9 2024-04-06T03:09:05.515492586Z [2024-04-06T03:09:05.515+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:09:05.515841802Z [2024-04-06T03:09:05.515+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:08:00+00:00, run_id=scheduled__2024-04-06T03:08:00+00:00, run_start_date=2024-04-06 03:09:00.636059+00:00, run_end_date=2024-04-06 03:09:05.515373+00:00, run_duration=4.879314, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:08:00+00:00, data_interval_end=2024-04-06 03:09:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:09:05.526066767Z [2024-04-06T03:09:05.525+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:09:00+00:00, run_after=2024-04-06T03:10:00+00:00 2024-04-06T03:09:05.570146702Z [2024-04-06T03:09:05.569+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:08:00+00:00 exited with status success for try_number 1 2024-04-06T03:09:05.575753236Z [2024-04-06T03:09:05.575+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:08:00+00:00, map_index=-1, run_start_date=2024-04-06 03:09:03.073960+00:00, run_end_date=2024-04-06 03:09:05.325784+00:00, run_duration=2.251824, state=success, executor_state=success, try_number=1, max_tries=1, job_id=344, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:09:00.695851+00:00, queued_by_job_id=2, pid=7778 2024-04-06T03:09:06.614280037Z [2024-04-06T03:09:06.613+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:09:06.614442537Z [2024-04-06T03:09:06.614+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:08:00+00:00, run_id=scheduled__2024-04-06T03:08:00+00:00, run_start_date=2024-04-06 03:09:00.637535+00:00, run_end_date=2024-04-06 03:09:06.614055+00:00, run_duration=5.97652, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:08:00+00:00, data_interval_end=2024-04-06 03:09:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:09:06.623958318Z [2024-04-06T03:09:06.623+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:09:00+00:00, run_after=2024-04-06T03:10:00+00:00 2024-04-06T03:09:06.661385853Z [2024-04-06T03:09:06.660+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:08:00+00:00 exited with status success for try_number 1 2024-04-06T03:09:06.669798627Z [2024-04-06T03:09:06.669+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:08:00+00:00, map_index=-1, run_start_date=2024-04-06 03:09:02.796450+00:00, run_end_date=2024-04-06 03:09:05.954358+00:00, run_duration=3.157908, state=success, executor_state=success, try_number=1, max_tries=1, job_id=343, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:09:00.695851+00:00, queued_by_job_id=2, pid=7770 2024-04-06T03:10:00.381710383Z [2024-04-06T03:10:00.380+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:10:00+00:00, run_after=2024-04-06T03:15:00+00:00 2024-04-06T03:10:00.400179003Z [2024-04-06T03:10:00.399+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:10:00.412767902Z [2024-04-06T03:10:00.412+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:10:00.438816823Z [2024-04-06T03:10:00.438+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:10:00+00:00, run_after=2024-04-06T03:11:00+00:00 2024-04-06T03:10:00.547820052Z [2024-04-06T03:10:00.547+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-06T03:10:00.547855485Z 2024-04-06T03:10:00.547862220Z 2024-04-06T03:10:00.547868820Z 2024-04-06T03:10:00.547874445Z 2024-04-06T03:10:00.547880402Z [2024-04-06T03:10:00.547+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:10:00.548033315Z [2024-04-06T03:10:00.547+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T03:10:00.548046255Z [2024-04-06T03:10:00.547+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:10:00.548109572Z [2024-04-06T03:10:00.547+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:10:00.549021444Z [2024-04-06T03:10:00.548+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:10:00.549035020Z 2024-04-06T03:10:00.549042116Z 2024-04-06T03:10:00.549073201Z 2024-04-06T03:10:00.549080541Z 2024-04-06T03:10:00.553630304Z [2024-04-06T03:10:00.553+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-06T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-06T03:10:00.553650923Z [2024-04-06T03:10:00.553+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:10:00.553894358Z [2024-04-06T03:10:00.553+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T03:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:10:00.553939863Z [2024-04-06T03:10:00.553+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:10:00.554182241Z [2024-04-06T03:10:00.553+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:10:00.554227800Z [2024-04-06T03:10:00.554+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:10:00.554425135Z [2024-04-06T03:10:00.554+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:10:00.554478847Z [2024-04-06T03:10:00.554+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:10:01.087306557Z [2024-04-06T03:10:01.086+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T03:05:00+00:00 exited with status queued for try_number 1 2024-04-06T03:10:01.087345771Z [2024-04-06T03:10:01.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:08:00+00:00 exited with status queued for try_number 1 2024-04-06T03:10:01.087418508Z [2024-04-06T03:10:01.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:09:00+00:00 exited with status queued for try_number 1 2024-04-06T03:10:01.087489039Z [2024-04-06T03:10:01.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:09:00+00:00 exited with status queued for try_number 1 2024-04-06T03:10:01.111716540Z [2024-04-06T03:10:01.111+0000] {scheduler_job.py:635} INFO - Setting external_id for to a99452a9-d5a1-412b-9084-c0f493b1c2d0 2024-04-06T03:10:01.111790331Z [2024-04-06T03:10:01.111+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1661fc88-e31c-486d-a2fa-3cd7683b2f26 2024-04-06T03:10:01.111932848Z [2024-04-06T03:10:01.111+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2a5033ed-14c0-435d-b8f1-54918afb1b80 2024-04-06T03:10:01.112014157Z [2024-04-06T03:10:01.111+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62de4059-db6b-451c-a707-7b4e3373ce8a 2024-04-06T03:10:03.984895811Z [2024-04-06T03:10:03.984+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:10:03.992733552Z [2024-04-06T03:10:03.992+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 03:08:00+00:00, run_id=scheduled__2024-04-06T03:08:00+00:00, run_start_date=2024-04-06 03:10:00.458095+00:00, run_end_date=2024-04-06 03:10:03.984823+00:00, run_duration=3.526728, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:08:00+00:00, data_interval_end=2024-04-06 03:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T03:10:04.031065347Z [2024-04-06T03:10:04.030+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T03:10:00+00:00, run_after=2024-04-06T03:12:00+00:00 2024-04-06T03:10:04.240038903Z [2024-04-06T03:10:04.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:08:00+00:00 exited with status success for try_number 1 2024-04-06T03:10:04.277154700Z [2024-04-06T03:10:04.270+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T03:08:00+00:00, map_index=-1, run_start_date=2024-04-06 03:10:02.024858+00:00, run_end_date=2024-04-06 03:10:03.233703+00:00, run_duration=1.208845, state=success, executor_state=success, try_number=1, max_tries=1, job_id=345, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:10:00.550338+00:00, queued_by_job_id=2, pid=7814 2024-04-06T03:10:05.794420570Z [2024-04-06T03:10:05.793+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:10:05.794461133Z 2024-04-06T03:10:05.798033906Z [2024-04-06T03:10:05.794+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:10:05.798681744Z [2024-04-06T03:10:05.798+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:10:05.798693252Z 2024-04-06T03:10:05.806744661Z [2024-04-06T03:10:05.806+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='split_metrics', run_id='scheduled__2024-04-06T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-06T03:10:05.806942693Z [2024-04-06T03:10:05.806+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:10:05.937287657Z [2024-04-06T03:10:05.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T03:05:00+00:00 exited with status queued for try_number 1 2024-04-06T03:10:05.937431890Z [2024-04-06T03:10:05.937+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T03:05:00+00:00 exited with status success for try_number 1 2024-04-06T03:10:05.956449872Z [2024-04-06T03:10:05.956+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3e5cd62-6da2-4382-b03c-3423bdf1c2bc 2024-04-06T03:10:05.956612603Z [2024-04-06T03:10:05.956+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-06T03:05:00+00:00, map_index=-1, run_start_date=2024-04-06 03:10:04.808005+00:00, run_end_date=2024-04-06 03:10:05.446031+00:00, run_duration=0.638026, state=success, executor_state=success, try_number=1, max_tries=1, job_id=348, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:10:00.550338+00:00, queued_by_job_id=2, pid=7865 2024-04-06T03:10:07.110812979Z [2024-04-06T03:10:07.110+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:10:07.111249188Z [2024-04-06T03:10:07.111+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:09:00+00:00, run_id=scheduled__2024-04-06T03:09:00+00:00, run_start_date=2024-04-06 03:10:00.460853+00:00, run_end_date=2024-04-06 03:10:07.110901+00:00, run_duration=6.650048, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:09:00+00:00, data_interval_end=2024-04-06 03:10:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:10:07.123486055Z [2024-04-06T03:10:07.123+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:10:00+00:00, run_after=2024-04-06T03:11:00+00:00 2024-04-06T03:10:07.129834177Z [2024-04-06T03:10:07.129+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:10:07.130211730Z [2024-04-06T03:10:07.130+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:09:00+00:00, run_id=scheduled__2024-04-06T03:09:00+00:00, run_start_date=2024-04-06 03:10:00.459577+00:00, run_end_date=2024-04-06 03:10:07.129744+00:00, run_duration=6.670167, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:09:00+00:00, data_interval_end=2024-04-06 03:10:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:10:07.140966987Z [2024-04-06T03:10:07.140+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:10:00+00:00, run_after=2024-04-06T03:11:00+00:00 2024-04-06T03:10:07.184483969Z [2024-04-06T03:10:07.184+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:09:00+00:00 exited with status success for try_number 1 2024-04-06T03:10:07.184721903Z [2024-04-06T03:10:07.184+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:09:00+00:00 exited with status success for try_number 1 2024-04-06T03:10:07.190655326Z [2024-04-06T03:10:07.190+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:09:00+00:00, map_index=-1, run_start_date=2024-04-06 03:10:04.148692+00:00, run_end_date=2024-04-06 03:10:06.405841+00:00, run_duration=2.257149, state=success, executor_state=success, try_number=1, max_tries=1, job_id=346, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:10:00.550338+00:00, queued_by_job_id=2, pid=7837 2024-04-06T03:10:07.190878762Z [2024-04-06T03:10:07.190+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:09:00+00:00, map_index=-1, run_start_date=2024-04-06 03:10:04.835457+00:00, run_end_date=2024-04-06 03:10:06.421024+00:00, run_duration=1.585567, state=success, executor_state=success, try_number=1, max_tries=1, job_id=347, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:10:00.550338+00:00, queued_by_job_id=2, pid=7864 2024-04-06T03:10:08.966241138Z [2024-04-06T03:10:08.965+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:10:08.966277594Z 2024-04-06T03:10:08.966560784Z [2024-04-06T03:10:08.966+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:10:08.967377979Z [2024-04-06T03:10:08.967+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:10:08.967406197Z 2024-04-06T03:10:08.970407084Z [2024-04-06T03:10:08.970+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='collect_metrics', run_id='scheduled__2024-04-06T03:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-06T03:10:08.970790463Z [2024-04-06T03:10:08.970+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T03:10:09.036034370Z [2024-04-06T03:10:09.035+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T03:05:00+00:00 exited with status queued for try_number 1 2024-04-06T03:10:09.036346240Z [2024-04-06T03:10:09.036+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T03:05:00+00:00 exited with status success for try_number 1 2024-04-06T03:10:09.045279824Z [2024-04-06T03:10:09.044+0000] {scheduler_job.py:635} INFO - Setting external_id for to dfe2be02-1cb4-4fe9-9b4b-4a78a3905872 2024-04-06T03:10:09.045515896Z [2024-04-06T03:10:09.045+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=split_metrics, run_id=scheduled__2024-04-06T03:05:00+00:00, map_index=-1, run_start_date=2024-04-06 03:10:07.546520+00:00, run_end_date=2024-04-06 03:10:07.888661+00:00, run_duration=0.342141, state=success, executor_state=success, try_number=1, max_tries=1, job_id=349, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:10:05.799206+00:00, queued_by_job_id=2, pid=7895 2024-04-06T03:10:13.042804898Z [2024-04-06T03:10:13.042+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:10:13.042854422Z 2024-04-06T03:10:13.042870364Z [2024-04-06T03:10:13.042+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:10:13.043512506Z [2024-04-06T03:10:13.043+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:10:13.043524981Z 2024-04-06T03:10:13.046788082Z [2024-04-06T03:10:13.046+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='send_prometheus', run_id='scheduled__2024-04-06T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:10:13.046968941Z [2024-04-06T03:10:13.046+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:10:13.362065111Z [2024-04-06T03:10:13.361+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T03:05:00+00:00 exited with status queued for try_number 1 2024-04-06T03:10:13.362188455Z [2024-04-06T03:10:13.361+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T03:05:00+00:00 exited with status success for try_number 1 2024-04-06T03:10:13.370419028Z [2024-04-06T03:10:13.369+0000] {scheduler_job.py:635} INFO - Setting external_id for to 52b04c94-8312-4682-b9bf-2fe5ded186b8 2024-04-06T03:10:13.370690345Z [2024-04-06T03:10:13.370+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=collect_metrics, run_id=scheduled__2024-04-06T03:05:00+00:00, map_index=0, run_start_date=2024-04-06 03:10:10.996306+00:00, run_end_date=2024-04-06 03:10:12.326812+00:00, run_duration=1.330506, state=success, executor_state=success, try_number=1, max_tries=1, job_id=350, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:10:08.968019+00:00, queued_by_job_id=2, pid=7920 2024-04-06T03:10:15.943634667Z [2024-04-06T03:10:15.943+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:10:15.944333019Z [2024-04-06T03:10:15.943+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:05:00+00:00, run_id=scheduled__2024-04-06T03:05:00+00:00, run_start_date=2024-04-06 03:10:00.456388+00:00, run_end_date=2024-04-06 03:10:15.943514+00:00, run_duration=15.487126, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:05:00+00:00, data_interval_end=2024-04-06 03:10:00+00:00, dag_hash=eecc559ff32fe9a7c4345875f113a0a9 2024-04-06T03:10:15.953949601Z [2024-04-06T03:10:15.953+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:10:00+00:00, run_after=2024-04-06T03:15:00+00:00 2024-04-06T03:10:16.022138216Z [2024-04-06T03:10:16.021+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T03:05:00+00:00 exited with status success for try_number 1 2024-04-06T03:10:16.028656910Z [2024-04-06T03:10:16.028+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=send_prometheus, run_id=scheduled__2024-04-06T03:05:00+00:00, map_index=-1, run_start_date=2024-04-06 03:10:14.832691+00:00, run_end_date=2024-04-06 03:10:15.276659+00:00, run_duration=0.443968, state=success, executor_state=success, try_number=1, max_tries=1, job_id=351, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:10:13.043920+00:00, queued_by_job_id=2, pid=7941 2024-04-06T03:10:20.508293367Z [2024-04-06T03:10:20.507+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-06T03:11:00.455395469Z [2024-04-06T03:11:00.454+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:11:00+00:00, run_after=2024-04-06T03:12:00+00:00 2024-04-06T03:11:00.462843798Z [2024-04-06T03:11:00.462+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:11:00.511141138Z [2024-04-06T03:11:00.510+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T03:11:00.511172248Z 2024-04-06T03:11:00.511179625Z 2024-04-06T03:11:00.511280017Z [2024-04-06T03:11:00.511+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:11:00.511448130Z [2024-04-06T03:11:00.511+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:11:00.512013987Z [2024-04-06T03:11:00.511+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:11:00.512030933Z 2024-04-06T03:11:00.512075307Z 2024-04-06T03:11:00.514611399Z [2024-04-06T03:11:00.514+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:11:00.514794646Z [2024-04-06T03:11:00.514+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:11:00.515018197Z [2024-04-06T03:11:00.514+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:11:00.515163097Z [2024-04-06T03:11:00.515+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:11:00.770339244Z [2024-04-06T03:11:00.760+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:10:00+00:00 exited with status queued for try_number 1 2024-04-06T03:11:00.770363395Z [2024-04-06T03:11:00.760+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:10:00+00:00 exited with status queued for try_number 1 2024-04-06T03:11:00.787074875Z [2024-04-06T03:11:00.784+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35489eb4-74b9-4496-9235-c9538232427b 2024-04-06T03:11:00.787098553Z [2024-04-06T03:11:00.786+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e397704-9b70-4c7e-bd85-409a5b750e69 2024-04-06T03:11:05.540688888Z [2024-04-06T03:11:05.540+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:11:05.541060809Z [2024-04-06T03:11:05.540+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:10:00+00:00, run_id=scheduled__2024-04-06T03:10:00+00:00, run_start_date=2024-04-06 03:11:00.472723+00:00, run_end_date=2024-04-06 03:11:05.540720+00:00, run_duration=5.067997, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:10:00+00:00, data_interval_end=2024-04-06 03:11:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:11:05.549575039Z [2024-04-06T03:11:05.549+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:11:00+00:00, run_after=2024-04-06T03:12:00+00:00 2024-04-06T03:11:05.555148576Z [2024-04-06T03:11:05.554+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:11:05.555441779Z [2024-04-06T03:11:05.555+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:10:00+00:00, run_id=scheduled__2024-04-06T03:10:00+00:00, run_start_date=2024-04-06 03:11:00.473981+00:00, run_end_date=2024-04-06 03:11:05.555163+00:00, run_duration=5.081182, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:10:00+00:00, data_interval_end=2024-04-06 03:11:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:11:05.563384712Z [2024-04-06T03:11:05.563+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:11:00+00:00, run_after=2024-04-06T03:12:00+00:00 2024-04-06T03:11:05.602586068Z [2024-04-06T03:11:05.593+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:10:00+00:00 exited with status success for try_number 1 2024-04-06T03:11:05.603197922Z [2024-04-06T03:11:05.602+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:10:00+00:00 exited with status success for try_number 1 2024-04-06T03:11:05.614573343Z [2024-04-06T03:11:05.614+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:10:00+00:00, map_index=-1, run_start_date=2024-04-06 03:11:03.509466+00:00, run_end_date=2024-04-06 03:11:05.381552+00:00, run_duration=1.872086, state=success, executor_state=success, try_number=1, max_tries=1, job_id=353, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:11:00.512583+00:00, queued_by_job_id=2, pid=7967 2024-04-06T03:11:05.614851754Z [2024-04-06T03:11:05.614+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:10:00+00:00, map_index=-1, run_start_date=2024-04-06 03:11:02.971780+00:00, run_end_date=2024-04-06 03:11:04.954908+00:00, run_duration=1.983128, state=success, executor_state=success, try_number=1, max_tries=1, job_id=352, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:11:00.512583+00:00, queued_by_job_id=2, pid=7955 2024-04-06T03:12:00.862165567Z [2024-04-06T03:12:00.861+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:12:00+00:00, run_after=2024-04-06T03:13:00+00:00 2024-04-06T03:12:00.873892878Z [2024-04-06T03:12:00.873+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:12:00.883293804Z [2024-04-06T03:12:00.882+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:12:00.970444601Z [2024-04-06T03:12:00.970+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T03:12:00.970467978Z 2024-04-06T03:12:00.970472698Z 2024-04-06T03:12:00.970476282Z 2024-04-06T03:12:00.970546306Z [2024-04-06T03:12:00.970+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T03:12:00.970681109Z [2024-04-06T03:12:00.970+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:12:00.970812647Z [2024-04-06T03:12:00.970+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:12:00.971381543Z [2024-04-06T03:12:00.971+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:12:00.971394381Z 2024-04-06T03:12:00.971398503Z 2024-04-06T03:12:00.971402669Z 2024-04-06T03:12:00.975085924Z [2024-04-06T03:12:00.974+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:12:00.975274454Z [2024-04-06T03:12:00.975+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:12:00.975588170Z [2024-04-06T03:12:00.975+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:12:00.975821709Z [2024-04-06T03:12:00.975+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:12:00.976271912Z [2024-04-06T03:12:00.976+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:12:00.976443557Z [2024-04-06T03:12:00.976+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:12:01.335173940Z [2024-04-06T03:12:01.334+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:10:00+00:00 exited with status queued for try_number 1 2024-04-06T03:12:01.335414140Z [2024-04-06T03:12:01.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:11:00+00:00 exited with status queued for try_number 1 2024-04-06T03:12:01.335605406Z [2024-04-06T03:12:01.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:11:00+00:00 exited with status queued for try_number 1 2024-04-06T03:12:01.345111834Z [2024-04-06T03:12:01.344+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2671aad5-1963-477a-924c-a28fdcc92a96 2024-04-06T03:12:01.346021708Z [2024-04-06T03:12:01.345+0000] {scheduler_job.py:635} INFO - Setting external_id for to 249447a8-fa25-4d7b-9bbc-3844d85ba88b 2024-04-06T03:12:01.347066802Z [2024-04-06T03:12:01.346+0000] {scheduler_job.py:635} INFO - Setting external_id for to 21e0b62d-f57d-4674-b4aa-ac2f0895ea4f 2024-04-06T03:12:02.979106392Z [2024-04-06T03:12:02.978+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:12:02.981033301Z [2024-04-06T03:12:02.980+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 03:10:00+00:00, run_id=scheduled__2024-04-06T03:10:00+00:00, run_start_date=2024-04-06 03:12:00.896329+00:00, run_end_date=2024-04-06 03:12:02.980620+00:00, run_duration=2.084291, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:10:00+00:00, data_interval_end=2024-04-06 03:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T03:12:02.998078909Z [2024-04-06T03:12:02.993+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T03:12:00+00:00, run_after=2024-04-06T03:14:00+00:00 2024-04-06T03:12:03.110071622Z [2024-04-06T03:12:03.109+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:10:00+00:00 exited with status success for try_number 1 2024-04-06T03:12:03.117792412Z [2024-04-06T03:12:03.116+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T03:10:00+00:00, map_index=-1, run_start_date=2024-04-06 03:12:02.134696+00:00, run_end_date=2024-04-06 03:12:02.760449+00:00, run_duration=0.625753, state=success, executor_state=success, try_number=1, max_tries=1, job_id=354, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:12:00.972322+00:00, queued_by_job_id=2, pid=8000 2024-04-06T03:12:05.277497695Z [2024-04-06T03:12:05.277+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:12:05.277619823Z [2024-04-06T03:12:05.277+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:11:00+00:00, run_id=scheduled__2024-04-06T03:11:00+00:00, run_start_date=2024-04-06 03:12:00.897642+00:00, run_end_date=2024-04-06 03:12:05.277396+00:00, run_duration=4.379754, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:11:00+00:00, data_interval_end=2024-04-06 03:12:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:12:05.288749245Z [2024-04-06T03:12:05.288+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:12:00+00:00, run_after=2024-04-06T03:13:00+00:00 2024-04-06T03:12:05.329343584Z [2024-04-06T03:12:05.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:11:00+00:00 exited with status success for try_number 1 2024-04-06T03:12:05.336106019Z [2024-04-06T03:12:05.335+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:11:00+00:00, map_index=-1, run_start_date=2024-04-06 03:12:03.396327+00:00, run_end_date=2024-04-06 03:12:04.709079+00:00, run_duration=1.312752, state=success, executor_state=success, try_number=1, max_tries=1, job_id=355, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:12:00.972322+00:00, queued_by_job_id=2, pid=8021 2024-04-06T03:12:08.064086620Z [2024-04-06T03:12:08.063+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:12:08.065248144Z [2024-04-06T03:12:08.064+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:11:00+00:00, run_id=scheduled__2024-04-06T03:11:00+00:00, run_start_date=2024-04-06 03:12:00.898805+00:00, run_end_date=2024-04-06 03:12:08.063976+00:00, run_duration=7.165171, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:11:00+00:00, data_interval_end=2024-04-06 03:12:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:12:08.076596105Z [2024-04-06T03:12:08.076+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:12:00+00:00, run_after=2024-04-06T03:13:00+00:00 2024-04-06T03:12:08.124414212Z [2024-04-06T03:12:08.123+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:11:00+00:00 exited with status success for try_number 1 2024-04-06T03:12:08.128691506Z [2024-04-06T03:12:08.128+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:11:00+00:00, map_index=-1, run_start_date=2024-04-06 03:12:04.255071+00:00, run_end_date=2024-04-06 03:12:07.134288+00:00, run_duration=2.879217, state=success, executor_state=success, try_number=1, max_tries=1, job_id=356, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:12:00.972322+00:00, queued_by_job_id=2, pid=8040 2024-04-06T03:13:00.245090700Z [2024-04-06T03:13:00.243+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:13:00.266697216Z [2024-04-06T03:13:00.266+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:13:00+00:00, run_after=2024-04-06T03:14:00+00:00 2024-04-06T03:13:00.348901086Z [2024-04-06T03:13:00.348+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T03:13:00.348992534Z 2024-04-06T03:13:00.349004299Z 2024-04-06T03:13:00.349025896Z [2024-04-06T03:13:00.348+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:13:00.349103669Z [2024-04-06T03:13:00.348+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:13:00.349419661Z [2024-04-06T03:13:00.349+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:13:00.349457640Z 2024-04-06T03:13:00.349467588Z 2024-04-06T03:13:00.353914177Z [2024-04-06T03:13:00.353+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:13:00.354334373Z [2024-04-06T03:13:00.353+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:13:00.354819494Z [2024-04-06T03:13:00.354+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:13:00.355037225Z [2024-04-06T03:13:00.354+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:13:00.633740895Z [2024-04-06T03:13:00.633+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:12:00+00:00 exited with status queued for try_number 1 2024-04-06T03:13:00.633794272Z [2024-04-06T03:13:00.633+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:12:00+00:00 exited with status queued for try_number 1 2024-04-06T03:13:00.650076021Z [2024-04-06T03:13:00.649+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa19595e-04bc-4450-a3fb-32db9c46880b 2024-04-06T03:13:00.650746413Z [2024-04-06T03:13:00.650+0000] {scheduler_job.py:635} INFO - Setting external_id for to 65b941ec-57a6-4a3f-878f-9b1b37655243 2024-04-06T03:13:05.183695179Z [2024-04-06T03:13:05.183+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:13:05.184409324Z [2024-04-06T03:13:05.184+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:12:00+00:00, run_id=scheduled__2024-04-06T03:12:00+00:00, run_start_date=2024-04-06 03:13:00.279741+00:00, run_end_date=2024-04-06 03:13:05.183860+00:00, run_duration=4.904119, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:12:00+00:00, data_interval_end=2024-04-06 03:13:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:13:05.196786607Z [2024-04-06T03:13:05.196+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:13:00+00:00, run_after=2024-04-06T03:14:00+00:00 2024-04-06T03:13:05.246226030Z [2024-04-06T03:13:05.245+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:12:00+00:00 exited with status success for try_number 1 2024-04-06T03:13:05.250900436Z [2024-04-06T03:13:05.250+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:12:00+00:00, map_index=-1, run_start_date=2024-04-06 03:13:02.547457+00:00, run_end_date=2024-04-06 03:13:04.441999+00:00, run_duration=1.894542, state=success, executor_state=success, try_number=1, max_tries=1, job_id=358, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:13:00.349988+00:00, queued_by_job_id=2, pid=8087 2024-04-06T03:13:06.311231882Z [2024-04-06T03:13:06.310+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:13:06.312478253Z [2024-04-06T03:13:06.311+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:12:00+00:00, run_id=scheduled__2024-04-06T03:12:00+00:00, run_start_date=2024-04-06 03:13:00.282842+00:00, run_end_date=2024-04-06 03:13:06.311048+00:00, run_duration=6.028206, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:12:00+00:00, data_interval_end=2024-04-06 03:13:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:13:06.342343745Z [2024-04-06T03:13:06.341+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:13:00+00:00, run_after=2024-04-06T03:14:00+00:00 2024-04-06T03:13:06.390914073Z [2024-04-06T03:13:06.390+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:12:00+00:00 exited with status success for try_number 1 2024-04-06T03:13:06.400194542Z [2024-04-06T03:13:06.399+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:12:00+00:00, map_index=-1, run_start_date=2024-04-06 03:13:02.498141+00:00, run_end_date=2024-04-06 03:13:05.165410+00:00, run_duration=2.667269, state=success, executor_state=success, try_number=1, max_tries=1, job_id=357, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:13:00.349988+00:00, queued_by_job_id=2, pid=8086 2024-04-06T03:14:00.965042903Z [2024-04-06T03:14:00.964+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:14:00.984774858Z [2024-04-06T03:14:00.984+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:14:00+00:00, run_after=2024-04-06T03:15:00+00:00 2024-04-06T03:14:00.995347066Z [2024-04-06T03:14:00.995+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:14:01.089168996Z [2024-04-06T03:14:01.088+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T03:14:01.089206686Z 2024-04-06T03:14:01.089217955Z 2024-04-06T03:14:01.089226831Z 2024-04-06T03:14:01.089284535Z [2024-04-06T03:14:01.089+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T03:14:01.089408477Z [2024-04-06T03:14:01.089+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:14:01.089453495Z [2024-04-06T03:14:01.089+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:14:01.090178079Z [2024-04-06T03:14:01.089+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:14:01.090203215Z 2024-04-06T03:14:01.090239275Z 2024-04-06T03:14:01.090249444Z 2024-04-06T03:14:01.093229751Z [2024-04-06T03:14:01.093+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:14:01.093363338Z [2024-04-06T03:14:01.093+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:14:01.093627667Z [2024-04-06T03:14:01.093+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:14:01.093755701Z [2024-04-06T03:14:01.093+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:14:01.094069930Z [2024-04-06T03:14:01.093+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:14:01.094192442Z [2024-04-06T03:14:01.094+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:14:01.431358530Z [2024-04-06T03:14:01.430+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:12:00+00:00 exited with status queued for try_number 1 2024-04-06T03:14:01.431541568Z [2024-04-06T03:14:01.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:13:00+00:00 exited with status queued for try_number 1 2024-04-06T03:14:01.431652014Z [2024-04-06T03:14:01.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:13:00+00:00 exited with status queued for try_number 1 2024-04-06T03:14:01.449441852Z [2024-04-06T03:14:01.449+0000] {scheduler_job.py:635} INFO - Setting external_id for to ec8f3cb6-ea33-4896-b4cd-e935db4bfefb 2024-04-06T03:14:01.450326099Z [2024-04-06T03:14:01.450+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8269c2d4-e016-4073-9cd1-a857aabe813e 2024-04-06T03:14:01.450497934Z [2024-04-06T03:14:01.450+0000] {scheduler_job.py:635} INFO - Setting external_id for to f76c814f-2d40-4294-b96f-77333e6824ee 2024-04-06T03:14:03.959508792Z [2024-04-06T03:14:03.959+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:14:03.960603477Z [2024-04-06T03:14:03.960+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 03:12:00+00:00, run_id=scheduled__2024-04-06T03:12:00+00:00, run_start_date=2024-04-06 03:14:01.022502+00:00, run_end_date=2024-04-06 03:14:03.960227+00:00, run_duration=2.937725, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:12:00+00:00, data_interval_end=2024-04-06 03:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T03:14:03.969631013Z [2024-04-06T03:14:03.969+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T03:14:00+00:00, run_after=2024-04-06T03:16:00+00:00 2024-04-06T03:14:04.095450545Z [2024-04-06T03:14:04.095+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:12:00+00:00 exited with status success for try_number 1 2024-04-06T03:14:04.119119627Z [2024-04-06T03:14:04.118+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T03:12:00+00:00, map_index=-1, run_start_date=2024-04-06 03:14:02.364329+00:00, run_end_date=2024-04-06 03:14:02.783566+00:00, run_duration=0.419237, state=success, executor_state=success, try_number=1, max_tries=1, job_id=359, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:14:01.090998+00:00, queued_by_job_id=2, pid=8122 2024-04-06T03:14:06.286893208Z [2024-04-06T03:14:06.286+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:14:06.287103077Z [2024-04-06T03:14:06.286+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:13:00+00:00, run_id=scheduled__2024-04-06T03:13:00+00:00, run_start_date=2024-04-06 03:14:01.024763+00:00, run_end_date=2024-04-06 03:14:06.286631+00:00, run_duration=5.261868, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:13:00+00:00, data_interval_end=2024-04-06 03:14:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:14:06.296368192Z [2024-04-06T03:14:06.295+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:14:00+00:00, run_after=2024-04-06T03:15:00+00:00 2024-04-06T03:14:06.304077546Z [2024-04-06T03:14:06.303+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:14:06.304389159Z [2024-04-06T03:14:06.304+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:13:00+00:00, run_id=scheduled__2024-04-06T03:13:00+00:00, run_start_date=2024-04-06 03:14:01.038662+00:00, run_end_date=2024-04-06 03:14:06.303980+00:00, run_duration=5.265318, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:13:00+00:00, data_interval_end=2024-04-06 03:14:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:14:06.314174319Z [2024-04-06T03:14:06.313+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:14:00+00:00, run_after=2024-04-06T03:15:00+00:00 2024-04-06T03:14:06.359640160Z [2024-04-06T03:14:06.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:13:00+00:00 exited with status success for try_number 1 2024-04-06T03:14:06.360138796Z [2024-04-06T03:14:06.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:13:00+00:00 exited with status success for try_number 1 2024-04-06T03:14:06.370441779Z [2024-04-06T03:14:06.370+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:13:00+00:00, map_index=-1, run_start_date=2024-04-06 03:14:03.720859+00:00, run_end_date=2024-04-06 03:14:05.625489+00:00, run_duration=1.90463, state=success, executor_state=success, try_number=1, max_tries=1, job_id=360, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:14:01.090998+00:00, queued_by_job_id=2, pid=8152 2024-04-06T03:14:06.371230898Z [2024-04-06T03:14:06.370+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:13:00+00:00, map_index=-1, run_start_date=2024-04-06 03:14:03.886446+00:00, run_end_date=2024-04-06 03:14:06.124680+00:00, run_duration=2.238234, state=success, executor_state=success, try_number=1, max_tries=1, job_id=361, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:14:01.090998+00:00, queued_by_job_id=2, pid=8153 2024-04-06T03:15:00.071156450Z [2024-04-06T03:15:00.070+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:15:00+00:00, run_after=2024-04-06T03:16:00+00:00 2024-04-06T03:15:00.082229525Z [2024-04-06T03:15:00.081+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:15:00.102597926Z [2024-04-06T03:15:00.102+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:15:00+00:00, run_after=2024-04-06T03:20:00+00:00 2024-04-06T03:15:00.195001616Z [2024-04-06T03:15:00.194+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T03:15:00.195066036Z 2024-04-06T03:15:00.195074296Z 2024-04-06T03:15:00.195080809Z 2024-04-06T03:15:00.195086899Z [2024-04-06T03:15:00.194+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:15:00.195128391Z [2024-04-06T03:15:00.194+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:15:00.195211128Z [2024-04-06T03:15:00.195+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:15:00.196446316Z [2024-04-06T03:15:00.196+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:15:00.196491902Z 2024-04-06T03:15:00.196499701Z 2024-04-06T03:15:00.196505735Z 2024-04-06T03:15:00.201084912Z [2024-04-06T03:15:00.200+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-06T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-06T03:15:00.201121106Z [2024-04-06T03:15:00.200+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:15:00.201286860Z [2024-04-06T03:15:00.201+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:15:00.201420768Z [2024-04-06T03:15:00.201+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:15:00.201639154Z [2024-04-06T03:15:00.201+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:15:00.201714037Z [2024-04-06T03:15:00.201+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:15:00.397399635Z [2024-04-06T03:15:00.396+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T03:10:00+00:00 exited with status queued for try_number 1 2024-04-06T03:15:00.397600144Z [2024-04-06T03:15:00.397+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:14:00+00:00 exited with status queued for try_number 1 2024-04-06T03:15:00.398788552Z [2024-04-06T03:15:00.397+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:14:00+00:00 exited with status queued for try_number 1 2024-04-06T03:15:00.414227068Z [2024-04-06T03:15:00.413+0000] {scheduler_job.py:635} INFO - Setting external_id for to f3555b2c-780b-4133-a896-017543a61535 2024-04-06T03:15:00.415834256Z [2024-04-06T03:15:00.415+0000] {scheduler_job.py:635} INFO - Setting external_id for to bfa13ca1-a5d3-4cd2-9462-d2380c4d0c10 2024-04-06T03:15:00.416172814Z [2024-04-06T03:15:00.415+0000] {scheduler_job.py:635} INFO - Setting external_id for to 08faf3f9-d6d1-47a7-82fd-0c96a32fb010 2024-04-06T03:15:04.367942705Z [2024-04-06T03:15:04.367+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:15:04.367979334Z 2024-04-06T03:15:04.368092680Z [2024-04-06T03:15:04.367+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:15:04.368874358Z [2024-04-06T03:15:04.368+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:15:04.368886732Z 2024-04-06T03:15:04.374365254Z [2024-04-06T03:15:04.374+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='split_metrics', run_id='scheduled__2024-04-06T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-06T03:15:04.375221797Z [2024-04-06T03:15:04.375+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:15:04.414571886Z [2024-04-06T03:15:04.414+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T03:10:00+00:00 exited with status queued for try_number 1 2024-04-06T03:15:04.414718256Z [2024-04-06T03:15:04.414+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T03:10:00+00:00 exited with status success for try_number 1 2024-04-06T03:15:04.421774151Z [2024-04-06T03:15:04.421+0000] {scheduler_job.py:635} INFO - Setting external_id for to c80aff28-29ec-4018-8678-37b2e0f13820 2024-04-06T03:15:04.423254377Z [2024-04-06T03:15:04.423+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-06T03:10:00+00:00, map_index=-1, run_start_date=2024-04-06 03:15:03.014341+00:00, run_end_date=2024-04-06 03:15:03.392682+00:00, run_duration=0.378341, state=success, executor_state=success, try_number=1, max_tries=1, job_id=362, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:15:00.197277+00:00, queued_by_job_id=2, pid=8219 2024-04-06T03:15:05.544567413Z [2024-04-06T03:15:05.544+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:15:05.544784350Z [2024-04-06T03:15:05.544+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:14:00+00:00, run_id=scheduled__2024-04-06T03:14:00+00:00, run_start_date=2024-04-06 03:15:00.124434+00:00, run_end_date=2024-04-06 03:15:05.544484+00:00, run_duration=5.42005, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:14:00+00:00, data_interval_end=2024-04-06 03:15:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:15:05.556141557Z [2024-04-06T03:15:05.555+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:15:00+00:00, run_after=2024-04-06T03:16:00+00:00 2024-04-06T03:15:05.568263784Z [2024-04-06T03:15:05.567+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:15:05.568434739Z [2024-04-06T03:15:05.568+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:14:00+00:00, run_id=scheduled__2024-04-06T03:14:00+00:00, run_start_date=2024-04-06 03:15:00.128496+00:00, run_end_date=2024-04-06 03:15:05.568186+00:00, run_duration=5.43969, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:14:00+00:00, data_interval_end=2024-04-06 03:15:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:15:05.579469616Z [2024-04-06T03:15:05.579+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:15:00+00:00, run_after=2024-04-06T03:16:00+00:00 2024-04-06T03:15:05.629224950Z [2024-04-06T03:15:05.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:14:00+00:00 exited with status success for try_number 1 2024-04-06T03:15:05.629285603Z [2024-04-06T03:15:05.629+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:14:00+00:00 exited with status success for try_number 1 2024-04-06T03:15:05.636837041Z [2024-04-06T03:15:05.636+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:14:00+00:00, map_index=-1, run_start_date=2024-04-06 03:15:03.405484+00:00, run_end_date=2024-04-06 03:15:04.673692+00:00, run_duration=1.268208, state=success, executor_state=success, try_number=1, max_tries=1, job_id=364, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:15:00.197277+00:00, queued_by_job_id=2, pid=8230 2024-04-06T03:15:05.636985647Z [2024-04-06T03:15:05.636+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:14:00+00:00, map_index=-1, run_start_date=2024-04-06 03:15:03.101591+00:00, run_end_date=2024-04-06 03:15:04.977538+00:00, run_duration=1.875947, state=success, executor_state=success, try_number=1, max_tries=1, job_id=363, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:15:00.197277+00:00, queued_by_job_id=2, pid=8220 2024-04-06T03:15:06.768230676Z [2024-04-06T03:15:06.767+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:15:06.768267147Z 2024-04-06T03:15:06.768659268Z [2024-04-06T03:15:06.768+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:15:06.770757027Z [2024-04-06T03:15:06.770+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:15:06.770827317Z 2024-04-06T03:15:06.775080290Z [2024-04-06T03:15:06.774+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='collect_metrics', run_id='scheduled__2024-04-06T03:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-06T03:15:06.775596498Z [2024-04-06T03:15:06.775+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T03:15:06.836118800Z [2024-04-06T03:15:06.835+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T03:10:00+00:00 exited with status queued for try_number 1 2024-04-06T03:15:06.843006173Z [2024-04-06T03:15:06.842+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ea71a70-4ceb-430c-8d99-74f303086655 2024-04-06T03:15:06.947695747Z [2024-04-06T03:15:06.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T03:10:00+00:00 exited with status success for try_number 1 2024-04-06T03:15:06.958387976Z [2024-04-06T03:15:06.957+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=split_metrics, run_id=scheduled__2024-04-06T03:10:00+00:00, map_index=-1, run_start_date=2024-04-06 03:15:06.251560+00:00, run_end_date=2024-04-06 03:15:06.614961+00:00, run_duration=0.363401, state=success, executor_state=success, try_number=1, max_tries=1, job_id=365, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:15:04.369356+00:00, queued_by_job_id=2, pid=8259 2024-04-06T03:15:10.518279943Z [2024-04-06T03:15:10.517+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:15:10.518326685Z 2024-04-06T03:15:10.518443732Z [2024-04-06T03:15:10.518+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:15:10.519644961Z [2024-04-06T03:15:10.519+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:15:10.519664587Z 2024-04-06T03:15:10.524281207Z [2024-04-06T03:15:10.523+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='send_prometheus', run_id='scheduled__2024-04-06T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:15:10.524804090Z [2024-04-06T03:15:10.524+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:15:10.588924223Z [2024-04-06T03:15:10.587+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T03:10:00+00:00 exited with status queued for try_number 1 2024-04-06T03:15:10.589053864Z [2024-04-06T03:15:10.588+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T03:10:00+00:00 exited with status success for try_number 1 2024-04-06T03:15:10.598332706Z [2024-04-06T03:15:10.598+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc444bbd-5544-409b-9a2d-2b66a2574508 2024-04-06T03:15:10.598522652Z [2024-04-06T03:15:10.598+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=collect_metrics, run_id=scheduled__2024-04-06T03:10:00+00:00, map_index=0, run_start_date=2024-04-06 03:15:08.436581+00:00, run_end_date=2024-04-06 03:15:09.721368+00:00, run_duration=1.284787, state=success, executor_state=success, try_number=1, max_tries=1, job_id=366, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:15:06.771591+00:00, queued_by_job_id=2, pid=8271 2024-04-06T03:15:13.222905751Z [2024-04-06T03:15:13.222+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:15:13.223191558Z [2024-04-06T03:15:13.223+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:10:00+00:00, run_id=scheduled__2024-04-06T03:10:00+00:00, run_start_date=2024-04-06 03:15:00.122195+00:00, run_end_date=2024-04-06 03:15:13.222811+00:00, run_duration=13.100616, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:10:00+00:00, data_interval_end=2024-04-06 03:15:00+00:00, dag_hash=eecc559ff32fe9a7c4345875f113a0a9 2024-04-06T03:15:13.229372838Z [2024-04-06T03:15:13.229+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:15:00+00:00, run_after=2024-04-06T03:20:00+00:00 2024-04-06T03:15:13.263783239Z [2024-04-06T03:15:13.263+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T03:10:00+00:00 exited with status success for try_number 1 2024-04-06T03:15:13.268973127Z [2024-04-06T03:15:13.268+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=send_prometheus, run_id=scheduled__2024-04-06T03:10:00+00:00, map_index=-1, run_start_date=2024-04-06 03:15:12.314967+00:00, run_end_date=2024-04-06 03:15:12.736962+00:00, run_duration=0.421995, state=success, executor_state=success, try_number=1, max_tries=1, job_id=367, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:15:10.520385+00:00, queued_by_job_id=2, pid=8305 2024-04-06T03:15:20.586488396Z [2024-04-06T03:15:20.585+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-06T03:16:00.730518959Z [2024-04-06T03:16:00.729+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:16:00+00:00, run_after=2024-04-06T03:17:00+00:00 2024-04-06T03:16:00.736904419Z [2024-04-06T03:16:00.736+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:16:00.745173655Z [2024-04-06T03:16:00.744+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:16:00.819889834Z [2024-04-06T03:16:00.819+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T03:16:00.819943537Z 2024-04-06T03:16:00.819951671Z 2024-04-06T03:16:00.819955137Z 2024-04-06T03:16:00.820008720Z [2024-04-06T03:16:00.819+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T03:16:00.820160374Z [2024-04-06T03:16:00.820+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:16:00.820394980Z [2024-04-06T03:16:00.820+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:16:00.821329638Z [2024-04-06T03:16:00.821+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:16:00.821341538Z 2024-04-06T03:16:00.821345303Z 2024-04-06T03:16:00.821348813Z 2024-04-06T03:16:00.824509747Z [2024-04-06T03:16:00.824+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:16:00.824728875Z [2024-04-06T03:16:00.824+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:16:00.825083170Z [2024-04-06T03:16:00.824+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:16:00.825306548Z [2024-04-06T03:16:00.825+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:16:00.825568888Z [2024-04-06T03:16:00.825+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:16:00.825731658Z [2024-04-06T03:16:00.825+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:16:01.164966227Z [2024-04-06T03:16:01.164+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:14:00+00:00 exited with status queued for try_number 1 2024-04-06T03:16:01.166496089Z [2024-04-06T03:16:01.164+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:15:00+00:00 exited with status queued for try_number 1 2024-04-06T03:16:01.166734024Z [2024-04-06T03:16:01.166+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:15:00+00:00 exited with status queued for try_number 1 2024-04-06T03:16:01.175798657Z [2024-04-06T03:16:01.175+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80b1523d-f95c-41b0-a18f-49544ec41eeb 2024-04-06T03:16:01.176248566Z [2024-04-06T03:16:01.176+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60d22977-0016-42ea-b36a-d70659bbfbde 2024-04-06T03:16:01.176582792Z [2024-04-06T03:16:01.176+0000] {scheduler_job.py:635} INFO - Setting external_id for to a7b14ef4-49f1-4813-b15c-cb8688675c75 2024-04-06T03:16:03.907108834Z [2024-04-06T03:16:03.906+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:16:03.911602266Z [2024-04-06T03:16:03.911+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 03:14:00+00:00, run_id=scheduled__2024-04-06T03:14:00+00:00, run_start_date=2024-04-06 03:16:00.757664+00:00, run_end_date=2024-04-06 03:16:03.907020+00:00, run_duration=3.149356, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:14:00+00:00, data_interval_end=2024-04-06 03:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T03:16:03.921880731Z [2024-04-06T03:16:03.921+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T03:16:00+00:00, run_after=2024-04-06T03:18:00+00:00 2024-04-06T03:16:04.010155015Z [2024-04-06T03:16:04.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:14:00+00:00 exited with status success for try_number 1 2024-04-06T03:16:04.015374468Z [2024-04-06T03:16:04.014+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T03:14:00+00:00, map_index=-1, run_start_date=2024-04-06 03:16:01.928172+00:00, run_end_date=2024-04-06 03:16:02.584044+00:00, run_duration=0.655872, state=success, executor_state=success, try_number=1, max_tries=1, job_id=368, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:16:00.822099+00:00, queued_by_job_id=2, pid=8309 2024-04-06T03:16:06.742613681Z [2024-04-06T03:16:06.741+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:16:06.742996489Z [2024-04-06T03:16:06.742+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:15:00+00:00, run_id=scheduled__2024-04-06T03:15:00+00:00, run_start_date=2024-04-06 03:16:00.758806+00:00, run_end_date=2024-04-06 03:16:06.742388+00:00, run_duration=5.983582, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:15:00+00:00, data_interval_end=2024-04-06 03:16:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:16:06.757157015Z [2024-04-06T03:16:06.756+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:16:00+00:00, run_after=2024-04-06T03:17:00+00:00 2024-04-06T03:16:06.839229540Z [2024-04-06T03:16:06.838+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:15:00+00:00 exited with status success for try_number 1 2024-04-06T03:16:06.847765261Z [2024-04-06T03:16:06.847+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:15:00+00:00, map_index=-1, run_start_date=2024-04-06 03:16:03.831350+00:00, run_end_date=2024-04-06 03:16:06.038358+00:00, run_duration=2.207008, state=success, executor_state=success, try_number=1, max_tries=1, job_id=369, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:16:00.822099+00:00, queued_by_job_id=2, pid=8339 2024-04-06T03:16:07.922491802Z [2024-04-06T03:16:07.922+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:16:07.922935649Z [2024-04-06T03:16:07.922+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:15:00+00:00, run_id=scheduled__2024-04-06T03:15:00+00:00, run_start_date=2024-04-06 03:16:00.759886+00:00, run_end_date=2024-04-06 03:16:07.922495+00:00, run_duration=7.162609, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:15:00+00:00, data_interval_end=2024-04-06 03:16:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:16:07.932172583Z [2024-04-06T03:16:07.931+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:16:00+00:00, run_after=2024-04-06T03:17:00+00:00 2024-04-06T03:16:07.967153201Z [2024-04-06T03:16:07.966+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:15:00+00:00 exited with status success for try_number 1 2024-04-06T03:16:07.973507449Z [2024-04-06T03:16:07.973+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:15:00+00:00, map_index=-1, run_start_date=2024-04-06 03:16:04.079777+00:00, run_end_date=2024-04-06 03:16:06.909977+00:00, run_duration=2.8302, state=success, executor_state=success, try_number=1, max_tries=1, job_id=370, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:16:00.822099+00:00, queued_by_job_id=2, pid=8340 2024-04-06T03:17:00.789203712Z [2024-04-06T03:17:00.788+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:17:00+00:00, run_after=2024-04-06T03:18:00+00:00 2024-04-06T03:17:00.795024975Z [2024-04-06T03:17:00.794+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:17:00.838144720Z [2024-04-06T03:17:00.837+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T03:17:00.838167756Z 2024-04-06T03:17:00.838182665Z 2024-04-06T03:17:00.838908124Z [2024-04-06T03:17:00.838+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:17:00.839111589Z [2024-04-06T03:17:00.838+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:17:00.839650329Z [2024-04-06T03:17:00.839+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:17:00.839658888Z 2024-04-06T03:17:00.839662021Z 2024-04-06T03:17:00.842176019Z [2024-04-06T03:17:00.841+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:17:00.842499471Z [2024-04-06T03:17:00.842+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:17:00.842799895Z [2024-04-06T03:17:00.842+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:17:00.842939015Z [2024-04-06T03:17:00.842+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:17:01.105891326Z [2024-04-06T03:17:01.105+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:16:00+00:00 exited with status queued for try_number 1 2024-04-06T03:17:01.106232433Z [2024-04-06T03:17:01.105+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:16:00+00:00 exited with status queued for try_number 1 2024-04-06T03:17:01.114069666Z [2024-04-06T03:17:01.113+0000] {scheduler_job.py:635} INFO - Setting external_id for to e1a20c92-4eaf-4ab6-b46e-fe15b457fd05 2024-04-06T03:17:01.114831036Z [2024-04-06T03:17:01.114+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff4e6b84-8068-4472-9600-0f0f7fc1fd62 2024-04-06T03:17:05.495617569Z [2024-04-06T03:17:05.495+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:17:05.496303836Z [2024-04-06T03:17:05.496+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:16:00+00:00, run_id=scheduled__2024-04-06T03:16:00+00:00, run_start_date=2024-04-06 03:17:00.803053+00:00, run_end_date=2024-04-06 03:17:05.495833+00:00, run_duration=4.69278, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:16:00+00:00, data_interval_end=2024-04-06 03:17:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:17:05.505237681Z [2024-04-06T03:17:05.505+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:17:00+00:00, run_after=2024-04-06T03:18:00+00:00 2024-04-06T03:17:05.552681458Z [2024-04-06T03:17:05.552+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:16:00+00:00 exited with status success for try_number 1 2024-04-06T03:17:05.558330299Z [2024-04-06T03:17:05.557+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:16:00+00:00, map_index=-1, run_start_date=2024-04-06 03:17:03.024596+00:00, run_end_date=2024-04-06 03:17:05.039528+00:00, run_duration=2.014932, state=success, executor_state=success, try_number=1, max_tries=1, job_id=371, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:17:00.840241+00:00, queued_by_job_id=2, pid=8394 2024-04-06T03:17:06.619077932Z [2024-04-06T03:17:06.618+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:17:06.619144672Z [2024-04-06T03:17:06.618+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:16:00+00:00, run_id=scheduled__2024-04-06T03:16:00+00:00, run_start_date=2024-04-06 03:17:00.804307+00:00, run_end_date=2024-04-06 03:17:06.618873+00:00, run_duration=5.814566, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:16:00+00:00, data_interval_end=2024-04-06 03:17:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:17:06.628402871Z [2024-04-06T03:17:06.628+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:17:00+00:00, run_after=2024-04-06T03:18:00+00:00 2024-04-06T03:17:06.681408843Z [2024-04-06T03:17:06.680+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:16:00+00:00 exited with status success for try_number 1 2024-04-06T03:17:06.686659770Z [2024-04-06T03:17:06.686+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:16:00+00:00, map_index=-1, run_start_date=2024-04-06 03:17:03.069539+00:00, run_end_date=2024-04-06 03:17:06.285907+00:00, run_duration=3.216368, state=success, executor_state=success, try_number=1, max_tries=1, job_id=372, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:17:00.840241+00:00, queued_by_job_id=2, pid=8395 2024-04-06T03:18:00.741186394Z [2024-04-06T03:18:00.740+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:18:00.747527035Z [2024-04-06T03:18:00.747+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:18:00.775567813Z [2024-04-06T03:18:00.774+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:18:00+00:00, run_after=2024-04-06T03:19:00+00:00 2024-04-06T03:18:00.847587524Z [2024-04-06T03:18:00.847+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T03:18:00.847620262Z 2024-04-06T03:18:00.847624851Z 2024-04-06T03:18:00.847627956Z 2024-04-06T03:18:00.847731511Z [2024-04-06T03:18:00.847+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T03:18:00.847921307Z [2024-04-06T03:18:00.847+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:18:00.848163223Z [2024-04-06T03:18:00.847+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:18:00.848948095Z [2024-04-06T03:18:00.848+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:18:00.848962644Z 2024-04-06T03:18:00.848968034Z 2024-04-06T03:18:00.848973045Z 2024-04-06T03:18:00.853483252Z [2024-04-06T03:18:00.853+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:18:00.853759334Z [2024-04-06T03:18:00.853+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:18:00.854165459Z [2024-04-06T03:18:00.853+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:18:00.854332759Z [2024-04-06T03:18:00.854+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:18:00.854685946Z [2024-04-06T03:18:00.854+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:18:00.854801708Z [2024-04-06T03:18:00.854+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:18:01.365429855Z [2024-04-06T03:18:01.364+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:16:00+00:00 exited with status queued for try_number 1 2024-04-06T03:18:01.365540735Z [2024-04-06T03:18:01.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:17:00+00:00 exited with status queued for try_number 1 2024-04-06T03:18:01.365546155Z [2024-04-06T03:18:01.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:17:00+00:00 exited with status queued for try_number 1 2024-04-06T03:18:01.397950142Z [2024-04-06T03:18:01.397+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b6e7561-1efc-4a96-b91f-7f110ac7c7d4 2024-04-06T03:18:01.398116767Z [2024-04-06T03:18:01.397+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4bbdc8a5-992c-4cee-be9a-2dcbce114823 2024-04-06T03:18:01.398124373Z [2024-04-06T03:18:01.397+0000] {scheduler_job.py:635} INFO - Setting external_id for to e30c7f92-9584-493e-beff-f4dc1ac5d620 2024-04-06T03:18:03.707407988Z [2024-04-06T03:18:03.707+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:18:03.707714526Z [2024-04-06T03:18:03.707+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 03:16:00+00:00, run_id=scheduled__2024-04-06T03:16:00+00:00, run_start_date=2024-04-06 03:18:00.789286+00:00, run_end_date=2024-04-06 03:18:03.707346+00:00, run_duration=2.91806, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:16:00+00:00, data_interval_end=2024-04-06 03:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T03:18:03.714892513Z [2024-04-06T03:18:03.714+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T03:18:00+00:00, run_after=2024-04-06T03:20:00+00:00 2024-04-06T03:18:03.759125592Z [2024-04-06T03:18:03.758+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:16:00+00:00 exited with status success for try_number 1 2024-04-06T03:18:03.763367425Z [2024-04-06T03:18:03.763+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T03:16:00+00:00, map_index=-1, run_start_date=2024-04-06 03:18:02.257422+00:00, run_end_date=2024-04-06 03:18:03.102673+00:00, run_duration=0.845251, state=success, executor_state=success, try_number=1, max_tries=1, job_id=373, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:18:00.850190+00:00, queued_by_job_id=2, pid=8431 2024-04-06T03:18:07.026773721Z [2024-04-06T03:18:07.026+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:18:07.027022740Z [2024-04-06T03:18:07.026+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:17:00+00:00, run_id=scheduled__2024-04-06T03:17:00+00:00, run_start_date=2024-04-06 03:18:00.791179+00:00, run_end_date=2024-04-06 03:18:07.026549+00:00, run_duration=6.23537, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:17:00+00:00, data_interval_end=2024-04-06 03:18:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:18:07.040267012Z [2024-04-06T03:18:07.039+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:18:00+00:00, run_after=2024-04-06T03:19:00+00:00 2024-04-06T03:18:07.082059708Z [2024-04-06T03:18:07.081+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:17:00+00:00 exited with status success for try_number 1 2024-04-06T03:18:07.092986966Z [2024-04-06T03:18:07.092+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:17:00+00:00, map_index=-1, run_start_date=2024-04-06 03:18:03.674914+00:00, run_end_date=2024-04-06 03:18:05.894206+00:00, run_duration=2.219292, state=success, executor_state=success, try_number=1, max_tries=1, job_id=374, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:18:00.850190+00:00, queued_by_job_id=2, pid=8451 2024-04-06T03:18:08.145325766Z [2024-04-06T03:18:08.144+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:18:08.145447024Z [2024-04-06T03:18:08.145+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:17:00+00:00, run_id=scheduled__2024-04-06T03:17:00+00:00, run_start_date=2024-04-06 03:18:00.792646+00:00, run_end_date=2024-04-06 03:18:08.145205+00:00, run_duration=7.352559, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:17:00+00:00, data_interval_end=2024-04-06 03:18:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:18:08.181770209Z [2024-04-06T03:18:08.155+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:18:00+00:00, run_after=2024-04-06T03:19:00+00:00 2024-04-06T03:18:08.202131347Z [2024-04-06T03:18:08.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:17:00+00:00 exited with status success for try_number 1 2024-04-06T03:18:08.208605178Z [2024-04-06T03:18:08.206+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:17:00+00:00, map_index=-1, run_start_date=2024-04-06 03:18:04.146636+00:00, run_end_date=2024-04-06 03:18:07.067979+00:00, run_duration=2.921343, state=success, executor_state=success, try_number=1, max_tries=1, job_id=375, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:18:00.850190+00:00, queued_by_job_id=2, pid=8470 2024-04-06T03:19:00.724174239Z [2024-04-06T03:19:00.722+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:19:00.738356063Z [2024-04-06T03:19:00.737+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:19:00+00:00, run_after=2024-04-06T03:20:00+00:00 2024-04-06T03:19:00.806131756Z [2024-04-06T03:19:00.804+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T03:19:00.806167775Z 2024-04-06T03:19:00.806174784Z 2024-04-06T03:19:00.806729896Z [2024-04-06T03:19:00.806+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:19:00.807113273Z [2024-04-06T03:19:00.806+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:19:00.808211488Z [2024-04-06T03:19:00.807+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:19:00.808230879Z 2024-04-06T03:19:00.808237700Z 2024-04-06T03:19:00.812770315Z [2024-04-06T03:19:00.812+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:19:00.813073557Z [2024-04-06T03:19:00.812+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:19:00.813472110Z [2024-04-06T03:19:00.813+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:19:00.813676213Z [2024-04-06T03:19:00.813+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:19:01.065649596Z [2024-04-06T03:19:01.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:18:00+00:00 exited with status queued for try_number 1 2024-04-06T03:19:01.069312402Z [2024-04-06T03:19:01.069+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:18:00+00:00 exited with status queued for try_number 1 2024-04-06T03:19:01.089314390Z [2024-04-06T03:19:01.088+0000] {scheduler_job.py:635} INFO - Setting external_id for to 943ab92a-163c-4ac9-915b-48cfb69d7286 2024-04-06T03:19:01.089551829Z [2024-04-06T03:19:01.089+0000] {scheduler_job.py:635} INFO - Setting external_id for to da707e7e-08ae-48dc-bb88-a5c2dafbf031 2024-04-06T03:19:05.829283639Z [2024-04-06T03:19:05.828+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:19:05.829726839Z [2024-04-06T03:19:05.829+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:18:00+00:00, run_id=scheduled__2024-04-06T03:18:00+00:00, run_start_date=2024-04-06 03:19:00.749879+00:00, run_end_date=2024-04-06 03:19:05.829109+00:00, run_duration=5.07923, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:18:00+00:00, data_interval_end=2024-04-06 03:19:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:19:05.843739693Z [2024-04-06T03:19:05.843+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:19:00+00:00, run_after=2024-04-06T03:20:00+00:00 2024-04-06T03:19:05.921421676Z [2024-04-06T03:19:05.920+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:18:00+00:00 exited with status success for try_number 1 2024-04-06T03:19:05.930406943Z [2024-04-06T03:19:05.929+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:18:00+00:00, map_index=-1, run_start_date=2024-04-06 03:19:03.058549+00:00, run_end_date=2024-04-06 03:19:05.449301+00:00, run_duration=2.390752, state=success, executor_state=success, try_number=1, max_tries=1, job_id=376, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:19:00.809471+00:00, queued_by_job_id=2, pid=8515 2024-04-06T03:19:06.987343362Z [2024-04-06T03:19:06.986+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:19:06.987940545Z [2024-04-06T03:19:06.987+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:18:00+00:00, run_id=scheduled__2024-04-06T03:18:00+00:00, run_start_date=2024-04-06 03:19:00.747896+00:00, run_end_date=2024-04-06 03:19:06.987372+00:00, run_duration=6.239476, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:18:00+00:00, data_interval_end=2024-04-06 03:19:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:19:06.999307678Z [2024-04-06T03:19:06.998+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:19:00+00:00, run_after=2024-04-06T03:20:00+00:00 2024-04-06T03:19:07.035254845Z [2024-04-06T03:19:07.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:18:00+00:00 exited with status success for try_number 1 2024-04-06T03:19:07.043327795Z [2024-04-06T03:19:07.042+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:18:00+00:00, map_index=-1, run_start_date=2024-04-06 03:19:03.168521+00:00, run_end_date=2024-04-06 03:19:05.982945+00:00, run_duration=2.814424, state=success, executor_state=success, try_number=1, max_tries=1, job_id=377, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:19:00.809471+00:00, queued_by_job_id=2, pid=8516 2024-04-06T03:20:00.530738887Z [2024-04-06T03:20:00.529+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:20:00+00:00, run_after=2024-04-06T03:21:00+00:00 2024-04-06T03:20:00.546585463Z [2024-04-06T03:20:00.546+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:20:00.555004722Z [2024-04-06T03:20:00.554+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:20:00.571425853Z [2024-04-06T03:20:00.570+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:20:00+00:00, run_after=2024-04-06T03:25:00+00:00 2024-04-06T03:20:00.670366620Z [2024-04-06T03:20:00.669+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-06T03:20:00.670409134Z 2024-04-06T03:20:00.670452765Z 2024-04-06T03:20:00.670463874Z 2024-04-06T03:20:00.670472593Z 2024-04-06T03:20:00.670513890Z [2024-04-06T03:20:00.670+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:20:00.670876872Z [2024-04-06T03:20:00.670+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T03:20:00.671277650Z [2024-04-06T03:20:00.670+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:20:00.671646582Z [2024-04-06T03:20:00.671+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:20:00.672877064Z [2024-04-06T03:20:00.672+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:20:00.672897437Z 2024-04-06T03:20:00.672905102Z 2024-04-06T03:20:00.672912022Z 2024-04-06T03:20:00.672918764Z 2024-04-06T03:20:00.680387816Z [2024-04-06T03:20:00.679+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-06T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-06T03:20:00.680776753Z [2024-04-06T03:20:00.680+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:20:00.681218429Z [2024-04-06T03:20:00.680+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:20:00.681679226Z [2024-04-06T03:20:00.681+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:20:00.682190279Z [2024-04-06T03:20:00.681+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:20:00.682478358Z [2024-04-06T03:20:00.682+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:20:00.683105466Z [2024-04-06T03:20:00.682+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:20:00.683526739Z [2024-04-06T03:20:00.682+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:20:00.961776187Z [2024-04-06T03:20:00.961+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T03:15:00+00:00 exited with status queued for try_number 1 2024-04-06T03:20:00.961800670Z [2024-04-06T03:20:00.961+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:18:00+00:00 exited with status queued for try_number 1 2024-04-06T03:20:00.961820766Z [2024-04-06T03:20:00.961+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:19:00+00:00 exited with status queued for try_number 1 2024-04-06T03:20:00.961890529Z [2024-04-06T03:20:00.961+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:19:00+00:00 exited with status queued for try_number 1 2024-04-06T03:20:00.971013959Z [2024-04-06T03:20:00.970+0000] {scheduler_job.py:635} INFO - Setting external_id for to 433f2e46-9d9a-487f-bde4-6ae8786a7fee 2024-04-06T03:20:00.971125563Z [2024-04-06T03:20:00.970+0000] {scheduler_job.py:635} INFO - Setting external_id for to 46ea179f-b54f-4eb0-91c1-5d2c66f1bde6 2024-04-06T03:20:00.971296273Z [2024-04-06T03:20:00.971+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3fb67e43-9f2b-4b08-9a82-6e1cfc62ce2c 2024-04-06T03:20:00.971444285Z [2024-04-06T03:20:00.971+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3db1cdb2-8288-46aa-8c97-8e347e6e8cf1 2024-04-06T03:20:03.741264409Z [2024-04-06T03:20:03.740+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:20:03.741506737Z [2024-04-06T03:20:03.741+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 03:18:00+00:00, run_id=scheduled__2024-04-06T03:18:00+00:00, run_start_date=2024-04-06 03:20:00.589794+00:00, run_end_date=2024-04-06 03:20:03.741205+00:00, run_duration=3.151411, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:18:00+00:00, data_interval_end=2024-04-06 03:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T03:20:03.755031064Z [2024-04-06T03:20:03.754+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T03:20:00+00:00, run_after=2024-04-06T03:22:00+00:00 2024-04-06T03:20:04.869697060Z [2024-04-06T03:20:04.860+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:18:00+00:00 exited with status success for try_number 1 2024-04-06T03:20:04.905802486Z [2024-04-06T03:20:04.905+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T03:18:00+00:00, map_index=-1, run_start_date=2024-04-06 03:20:02.602411+00:00, run_end_date=2024-04-06 03:20:03.699605+00:00, run_duration=1.097194, state=success, executor_state=success, try_number=1, max_tries=1, job_id=378, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:20:00.674925+00:00, queued_by_job_id=2, pid=8553 2024-04-06T03:20:07.141041798Z [2024-04-06T03:20:07.140+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:20:07.141293633Z [2024-04-06T03:20:07.140+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:19:00+00:00, run_id=scheduled__2024-04-06T03:19:00+00:00, run_start_date=2024-04-06 03:20:00.592191+00:00, run_end_date=2024-04-06 03:20:07.140859+00:00, run_duration=6.548668, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:19:00+00:00, data_interval_end=2024-04-06 03:20:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:20:07.152282471Z [2024-04-06T03:20:07.151+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:20:00+00:00, run_after=2024-04-06T03:21:00+00:00 2024-04-06T03:20:07.220507013Z [2024-04-06T03:20:07.220+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:20:07.220546341Z 2024-04-06T03:20:07.220817190Z [2024-04-06T03:20:07.220+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:20:07.221671530Z [2024-04-06T03:20:07.221+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:20:07.221683311Z 2024-04-06T03:20:07.224507740Z [2024-04-06T03:20:07.224+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='split_metrics', run_id='scheduled__2024-04-06T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-06T03:20:07.224756952Z [2024-04-06T03:20:07.224+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:20:07.271768906Z [2024-04-06T03:20:07.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T03:15:00+00:00 exited with status queued for try_number 1 2024-04-06T03:20:07.272057069Z [2024-04-06T03:20:07.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T03:15:00+00:00 exited with status success for try_number 1 2024-04-06T03:20:07.272189321Z [2024-04-06T03:20:07.272+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:19:00+00:00 exited with status success for try_number 1 2024-04-06T03:20:07.278369964Z [2024-04-06T03:20:07.278+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:19:00+00:00, map_index=-1, run_start_date=2024-04-06 03:20:04.231482+00:00, run_end_date=2024-04-06 03:20:06.301674+00:00, run_duration=2.070192, state=success, executor_state=success, try_number=1, max_tries=1, job_id=379, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:20:00.674925+00:00, queued_by_job_id=2, pid=8574 2024-04-06T03:20:07.278659872Z [2024-04-06T03:20:07.278+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e6d9ffc-48f2-44dc-b610-15f3c1516331 2024-04-06T03:20:07.278863612Z [2024-04-06T03:20:07.278+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-06T03:15:00+00:00, map_index=-1, run_start_date=2024-04-06 03:20:05.484154+00:00, run_end_date=2024-04-06 03:20:06.051193+00:00, run_duration=0.567039, state=success, executor_state=success, try_number=1, max_tries=1, job_id=380, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:20:00.674925+00:00, queued_by_job_id=2, pid=8602 2024-04-06T03:20:08.397571081Z [2024-04-06T03:20:08.397+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:20:08.397735576Z [2024-04-06T03:20:08.397+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:19:00+00:00, run_id=scheduled__2024-04-06T03:19:00+00:00, run_start_date=2024-04-06 03:20:00.591031+00:00, run_end_date=2024-04-06 03:20:08.397458+00:00, run_duration=7.806427, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:19:00+00:00, data_interval_end=2024-04-06 03:20:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:20:08.408098082Z [2024-04-06T03:20:08.407+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:20:00+00:00, run_after=2024-04-06T03:21:00+00:00 2024-04-06T03:20:08.488052372Z [2024-04-06T03:20:08.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:19:00+00:00 exited with status success for try_number 1 2024-04-06T03:20:08.496955977Z [2024-04-06T03:20:08.495+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:19:00+00:00, map_index=-1, run_start_date=2024-04-06 03:20:05.921587+00:00, run_end_date=2024-04-06 03:20:07.577448+00:00, run_duration=1.655861, state=success, executor_state=success, try_number=1, max_tries=1, job_id=381, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:20:00.674925+00:00, queued_by_job_id=2, pid=8612 2024-04-06T03:20:09.556677567Z [2024-04-06T03:20:09.556+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:20:09.556711497Z 2024-04-06T03:20:09.556722129Z [2024-04-06T03:20:09.556+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:20:09.557365097Z [2024-04-06T03:20:09.557+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:20:09.557398666Z 2024-04-06T03:20:09.560474599Z [2024-04-06T03:20:09.560+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='collect_metrics', run_id='scheduled__2024-04-06T03:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-06T03:20:09.560551744Z [2024-04-06T03:20:09.560+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T03:20:09.620029335Z [2024-04-06T03:20:09.619+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T03:15:00+00:00 exited with status queued for try_number 1 2024-04-06T03:20:09.620163804Z [2024-04-06T03:20:09.619+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T03:15:00+00:00 exited with status success for try_number 1 2024-04-06T03:20:09.626825196Z [2024-04-06T03:20:09.626+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea626d9c-6f1d-4827-8a49-aca2b708b5fb 2024-04-06T03:20:09.626941590Z [2024-04-06T03:20:09.626+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=split_metrics, run_id=scheduled__2024-04-06T03:15:00+00:00, map_index=-1, run_start_date=2024-04-06 03:20:08.992308+00:00, run_end_date=2024-04-06 03:20:09.390714+00:00, run_duration=0.398406, state=success, executor_state=success, try_number=1, max_tries=1, job_id=382, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:20:07.222369+00:00, queued_by_job_id=2, pid=8633 2024-04-06T03:20:13.449031210Z [2024-04-06T03:20:13.448+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:20:13.449071466Z 2024-04-06T03:20:13.449447898Z [2024-04-06T03:20:13.448+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:20:13.450461606Z [2024-04-06T03:20:13.450+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:20:13.450484053Z 2024-04-06T03:20:13.453918979Z [2024-04-06T03:20:13.453+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='send_prometheus', run_id='scheduled__2024-04-06T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:20:13.454293601Z [2024-04-06T03:20:13.453+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:20:13.532839761Z [2024-04-06T03:20:13.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T03:15:00+00:00 exited with status queued for try_number 1 2024-04-06T03:20:13.533297896Z [2024-04-06T03:20:13.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T03:15:00+00:00 exited with status success for try_number 1 2024-04-06T03:20:13.541662758Z [2024-04-06T03:20:13.541+0000] {scheduler_job.py:635} INFO - Setting external_id for to ae0aba6d-9d33-4d97-b3ab-f4cd1458d70b 2024-04-06T03:20:13.542171236Z [2024-04-06T03:20:13.541+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=collect_metrics, run_id=scheduled__2024-04-06T03:15:00+00:00, map_index=0, run_start_date=2024-04-06 03:20:11.288458+00:00, run_end_date=2024-04-06 03:20:12.675380+00:00, run_duration=1.386922, state=success, executor_state=success, try_number=1, max_tries=1, job_id=383, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:20:09.557679+00:00, queued_by_job_id=2, pid=8659 2024-04-06T03:20:16.110719856Z [2024-04-06T03:20:16.108+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:20:16.111505419Z [2024-04-06T03:20:16.111+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:15:00+00:00, run_id=scheduled__2024-04-06T03:15:00+00:00, run_start_date=2024-04-06 03:20:00.588477+00:00, run_end_date=2024-04-06 03:20:16.110610+00:00, run_duration=15.522133, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:15:00+00:00, data_interval_end=2024-04-06 03:20:00+00:00, dag_hash=eecc559ff32fe9a7c4345875f113a0a9 2024-04-06T03:20:16.126111889Z [2024-04-06T03:20:16.125+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:20:00+00:00, run_after=2024-04-06T03:25:00+00:00 2024-04-06T03:20:16.175080777Z [2024-04-06T03:20:16.174+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T03:15:00+00:00 exited with status success for try_number 1 2024-04-06T03:20:16.182824239Z [2024-04-06T03:20:16.182+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=send_prometheus, run_id=scheduled__2024-04-06T03:15:00+00:00, map_index=-1, run_start_date=2024-04-06 03:20:15.337688+00:00, run_end_date=2024-04-06 03:20:15.740353+00:00, run_duration=0.402665, state=success, executor_state=success, try_number=1, max_tries=1, job_id=384, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:20:13.451103+00:00, queued_by_job_id=2, pid=8680 2024-04-06T03:20:20.635342564Z [2024-04-06T03:20:20.634+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-06T03:21:00.117129924Z [2024-04-06T03:21:00.116+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:21:00.133160541Z [2024-04-06T03:21:00.132+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:21:00+00:00, run_after=2024-04-06T03:22:00+00:00 2024-04-06T03:21:00.198904190Z [2024-04-06T03:21:00.198+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T03:21:00.198955770Z 2024-04-06T03:21:00.198966713Z 2024-04-06T03:21:00.198989814Z [2024-04-06T03:21:00.198+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:21:00.199174164Z [2024-04-06T03:21:00.198+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:21:00.200222319Z [2024-04-06T03:21:00.199+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:21:00.200251171Z 2024-04-06T03:21:00.200261019Z 2024-04-06T03:21:00.204252341Z [2024-04-06T03:21:00.203+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:21:00.204421251Z [2024-04-06T03:21:00.204+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:21:00.204763250Z [2024-04-06T03:21:00.204+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:21:00.204896732Z [2024-04-06T03:21:00.204+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:21:00.364401084Z [2024-04-06T03:21:00.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:20:00+00:00 exited with status queued for try_number 1 2024-04-06T03:21:00.364428628Z [2024-04-06T03:21:00.364+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:20:00+00:00 exited with status queued for try_number 1 2024-04-06T03:21:00.370948740Z [2024-04-06T03:21:00.370+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75c10fb0-4440-465c-916c-c5adc52378e0 2024-04-06T03:21:00.370973588Z [2024-04-06T03:21:00.370+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8db4bfd7-d5c8-4fe1-92d9-ab875a9a8ca7 2024-04-06T03:21:04.207216961Z [2024-04-06T03:21:04.206+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:21:04.207419857Z [2024-04-06T03:21:04.207+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:20:00+00:00, run_id=scheduled__2024-04-06T03:20:00+00:00, run_start_date=2024-04-06 03:21:00.142323+00:00, run_end_date=2024-04-06 03:21:04.207131+00:00, run_duration=4.064808, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:20:00+00:00, data_interval_end=2024-04-06 03:21:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:21:04.216818604Z [2024-04-06T03:21:04.216+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:21:00+00:00, run_after=2024-04-06T03:22:00+00:00 2024-04-06T03:21:04.269923293Z [2024-04-06T03:21:04.268+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:20:00+00:00 exited with status success for try_number 1 2024-04-06T03:21:04.273595832Z [2024-04-06T03:21:04.272+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:20:00+00:00, map_index=-1, run_start_date=2024-04-06 03:21:02.086992+00:00, run_end_date=2024-04-06 03:21:04.092084+00:00, run_duration=2.005092, state=success, executor_state=success, try_number=1, max_tries=1, job_id=385, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:21:00.200965+00:00, queued_by_job_id=2, pid=8703 2024-04-06T03:21:05.314081699Z [2024-04-06T03:21:05.313+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:21:05.314578033Z [2024-04-06T03:21:05.314+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:20:00+00:00, run_id=scheduled__2024-04-06T03:20:00+00:00, run_start_date=2024-04-06 03:21:00.143667+00:00, run_end_date=2024-04-06 03:21:05.314266+00:00, run_duration=5.170599, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:20:00+00:00, data_interval_end=2024-04-06 03:21:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:21:05.323138052Z [2024-04-06T03:21:05.322+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:21:00+00:00, run_after=2024-04-06T03:22:00+00:00 2024-04-06T03:21:05.355920248Z [2024-04-06T03:21:05.355+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:20:00+00:00 exited with status success for try_number 1 2024-04-06T03:21:05.360717904Z [2024-04-06T03:21:05.360+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:20:00+00:00, map_index=-1, run_start_date=2024-04-06 03:21:02.303741+00:00, run_end_date=2024-04-06 03:21:04.605498+00:00, run_duration=2.301757, state=success, executor_state=success, try_number=1, max_tries=1, job_id=386, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:21:00.200965+00:00, queued_by_job_id=2, pid=8704 2024-04-06T03:22:00.084365576Z [2024-04-06T03:22:00.083+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:22:00.102410610Z [2024-04-06T03:22:00.101+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:22:00.126362339Z [2024-04-06T03:22:00.125+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:22:00+00:00, run_after=2024-04-06T03:23:00+00:00 2024-04-06T03:22:00.207962654Z [2024-04-06T03:22:00.207+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T03:22:00.208029276Z 2024-04-06T03:22:00.208037677Z 2024-04-06T03:22:00.208044981Z 2024-04-06T03:22:00.208136954Z [2024-04-06T03:22:00.207+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T03:22:00.208450142Z [2024-04-06T03:22:00.208+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:22:00.208668831Z [2024-04-06T03:22:00.208+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:22:00.209449721Z [2024-04-06T03:22:00.209+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:22:00.209460171Z 2024-04-06T03:22:00.209466035Z 2024-04-06T03:22:00.209471821Z 2024-04-06T03:22:00.214373359Z [2024-04-06T03:22:00.214+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:22:00.214551440Z [2024-04-06T03:22:00.214+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:22:00.214909927Z [2024-04-06T03:22:00.214+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:22:00.215091872Z [2024-04-06T03:22:00.214+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:22:00.215411631Z [2024-04-06T03:22:00.215+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:22:00.215571133Z [2024-04-06T03:22:00.215+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:22:00.441706362Z [2024-04-06T03:22:00.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:20:00+00:00 exited with status queued for try_number 1 2024-04-06T03:22:00.441786611Z [2024-04-06T03:22:00.441+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:21:00+00:00 exited with status queued for try_number 1 2024-04-06T03:22:00.441978299Z [2024-04-06T03:22:00.441+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:21:00+00:00 exited with status queued for try_number 1 2024-04-06T03:22:00.451620657Z [2024-04-06T03:22:00.451+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6060f05e-7e32-45fd-8a3e-64029d0a8e64 2024-04-06T03:22:00.451842670Z [2024-04-06T03:22:00.451+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a4bd535-e9d3-4bed-b25c-6e3ac0b622b1 2024-04-06T03:22:00.452000029Z [2024-04-06T03:22:00.451+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0f3bac33-0e7f-4230-9265-2bb4427bf220 2024-04-06T03:22:01.633554653Z [2024-04-06T03:22:01.633+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:22:01.639548751Z [2024-04-06T03:22:01.639+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 03:20:00+00:00, run_id=scheduled__2024-04-06T03:20:00+00:00, run_start_date=2024-04-06 03:22:00.141078+00:00, run_end_date=2024-04-06 03:22:01.633449+00:00, run_duration=1.492371, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:20:00+00:00, data_interval_end=2024-04-06 03:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T03:22:01.664001009Z [2024-04-06T03:22:01.662+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T03:22:00+00:00, run_after=2024-04-06T03:24:00+00:00 2024-04-06T03:22:02.962740725Z [2024-04-06T03:22:02.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:20:00+00:00 exited with status success for try_number 1 2024-04-06T03:22:02.971597616Z [2024-04-06T03:22:02.971+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T03:20:00+00:00, map_index=-1, run_start_date=2024-04-06 03:22:00.990101+00:00, run_end_date=2024-04-06 03:22:01.601507+00:00, run_duration=0.611406, state=success, executor_state=success, try_number=1, max_tries=1, job_id=387, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:22:00.210630+00:00, queued_by_job_id=2, pid=8739 2024-04-06T03:22:05.178236575Z [2024-04-06T03:22:05.177+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:22:05.178613942Z [2024-04-06T03:22:05.178+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:21:00+00:00, run_id=scheduled__2024-04-06T03:21:00+00:00, run_start_date=2024-04-06 03:22:00.142495+00:00, run_end_date=2024-04-06 03:22:05.178276+00:00, run_duration=5.035781, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:21:00+00:00, data_interval_end=2024-04-06 03:22:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:22:05.188105752Z [2024-04-06T03:22:05.187+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:22:00+00:00, run_after=2024-04-06T03:23:00+00:00 2024-04-06T03:22:05.195878074Z [2024-04-06T03:22:05.195+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:22:05.196215580Z [2024-04-06T03:22:05.195+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:21:00+00:00, run_id=scheduled__2024-04-06T03:21:00+00:00, run_start_date=2024-04-06 03:22:00.143652+00:00, run_end_date=2024-04-06 03:22:05.195907+00:00, run_duration=5.052255, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:21:00+00:00, data_interval_end=2024-04-06 03:22:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:22:05.205091463Z [2024-04-06T03:22:05.204+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:22:00+00:00, run_after=2024-04-06T03:23:00+00:00 2024-04-06T03:22:05.239001209Z [2024-04-06T03:22:05.238+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:21:00+00:00 exited with status success for try_number 1 2024-04-06T03:22:05.239149402Z [2024-04-06T03:22:05.239+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:21:00+00:00 exited with status success for try_number 1 2024-04-06T03:22:05.246589104Z [2024-04-06T03:22:05.246+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:21:00+00:00, map_index=-1, run_start_date=2024-04-06 03:22:03.091591+00:00, run_end_date=2024-04-06 03:22:04.470327+00:00, run_duration=1.378736, state=success, executor_state=success, try_number=1, max_tries=1, job_id=389, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:22:00.210630+00:00, queued_by_job_id=2, pid=8770 2024-04-06T03:22:05.246793443Z [2024-04-06T03:22:05.246+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:21:00+00:00, map_index=-1, run_start_date=2024-04-06 03:22:02.757247+00:00, run_end_date=2024-04-06 03:22:05.006968+00:00, run_duration=2.249721, state=success, executor_state=success, try_number=1, max_tries=1, job_id=388, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:22:00.210630+00:00, queued_by_job_id=2, pid=8764 2024-04-06T03:23:01.037145156Z [2024-04-06T03:23:01.036+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:23:01.062700449Z [2024-04-06T03:23:01.062+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:23:00+00:00, run_after=2024-04-06T03:24:00+00:00 2024-04-06T03:23:01.122178435Z [2024-04-06T03:23:01.121+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T03:23:01.122205075Z 2024-04-06T03:23:01.122208833Z 2024-04-06T03:23:01.125105400Z [2024-04-06T03:23:01.122+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:23:01.127046919Z [2024-04-06T03:23:01.126+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:23:01.127795046Z [2024-04-06T03:23:01.127+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:23:01.127806217Z 2024-04-06T03:23:01.127809521Z 2024-04-06T03:23:01.133884973Z [2024-04-06T03:23:01.133+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:23:01.134152763Z [2024-04-06T03:23:01.133+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:23:01.134498090Z [2024-04-06T03:23:01.134+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:23:01.134687266Z [2024-04-06T03:23:01.134+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:23:01.327099199Z [2024-04-06T03:23:01.326+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:22:00+00:00 exited with status queued for try_number 1 2024-04-06T03:23:01.329075927Z [2024-04-06T03:23:01.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:22:00+00:00 exited with status queued for try_number 1 2024-04-06T03:23:01.336925756Z [2024-04-06T03:23:01.336+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5aa37b2c-f1c4-42aa-89f1-7fc41b5bac4c 2024-04-06T03:23:01.337200921Z [2024-04-06T03:23:01.337+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a72c7f0-5d11-439c-a071-da993c0766ed 2024-04-06T03:23:06.174558921Z [2024-04-06T03:23:06.173+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:23:06.175338747Z [2024-04-06T03:23:06.174+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:22:00+00:00, run_id=scheduled__2024-04-06T03:22:00+00:00, run_start_date=2024-04-06 03:23:01.078311+00:00, run_end_date=2024-04-06 03:23:06.174415+00:00, run_duration=5.096104, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:22:00+00:00, data_interval_end=2024-04-06 03:23:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:23:06.196132121Z [2024-04-06T03:23:06.195+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:23:00+00:00, run_after=2024-04-06T03:24:00+00:00 2024-04-06T03:23:06.258314778Z [2024-04-06T03:23:06.257+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:22:00+00:00 exited with status success for try_number 1 2024-04-06T03:23:06.263868373Z [2024-04-06T03:23:06.263+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:22:00+00:00, map_index=-1, run_start_date=2024-04-06 03:23:03.290179+00:00, run_end_date=2024-04-06 03:23:05.054914+00:00, run_duration=1.764735, state=success, executor_state=success, try_number=1, max_tries=1, job_id=390, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:23:01.128652+00:00, queued_by_job_id=2, pid=8824 2024-04-06T03:23:07.331840484Z [2024-04-06T03:23:07.331+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:23:07.332605947Z [2024-04-06T03:23:07.332+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:22:00+00:00, run_id=scheduled__2024-04-06T03:22:00+00:00, run_start_date=2024-04-06 03:23:01.079549+00:00, run_end_date=2024-04-06 03:23:07.331658+00:00, run_duration=6.252109, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:22:00+00:00, data_interval_end=2024-04-06 03:23:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:23:07.359147500Z [2024-04-06T03:23:07.358+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:23:00+00:00, run_after=2024-04-06T03:24:00+00:00 2024-04-06T03:23:07.407635445Z [2024-04-06T03:23:07.407+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:22:00+00:00 exited with status success for try_number 1 2024-04-06T03:23:07.416246672Z [2024-04-06T03:23:07.415+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:22:00+00:00, map_index=-1, run_start_date=2024-04-06 03:23:03.527856+00:00, run_end_date=2024-04-06 03:23:06.650725+00:00, run_duration=3.122869, state=success, executor_state=success, try_number=1, max_tries=1, job_id=391, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:23:01.128652+00:00, queued_by_job_id=2, pid=8825 2024-04-06T03:24:00.916046680Z [2024-04-06T03:24:00.915+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:24:00.932367381Z [2024-04-06T03:24:00.932+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:24:00+00:00, run_after=2024-04-06T03:25:00+00:00 2024-04-06T03:24:00.941481480Z [2024-04-06T03:24:00.941+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:24:01.026813032Z [2024-04-06T03:24:01.026+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T03:24:01.026837322Z 2024-04-06T03:24:01.026841135Z 2024-04-06T03:24:01.026844383Z 2024-04-06T03:24:01.026887640Z [2024-04-06T03:24:01.026+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T03:24:01.027265254Z [2024-04-06T03:24:01.026+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:24:01.027457136Z [2024-04-06T03:24:01.027+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:24:01.028014372Z [2024-04-06T03:24:01.027+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:24:01.028024064Z 2024-04-06T03:24:01.028040957Z 2024-04-06T03:24:01.028044376Z 2024-04-06T03:24:01.032095296Z [2024-04-06T03:24:01.031+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T03:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:24:01.032250877Z [2024-04-06T03:24:01.032+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:24:01.032479807Z [2024-04-06T03:24:01.032+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:24:01.032639353Z [2024-04-06T03:24:01.032+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:24:01.032881589Z [2024-04-06T03:24:01.032+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:24:01.033044401Z [2024-04-06T03:24:01.032+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:24:01.243438836Z [2024-04-06T03:24:01.242+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:22:00+00:00 exited with status queued for try_number 1 2024-04-06T03:24:01.243492442Z [2024-04-06T03:24:01.243+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:23:00+00:00 exited with status queued for try_number 1 2024-04-06T03:24:01.243496580Z [2024-04-06T03:24:01.243+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:23:00+00:00 exited with status queued for try_number 1 2024-04-06T03:24:01.251779687Z [2024-04-06T03:24:01.251+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0195b8fb-078c-45d1-b580-77b98399e2ed 2024-04-06T03:24:01.251920738Z [2024-04-06T03:24:01.251+0000] {scheduler_job.py:635} INFO - Setting external_id for to cd573fde-9e03-4607-a3f0-68270a5de828 2024-04-06T03:24:01.252069336Z [2024-04-06T03:24:01.251+0000] {scheduler_job.py:635} INFO - Setting external_id for to d831e109-5f25-44e4-8262-db71febc4df7 2024-04-06T03:24:03.611022907Z [2024-04-06T03:24:03.610+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:24:03.611418999Z [2024-04-06T03:24:03.611+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 03:22:00+00:00, run_id=scheduled__2024-04-06T03:22:00+00:00, run_start_date=2024-04-06 03:24:00.961240+00:00, run_end_date=2024-04-06 03:24:03.610938+00:00, run_duration=2.649698, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:22:00+00:00, data_interval_end=2024-04-06 03:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T03:24:03.620033106Z [2024-04-06T03:24:03.619+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T03:24:00+00:00, run_after=2024-04-06T03:26:00+00:00 2024-04-06T03:24:03.685023949Z [2024-04-06T03:24:03.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:22:00+00:00 exited with status success for try_number 1 2024-04-06T03:24:03.689847145Z [2024-04-06T03:24:03.689+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T03:22:00+00:00, map_index=-1, run_start_date=2024-04-06 03:24:02.008067+00:00, run_end_date=2024-04-06 03:24:02.663483+00:00, run_duration=0.655416, state=success, executor_state=success, try_number=1, max_tries=1, job_id=392, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:24:01.029036+00:00, queued_by_job_id=2, pid=8859 2024-04-06T03:24:06.030950565Z [2024-04-06T03:24:06.030+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:24:06.031273751Z [2024-04-06T03:24:06.030+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:23:00+00:00, run_id=scheduled__2024-04-06T03:23:00+00:00, run_start_date=2024-04-06 03:24:00.963704+00:00, run_end_date=2024-04-06 03:24:06.030691+00:00, run_duration=5.066987, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:23:00+00:00, data_interval_end=2024-04-06 03:24:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:24:06.044168988Z [2024-04-06T03:24:06.043+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:24:00+00:00, run_after=2024-04-06T03:25:00+00:00 2024-04-06T03:24:06.059507829Z [2024-04-06T03:24:06.058+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:24:06.060427104Z [2024-04-06T03:24:06.059+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:23:00+00:00, run_id=scheduled__2024-04-06T03:23:00+00:00, run_start_date=2024-04-06 03:24:00.962574+00:00, run_end_date=2024-04-06 03:24:06.059674+00:00, run_duration=5.0971, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:23:00+00:00, data_interval_end=2024-04-06 03:24:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:24:06.076012628Z [2024-04-06T03:24:06.075+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:24:00+00:00, run_after=2024-04-06T03:25:00+00:00 2024-04-06T03:24:06.118914680Z [2024-04-06T03:24:06.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:23:00+00:00 exited with status success for try_number 1 2024-04-06T03:24:06.119337681Z [2024-04-06T03:24:06.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:23:00+00:00 exited with status success for try_number 1 2024-04-06T03:24:06.131822397Z [2024-04-06T03:24:06.131+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:23:00+00:00, map_index=-1, run_start_date=2024-04-06 03:24:03.561982+00:00, run_end_date=2024-04-06 03:24:04.928726+00:00, run_duration=1.366744, state=success, executor_state=success, try_number=1, max_tries=1, job_id=394, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:24:01.029036+00:00, queued_by_job_id=2, pid=8890 2024-04-06T03:24:06.132481348Z [2024-04-06T03:24:06.132+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:23:00+00:00, map_index=-1, run_start_date=2024-04-06 03:24:03.359512+00:00, run_end_date=2024-04-06 03:24:05.254819+00:00, run_duration=1.895307, state=success, executor_state=success, try_number=1, max_tries=1, job_id=393, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:24:01.029036+00:00, queued_by_job_id=2, pid=8889 2024-04-06T03:25:00.280853889Z [2024-04-06T03:25:00.279+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:25:00+00:00, run_after=2024-04-06T03:30:00+00:00 2024-04-06T03:25:00.295989343Z [2024-04-06T03:25:00.295+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:25:00+00:00, run_after=2024-04-06T03:26:00+00:00 2024-04-06T03:25:00.303806772Z [2024-04-06T03:25:00.303+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:25:00.412130459Z [2024-04-06T03:25:00.411+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T03:25:00.412210647Z 2024-04-06T03:25:00.412224165Z 2024-04-06T03:25:00.412233248Z 2024-04-06T03:25:00.412302484Z [2024-04-06T03:25:00.411+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:25:00.413147710Z [2024-04-06T03:25:00.412+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:25:00.413656901Z [2024-04-06T03:25:00.413+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:25:00.415207436Z [2024-04-06T03:25:00.414+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:25:00.415237005Z 2024-04-06T03:25:00.415292224Z 2024-04-06T03:25:00.415301427Z 2024-04-06T03:25:00.422611853Z [2024-04-06T03:25:00.422+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-06T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-06T03:25:00.422751951Z [2024-04-06T03:25:00.422+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:25:00.423407038Z [2024-04-06T03:25:00.423+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:25:00.423902532Z [2024-04-06T03:25:00.423+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:25:00.425211634Z [2024-04-06T03:25:00.424+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:25:00.426899204Z [2024-04-06T03:25:00.425+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:25:00.623135210Z [2024-04-06T03:25:00.622+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T03:20:00+00:00 exited with status queued for try_number 1 2024-04-06T03:25:00.623173058Z [2024-04-06T03:25:00.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:24:00+00:00 exited with status queued for try_number 1 2024-04-06T03:25:00.623320825Z [2024-04-06T03:25:00.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:24:00+00:00 exited with status queued for try_number 1 2024-04-06T03:25:00.631906921Z [2024-04-06T03:25:00.631+0000] {scheduler_job.py:635} INFO - Setting external_id for to f044b691-04b7-4880-a6a6-239b72be217b 2024-04-06T03:25:00.631999051Z [2024-04-06T03:25:00.631+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7988d1a6-e75e-4d43-a2f7-a49591f55743 2024-04-06T03:25:00.632290179Z [2024-04-06T03:25:00.632+0000] {scheduler_job.py:635} INFO - Setting external_id for to a4f89656-c84c-44a1-a17f-7ca36038e5d1 2024-04-06T03:25:04.484477420Z [2024-04-06T03:25:04.484+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:25:04.484505836Z 2024-04-06T03:25:04.484516853Z [2024-04-06T03:25:04.484+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:25:04.485034424Z [2024-04-06T03:25:04.484+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:25:04.485044997Z 2024-04-06T03:25:04.487288772Z [2024-04-06T03:25:04.487+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='split_metrics', run_id='scheduled__2024-04-06T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-06T03:25:04.487373294Z [2024-04-06T03:25:04.487+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:25:04.550267477Z [2024-04-06T03:25:04.549+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T03:20:00+00:00 exited with status queued for try_number 1 2024-04-06T03:25:04.552004029Z [2024-04-06T03:25:04.550+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T03:20:00+00:00 exited with status success for try_number 1 2024-04-06T03:25:04.572084720Z [2024-04-06T03:25:04.571+0000] {scheduler_job.py:635} INFO - Setting external_id for to a42ee5dc-2b5c-4f30-ba62-da7eb5857fcd 2024-04-06T03:25:04.575437834Z [2024-04-06T03:25:04.575+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-06T03:20:00+00:00, map_index=-1, run_start_date=2024-04-06 03:25:03.467526+00:00, run_end_date=2024-04-06 03:25:04.165419+00:00, run_duration=0.697893, state=success, executor_state=success, try_number=1, max_tries=1, job_id=395, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:25:00.418094+00:00, queued_by_job_id=2, pid=8946 2024-04-06T03:25:05.893946662Z [2024-04-06T03:25:05.893+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:25:05.894443563Z [2024-04-06T03:25:05.894+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:24:00+00:00, run_id=scheduled__2024-04-06T03:24:00+00:00, run_start_date=2024-04-06 03:25:00.323082+00:00, run_end_date=2024-04-06 03:25:05.893949+00:00, run_duration=5.570867, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:24:00+00:00, data_interval_end=2024-04-06 03:25:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:25:05.904753863Z [2024-04-06T03:25:05.904+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:25:00+00:00, run_after=2024-04-06T03:26:00+00:00 2024-04-06T03:25:05.951907555Z [2024-04-06T03:25:05.951+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:24:00+00:00 exited with status success for try_number 1 2024-04-06T03:25:05.956771037Z [2024-04-06T03:25:05.956+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:24:00+00:00, map_index=-1, run_start_date=2024-04-06 03:25:03.638437+00:00, run_end_date=2024-04-06 03:25:05.297877+00:00, run_duration=1.65944, state=success, executor_state=success, try_number=1, max_tries=1, job_id=396, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:25:00.418094+00:00, queued_by_job_id=2, pid=8947 2024-04-06T03:25:07.035039692Z [2024-04-06T03:25:07.034+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:25:07.035452664Z [2024-04-06T03:25:07.035+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:24:00+00:00, run_id=scheduled__2024-04-06T03:24:00+00:00, run_start_date=2024-04-06 03:25:00.326210+00:00, run_end_date=2024-04-06 03:25:07.035003+00:00, run_duration=6.708793, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:24:00+00:00, data_interval_end=2024-04-06 03:25:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:25:07.051646890Z [2024-04-06T03:25:07.051+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:25:00+00:00, run_after=2024-04-06T03:26:00+00:00 2024-04-06T03:25:07.144702741Z [2024-04-06T03:25:07.144+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:25:07.144743582Z 2024-04-06T03:25:07.144753330Z [2024-04-06T03:25:07.144+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:25:07.145358695Z [2024-04-06T03:25:07.145+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:25:07.145378910Z 2024-04-06T03:25:07.148188077Z [2024-04-06T03:25:07.147+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='collect_metrics', run_id='scheduled__2024-04-06T03:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-06T03:25:07.148267071Z [2024-04-06T03:25:07.147+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T03:25:07.220293441Z [2024-04-06T03:25:07.219+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T03:20:00+00:00 exited with status queued for try_number 1 2024-04-06T03:25:07.220718881Z [2024-04-06T03:25:07.220+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:24:00+00:00 exited with status success for try_number 1 2024-04-06T03:25:07.226399139Z [2024-04-06T03:25:07.226+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:24:00+00:00, map_index=-1, run_start_date=2024-04-06 03:25:04.589714+00:00, run_end_date=2024-04-06 03:25:06.406829+00:00, run_duration=1.817115, state=success, executor_state=success, try_number=1, max_tries=1, job_id=397, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:25:00.418094+00:00, queued_by_job_id=2, pid=8976 2024-04-06T03:25:07.226768311Z [2024-04-06T03:25:07.226+0000] {scheduler_job.py:635} INFO - Setting external_id for to c40a8e5e-dfeb-4239-840a-66e538f3969f 2024-04-06T03:25:07.297424017Z [2024-04-06T03:25:07.296+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T03:20:00+00:00 exited with status success for try_number 1 2024-04-06T03:25:07.303392043Z [2024-04-06T03:25:07.303+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=split_metrics, run_id=scheduled__2024-04-06T03:20:00+00:00, map_index=-1, run_start_date=2024-04-06 03:25:06.656408+00:00, run_end_date=2024-04-06 03:25:06.984843+00:00, run_duration=0.328435, state=success, executor_state=success, try_number=1, max_tries=1, job_id=398, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:25:04.485290+00:00, queued_by_job_id=2, pid=8996 2024-04-06T03:25:10.565979957Z [2024-04-06T03:25:10.565+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:25:10.566005581Z 2024-04-06T03:25:10.566011951Z [2024-04-06T03:25:10.565+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:25:10.566585392Z [2024-04-06T03:25:10.566+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:25:10.566593775Z 2024-04-06T03:25:10.568565125Z [2024-04-06T03:25:10.568+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='send_prometheus', run_id='scheduled__2024-04-06T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:25:10.568621585Z [2024-04-06T03:25:10.568+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:25:10.615967281Z [2024-04-06T03:25:10.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T03:20:00+00:00 exited with status queued for try_number 1 2024-04-06T03:25:10.616180189Z [2024-04-06T03:25:10.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T03:20:00+00:00 exited with status success for try_number 1 2024-04-06T03:25:10.635565582Z [2024-04-06T03:25:10.635+0000] {scheduler_job.py:635} INFO - Setting external_id for to f9284663-9426-4369-b169-a7472d089ed9 2024-04-06T03:25:10.635819927Z [2024-04-06T03:25:10.635+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=collect_metrics, run_id=scheduled__2024-04-06T03:20:00+00:00, map_index=0, run_start_date=2024-04-06 03:25:08.813512+00:00, run_end_date=2024-04-06 03:25:10.164813+00:00, run_duration=1.351301, state=success, executor_state=success, try_number=1, max_tries=1, job_id=399, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:25:07.145684+00:00, queued_by_job_id=2, pid=9008 2024-04-06T03:25:13.234974227Z [2024-04-06T03:25:13.234+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:25:13.235345225Z [2024-04-06T03:25:13.234+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:20:00+00:00, run_id=scheduled__2024-04-06T03:20:00+00:00, run_start_date=2024-04-06 03:25:00.319370+00:00, run_end_date=2024-04-06 03:25:13.234831+00:00, run_duration=12.915461, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:20:00+00:00, data_interval_end=2024-04-06 03:25:00+00:00, dag_hash=eecc559ff32fe9a7c4345875f113a0a9 2024-04-06T03:25:13.244007269Z [2024-04-06T03:25:13.243+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:25:00+00:00, run_after=2024-04-06T03:30:00+00:00 2024-04-06T03:25:13.289717495Z [2024-04-06T03:25:13.289+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T03:20:00+00:00 exited with status success for try_number 1 2024-04-06T03:25:13.296380039Z [2024-04-06T03:25:13.295+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=send_prometheus, run_id=scheduled__2024-04-06T03:20:00+00:00, map_index=-1, run_start_date=2024-04-06 03:25:12.329122+00:00, run_end_date=2024-04-06 03:25:12.738533+00:00, run_duration=0.409411, state=success, executor_state=success, try_number=1, max_tries=1, job_id=400, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:25:10.566781+00:00, queued_by_job_id=2, pid=9042 2024-04-06T03:25:20.753188366Z [2024-04-06T03:25:20.752+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-06T03:26:00.787824329Z [2024-04-06T03:26:00.787+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:26:00.794736965Z [2024-04-06T03:26:00.794+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:26:00.806329625Z [2024-04-06T03:26:00.806+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:26:00+00:00, run_after=2024-04-06T03:27:00+00:00 2024-04-06T03:26:00.909170983Z [2024-04-06T03:26:00.908+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T03:26:00.909210846Z 2024-04-06T03:26:00.909219861Z 2024-04-06T03:26:00.909224596Z 2024-04-06T03:26:00.909435052Z [2024-04-06T03:26:00.909+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T03:26:00.909608251Z [2024-04-06T03:26:00.909+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:26:00.909797799Z [2024-04-06T03:26:00.909+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:26:00.910589035Z [2024-04-06T03:26:00.910+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:26:00.910600549Z 2024-04-06T03:26:00.910605863Z 2024-04-06T03:26:00.910611116Z 2024-04-06T03:26:00.914371526Z [2024-04-06T03:26:00.914+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T03:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:26:00.915047529Z [2024-04-06T03:26:00.914+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:26:00.915309057Z [2024-04-06T03:26:00.915+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:26:00.915447494Z [2024-04-06T03:26:00.915+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:26:00.915675932Z [2024-04-06T03:26:00.915+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:26:00.915893639Z [2024-04-06T03:26:00.915+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:26:01.195595190Z [2024-04-06T03:26:01.194+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:24:00+00:00 exited with status queued for try_number 1 2024-04-06T03:26:01.195745106Z [2024-04-06T03:26:01.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:25:00+00:00 exited with status queued for try_number 1 2024-04-06T03:26:01.195921977Z [2024-04-06T03:26:01.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:25:00+00:00 exited with status queued for try_number 1 2024-04-06T03:26:01.209875194Z [2024-04-06T03:26:01.209+0000] {scheduler_job.py:635} INFO - Setting external_id for to 776e3934-191c-44ed-83e1-166077263755 2024-04-06T03:26:01.210237038Z [2024-04-06T03:26:01.209+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f4f76e4-cf00-4b60-8eae-bdca1bae787a 2024-04-06T03:26:01.210466964Z [2024-04-06T03:26:01.210+0000] {scheduler_job.py:635} INFO - Setting external_id for to 621181f3-e946-403f-b58d-a8025397f957 2024-04-06T03:26:04.222739599Z [2024-04-06T03:26:04.222+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:26:04.225669172Z [2024-04-06T03:26:04.225+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 03:24:00+00:00, run_id=scheduled__2024-04-06T03:24:00+00:00, run_start_date=2024-04-06 03:26:00.815614+00:00, run_end_date=2024-04-06 03:26:04.225032+00:00, run_duration=3.409418, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:24:00+00:00, data_interval_end=2024-04-06 03:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T03:26:04.286079496Z [2024-04-06T03:26:04.272+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T03:26:00+00:00, run_after=2024-04-06T03:28:00+00:00 2024-04-06T03:26:04.364259984Z [2024-04-06T03:26:04.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:24:00+00:00 exited with status success for try_number 1 2024-04-06T03:26:04.368913030Z [2024-04-06T03:26:04.368+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T03:24:00+00:00, map_index=-1, run_start_date=2024-04-06 03:26:02.022729+00:00, run_end_date=2024-04-06 03:26:03.204741+00:00, run_duration=1.182012, state=success, executor_state=success, try_number=1, max_tries=1, job_id=401, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:26:00.911289+00:00, queued_by_job_id=2, pid=9046 2024-04-06T03:26:06.583470373Z [2024-04-06T03:26:06.583+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:26:06.583819651Z [2024-04-06T03:26:06.583+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:25:00+00:00, run_id=scheduled__2024-04-06T03:25:00+00:00, run_start_date=2024-04-06 03:26:00.816799+00:00, run_end_date=2024-04-06 03:26:06.583391+00:00, run_duration=5.766592, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:25:00+00:00, data_interval_end=2024-04-06 03:26:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:26:06.594223470Z [2024-04-06T03:26:06.593+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:26:00+00:00, run_after=2024-04-06T03:27:00+00:00 2024-04-06T03:26:06.647129173Z [2024-04-06T03:26:06.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:25:00+00:00 exited with status success for try_number 1 2024-04-06T03:26:06.653709652Z [2024-04-06T03:26:06.653+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:25:00+00:00, map_index=-1, run_start_date=2024-04-06 03:26:03.501618+00:00, run_end_date=2024-04-06 03:26:06.403518+00:00, run_duration=2.9019, state=success, executor_state=success, try_number=1, max_tries=1, job_id=402, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:26:00.911289+00:00, queued_by_job_id=2, pid=9075 2024-04-06T03:26:08.782229167Z [2024-04-06T03:26:08.781+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:26:08.782810875Z [2024-04-06T03:26:08.782+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:25:00+00:00, run_id=scheduled__2024-04-06T03:25:00+00:00, run_start_date=2024-04-06 03:26:00.817983+00:00, run_end_date=2024-04-06 03:26:08.782158+00:00, run_duration=7.964175, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:25:00+00:00, data_interval_end=2024-04-06 03:26:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:26:08.795928136Z [2024-04-06T03:26:08.795+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:26:00+00:00, run_after=2024-04-06T03:27:00+00:00 2024-04-06T03:26:08.829129894Z [2024-04-06T03:26:08.828+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:25:00+00:00 exited with status success for try_number 1 2024-04-06T03:26:08.834577558Z [2024-04-06T03:26:08.834+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:25:00+00:00, map_index=-1, run_start_date=2024-04-06 03:26:03.525120+00:00, run_end_date=2024-04-06 03:26:07.734449+00:00, run_duration=4.209329, state=success, executor_state=success, try_number=1, max_tries=1, job_id=403, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:26:00.911289+00:00, queued_by_job_id=2, pid=9076 2024-04-06T03:26:38.998379553Z [2024-04-06T03:26:38.997+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:26:38.998474277Z 2024-04-06T03:26:38.998538573Z [2024-04-06T03:26:38.998+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-04-06T03:26:38.999265140Z [2024-04-06T03:26:38.999+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:26:38.999280672Z 2024-04-06T03:26:39.006725185Z [2024-04-06T03:26:39.006+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240406032638_492028', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:26:39.007291524Z [2024-04-06T03:26:39.006+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240406032638_492028', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-06T03:26:39.061388777Z [2024-04-06T03:26:39.061+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240406032638_492028 exited with status queued for try_number 1 2024-04-06T03:26:39.066857611Z [2024-04-06T03:26:39.066+0000] {scheduler_job.py:635} INFO - Setting external_id for to 556e9042-525a-4ee3-8a0c-b2011e6e378c 2024-04-06T03:26:40.223054933Z [2024-04-06T03:26:40.222+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:26:40.223474407Z [2024-04-06T03:26:40.223+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-04-06 03:26:38.559461+00:00, run_id=scaleout_vdu_20240406032638_492028, run_start_date=2024-04-06 03:26:38.956023+00:00, run_end_date=2024-04-06 03:26:40.223001+00:00, run_duration=1.266978, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-06 03:26:38.559461+00:00, data_interval_end=2024-04-06 03:26:38.559461+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-04-06T03:26:40.227267723Z [2024-04-06T03:26:40.227+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-04-06T03:26:41.320651184Z [2024-04-06T03:26:41.320+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240406032638_492028 exited with status success for try_number 1 2024-04-06T03:26:41.325011119Z [2024-04-06T03:26:41.324+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240406032638_492028, map_index=-1, run_start_date=2024-04-06 03:26:39.719167+00:00, run_end_date=2024-04-06 03:26:40.198598+00:00, run_duration=0.479431, state=success, executor_state=success, try_number=1, max_tries=1, job_id=404, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:26:38.999822+00:00, queued_by_job_id=2, pid=9109 2024-04-06T03:27:00.200293057Z [2024-04-06T03:27:00.199+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:27:00+00:00, run_after=2024-04-06T03:28:00+00:00 2024-04-06T03:27:00.212300681Z [2024-04-06T03:27:00.211+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:27:00.308588429Z [2024-04-06T03:27:00.308+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T03:27:00.308629274Z 2024-04-06T03:27:00.308633815Z 2024-04-06T03:27:00.308824781Z [2024-04-06T03:27:00.308+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:27:00.309022132Z [2024-04-06T03:27:00.308+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:27:00.310471868Z [2024-04-06T03:27:00.310+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:27:00.310483162Z 2024-04-06T03:27:00.310486386Z 2024-04-06T03:27:00.316100019Z [2024-04-06T03:27:00.315+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:27:00.316211554Z [2024-04-06T03:27:00.315+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:27:00.316553752Z [2024-04-06T03:27:00.316+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:27:00.316675659Z [2024-04-06T03:27:00.316+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:27:00.492567638Z [2024-04-06T03:27:00.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:26:00+00:00 exited with status queued for try_number 1 2024-04-06T03:27:00.492598031Z [2024-04-06T03:27:00.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:26:00+00:00 exited with status queued for try_number 1 2024-04-06T03:27:00.499754176Z [2024-04-06T03:27:00.499+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d983c5a-ad4e-441e-b231-17cf98f5a254 2024-04-06T03:27:00.499978867Z [2024-04-06T03:27:00.499+0000] {scheduler_job.py:635} INFO - Setting external_id for to c173b92d-7f41-47b8-a264-b1f37ed23eee 2024-04-06T03:27:05.367157847Z [2024-04-06T03:27:05.366+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:27:05.367248998Z [2024-04-06T03:27:05.367+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:26:00+00:00, run_id=scheduled__2024-04-06T03:26:00+00:00, run_start_date=2024-04-06 03:27:00.227031+00:00, run_end_date=2024-04-06 03:27:05.366954+00:00, run_duration=5.139923, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:26:00+00:00, data_interval_end=2024-04-06 03:27:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:27:05.375753558Z [2024-04-06T03:27:05.375+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:27:00+00:00, run_after=2024-04-06T03:28:00+00:00 2024-04-06T03:27:05.381842427Z [2024-04-06T03:27:05.381+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:27:05.381969729Z [2024-04-06T03:27:05.381+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:26:00+00:00, run_id=scheduled__2024-04-06T03:26:00+00:00, run_start_date=2024-04-06 03:27:00.228800+00:00, run_end_date=2024-04-06 03:27:05.381676+00:00, run_duration=5.152876, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:26:00+00:00, data_interval_end=2024-04-06 03:27:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:27:05.390409927Z [2024-04-06T03:27:05.390+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:27:00+00:00, run_after=2024-04-06T03:28:00+00:00 2024-04-06T03:27:05.419807979Z [2024-04-06T03:27:05.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:26:00+00:00 exited with status success for try_number 1 2024-04-06T03:27:05.419865689Z [2024-04-06T03:27:05.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:26:00+00:00 exited with status success for try_number 1 2024-04-06T03:27:05.425468347Z [2024-04-06T03:27:05.425+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:26:00+00:00, map_index=-1, run_start_date=2024-04-06 03:27:02.407759+00:00, run_end_date=2024-04-06 03:27:04.206480+00:00, run_duration=1.798721, state=success, executor_state=success, try_number=1, max_tries=1, job_id=406, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:27:00.312124+00:00, queued_by_job_id=2, pid=9143 2024-04-06T03:27:05.425555121Z [2024-04-06T03:27:05.425+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:26:00+00:00, map_index=-1, run_start_date=2024-04-06 03:27:02.309614+00:00, run_end_date=2024-04-06 03:27:04.871047+00:00, run_duration=2.561433, state=success, executor_state=success, try_number=1, max_tries=1, job_id=405, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:27:00.312124+00:00, queued_by_job_id=2, pid=9142 2024-04-06T03:28:00.099862938Z [2024-04-06T03:28:00.099+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:28:00+00:00, run_after=2024-04-06T03:29:00+00:00 2024-04-06T03:28:00.109988438Z [2024-04-06T03:28:00.109+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:28:00.118012975Z [2024-04-06T03:28:00.117+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:28:00.221188204Z [2024-04-06T03:28:00.220+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T03:28:00.221252775Z 2024-04-06T03:28:00.221259221Z 2024-04-06T03:28:00.221263518Z 2024-04-06T03:28:00.221480444Z [2024-04-06T03:28:00.221+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T03:28:00.221873194Z [2024-04-06T03:28:00.221+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:28:00.222159071Z [2024-04-06T03:28:00.221+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:28:00.223000203Z [2024-04-06T03:28:00.222+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:28:00.223010919Z 2024-04-06T03:28:00.223014850Z 2024-04-06T03:28:00.223018041Z 2024-04-06T03:28:00.227508649Z [2024-04-06T03:28:00.227+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T03:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:28:00.228051750Z [2024-04-06T03:28:00.227+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:28:00.228489829Z [2024-04-06T03:28:00.228+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:28:00.228734564Z [2024-04-06T03:28:00.228+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:28:00.228981852Z [2024-04-06T03:28:00.228+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:28:00.229178523Z [2024-04-06T03:28:00.228+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:28:00.456955048Z [2024-04-06T03:28:00.453+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:26:00+00:00 exited with status queued for try_number 1 2024-04-06T03:28:00.457122501Z [2024-04-06T03:28:00.456+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:27:00+00:00 exited with status queued for try_number 1 2024-04-06T03:28:00.457213255Z [2024-04-06T03:28:00.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:27:00+00:00 exited with status queued for try_number 1 2024-04-06T03:28:00.466911404Z [2024-04-06T03:28:00.466+0000] {scheduler_job.py:635} INFO - Setting external_id for to 26f18761-15ea-4a7c-9f50-90e4b30ab790 2024-04-06T03:28:00.467433592Z [2024-04-06T03:28:00.467+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed8ef454-c012-45ec-90b1-8af2606e3f90 2024-04-06T03:28:00.467940273Z [2024-04-06T03:28:00.467+0000] {scheduler_job.py:635} INFO - Setting external_id for to a223a8d9-a42d-460b-8c41-bd2c519a7054 2024-04-06T03:28:01.674639604Z [2024-04-06T03:28:01.670+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:28:01.674675874Z [2024-04-06T03:28:01.671+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 03:26:00+00:00, run_id=scheduled__2024-04-06T03:26:00+00:00, run_start_date=2024-04-06 03:28:00.130887+00:00, run_end_date=2024-04-06 03:28:01.671564+00:00, run_duration=1.540677, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:26:00+00:00, data_interval_end=2024-04-06 03:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T03:28:01.685970163Z [2024-04-06T03:28:01.685+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T03:28:00+00:00, run_after=2024-04-06T03:30:00+00:00 2024-04-06T03:28:03.166841490Z [2024-04-06T03:28:03.166+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:26:00+00:00 exited with status success for try_number 1 2024-04-06T03:28:03.187191059Z [2024-04-06T03:28:03.186+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T03:26:00+00:00, map_index=-1, run_start_date=2024-04-06 03:28:01.074990+00:00, run_end_date=2024-04-06 03:28:01.560157+00:00, run_duration=0.485167, state=success, executor_state=success, try_number=1, max_tries=1, job_id=407, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:28:00.224059+00:00, queued_by_job_id=2, pid=9179 2024-04-06T03:28:06.529549920Z [2024-04-06T03:28:06.528+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:28:06.530571555Z [2024-04-06T03:28:06.529+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:27:00+00:00, run_id=scheduled__2024-04-06T03:27:00+00:00, run_start_date=2024-04-06 03:28:00.132214+00:00, run_end_date=2024-04-06 03:28:06.529298+00:00, run_duration=6.397084, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:27:00+00:00, data_interval_end=2024-04-06 03:28:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:28:06.541009255Z [2024-04-06T03:28:06.540+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:28:00+00:00, run_after=2024-04-06T03:29:00+00:00 2024-04-06T03:28:06.547392217Z [2024-04-06T03:28:06.547+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:28:06.547592938Z [2024-04-06T03:28:06.547+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:27:00+00:00, run_id=scheduled__2024-04-06T03:27:00+00:00, run_start_date=2024-04-06 03:28:00.133564+00:00, run_end_date=2024-04-06 03:28:06.547277+00:00, run_duration=6.413713, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:27:00+00:00, data_interval_end=2024-04-06 03:28:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:28:06.556030492Z [2024-04-06T03:28:06.555+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:28:00+00:00, run_after=2024-04-06T03:29:00+00:00 2024-04-06T03:28:06.596348538Z [2024-04-06T03:28:06.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:27:00+00:00 exited with status success for try_number 1 2024-04-06T03:28:06.596466933Z [2024-04-06T03:28:06.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:27:00+00:00 exited with status success for try_number 1 2024-04-06T03:28:06.604805877Z [2024-04-06T03:28:06.604+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:27:00+00:00, map_index=-1, run_start_date=2024-04-06 03:28:03.506833+00:00, run_end_date=2024-04-06 03:28:05.563317+00:00, run_duration=2.056484, state=success, executor_state=success, try_number=1, max_tries=1, job_id=408, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:28:00.224059+00:00, queued_by_job_id=2, pid=9209 2024-04-06T03:28:06.605108577Z [2024-04-06T03:28:06.604+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:27:00+00:00, map_index=-1, run_start_date=2024-04-06 03:28:03.411191+00:00, run_end_date=2024-04-06 03:28:05.917123+00:00, run_duration=2.505932, state=success, executor_state=success, try_number=1, max_tries=1, job_id=409, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:28:00.224059+00:00, queued_by_job_id=2, pid=9208 2024-04-06T03:29:00.191827463Z [2024-04-06T03:29:00.191+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:29:00+00:00, run_after=2024-04-06T03:30:00+00:00 2024-04-06T03:29:00.200322136Z [2024-04-06T03:29:00.199+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:29:00.258306835Z [2024-04-06T03:29:00.257+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T03:29:00.258352218Z 2024-04-06T03:29:00.258357754Z 2024-04-06T03:29:00.258396535Z [2024-04-06T03:29:00.258+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:29:00.258681861Z [2024-04-06T03:29:00.258+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:29:00.260811710Z [2024-04-06T03:29:00.260+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:29:00.260886754Z 2024-04-06T03:29:00.260894339Z 2024-04-06T03:29:00.263939820Z [2024-04-06T03:29:00.263+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:29:00.264158271Z [2024-04-06T03:29:00.263+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:29:00.264540591Z [2024-04-06T03:29:00.264+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:29:00.264705111Z [2024-04-06T03:29:00.264+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:29:00.424827935Z [2024-04-06T03:29:00.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:28:00+00:00 exited with status queued for try_number 1 2024-04-06T03:29:00.425104122Z [2024-04-06T03:29:00.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:28:00+00:00 exited with status queued for try_number 1 2024-04-06T03:29:00.434663057Z [2024-04-06T03:29:00.434+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34c5a19c-9413-4dd9-ac26-703feafeffe2 2024-04-06T03:29:00.434855630Z [2024-04-06T03:29:00.434+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e894e49-a102-4a12-9bbb-02897459852e 2024-04-06T03:29:03.790440587Z [2024-04-06T03:29:03.789+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:29:03.790871578Z [2024-04-06T03:29:03.790+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:28:00+00:00, run_id=scheduled__2024-04-06T03:28:00+00:00, run_start_date=2024-04-06 03:29:00.210872+00:00, run_end_date=2024-04-06 03:29:03.790352+00:00, run_duration=3.57948, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:28:00+00:00, data_interval_end=2024-04-06 03:29:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:29:03.821643675Z [2024-04-06T03:29:03.821+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:29:00+00:00, run_after=2024-04-06T03:30:00+00:00 2024-04-06T03:29:03.873790241Z [2024-04-06T03:29:03.873+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:28:00+00:00 exited with status success for try_number 1 2024-04-06T03:29:03.883435082Z [2024-04-06T03:29:03.883+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:28:00+00:00, map_index=-1, run_start_date=2024-04-06 03:29:02.209296+00:00, run_end_date=2024-04-06 03:29:03.583275+00:00, run_duration=1.373979, state=success, executor_state=success, try_number=1, max_tries=1, job_id=410, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:29:00.261517+00:00, queued_by_job_id=2, pid=9263 2024-04-06T03:29:04.995437774Z [2024-04-06T03:29:04.994+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:29:04.996850946Z [2024-04-06T03:29:04.996+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:28:00+00:00, run_id=scheduled__2024-04-06T03:28:00+00:00, run_start_date=2024-04-06 03:29:00.212141+00:00, run_end_date=2024-04-06 03:29:04.996440+00:00, run_duration=4.784299, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:28:00+00:00, data_interval_end=2024-04-06 03:29:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:29:05.024788725Z [2024-04-06T03:29:05.023+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:29:00+00:00, run_after=2024-04-06T03:30:00+00:00 2024-04-06T03:29:05.501981846Z [2024-04-06T03:29:05.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:28:00+00:00 exited with status success for try_number 1 2024-04-06T03:29:05.505983047Z [2024-04-06T03:29:05.505+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:28:00+00:00, map_index=-1, run_start_date=2024-04-06 03:29:02.449579+00:00, run_end_date=2024-04-06 03:29:04.896534+00:00, run_duration=2.446955, state=success, executor_state=success, try_number=1, max_tries=1, job_id=411, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:29:00.261517+00:00, queued_by_job_id=2, pid=9264 2024-04-06T03:30:00.335425891Z [2024-04-06T03:30:00.334+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:30:00+00:00, run_after=2024-04-06T03:35:00+00:00 2024-04-06T03:30:00.351375124Z [2024-04-06T03:30:00.350+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:30:00+00:00, run_after=2024-04-06T03:31:00+00:00 2024-04-06T03:30:00.359598449Z [2024-04-06T03:30:00.359+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:30:00.367083456Z [2024-04-06T03:30:00.366+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:30:00.472214365Z [2024-04-06T03:30:00.470+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-06T03:30:00.472249258Z 2024-04-06T03:30:00.472255729Z 2024-04-06T03:30:00.472262004Z 2024-04-06T03:30:00.472267183Z 2024-04-06T03:30:00.472272422Z [2024-04-06T03:30:00.470+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:30:00.472280560Z [2024-04-06T03:30:00.471+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T03:30:00.472286038Z [2024-04-06T03:30:00.471+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:30:00.472291232Z [2024-04-06T03:30:00.471+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:30:00.472296825Z [2024-04-06T03:30:00.471+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:30:00.472343888Z 2024-04-06T03:30:00.472354222Z 2024-04-06T03:30:00.472422111Z 2024-04-06T03:30:00.472431333Z 2024-04-06T03:30:00.478596540Z [2024-04-06T03:30:00.476+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-06T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-06T03:30:00.478618410Z [2024-04-06T03:30:00.477+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:30:00.478624531Z [2024-04-06T03:30:00.477+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T03:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:30:00.478629749Z [2024-04-06T03:30:00.477+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:30:00.478645920Z [2024-04-06T03:30:00.478+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:30:00.478650452Z [2024-04-06T03:30:00.478+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:30:00.480703324Z [2024-04-06T03:30:00.478+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:30:00.480717622Z [2024-04-06T03:30:00.478+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:30:00.802601264Z [2024-04-06T03:30:00.802+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T03:25:00+00:00 exited with status queued for try_number 1 2024-04-06T03:30:00.802643167Z [2024-04-06T03:30:00.802+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:28:00+00:00 exited with status queued for try_number 1 2024-04-06T03:30:00.802691584Z [2024-04-06T03:30:00.802+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:29:00+00:00 exited with status queued for try_number 1 2024-04-06T03:30:00.802746923Z [2024-04-06T03:30:00.802+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:29:00+00:00 exited with status queued for try_number 1 2024-04-06T03:30:00.823523031Z [2024-04-06T03:30:00.823+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba1804ab-d577-4c8c-bc19-f93e88b038f4 2024-04-06T03:30:00.824135395Z [2024-04-06T03:30:00.823+0000] {scheduler_job.py:635} INFO - Setting external_id for to f046b3e3-1180-4ba8-b9b0-505d9d76d026 2024-04-06T03:30:00.824146352Z [2024-04-06T03:30:00.823+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4410b79f-aaa7-4371-a51c-b20b65bdf2e3 2024-04-06T03:30:00.824149446Z [2024-04-06T03:30:00.823+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6561ced-ced3-41f7-a432-2102aa852097 2024-04-06T03:30:02.589079752Z [2024-04-06T03:30:02.587+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:30:02.589327350Z [2024-04-06T03:30:02.589+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 03:28:00+00:00, run_id=scheduled__2024-04-06T03:28:00+00:00, run_start_date=2024-04-06 03:30:00.382675+00:00, run_end_date=2024-04-06 03:30:02.589005+00:00, run_duration=2.20633, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:28:00+00:00, data_interval_end=2024-04-06 03:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T03:30:02.599062736Z [2024-04-06T03:30:02.598+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T03:30:00+00:00, run_after=2024-04-06T03:32:00+00:00 2024-04-06T03:30:02.709798332Z [2024-04-06T03:30:02.709+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:28:00+00:00 exited with status success for try_number 1 2024-04-06T03:30:02.719957153Z [2024-04-06T03:30:02.719+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T03:28:00+00:00, map_index=-1, run_start_date=2024-04-06 03:30:01.602454+00:00, run_end_date=2024-04-06 03:30:02.141488+00:00, run_duration=0.539034, state=success, executor_state=success, try_number=1, max_tries=1, job_id=412, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:30:00.474383+00:00, queued_by_job_id=2, pid=9300 2024-04-06T03:30:05.000299573Z [2024-04-06T03:30:04.999+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:30:05.002618563Z [2024-04-06T03:30:05.002+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:29:00+00:00, run_id=scheduled__2024-04-06T03:29:00+00:00, run_start_date=2024-04-06 03:30:00.383830+00:00, run_end_date=2024-04-06 03:30:05.000213+00:00, run_duration=4.616383, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:29:00+00:00, data_interval_end=2024-04-06 03:30:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:30:05.011487399Z [2024-04-06T03:30:05.011+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:30:00+00:00, run_after=2024-04-06T03:31:00+00:00 2024-04-06T03:30:05.044426987Z [2024-04-06T03:30:05.044+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:30:05.044474009Z 2024-04-06T03:30:05.044485683Z [2024-04-06T03:30:05.044+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:30:05.044955189Z [2024-04-06T03:30:05.044+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:30:05.044962711Z 2024-04-06T03:30:05.047165346Z [2024-04-06T03:30:05.046+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='split_metrics', run_id='scheduled__2024-04-06T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-06T03:30:05.047243752Z [2024-04-06T03:30:05.047+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:30:05.213194548Z [2024-04-06T03:30:05.212+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T03:25:00+00:00 exited with status queued for try_number 1 2024-04-06T03:30:05.213352842Z [2024-04-06T03:30:05.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T03:25:00+00:00 exited with status success for try_number 1 2024-04-06T03:30:05.213489283Z [2024-04-06T03:30:05.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:29:00+00:00 exited with status success for try_number 1 2024-04-06T03:30:05.231053194Z [2024-04-06T03:30:05.230+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:29:00+00:00, map_index=-1, run_start_date=2024-04-06 03:30:03.225762+00:00, run_end_date=2024-04-06 03:30:04.650928+00:00, run_duration=1.425166, state=success, executor_state=success, try_number=1, max_tries=1, job_id=413, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:30:00.474383+00:00, queued_by_job_id=2, pid=9322 2024-04-06T03:30:05.237484920Z [2024-04-06T03:30:05.237+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-06T03:25:00+00:00, map_index=-1, run_start_date=2024-04-06 03:30:04.057659+00:00, run_end_date=2024-04-06 03:30:04.626016+00:00, run_duration=0.568357, state=success, executor_state=success, try_number=1, max_tries=1, job_id=415, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:30:00.474383+00:00, queued_by_job_id=2, pid=9351 2024-04-06T03:30:05.237714892Z [2024-04-06T03:30:05.237+0000] {scheduler_job.py:635} INFO - Setting external_id for to d1ba0902-b3d5-4d12-a205-dc1dfa5829d5 2024-04-06T03:30:06.492862977Z [2024-04-06T03:30:06.492+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:30:06.493271946Z [2024-04-06T03:30:06.493+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:29:00+00:00, run_id=scheduled__2024-04-06T03:29:00+00:00, run_start_date=2024-04-06 03:30:00.385250+00:00, run_end_date=2024-04-06 03:30:06.492704+00:00, run_duration=6.107454, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:29:00+00:00, data_interval_end=2024-04-06 03:30:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:30:06.501551977Z [2024-04-06T03:30:06.501+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:30:00+00:00, run_after=2024-04-06T03:31:00+00:00 2024-04-06T03:30:06.546654689Z [2024-04-06T03:30:06.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:29:00+00:00 exited with status success for try_number 1 2024-04-06T03:30:06.554388406Z [2024-04-06T03:30:06.554+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:29:00+00:00, map_index=-1, run_start_date=2024-04-06 03:30:03.903245+00:00, run_end_date=2024-04-06 03:30:06.074970+00:00, run_duration=2.171725, state=success, executor_state=success, try_number=1, max_tries=1, job_id=414, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:30:00.474383+00:00, queued_by_job_id=2, pid=9350 2024-04-06T03:30:07.672128109Z [2024-04-06T03:30:07.671+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:30:07.672171683Z 2024-04-06T03:30:07.672767331Z [2024-04-06T03:30:07.672+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:30:07.674681668Z [2024-04-06T03:30:07.674+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:30:07.674717049Z 2024-04-06T03:30:07.679925354Z [2024-04-06T03:30:07.679+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='collect_metrics', run_id='scheduled__2024-04-06T03:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-06T03:30:07.680595575Z [2024-04-06T03:30:07.680+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T03:30:07.737454030Z [2024-04-06T03:30:07.737+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T03:25:00+00:00 exited with status queued for try_number 1 2024-04-06T03:30:07.737783548Z [2024-04-06T03:30:07.737+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T03:25:00+00:00 exited with status success for try_number 1 2024-04-06T03:30:07.744754879Z [2024-04-06T03:30:07.744+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6d115775-026f-4177-ab4a-be688ab01772 2024-04-06T03:30:07.745081907Z [2024-04-06T03:30:07.744+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=split_metrics, run_id=scheduled__2024-04-06T03:25:00+00:00, map_index=-1, run_start_date=2024-04-06 03:30:06.877514+00:00, run_end_date=2024-04-06 03:30:07.242516+00:00, run_duration=0.365002, state=success, executor_state=success, try_number=1, max_tries=1, job_id=416, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:30:05.045228+00:00, queued_by_job_id=2, pid=9381 2024-04-06T03:30:11.510630697Z [2024-04-06T03:30:11.510+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:30:11.510653505Z 2024-04-06T03:30:11.510890801Z [2024-04-06T03:30:11.510+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:30:11.511453087Z [2024-04-06T03:30:11.511+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:30:11.511475696Z 2024-04-06T03:30:11.517110483Z [2024-04-06T03:30:11.516+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='send_prometheus', run_id='scheduled__2024-04-06T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:30:11.517293282Z [2024-04-06T03:30:11.517+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:30:11.627897122Z [2024-04-06T03:30:11.627+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T03:25:00+00:00 exited with status queued for try_number 1 2024-04-06T03:30:11.629081144Z [2024-04-06T03:30:11.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T03:25:00+00:00 exited with status success for try_number 1 2024-04-06T03:30:11.647605336Z [2024-04-06T03:30:11.647+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4ee5147-331c-4a3d-91a4-bef384e53c00 2024-04-06T03:30:11.648267895Z [2024-04-06T03:30:11.647+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=collect_metrics, run_id=scheduled__2024-04-06T03:25:00+00:00, map_index=0, run_start_date=2024-04-06 03:30:09.584512+00:00, run_end_date=2024-04-06 03:30:11.154849+00:00, run_duration=1.570337, state=success, executor_state=success, try_number=1, max_tries=1, job_id=417, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:30:07.675771+00:00, queued_by_job_id=2, pid=9402 2024-04-06T03:30:14.691100008Z [2024-04-06T03:30:14.690+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:30:14.691396740Z [2024-04-06T03:30:14.691+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:25:00+00:00, run_id=scheduled__2024-04-06T03:25:00+00:00, run_start_date=2024-04-06 03:30:00.381305+00:00, run_end_date=2024-04-06 03:30:14.690990+00:00, run_duration=14.309685, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:25:00+00:00, data_interval_end=2024-04-06 03:30:00+00:00, dag_hash=eecc559ff32fe9a7c4345875f113a0a9 2024-04-06T03:30:14.697312847Z [2024-04-06T03:30:14.697+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:30:00+00:00, run_after=2024-04-06T03:35:00+00:00 2024-04-06T03:30:14.728481279Z [2024-04-06T03:30:14.728+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T03:25:00+00:00 exited with status success for try_number 1 2024-04-06T03:30:14.733915233Z [2024-04-06T03:30:14.733+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=send_prometheus, run_id=scheduled__2024-04-06T03:25:00+00:00, map_index=-1, run_start_date=2024-04-06 03:30:13.261128+00:00, run_end_date=2024-04-06 03:30:13.616217+00:00, run_duration=0.355089, state=success, executor_state=success, try_number=1, max_tries=1, job_id=418, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:30:11.511846+00:00, queued_by_job_id=2, pid=9426 2024-04-06T03:30:20.842039038Z [2024-04-06T03:30:20.837+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-06T03:31:00.781291780Z [2024-04-06T03:31:00.780+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:31:00.793505229Z [2024-04-06T03:31:00.793+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:31:00+00:00, run_after=2024-04-06T03:32:00+00:00 2024-04-06T03:31:00.867447549Z [2024-04-06T03:31:00.866+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T03:31:00.867530144Z 2024-04-06T03:31:00.867534640Z 2024-04-06T03:31:00.867537819Z [2024-04-06T03:31:00.867+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:31:00.867540912Z [2024-04-06T03:31:00.867+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:31:00.867787077Z [2024-04-06T03:31:00.867+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:31:00.867794035Z 2024-04-06T03:31:00.867797289Z 2024-04-06T03:31:00.871011355Z [2024-04-06T03:31:00.870+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:31:00.871177611Z [2024-04-06T03:31:00.870+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:31:00.871495624Z [2024-04-06T03:31:00.871+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:31:00.871609523Z [2024-04-06T03:31:00.871+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:31:01.041721306Z [2024-04-06T03:31:01.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:30:00+00:00 exited with status queued for try_number 1 2024-04-06T03:31:01.041821371Z [2024-04-06T03:31:01.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:30:00+00:00 exited with status queued for try_number 1 2024-04-06T03:31:01.048147439Z [2024-04-06T03:31:01.047+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3db3e3a1-b9c3-4439-9d79-6cc5ac8f1590 2024-04-06T03:31:01.048210705Z [2024-04-06T03:31:01.048+0000] {scheduler_job.py:635} INFO - Setting external_id for to b2000b87-dbde-4b23-920e-dca88976506b 2024-04-06T03:31:04.773465763Z [2024-04-06T03:31:04.773+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:31:04.773740209Z [2024-04-06T03:31:04.773+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:30:00+00:00, run_id=scheduled__2024-04-06T03:30:00+00:00, run_start_date=2024-04-06 03:31:00.803093+00:00, run_end_date=2024-04-06 03:31:04.773384+00:00, run_duration=3.970291, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:30:00+00:00, data_interval_end=2024-04-06 03:31:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:31:04.784848221Z [2024-04-06T03:31:04.784+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:31:00+00:00, run_after=2024-04-06T03:32:00+00:00 2024-04-06T03:31:04.817545273Z [2024-04-06T03:31:04.817+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:30:00+00:00 exited with status success for try_number 1 2024-04-06T03:31:04.823746766Z [2024-04-06T03:31:04.823+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:30:00+00:00, map_index=-1, run_start_date=2024-04-06 03:31:02.926358+00:00, run_end_date=2024-04-06 03:31:04.522271+00:00, run_duration=1.595913, state=success, executor_state=success, try_number=1, max_tries=1, job_id=419, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:31:00.868569+00:00, queued_by_job_id=2, pid=9448 2024-04-06T03:31:05.878649347Z [2024-04-06T03:31:05.877+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:31:05.879370707Z [2024-04-06T03:31:05.878+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:30:00+00:00, run_id=scheduled__2024-04-06T03:30:00+00:00, run_start_date=2024-04-06 03:31:00.804420+00:00, run_end_date=2024-04-06 03:31:05.878777+00:00, run_duration=5.074357, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:30:00+00:00, data_interval_end=2024-04-06 03:31:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:31:05.894644634Z [2024-04-06T03:31:05.894+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:31:00+00:00, run_after=2024-04-06T03:32:00+00:00 2024-04-06T03:31:05.936056426Z [2024-04-06T03:31:05.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:30:00+00:00 exited with status success for try_number 1 2024-04-06T03:31:05.944677178Z [2024-04-06T03:31:05.943+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:30:00+00:00, map_index=-1, run_start_date=2024-04-06 03:31:03.029119+00:00, run_end_date=2024-04-06 03:31:05.217376+00:00, run_duration=2.188257, state=success, executor_state=success, try_number=1, max_tries=1, job_id=420, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:31:00.868569+00:00, queued_by_job_id=2, pid=9449 2024-04-06T03:32:00.087349749Z [2024-04-06T03:32:00.086+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:32:00.095735379Z [2024-04-06T03:32:00.095+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:32:00.109628439Z [2024-04-06T03:32:00.109+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:32:00+00:00, run_after=2024-04-06T03:33:00+00:00 2024-04-06T03:32:00.182989981Z [2024-04-06T03:32:00.182+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T03:32:00.183012526Z 2024-04-06T03:32:00.183017335Z 2024-04-06T03:32:00.183020627Z 2024-04-06T03:32:00.183220313Z [2024-04-06T03:32:00.182+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T03:32:00.183522666Z [2024-04-06T03:32:00.183+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:32:00.183619646Z [2024-04-06T03:32:00.183+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:32:00.184458082Z [2024-04-06T03:32:00.184+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:32:00.184473029Z 2024-04-06T03:32:00.184478017Z 2024-04-06T03:32:00.184482450Z 2024-04-06T03:32:00.188957705Z [2024-04-06T03:32:00.188+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:32:00.189260634Z [2024-04-06T03:32:00.188+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:32:00.189729426Z [2024-04-06T03:32:00.189+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:32:00.190129407Z [2024-04-06T03:32:00.189+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:32:00.190678302Z [2024-04-06T03:32:00.190+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:32:00.191033046Z [2024-04-06T03:32:00.190+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:32:00.379000733Z [2024-04-06T03:32:00.378+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:30:00+00:00 exited with status queued for try_number 1 2024-04-06T03:32:00.379173959Z [2024-04-06T03:32:00.378+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:31:00+00:00 exited with status queued for try_number 1 2024-04-06T03:32:00.379346166Z [2024-04-06T03:32:00.379+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:31:00+00:00 exited with status queued for try_number 1 2024-04-06T03:32:00.386660975Z [2024-04-06T03:32:00.386+0000] {scheduler_job.py:635} INFO - Setting external_id for to 63ed4c6f-5747-44e4-8ea5-f38967158566 2024-04-06T03:32:00.386853355Z [2024-04-06T03:32:00.386+0000] {scheduler_job.py:635} INFO - Setting external_id for to e07df300-7470-4db9-9fbd-95c3208bc87d 2024-04-06T03:32:00.387042322Z [2024-04-06T03:32:00.386+0000] {scheduler_job.py:635} INFO - Setting external_id for to 081ed6c2-a0e9-4b19-b5dd-e13b52a5f79a 2024-04-06T03:32:02.671235665Z [2024-04-06T03:32:02.670+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:32:02.671731707Z [2024-04-06T03:32:02.671+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 03:30:00+00:00, run_id=scheduled__2024-04-06T03:30:00+00:00, run_start_date=2024-04-06 03:32:00.120925+00:00, run_end_date=2024-04-06 03:32:02.671318+00:00, run_duration=2.550393, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:30:00+00:00, data_interval_end=2024-04-06 03:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T03:32:02.690098013Z [2024-04-06T03:32:02.689+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T03:32:00+00:00, run_after=2024-04-06T03:34:00+00:00 2024-04-06T03:32:02.819231793Z [2024-04-06T03:32:02.818+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:30:00+00:00 exited with status success for try_number 1 2024-04-06T03:32:02.842852120Z [2024-04-06T03:32:02.842+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T03:30:00+00:00, map_index=-1, run_start_date=2024-04-06 03:32:01.071049+00:00, run_end_date=2024-04-06 03:32:01.580871+00:00, run_duration=0.509822, state=success, executor_state=success, try_number=1, max_tries=1, job_id=421, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:32:00.185323+00:00, queued_by_job_id=2, pid=9483 2024-04-06T03:32:04.621585853Z [2024-04-06T03:32:04.621+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:32:04.621743362Z [2024-04-06T03:32:04.621+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:31:00+00:00, run_id=scheduled__2024-04-06T03:31:00+00:00, run_start_date=2024-04-06 03:32:00.122303+00:00, run_end_date=2024-04-06 03:32:04.621503+00:00, run_duration=4.4992, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:31:00+00:00, data_interval_end=2024-04-06 03:32:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:32:04.633023892Z [2024-04-06T03:32:04.632+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:32:00+00:00, run_after=2024-04-06T03:33:00+00:00 2024-04-06T03:32:04.664841319Z [2024-04-06T03:32:04.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:31:00+00:00 exited with status success for try_number 1 2024-04-06T03:32:04.675272991Z [2024-04-06T03:32:04.674+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:31:00+00:00, map_index=-1, run_start_date=2024-04-06 03:32:02.534243+00:00, run_end_date=2024-04-06 03:32:04.025507+00:00, run_duration=1.491264, state=success, executor_state=success, try_number=1, max_tries=1, job_id=422, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:32:00.185323+00:00, queued_by_job_id=2, pid=9513 2024-04-06T03:32:05.748463042Z [2024-04-06T03:32:05.747+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:32:05.748878461Z [2024-04-06T03:32:05.748+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:31:00+00:00, run_id=scheduled__2024-04-06T03:31:00+00:00, run_start_date=2024-04-06 03:32:00.123419+00:00, run_end_date=2024-04-06 03:32:05.748279+00:00, run_duration=5.62486, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:31:00+00:00, data_interval_end=2024-04-06 03:32:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:32:05.761945679Z [2024-04-06T03:32:05.761+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:32:00+00:00, run_after=2024-04-06T03:33:00+00:00 2024-04-06T03:32:05.798874972Z [2024-04-06T03:32:05.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:31:00+00:00 exited with status success for try_number 1 2024-04-06T03:32:05.807167464Z [2024-04-06T03:32:05.806+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:31:00+00:00, map_index=-1, run_start_date=2024-04-06 03:32:02.627796+00:00, run_end_date=2024-04-06 03:32:04.772202+00:00, run_duration=2.144406, state=success, executor_state=success, try_number=1, max_tries=1, job_id=423, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:32:00.185323+00:00, queued_by_job_id=2, pid=9514 2024-04-06T03:32:39.044575618Z [2024-04-06T03:32:39.043+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:32:39.044629169Z 2024-04-06T03:32:39.044892881Z [2024-04-06T03:32:39.044+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-04-06T03:32:39.045930094Z [2024-04-06T03:32:39.045+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:32:39.045958157Z 2024-04-06T03:32:39.049638351Z [2024-04-06T03:32:39.049+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240406033238_630310', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:32:39.049953153Z [2024-04-06T03:32:39.049+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240406033238_630310', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-06T03:32:39.126630853Z [2024-04-06T03:32:39.126+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240406033238_630310 exited with status queued for try_number 1 2024-04-06T03:32:39.134160088Z [2024-04-06T03:32:39.133+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4670d40-3cb2-44ab-83ae-65f79c529593 2024-04-06T03:32:40.661672113Z [2024-04-06T03:32:40.661+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:32:40.662039488Z [2024-04-06T03:32:40.661+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-04-06 03:32:38.505174+00:00, run_id=scaleout_vdu_20240406033238_630310, run_start_date=2024-04-06 03:32:38.993913+00:00, run_end_date=2024-04-06 03:32:40.661551+00:00, run_duration=1.667638, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-06 03:32:38.505174+00:00, data_interval_end=2024-04-06 03:32:38.505174+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-04-06T03:32:40.666246927Z [2024-04-06T03:32:40.665+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-04-06T03:32:40.704654899Z [2024-04-06T03:32:40.704+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240406033238_630310 exited with status success for try_number 1 2024-04-06T03:32:40.709967080Z [2024-04-06T03:32:40.709+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240406033238_630310, map_index=-1, run_start_date=2024-04-06 03:32:39.812829+00:00, run_end_date=2024-04-06 03:32:40.192652+00:00, run_duration=0.379823, state=success, executor_state=success, try_number=1, max_tries=1, job_id=424, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:32:39.046434+00:00, queued_by_job_id=2, pid=9547 2024-04-06T03:33:00.486330735Z [2024-04-06T03:33:00.486+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:33:00+00:00, run_after=2024-04-06T03:34:00+00:00 2024-04-06T03:33:00.495358760Z [2024-04-06T03:33:00.495+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:33:00.577417166Z [2024-04-06T03:33:00.577+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T03:33:00.577442273Z 2024-04-06T03:33:00.577446362Z 2024-04-06T03:33:00.577858551Z [2024-04-06T03:33:00.577+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:33:00.578075263Z [2024-04-06T03:33:00.577+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:33:00.578798349Z [2024-04-06T03:33:00.578+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:33:00.578810215Z 2024-04-06T03:33:00.578814250Z 2024-04-06T03:33:00.582100111Z [2024-04-06T03:33:00.581+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:33:00.582381318Z [2024-04-06T03:33:00.582+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:33:00.582796281Z [2024-04-06T03:33:00.582+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:33:00.583074248Z [2024-04-06T03:33:00.582+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:33:00.811532921Z [2024-04-06T03:33:00.811+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:32:00+00:00 exited with status queued for try_number 1 2024-04-06T03:33:00.811937800Z [2024-04-06T03:33:00.811+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:32:00+00:00 exited with status queued for try_number 1 2024-04-06T03:33:00.820790266Z [2024-04-06T03:33:00.820+0000] {scheduler_job.py:635} INFO - Setting external_id for to a421e4c2-e484-4dbd-af9c-2da6dcb5d860 2024-04-06T03:33:00.820949463Z [2024-04-06T03:33:00.820+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8fd34087-a7ec-4c01-a9bf-7b33fbc6f57a 2024-04-06T03:33:04.191921243Z [2024-04-06T03:33:04.191+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:33:04.192429083Z [2024-04-06T03:33:04.192+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:32:00+00:00, run_id=scheduled__2024-04-06T03:32:00+00:00, run_start_date=2024-04-06 03:33:00.514630+00:00, run_end_date=2024-04-06 03:33:04.192060+00:00, run_duration=3.67743, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:32:00+00:00, data_interval_end=2024-04-06 03:33:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:33:04.206335090Z [2024-04-06T03:33:04.206+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:33:00+00:00, run_after=2024-04-06T03:34:00+00:00 2024-04-06T03:33:04.263152336Z [2024-04-06T03:33:04.262+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:32:00+00:00 exited with status success for try_number 1 2024-04-06T03:33:04.268242187Z [2024-04-06T03:33:04.267+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:32:00+00:00, map_index=-1, run_start_date=2024-04-06 03:33:02.553533+00:00, run_end_date=2024-04-06 03:33:03.991761+00:00, run_duration=1.438228, state=success, executor_state=success, try_number=1, max_tries=1, job_id=425, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:33:00.579527+00:00, queued_by_job_id=2, pid=9579 2024-04-06T03:33:04.493454627Z [2024-04-06T03:33:04.493+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:33:04.495128417Z [2024-04-06T03:33:04.494+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:32:00+00:00, run_id=scheduled__2024-04-06T03:32:00+00:00, run_start_date=2024-04-06 03:33:00.518479+00:00, run_end_date=2024-04-06 03:33:04.494810+00:00, run_duration=3.976331, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:32:00+00:00, data_interval_end=2024-04-06 03:33:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:33:04.508717317Z [2024-04-06T03:33:04.508+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:33:00+00:00, run_after=2024-04-06T03:34:00+00:00 2024-04-06T03:33:04.552582827Z [2024-04-06T03:33:04.552+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:32:00+00:00 exited with status success for try_number 1 2024-04-06T03:33:04.564509206Z [2024-04-06T03:33:04.564+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:32:00+00:00, map_index=-1, run_start_date=2024-04-06 03:33:02.556521+00:00, run_end_date=2024-04-06 03:33:04.213856+00:00, run_duration=1.657335, state=success, executor_state=success, try_number=1, max_tries=1, job_id=426, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:33:00.579527+00:00, queued_by_job_id=2, pid=9578 2024-04-06T03:34:00.420885399Z [2024-04-06T03:34:00.419+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:34:00.432564009Z [2024-04-06T03:34:00.432+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:34:00.449099864Z [2024-04-06T03:34:00.448+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:34:00+00:00, run_after=2024-04-06T03:35:00+00:00 2024-04-06T03:34:00.522817714Z [2024-04-06T03:34:00.522+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T03:34:00.522881680Z 2024-04-06T03:34:00.522892527Z 2024-04-06T03:34:00.522901645Z 2024-04-06T03:34:00.522960482Z [2024-04-06T03:34:00.522+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T03:34:00.523045080Z [2024-04-06T03:34:00.522+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:34:00.523303654Z [2024-04-06T03:34:00.523+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:34:00.524261792Z [2024-04-06T03:34:00.523+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:34:00.524314923Z 2024-04-06T03:34:00.524325839Z 2024-04-06T03:34:00.524334911Z 2024-04-06T03:34:00.529601935Z [2024-04-06T03:34:00.529+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T03:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:34:00.530046779Z [2024-04-06T03:34:00.529+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:34:00.530325597Z [2024-04-06T03:34:00.530+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:34:00.530570539Z [2024-04-06T03:34:00.530+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:34:00.530914578Z [2024-04-06T03:34:00.530+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:34:00.531135329Z [2024-04-06T03:34:00.530+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:34:00.883022717Z [2024-04-06T03:34:00.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:32:00+00:00 exited with status queued for try_number 1 2024-04-06T03:34:00.883337340Z [2024-04-06T03:34:00.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:33:00+00:00 exited with status queued for try_number 1 2024-04-06T03:34:00.883501294Z [2024-04-06T03:34:00.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:33:00+00:00 exited with status queued for try_number 1 2024-04-06T03:34:00.898364779Z [2024-04-06T03:34:00.898+0000] {scheduler_job.py:635} INFO - Setting external_id for to be15744a-4b78-4522-a2ee-4ea644a709a3 2024-04-06T03:34:00.898588654Z [2024-04-06T03:34:00.898+0000] {scheduler_job.py:635} INFO - Setting external_id for to e304ed2e-cc0c-41a0-8fcf-19ab22abe474 2024-04-06T03:34:00.898781686Z [2024-04-06T03:34:00.898+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b2fd097-4d1f-40f6-8931-9860eaeeb135 2024-04-06T03:34:02.222395126Z [2024-04-06T03:34:02.216+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:34:02.222423799Z [2024-04-06T03:34:02.217+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 03:32:00+00:00, run_id=scheduled__2024-04-06T03:32:00+00:00, run_start_date=2024-04-06 03:34:00.460830+00:00, run_end_date=2024-04-06 03:34:02.217215+00:00, run_duration=1.756385, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:32:00+00:00, data_interval_end=2024-04-06 03:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T03:34:02.253739021Z [2024-04-06T03:34:02.247+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T03:34:00+00:00, run_after=2024-04-06T03:36:00+00:00 2024-04-06T03:34:02.380421126Z [2024-04-06T03:34:02.380+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:32:00+00:00 exited with status success for try_number 1 2024-04-06T03:34:02.392069480Z [2024-04-06T03:34:02.391+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T03:32:00+00:00, map_index=-1, run_start_date=2024-04-06 03:34:01.347663+00:00, run_end_date=2024-04-06 03:34:01.821089+00:00, run_duration=0.473426, state=success, executor_state=success, try_number=1, max_tries=1, job_id=427, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:34:00.525224+00:00, queued_by_job_id=2, pid=9614 2024-04-06T03:34:05.740257937Z [2024-04-06T03:34:05.739+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:34:05.740375000Z [2024-04-06T03:34:05.740+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:33:00+00:00, run_id=scheduled__2024-04-06T03:33:00+00:00, run_start_date=2024-04-06 03:34:00.462207+00:00, run_end_date=2024-04-06 03:34:05.740119+00:00, run_duration=5.277912, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:33:00+00:00, data_interval_end=2024-04-06 03:34:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:34:05.749272609Z [2024-04-06T03:34:05.748+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:34:00+00:00, run_after=2024-04-06T03:35:00+00:00 2024-04-06T03:34:05.757462155Z [2024-04-06T03:34:05.757+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:34:05.757591347Z [2024-04-06T03:34:05.757+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:33:00+00:00, run_id=scheduled__2024-04-06T03:33:00+00:00, run_start_date=2024-04-06 03:34:00.463510+00:00, run_end_date=2024-04-06 03:34:05.757343+00:00, run_duration=5.293833, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:33:00+00:00, data_interval_end=2024-04-06 03:34:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:34:05.767780322Z [2024-04-06T03:34:05.767+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:34:00+00:00, run_after=2024-04-06T03:35:00+00:00 2024-04-06T03:34:05.810551484Z [2024-04-06T03:34:05.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:33:00+00:00 exited with status success for try_number 1 2024-04-06T03:34:05.810595931Z [2024-04-06T03:34:05.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:33:00+00:00 exited with status success for try_number 1 2024-04-06T03:34:05.818632020Z [2024-04-06T03:34:05.818+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:33:00+00:00, map_index=-1, run_start_date=2024-04-06 03:34:03.088835+00:00, run_end_date=2024-04-06 03:34:04.472768+00:00, run_duration=1.383933, state=success, executor_state=success, try_number=1, max_tries=1, job_id=428, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:34:00.525224+00:00, queued_by_job_id=2, pid=9644 2024-04-06T03:34:05.819039435Z [2024-04-06T03:34:05.818+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:33:00+00:00, map_index=-1, run_start_date=2024-04-06 03:34:03.221221+00:00, run_end_date=2024-04-06 03:34:05.306765+00:00, run_duration=2.085544, state=success, executor_state=success, try_number=1, max_tries=1, job_id=429, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:34:00.525224+00:00, queued_by_job_id=2, pid=9645 2024-04-06T03:34:39.619098145Z [2024-04-06T03:34:39.618+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:34:39.619123229Z 2024-04-06T03:34:39.620197228Z [2024-04-06T03:34:39.619+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-04-06T03:34:39.622452402Z [2024-04-06T03:34:39.621+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:34:39.622468656Z 2024-04-06T03:34:39.627674137Z [2024-04-06T03:34:39.627+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240406033438_213091', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:34:39.627961093Z [2024-04-06T03:34:39.627+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240406033438_213091', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-06T03:34:39.723317627Z [2024-04-06T03:34:39.722+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240406033438_213091 exited with status queued for try_number 1 2024-04-06T03:34:39.736174170Z [2024-04-06T03:34:39.735+0000] {scheduler_job.py:635} INFO - Setting external_id for to dbf19e44-9506-40ae-8fa8-719631c1cf8b 2024-04-06T03:34:40.895515839Z [2024-04-06T03:34:40.895+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:34:40.895705719Z [2024-04-06T03:34:40.895+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-04-06 03:34:38.524699+00:00, run_id=scaleout_vdu_20240406033438_213091, run_start_date=2024-04-06 03:34:39.574565+00:00, run_end_date=2024-04-06 03:34:40.895424+00:00, run_duration=1.320859, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-06 03:34:38.524699+00:00, data_interval_end=2024-04-06 03:34:38.524699+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-04-06T03:34:40.898626754Z [2024-04-06T03:34:40.898+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-04-06T03:34:41.401940888Z [2024-04-06T03:34:41.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240406033438_213091 exited with status success for try_number 1 2024-04-06T03:34:41.407049161Z [2024-04-06T03:34:41.406+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240406033438_213091, map_index=-1, run_start_date=2024-04-06 03:34:40.388126+00:00, run_end_date=2024-04-06 03:34:40.779527+00:00, run_duration=0.391401, state=success, executor_state=success, try_number=1, max_tries=1, job_id=430, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:34:39.623370+00:00, queued_by_job_id=2, pid=9679 2024-04-06T03:35:00.927135146Z [2024-04-06T03:35:00.926+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:35:00+00:00, run_after=2024-04-06T03:36:00+00:00 2024-04-06T03:35:00.940771227Z [2024-04-06T03:35:00.940+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:35:00+00:00, run_after=2024-04-06T03:40:00+00:00 2024-04-06T03:35:00.954190556Z [2024-04-06T03:35:00.953+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:35:01.035971541Z [2024-04-06T03:35:01.035+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T03:35:01.036003851Z 2024-04-06T03:35:01.036018234Z 2024-04-06T03:35:01.036021600Z 2024-04-06T03:35:01.036350975Z [2024-04-06T03:35:01.035+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:35:01.036608647Z [2024-04-06T03:35:01.036+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:35:01.036820484Z [2024-04-06T03:35:01.036+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:35:01.037441748Z [2024-04-06T03:35:01.037+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:35:01.037452944Z 2024-04-06T03:35:01.037456578Z 2024-04-06T03:35:01.037459772Z 2024-04-06T03:35:01.040208163Z [2024-04-06T03:35:01.040+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-06T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-06T03:35:01.040561063Z [2024-04-06T03:35:01.040+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:35:01.040962260Z [2024-04-06T03:35:01.040+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:35:01.042150494Z [2024-04-06T03:35:01.041+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:35:01.042555241Z [2024-04-06T03:35:01.042+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:35:01.042831270Z [2024-04-06T03:35:01.042+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:35:01.364961717Z [2024-04-06T03:35:01.364+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T03:30:00+00:00 exited with status queued for try_number 1 2024-04-06T03:35:01.365283258Z [2024-04-06T03:35:01.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:34:00+00:00 exited with status queued for try_number 1 2024-04-06T03:35:01.365627586Z [2024-04-06T03:35:01.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:34:00+00:00 exited with status queued for try_number 1 2024-04-06T03:35:01.373927465Z [2024-04-06T03:35:01.373+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2ec68868-1b2b-495b-ac0b-332436e2b9eb 2024-04-06T03:35:01.374121668Z [2024-04-06T03:35:01.373+0000] {scheduler_job.py:635} INFO - Setting external_id for to 104bc87f-2225-40ce-941f-8bcfec2e64d4 2024-04-06T03:35:01.374263629Z [2024-04-06T03:35:01.374+0000] {scheduler_job.py:635} INFO - Setting external_id for to 653a4ec6-111f-400c-98cb-ad882cc48144 2024-04-06T03:35:06.422940842Z [2024-04-06T03:35:06.422+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:35:06.423538134Z [2024-04-06T03:35:06.423+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:34:00+00:00, run_id=scheduled__2024-04-06T03:34:00+00:00, run_start_date=2024-04-06 03:35:00.968069+00:00, run_end_date=2024-04-06 03:35:06.422723+00:00, run_duration=5.454654, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:34:00+00:00, data_interval_end=2024-04-06 03:35:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:35:06.443241431Z [2024-04-06T03:35:06.441+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:35:00+00:00, run_after=2024-04-06T03:36:00+00:00 2024-04-06T03:35:06.475502644Z [2024-04-06T03:35:06.474+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:35:06.476340852Z [2024-04-06T03:35:06.475+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:34:00+00:00, run_id=scheduled__2024-04-06T03:34:00+00:00, run_start_date=2024-04-06 03:35:00.969096+00:00, run_end_date=2024-04-06 03:35:06.475544+00:00, run_duration=5.506448, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:34:00+00:00, data_interval_end=2024-04-06 03:35:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:35:06.497686857Z [2024-04-06T03:35:06.497+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:35:00+00:00, run_after=2024-04-06T03:36:00+00:00 2024-04-06T03:35:06.520378717Z [2024-04-06T03:35:06.519+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:35:06.520441617Z 2024-04-06T03:35:06.520505903Z [2024-04-06T03:35:06.520+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:35:06.521248404Z [2024-04-06T03:35:06.520+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:35:06.521269000Z 2024-04-06T03:35:06.524529562Z [2024-04-06T03:35:06.524+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='split_metrics', run_id='scheduled__2024-04-06T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-06T03:35:06.524690824Z [2024-04-06T03:35:06.524+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:35:06.584428372Z [2024-04-06T03:35:06.583+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T03:30:00+00:00 exited with status queued for try_number 1 2024-04-06T03:35:06.585033070Z [2024-04-06T03:35:06.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T03:30:00+00:00 exited with status success for try_number 1 2024-04-06T03:35:06.585307147Z [2024-04-06T03:35:06.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:34:00+00:00 exited with status success for try_number 1 2024-04-06T03:35:06.585618420Z [2024-04-06T03:35:06.585+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:34:00+00:00 exited with status success for try_number 1 2024-04-06T03:35:06.597985760Z [2024-04-06T03:35:06.597+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-06T03:30:00+00:00, map_index=-1, run_start_date=2024-04-06 03:35:04.915113+00:00, run_end_date=2024-04-06 03:35:05.359878+00:00, run_duration=0.444765, state=success, executor_state=success, try_number=1, max_tries=1, job_id=433, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:35:01.038218+00:00, queued_by_job_id=2, pid=9742 2024-04-06T03:35:06.598711625Z [2024-04-06T03:35:06.598+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:34:00+00:00, map_index=-1, run_start_date=2024-04-06 03:35:03.863883+00:00, run_end_date=2024-04-06 03:35:05.732675+00:00, run_duration=1.868792, state=success, executor_state=success, try_number=1, max_tries=1, job_id=431, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:35:01.038218+00:00, queued_by_job_id=2, pid=9713 2024-04-06T03:35:06.599126844Z [2024-04-06T03:35:06.598+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:34:00+00:00, map_index=-1, run_start_date=2024-04-06 03:35:04.035050+00:00, run_end_date=2024-04-06 03:35:06.134268+00:00, run_duration=2.099218, state=success, executor_state=success, try_number=1, max_tries=1, job_id=432, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:35:01.038218+00:00, queued_by_job_id=2, pid=9714 2024-04-06T03:35:06.599495575Z [2024-04-06T03:35:06.599+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f65c9f0-45db-491f-9507-178b0413b681 2024-04-06T03:35:09.185524661Z [2024-04-06T03:35:09.179+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:35:09.185575875Z 2024-04-06T03:35:09.185579865Z [2024-04-06T03:35:09.179+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:35:09.185585987Z [2024-04-06T03:35:09.181+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:35:09.185589180Z 2024-04-06T03:35:09.185593573Z [2024-04-06T03:35:09.184+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='collect_metrics', run_id='scheduled__2024-04-06T03:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-06T03:35:09.185596876Z [2024-04-06T03:35:09.185+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T03:35:09.267711767Z [2024-04-06T03:35:09.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T03:30:00+00:00 exited with status queued for try_number 1 2024-04-06T03:35:09.267889757Z [2024-04-06T03:35:09.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T03:30:00+00:00 exited with status success for try_number 1 2024-04-06T03:35:09.274619241Z [2024-04-06T03:35:09.274+0000] {scheduler_job.py:635} INFO - Setting external_id for to da77345f-ee57-4754-894c-9889dcd259b4 2024-04-06T03:35:09.274700455Z [2024-04-06T03:35:09.274+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=split_metrics, run_id=scheduled__2024-04-06T03:30:00+00:00, map_index=-1, run_start_date=2024-04-06 03:35:08.026996+00:00, run_end_date=2024-04-06 03:35:08.453244+00:00, run_duration=0.426248, state=success, executor_state=success, try_number=1, max_tries=1, job_id=434, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:35:06.521690+00:00, queued_by_job_id=2, pid=9763 2024-04-06T03:35:13.160056704Z [2024-04-06T03:35:13.159+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:35:13.160134934Z 2024-04-06T03:35:13.160180843Z [2024-04-06T03:35:13.159+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:35:13.161137950Z [2024-04-06T03:35:13.160+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:35:13.161149529Z 2024-04-06T03:35:13.164510198Z [2024-04-06T03:35:13.164+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='send_prometheus', run_id='scheduled__2024-04-06T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:35:13.164768339Z [2024-04-06T03:35:13.164+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:35:13.231210569Z [2024-04-06T03:35:13.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T03:30:00+00:00 exited with status queued for try_number 1 2024-04-06T03:35:13.231268041Z [2024-04-06T03:35:13.231+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T03:30:00+00:00 exited with status success for try_number 1 2024-04-06T03:35:13.237782895Z [2024-04-06T03:35:13.237+0000] {scheduler_job.py:635} INFO - Setting external_id for to d7e4be1d-2bff-4e97-8d99-c800b1eeb347 2024-04-06T03:35:13.237894611Z [2024-04-06T03:35:13.237+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=collect_metrics, run_id=scheduled__2024-04-06T03:30:00+00:00, map_index=0, run_start_date=2024-04-06 03:35:10.940239+00:00, run_end_date=2024-04-06 03:35:12.063985+00:00, run_duration=1.123746, state=success, executor_state=success, try_number=1, max_tries=1, job_id=435, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:35:09.182264+00:00, queued_by_job_id=2, pid=9784 2024-04-06T03:35:16.061719403Z [2024-04-06T03:35:16.061+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:35:16.062128432Z [2024-04-06T03:35:16.061+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:30:00+00:00, run_id=scheduled__2024-04-06T03:30:00+00:00, run_start_date=2024-04-06 03:35:00.966806+00:00, run_end_date=2024-04-06 03:35:16.061603+00:00, run_duration=15.094797, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:30:00+00:00, data_interval_end=2024-04-06 03:35:00+00:00, dag_hash=eecc559ff32fe9a7c4345875f113a0a9 2024-04-06T03:35:16.070735363Z [2024-04-06T03:35:16.070+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:35:00+00:00, run_after=2024-04-06T03:40:00+00:00 2024-04-06T03:35:16.107825403Z [2024-04-06T03:35:16.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T03:30:00+00:00 exited with status success for try_number 1 2024-04-06T03:35:16.115899320Z [2024-04-06T03:35:16.115+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=send_prometheus, run_id=scheduled__2024-04-06T03:30:00+00:00, map_index=-1, run_start_date=2024-04-06 03:35:14.762967+00:00, run_end_date=2024-04-06 03:35:15.130298+00:00, run_duration=0.367331, state=success, executor_state=success, try_number=1, max_tries=1, job_id=436, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:35:13.161538+00:00, queued_by_job_id=2, pid=9808 2024-04-06T03:35:20.920064962Z [2024-04-06T03:35:20.919+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-06T03:36:00.187544855Z [2024-04-06T03:36:00.186+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:36:00.204918734Z [2024-04-06T03:36:00.204+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:36:00+00:00, run_after=2024-04-06T03:37:00+00:00 2024-04-06T03:36:00.212816593Z [2024-04-06T03:36:00.212+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:36:00.286989020Z [2024-04-06T03:36:00.286+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T03:36:00.287017956Z 2024-04-06T03:36:00.287023077Z 2024-04-06T03:36:00.287027062Z 2024-04-06T03:36:00.287031834Z [2024-04-06T03:36:00.286+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T03:36:00.287353197Z [2024-04-06T03:36:00.286+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:36:00.287518499Z [2024-04-06T03:36:00.287+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:36:00.288288893Z [2024-04-06T03:36:00.287+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:36:00.288319002Z 2024-04-06T03:36:00.288330369Z 2024-04-06T03:36:00.288339175Z 2024-04-06T03:36:00.293047984Z [2024-04-06T03:36:00.292+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T03:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:36:00.293309167Z [2024-04-06T03:36:00.292+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:36:00.293788920Z [2024-04-06T03:36:00.293+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:36:00.294062442Z [2024-04-06T03:36:00.293+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:36:00.294511685Z [2024-04-06T03:36:00.294+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:36:00.294586832Z [2024-04-06T03:36:00.294+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:36:00.505845771Z [2024-04-06T03:36:00.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:34:00+00:00 exited with status queued for try_number 1 2024-04-06T03:36:00.506108849Z [2024-04-06T03:36:00.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:35:00+00:00 exited with status queued for try_number 1 2024-04-06T03:36:00.506318770Z [2024-04-06T03:36:00.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:35:00+00:00 exited with status queued for try_number 1 2024-04-06T03:36:00.514000924Z [2024-04-06T03:36:00.513+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e2d76b7-63d5-4ff0-ad85-9c7280faab9e 2024-04-06T03:36:00.514224149Z [2024-04-06T03:36:00.514+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb3635fa-3bd5-4ee6-b064-ff08033f3011 2024-04-06T03:36:00.514536455Z [2024-04-06T03:36:00.514+0000] {scheduler_job.py:635} INFO - Setting external_id for to 76c66231-9c2a-4dc9-92df-fed21087662f 2024-04-06T03:36:01.783190834Z [2024-04-06T03:36:01.773+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:36:01.783532422Z [2024-04-06T03:36:01.783+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 03:34:00+00:00, run_id=scheduled__2024-04-06T03:34:00+00:00, run_start_date=2024-04-06 03:36:00.222375+00:00, run_end_date=2024-04-06 03:36:01.783138+00:00, run_duration=1.560763, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:34:00+00:00, data_interval_end=2024-04-06 03:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T03:36:01.811135168Z [2024-04-06T03:36:01.810+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T03:36:00+00:00, run_after=2024-04-06T03:38:00+00:00 2024-04-06T03:36:03.047791812Z [2024-04-06T03:36:03.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:34:00+00:00 exited with status success for try_number 1 2024-04-06T03:36:03.054135893Z [2024-04-06T03:36:03.053+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T03:34:00+00:00, map_index=-1, run_start_date=2024-04-06 03:36:01.086796+00:00, run_end_date=2024-04-06 03:36:01.676422+00:00, run_duration=0.589626, state=success, executor_state=success, try_number=1, max_tries=1, job_id=437, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:36:00.289685+00:00, queued_by_job_id=2, pid=9812 2024-04-06T03:36:06.589280566Z [2024-04-06T03:36:06.588+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:36:06.589727743Z [2024-04-06T03:36:06.589+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:35:00+00:00, run_id=scheduled__2024-04-06T03:35:00+00:00, run_start_date=2024-04-06 03:36:00.223603+00:00, run_end_date=2024-04-06 03:36:06.589135+00:00, run_duration=6.365532, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:35:00+00:00, data_interval_end=2024-04-06 03:36:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:36:06.604179510Z [2024-04-06T03:36:06.603+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:36:00+00:00, run_after=2024-04-06T03:37:00+00:00 2024-04-06T03:36:07.739488795Z [2024-04-06T03:36:07.739+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:35:00+00:00 exited with status success for try_number 1 2024-04-06T03:36:07.745449100Z [2024-04-06T03:36:07.744+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:35:00+00:00, map_index=-1, run_start_date=2024-04-06 03:36:03.473073+00:00, run_end_date=2024-04-06 03:36:06.549082+00:00, run_duration=3.076009, state=success, executor_state=success, try_number=1, max_tries=1, job_id=438, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:36:00.289685+00:00, queued_by_job_id=2, pid=9833 2024-04-06T03:36:08.225617898Z [2024-04-06T03:36:08.223+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:36:08.236097779Z [2024-04-06T03:36:08.223+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:35:00+00:00, run_id=scheduled__2024-04-06T03:35:00+00:00, run_start_date=2024-04-06 03:36:00.224798+00:00, run_end_date=2024-04-06 03:36:08.223526+00:00, run_duration=7.998728, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:35:00+00:00, data_interval_end=2024-04-06 03:36:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:36:08.287590231Z [2024-04-06T03:36:08.287+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:36:00+00:00, run_after=2024-04-06T03:37:00+00:00 2024-04-06T03:36:08.318662057Z [2024-04-06T03:36:08.318+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:35:00+00:00 exited with status success for try_number 1 2024-04-06T03:36:08.323356996Z [2024-04-06T03:36:08.323+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:35:00+00:00, map_index=-1, run_start_date=2024-04-06 03:36:04.187388+00:00, run_end_date=2024-04-06 03:36:07.818590+00:00, run_duration=3.631202, state=success, executor_state=success, try_number=1, max_tries=1, job_id=439, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:36:00.289685+00:00, queued_by_job_id=2, pid=9852 2024-04-06T03:37:00.150327924Z [2024-04-06T03:37:00.149+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:37:00+00:00, run_after=2024-04-06T03:38:00+00:00 2024-04-06T03:37:00.160337861Z [2024-04-06T03:37:00.159+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:37:00.259448012Z [2024-04-06T03:37:00.258+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T03:37:00.259480804Z 2024-04-06T03:37:00.259485154Z 2024-04-06T03:37:00.259907446Z [2024-04-06T03:37:00.259+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:37:00.261173758Z [2024-04-06T03:37:00.260+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:37:00.265421576Z [2024-04-06T03:37:00.264+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:37:00.265459333Z 2024-04-06T03:37:00.265469161Z 2024-04-06T03:37:00.272299497Z [2024-04-06T03:37:00.271+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:37:00.272392244Z [2024-04-06T03:37:00.272+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:37:00.273086456Z [2024-04-06T03:37:00.272+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:37:00.273505902Z [2024-04-06T03:37:00.273+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:37:00.436993759Z [2024-04-06T03:37:00.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:36:00+00:00 exited with status queued for try_number 1 2024-04-06T03:37:00.437197859Z [2024-04-06T03:37:00.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:36:00+00:00 exited with status queued for try_number 1 2024-04-06T03:37:00.445633174Z [2024-04-06T03:37:00.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to afb51c4f-aba6-499f-a8ee-37cfdec7944d 2024-04-06T03:37:00.445938503Z [2024-04-06T03:37:00.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to 558aee23-1b4b-4934-a64b-4a95561403ec 2024-04-06T03:37:04.149315991Z [2024-04-06T03:37:04.148+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:37:04.149902086Z [2024-04-06T03:37:04.149+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:36:00+00:00, run_id=scheduled__2024-04-06T03:36:00+00:00, run_start_date=2024-04-06 03:37:00.191536+00:00, run_end_date=2024-04-06 03:37:04.149253+00:00, run_duration=3.957717, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:36:00+00:00, data_interval_end=2024-04-06 03:37:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:37:04.158865988Z [2024-04-06T03:37:04.158+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:37:00+00:00, run_after=2024-04-06T03:38:00+00:00 2024-04-06T03:37:04.187039973Z [2024-04-06T03:37:04.186+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:36:00+00:00 exited with status success for try_number 1 2024-04-06T03:37:04.196583720Z [2024-04-06T03:37:04.196+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:36:00+00:00, map_index=-1, run_start_date=2024-04-06 03:37:02.340455+00:00, run_end_date=2024-04-06 03:37:03.900266+00:00, run_duration=1.559811, state=success, executor_state=success, try_number=1, max_tries=1, job_id=441, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:37:00.267727+00:00, queued_by_job_id=2, pid=9898 2024-04-06T03:37:05.260728867Z [2024-04-06T03:37:05.260+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:37:05.261374644Z [2024-04-06T03:37:05.261+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:36:00+00:00, run_id=scheduled__2024-04-06T03:36:00+00:00, run_start_date=2024-04-06 03:37:00.194537+00:00, run_end_date=2024-04-06 03:37:05.260985+00:00, run_duration=5.066448, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:36:00+00:00, data_interval_end=2024-04-06 03:37:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:37:05.271610771Z [2024-04-06T03:37:05.271+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:37:00+00:00, run_after=2024-04-06T03:38:00+00:00 2024-04-06T03:37:05.308518695Z [2024-04-06T03:37:05.307+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:36:00+00:00 exited with status success for try_number 1 2024-04-06T03:37:05.322683567Z [2024-04-06T03:37:05.322+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:36:00+00:00, map_index=-1, run_start_date=2024-04-06 03:37:02.218433+00:00, run_end_date=2024-04-06 03:37:04.156040+00:00, run_duration=1.937607, state=success, executor_state=success, try_number=1, max_tries=1, job_id=440, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:37:00.267727+00:00, queued_by_job_id=2, pid=9897 2024-04-06T03:38:01.064618035Z [2024-04-06T03:38:01.063+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:38:01.072645696Z [2024-04-06T03:38:01.072+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:38:01.084119223Z [2024-04-06T03:38:01.083+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:38:00+00:00, run_after=2024-04-06T03:39:00+00:00 2024-04-06T03:38:01.156742126Z [2024-04-06T03:38:01.156+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T03:38:01.156775049Z 2024-04-06T03:38:01.156793706Z 2024-04-06T03:38:01.156799787Z 2024-04-06T03:38:01.156827941Z [2024-04-06T03:38:01.156+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T03:38:01.156880419Z [2024-04-06T03:38:01.156+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:38:01.156981770Z [2024-04-06T03:38:01.156+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:38:01.157635184Z [2024-04-06T03:38:01.157+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:38:01.157662372Z 2024-04-06T03:38:01.157665940Z 2024-04-06T03:38:01.157669029Z 2024-04-06T03:38:01.161479792Z [2024-04-06T03:38:01.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T03:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:38:01.161602058Z [2024-04-06T03:38:01.161+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:38:01.161861731Z [2024-04-06T03:38:01.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:38:01.162013031Z [2024-04-06T03:38:01.161+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:38:01.162233308Z [2024-04-06T03:38:01.162+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:38:01.162318747Z [2024-04-06T03:38:01.162+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:38:01.418909415Z [2024-04-06T03:38:01.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:36:00+00:00 exited with status queued for try_number 1 2024-04-06T03:38:01.419215220Z [2024-04-06T03:38:01.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:37:00+00:00 exited with status queued for try_number 1 2024-04-06T03:38:01.419397945Z [2024-04-06T03:38:01.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:37:00+00:00 exited with status queued for try_number 1 2024-04-06T03:38:01.427603484Z [2024-04-06T03:38:01.427+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3f4cd1a-08b9-42c9-a4cc-428831b3fdbd 2024-04-06T03:38:01.427851297Z [2024-04-06T03:38:01.427+0000] {scheduler_job.py:635} INFO - Setting external_id for to d30f5f59-749a-44d6-901d-76ba3c271f20 2024-04-06T03:38:01.428063954Z [2024-04-06T03:38:01.427+0000] {scheduler_job.py:635} INFO - Setting external_id for to 590ac5fa-4e8c-42b0-8a86-a96f884bb97a 2024-04-06T03:38:04.038145249Z [2024-04-06T03:38:04.037+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:38:04.038366829Z [2024-04-06T03:38:04.038+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 03:36:00+00:00, run_id=scheduled__2024-04-06T03:36:00+00:00, run_start_date=2024-04-06 03:38:01.092960+00:00, run_end_date=2024-04-06 03:38:04.038069+00:00, run_duration=2.945109, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:36:00+00:00, data_interval_end=2024-04-06 03:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T03:38:04.044882227Z [2024-04-06T03:38:04.044+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T03:38:00+00:00, run_after=2024-04-06T03:40:00+00:00 2024-04-06T03:38:04.099035166Z [2024-04-06T03:38:04.098+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:36:00+00:00 exited with status success for try_number 1 2024-04-06T03:38:04.119947930Z [2024-04-06T03:38:04.119+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T03:36:00+00:00, map_index=-1, run_start_date=2024-04-06 03:38:02.379315+00:00, run_end_date=2024-04-06 03:38:02.893438+00:00, run_duration=0.514123, state=success, executor_state=success, try_number=1, max_tries=1, job_id=442, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:38:01.158500+00:00, queued_by_job_id=2, pid=9933 2024-04-06T03:38:06.203910836Z [2024-04-06T03:38:06.203+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:38:06.204174183Z [2024-04-06T03:38:06.203+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:37:00+00:00, run_id=scheduled__2024-04-06T03:37:00+00:00, run_start_date=2024-04-06 03:38:01.094128+00:00, run_end_date=2024-04-06 03:38:06.203749+00:00, run_duration=5.109621, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:37:00+00:00, data_interval_end=2024-04-06 03:38:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:38:06.213298380Z [2024-04-06T03:38:06.213+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:38:00+00:00, run_after=2024-04-06T03:39:00+00:00 2024-04-06T03:38:06.219590109Z [2024-04-06T03:38:06.219+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:38:06.219683431Z [2024-04-06T03:38:06.219+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:37:00+00:00, run_id=scheduled__2024-04-06T03:37:00+00:00, run_start_date=2024-04-06 03:38:01.095051+00:00, run_end_date=2024-04-06 03:38:06.219368+00:00, run_duration=5.124317, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:37:00+00:00, data_interval_end=2024-04-06 03:38:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:38:06.229122334Z [2024-04-06T03:38:06.228+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:38:00+00:00, run_after=2024-04-06T03:39:00+00:00 2024-04-06T03:38:06.273661631Z [2024-04-06T03:38:06.273+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:37:00+00:00 exited with status success for try_number 1 2024-04-06T03:38:06.273907066Z [2024-04-06T03:38:06.273+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:37:00+00:00 exited with status success for try_number 1 2024-04-06T03:38:06.282058393Z [2024-04-06T03:38:06.281+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:37:00+00:00, map_index=-1, run_start_date=2024-04-06 03:38:03.657800+00:00, run_end_date=2024-04-06 03:38:05.452234+00:00, run_duration=1.794434, state=success, executor_state=success, try_number=1, max_tries=1, job_id=443, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:38:01.158500+00:00, queued_by_job_id=2, pid=9957 2024-04-06T03:38:06.282315178Z [2024-04-06T03:38:06.282+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:37:00+00:00, map_index=-1, run_start_date=2024-04-06 03:38:03.929807+00:00, run_end_date=2024-04-06 03:38:05.909239+00:00, run_duration=1.979432, state=success, executor_state=success, try_number=1, max_tries=1, job_id=444, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:38:01.158500+00:00, queued_by_job_id=2, pid=9964 2024-04-06T03:39:00.164765674Z [2024-04-06T03:39:00.164+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:39:00.184163633Z [2024-04-06T03:39:00.183+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:39:00+00:00, run_after=2024-04-06T03:40:00+00:00 2024-04-06T03:39:00.248607670Z [2024-04-06T03:39:00.248+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T03:39:00.248644756Z 2024-04-06T03:39:00.248666493Z 2024-04-06T03:39:00.249077134Z [2024-04-06T03:39:00.248+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:39:00.249654047Z [2024-04-06T03:39:00.249+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:39:00.251139714Z [2024-04-06T03:39:00.250+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:39:00.251170102Z 2024-04-06T03:39:00.251181386Z 2024-04-06T03:39:00.255470211Z [2024-04-06T03:39:00.255+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:39:00.255753877Z [2024-04-06T03:39:00.255+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:39:00.256177265Z [2024-04-06T03:39:00.255+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:39:00.256479771Z [2024-04-06T03:39:00.256+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:39:00.457111974Z [2024-04-06T03:39:00.456+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:38:00+00:00 exited with status queued for try_number 1 2024-04-06T03:39:00.457338654Z [2024-04-06T03:39:00.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:38:00+00:00 exited with status queued for try_number 1 2024-04-06T03:39:00.469046719Z [2024-04-06T03:39:00.468+0000] {scheduler_job.py:635} INFO - Setting external_id for to a87619a7-1754-4b7d-844e-577efd6bf416 2024-04-06T03:39:00.469252552Z [2024-04-06T03:39:00.469+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6041d022-b003-4897-8807-314561bee5ac 2024-04-06T03:39:04.512764474Z [2024-04-06T03:39:04.512+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:39:04.513067338Z [2024-04-06T03:39:04.512+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:38:00+00:00, run_id=scheduled__2024-04-06T03:38:00+00:00, run_start_date=2024-04-06 03:39:00.194841+00:00, run_end_date=2024-04-06 03:39:04.512670+00:00, run_duration=4.317829, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:38:00+00:00, data_interval_end=2024-04-06 03:39:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:39:04.520981998Z [2024-04-06T03:39:04.520+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:39:00+00:00, run_after=2024-04-06T03:40:00+00:00 2024-04-06T03:39:04.526528376Z [2024-04-06T03:39:04.526+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:39:04.526813478Z [2024-04-06T03:39:04.526+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:38:00+00:00, run_id=scheduled__2024-04-06T03:38:00+00:00, run_start_date=2024-04-06 03:39:00.196014+00:00, run_end_date=2024-04-06 03:39:04.526489+00:00, run_duration=4.330475, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:38:00+00:00, data_interval_end=2024-04-06 03:39:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:39:04.537825477Z [2024-04-06T03:39:04.537+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:39:00+00:00, run_after=2024-04-06T03:40:00+00:00 2024-04-06T03:39:04.620290905Z [2024-04-06T03:39:04.619+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:38:00+00:00 exited with status success for try_number 1 2024-04-06T03:39:04.639295704Z [2024-04-06T03:39:04.638+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:38:00+00:00, map_index=-1, run_start_date=2024-04-06 03:39:02.079548+00:00, run_end_date=2024-04-06 03:39:03.524122+00:00, run_duration=1.444574, state=success, executor_state=success, try_number=1, max_tries=1, job_id=446, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:39:00.252250+00:00, queued_by_job_id=2, pid=10019 2024-04-06T03:39:05.729544418Z [2024-04-06T03:39:05.729+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:38:00+00:00 exited with status success for try_number 1 2024-04-06T03:39:05.735084125Z [2024-04-06T03:39:05.734+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:38:00+00:00, map_index=-1, run_start_date=2024-04-06 03:39:01.909975+00:00, run_end_date=2024-04-06 03:39:04.487662+00:00, run_duration=2.577687, state=success, executor_state=success, try_number=1, max_tries=1, job_id=445, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:39:00.252250+00:00, queued_by_job_id=2, pid=10018 2024-04-06T03:40:00.162212738Z [2024-04-06T03:40:00.161+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:40:00+00:00, run_after=2024-04-06T03:41:00+00:00 2024-04-06T03:40:00.173239985Z [2024-04-06T03:40:00.172+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:40:00.190327923Z [2024-04-06T03:40:00.189+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:40:00+00:00, run_after=2024-04-06T03:45:00+00:00 2024-04-06T03:40:00.200432322Z [2024-04-06T03:40:00.199+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:40:00.296389320Z [2024-04-06T03:40:00.295+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-06T03:40:00.296502826Z 2024-04-06T03:40:00.296522825Z 2024-04-06T03:40:00.296649445Z 2024-04-06T03:40:00.296759998Z 2024-04-06T03:40:00.296778803Z [2024-04-06T03:40:00.295+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:40:00.296849044Z [2024-04-06T03:40:00.296+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T03:40:00.296868046Z [2024-04-06T03:40:00.296+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:40:00.296972951Z [2024-04-06T03:40:00.296+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:40:00.297094272Z [2024-04-06T03:40:00.296+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:40:00.297135671Z 2024-04-06T03:40:00.297154443Z 2024-04-06T03:40:00.297169707Z 2024-04-06T03:40:00.297184569Z 2024-04-06T03:40:00.300865141Z [2024-04-06T03:40:00.300+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-06T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-06T03:40:00.300991226Z [2024-04-06T03:40:00.300+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:40:00.301250293Z [2024-04-06T03:40:00.301+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T03:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:40:00.301266441Z [2024-04-06T03:40:00.301+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:40:00.301508394Z [2024-04-06T03:40:00.301+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:40:00.301534847Z [2024-04-06T03:40:00.301+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:40:00.301748064Z [2024-04-06T03:40:00.301+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:40:00.301867725Z [2024-04-06T03:40:00.301+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:40:00.601130139Z [2024-04-06T03:40:00.600+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T03:35:00+00:00 exited with status queued for try_number 1 2024-04-06T03:40:00.601211589Z [2024-04-06T03:40:00.601+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:38:00+00:00 exited with status queued for try_number 1 2024-04-06T03:40:00.601344487Z [2024-04-06T03:40:00.601+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:39:00+00:00 exited with status queued for try_number 1 2024-04-06T03:40:00.601480541Z [2024-04-06T03:40:00.601+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:39:00+00:00 exited with status queued for try_number 1 2024-04-06T03:40:00.611211366Z [2024-04-06T03:40:00.610+0000] {scheduler_job.py:635} INFO - Setting external_id for to d416d33d-83e7-485c-b9fb-517d13c25203 2024-04-06T03:40:00.611378590Z [2024-04-06T03:40:00.611+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0a94c0d-8351-4413-9311-b4815e9743fb 2024-04-06T03:40:00.611537045Z [2024-04-06T03:40:00.611+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd46d4b9-25c6-4cf0-8b56-b6485fdcf33c 2024-04-06T03:40:00.611679520Z [2024-04-06T03:40:00.611+0000] {scheduler_job.py:635} INFO - Setting external_id for to a1979248-791d-4e5a-a245-8519d7c0c864 2024-04-06T03:40:02.158732389Z [2024-04-06T03:40:02.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:38:00+00:00 exited with status success for try_number 1 2024-04-06T03:40:02.165415432Z [2024-04-06T03:40:02.165+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T03:38:00+00:00, map_index=-1, run_start_date=2024-04-06 03:40:01.424723+00:00, run_end_date=2024-04-06 03:40:01.959239+00:00, run_duration=0.534516, state=success, executor_state=success, try_number=1, max_tries=1, job_id=447, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:40:00.298032+00:00, queued_by_job_id=2, pid=10055 2024-04-06T03:40:03.295241200Z [2024-04-06T03:40:03.294+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:40:03.297138340Z [2024-04-06T03:40:03.296+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 03:38:00+00:00, run_id=scheduled__2024-04-06T03:38:00+00:00, run_start_date=2024-04-06 03:40:00.214948+00:00, run_end_date=2024-04-06 03:40:03.296688+00:00, run_duration=3.08174, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:38:00+00:00, data_interval_end=2024-04-06 03:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T03:40:03.342243015Z [2024-04-06T03:40:03.341+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T03:40:00+00:00, run_after=2024-04-06T03:42:00+00:00 2024-04-06T03:40:05.095822266Z [2024-04-06T03:40:05.095+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:40:05.095847627Z 2024-04-06T03:40:05.096032051Z [2024-04-06T03:40:05.095+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:40:05.096706409Z [2024-04-06T03:40:05.096+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:40:05.096717953Z 2024-04-06T03:40:05.099085904Z [2024-04-06T03:40:05.098+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='split_metrics', run_id='scheduled__2024-04-06T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-06T03:40:05.099340831Z [2024-04-06T03:40:05.099+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:40:05.150156909Z [2024-04-06T03:40:05.149+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T03:35:00+00:00 exited with status queued for try_number 1 2024-04-06T03:40:05.151301999Z [2024-04-06T03:40:05.150+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T03:35:00+00:00 exited with status success for try_number 1 2024-04-06T03:40:05.158589207Z [2024-04-06T03:40:05.158+0000] {scheduler_job.py:635} INFO - Setting external_id for to d794008f-04a2-4b45-b4a7-2acec8e1f316 2024-04-06T03:40:05.160186235Z [2024-04-06T03:40:05.159+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-06T03:35:00+00:00, map_index=-1, run_start_date=2024-04-06 03:40:03.522681+00:00, run_end_date=2024-04-06 03:40:04.120062+00:00, run_duration=0.597381, state=success, executor_state=success, try_number=1, max_tries=1, job_id=449, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:40:00.298032+00:00, queued_by_job_id=2, pid=10087 2024-04-06T03:40:06.329201294Z [2024-04-06T03:40:06.328+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:40:06.329449073Z [2024-04-06T03:40:06.329+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:39:00+00:00, run_id=scheduled__2024-04-06T03:39:00+00:00, run_start_date=2024-04-06 03:40:00.216114+00:00, run_end_date=2024-04-06 03:40:06.329057+00:00, run_duration=6.112943, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:39:00+00:00, data_interval_end=2024-04-06 03:40:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:40:06.341599019Z [2024-04-06T03:40:06.341+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:40:00+00:00, run_after=2024-04-06T03:41:00+00:00 2024-04-06T03:40:06.348958966Z [2024-04-06T03:40:06.348+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:40:06.349134867Z [2024-04-06T03:40:06.348+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:39:00+00:00, run_id=scheduled__2024-04-06T03:39:00+00:00, run_start_date=2024-04-06 03:40:00.217193+00:00, run_end_date=2024-04-06 03:40:06.348833+00:00, run_duration=6.13164, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:39:00+00:00, data_interval_end=2024-04-06 03:40:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:40:06.357494909Z [2024-04-06T03:40:06.357+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:40:00+00:00, run_after=2024-04-06T03:41:00+00:00 2024-04-06T03:40:06.409777114Z [2024-04-06T03:40:06.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:39:00+00:00 exited with status success for try_number 1 2024-04-06T03:40:06.410014236Z [2024-04-06T03:40:06.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:39:00+00:00 exited with status success for try_number 1 2024-04-06T03:40:06.419862524Z [2024-04-06T03:40:06.419+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:39:00+00:00, map_index=-1, run_start_date=2024-04-06 03:40:04.068568+00:00, run_end_date=2024-04-06 03:40:05.520977+00:00, run_duration=1.452409, state=success, executor_state=success, try_number=1, max_tries=1, job_id=450, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:40:00.298032+00:00, queued_by_job_id=2, pid=10115 2024-04-06T03:40:06.420168676Z [2024-04-06T03:40:06.419+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:39:00+00:00, map_index=-1, run_start_date=2024-04-06 03:40:03.348309+00:00, run_end_date=2024-04-06 03:40:05.398421+00:00, run_duration=2.050112, state=success, executor_state=success, try_number=1, max_tries=1, job_id=448, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:40:00.298032+00:00, queued_by_job_id=2, pid=10086 2024-04-06T03:40:08.220527955Z [2024-04-06T03:40:08.220+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:40:08.220582676Z 2024-04-06T03:40:08.220587043Z [2024-04-06T03:40:08.220+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:40:08.220920049Z [2024-04-06T03:40:08.220+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:40:08.220940169Z 2024-04-06T03:40:08.225920778Z [2024-04-06T03:40:08.223+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='collect_metrics', run_id='scheduled__2024-04-06T03:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-06T03:40:08.225939818Z [2024-04-06T03:40:08.223+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T03:40:08.291342773Z [2024-04-06T03:40:08.291+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T03:35:00+00:00 exited with status queued for try_number 1 2024-04-06T03:40:08.291430561Z [2024-04-06T03:40:08.291+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T03:35:00+00:00 exited with status success for try_number 1 2024-04-06T03:40:08.299891416Z [2024-04-06T03:40:08.299+0000] {scheduler_job.py:635} INFO - Setting external_id for to ef83618b-83d4-410c-b193-1c9a481e26f4 2024-04-06T03:40:08.300654793Z [2024-04-06T03:40:08.299+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=split_metrics, run_id=scheduled__2024-04-06T03:35:00+00:00, map_index=-1, run_start_date=2024-04-06 03:40:06.818406+00:00, run_end_date=2024-04-06 03:40:07.245408+00:00, run_duration=0.427002, state=success, executor_state=success, try_number=1, max_tries=1, job_id=451, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:40:05.097118+00:00, queued_by_job_id=2, pid=10136 2024-04-06T03:40:11.610942420Z [2024-04-06T03:40:11.610+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:40:11.610970684Z 2024-04-06T03:40:11.611049402Z [2024-04-06T03:40:11.610+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:40:11.611616741Z [2024-04-06T03:40:11.611+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:40:11.611629283Z 2024-04-06T03:40:11.613509115Z [2024-04-06T03:40:11.613+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='send_prometheus', run_id='scheduled__2024-04-06T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:40:11.613667425Z [2024-04-06T03:40:11.613+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:40:11.681132970Z [2024-04-06T03:40:11.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T03:35:00+00:00 exited with status queued for try_number 1 2024-04-06T03:40:11.681167233Z [2024-04-06T03:40:11.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T03:35:00+00:00 exited with status success for try_number 1 2024-04-06T03:40:11.701963821Z [2024-04-06T03:40:11.696+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3df1db16-5eb5-49e2-9aa0-34015df16adf 2024-04-06T03:40:11.701982831Z [2024-04-06T03:40:11.701+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=collect_metrics, run_id=scheduled__2024-04-06T03:35:00+00:00, map_index=0, run_start_date=2024-04-06 03:40:09.862819+00:00, run_end_date=2024-04-06 03:40:11.041704+00:00, run_duration=1.178885, state=success, executor_state=success, try_number=1, max_tries=1, job_id=452, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:40:08.221305+00:00, queued_by_job_id=2, pid=10157 2024-04-06T03:40:14.074817330Z [2024-04-06T03:40:14.074+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:40:14.075206616Z [2024-04-06T03:40:14.074+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:35:00+00:00, run_id=scheduled__2024-04-06T03:35:00+00:00, run_start_date=2024-04-06 03:40:00.213507+00:00, run_end_date=2024-04-06 03:40:14.074617+00:00, run_duration=13.86111, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:35:00+00:00, data_interval_end=2024-04-06 03:40:00+00:00, dag_hash=eecc559ff32fe9a7c4345875f113a0a9 2024-04-06T03:40:14.084128389Z [2024-04-06T03:40:14.083+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:40:00+00:00, run_after=2024-04-06T03:45:00+00:00 2024-04-06T03:40:14.118161213Z [2024-04-06T03:40:14.117+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T03:35:00+00:00 exited with status success for try_number 1 2024-04-06T03:40:14.123665271Z [2024-04-06T03:40:14.123+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=send_prometheus, run_id=scheduled__2024-04-06T03:35:00+00:00, map_index=-1, run_start_date=2024-04-06 03:40:13.254671+00:00, run_end_date=2024-04-06 03:40:13.711864+00:00, run_duration=0.457193, state=success, executor_state=success, try_number=1, max_tries=1, job_id=453, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:40:11.611889+00:00, queued_by_job_id=2, pid=10181 2024-04-06T03:40:20.982230021Z [2024-04-06T03:40:20.981+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-06T03:41:00.962425128Z [2024-04-06T03:41:00.962+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:41:00+00:00, run_after=2024-04-06T03:42:00+00:00 2024-04-06T03:41:00.970345110Z [2024-04-06T03:41:00.970+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:41:01.036552377Z [2024-04-06T03:41:01.036+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T03:41:01.036623800Z 2024-04-06T03:41:01.036627800Z 2024-04-06T03:41:01.036649894Z [2024-04-06T03:41:01.036+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:41:01.036691372Z [2024-04-06T03:41:01.036+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:41:01.037464183Z [2024-04-06T03:41:01.037+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:41:01.037476578Z 2024-04-06T03:41:01.037480021Z 2024-04-06T03:41:01.040222326Z [2024-04-06T03:41:01.039+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:41:01.040236266Z [2024-04-06T03:41:01.040+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:41:01.040364317Z [2024-04-06T03:41:01.040+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:41:01.040465629Z [2024-04-06T03:41:01.040+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:41:01.271075097Z [2024-04-06T03:41:01.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:40:00+00:00 exited with status queued for try_number 1 2024-04-06T03:41:01.271115652Z [2024-04-06T03:41:01.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:40:00+00:00 exited with status queued for try_number 1 2024-04-06T03:41:01.282414379Z [2024-04-06T03:41:01.282+0000] {scheduler_job.py:635} INFO - Setting external_id for to cfa343c7-28ef-45c0-a6a1-dde35e1635dd 2024-04-06T03:41:01.282514752Z [2024-04-06T03:41:01.282+0000] {scheduler_job.py:635} INFO - Setting external_id for to db489ca4-05d9-488e-9be3-7f10dc713cf0 2024-04-06T03:41:05.618536618Z [2024-04-06T03:41:05.617+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:41:05.619137941Z [2024-04-06T03:41:05.618+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:40:00+00:00, run_id=scheduled__2024-04-06T03:40:00+00:00, run_start_date=2024-04-06 03:41:00.987557+00:00, run_end_date=2024-04-06 03:41:05.618467+00:00, run_duration=4.63091, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:40:00+00:00, data_interval_end=2024-04-06 03:41:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:41:05.635361415Z [2024-04-06T03:41:05.635+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:41:00+00:00, run_after=2024-04-06T03:42:00+00:00 2024-04-06T03:41:05.692144895Z [2024-04-06T03:41:05.691+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:40:00+00:00 exited with status success for try_number 1 2024-04-06T03:41:05.700722319Z [2024-04-06T03:41:05.700+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:40:00+00:00, map_index=-1, run_start_date=2024-04-06 03:41:03.224676+00:00, run_end_date=2024-04-06 03:41:05.410704+00:00, run_duration=2.186028, state=success, executor_state=success, try_number=1, max_tries=1, job_id=454, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:41:01.038044+00:00, queued_by_job_id=2, pid=10204 2024-04-06T03:41:07.875460783Z [2024-04-06T03:41:07.874+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:41:07.875778522Z [2024-04-06T03:41:07.875+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:40:00+00:00, run_id=scheduled__2024-04-06T03:40:00+00:00, run_start_date=2024-04-06 03:41:00.989067+00:00, run_end_date=2024-04-06 03:41:07.875091+00:00, run_duration=6.886024, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:40:00+00:00, data_interval_end=2024-04-06 03:41:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:41:07.890126806Z [2024-04-06T03:41:07.889+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:41:00+00:00, run_after=2024-04-06T03:42:00+00:00 2024-04-06T03:41:07.937584472Z [2024-04-06T03:41:07.937+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:40:00+00:00 exited with status success for try_number 1 2024-04-06T03:41:07.945332917Z [2024-04-06T03:41:07.944+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:40:00+00:00, map_index=-1, run_start_date=2024-04-06 03:41:03.342253+00:00, run_end_date=2024-04-06 03:41:06.786877+00:00, run_duration=3.444624, state=success, executor_state=success, try_number=1, max_tries=1, job_id=455, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:41:01.038044+00:00, queued_by_job_id=2, pid=10205 2024-04-06T03:41:49.846570486Z [2024-04-06T03:41:49.845+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:41:49.846660116Z 2024-04-06T03:41:49.846671720Z [2024-04-06T03:41:49.846+0000] {scheduler_job.py:425} INFO - DAG vdu_alarm has 0/16 running and queued tasks 2024-04-06T03:41:49.847503694Z [2024-04-06T03:41:49.847+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:41:49.847526131Z 2024-04-06T03:41:49.850647650Z [2024-04-06T03:41:49.850+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_alarm', task_id='main_task', run_id='vdu_alarm_20240406034148_065508', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:41:49.850702404Z [2024-04-06T03:41:49.850+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240406034148_065508', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-04-06T03:41:49.907817535Z [2024-04-06T03:41:49.907+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240406034148_065508 exited with status queued for try_number 1 2024-04-06T03:41:49.914038198Z [2024-04-06T03:41:49.913+0000] {scheduler_job.py:635} INFO - Setting external_id for to d8bf0513-0092-4250-b45f-491b50381c9d 2024-04-06T03:41:52.105520248Z [2024-04-06T03:41:52.104+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:41:52.106136783Z [2024-04-06T03:41:52.105+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_alarm, execution_date=2024-04-06 03:41:49.214489+00:00, run_id=vdu_alarm_20240406034148_065508, run_start_date=2024-04-06 03:41:49.796828+00:00, run_end_date=2024-04-06 03:41:52.105652+00:00, run_duration=2.308824, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-06 03:41:49.214489+00:00, data_interval_end=2024-04-06 03:41:49.214489+00:00, dag_hash=4c7a7f623757a362f63c388cf0edb231 2024-04-06T03:41:52.110976324Z [2024-04-06T03:41:52.110+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_alarm to None, run_after=None 2024-04-06T03:41:52.139010651Z [2024-04-06T03:41:52.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240406034148_065508 exited with status success for try_number 1 2024-04-06T03:41:52.144161080Z [2024-04-06T03:41:52.143+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_alarm, task_id=main_task, run_id=vdu_alarm_20240406034148_065508, map_index=-1, run_start_date=2024-04-06 03:41:50.513272+00:00, run_end_date=2024-04-06 03:41:50.925043+00:00, run_duration=0.411771, state=success, executor_state=success, try_number=1, max_tries=1, job_id=456, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:41:49.847818+00:00, queued_by_job_id=2, pid=10238 2024-04-06T03:42:01.032677055Z [2024-04-06T03:42:01.032+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:42:01.060667947Z [2024-04-06T03:42:01.060+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:42:00+00:00, run_after=2024-04-06T03:43:00+00:00 2024-04-06T03:42:01.071023134Z [2024-04-06T03:42:01.070+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:42:01.171226693Z [2024-04-06T03:42:01.170+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T03:42:01.171261939Z 2024-04-06T03:42:01.171268954Z 2024-04-06T03:42:01.171272010Z 2024-04-06T03:42:01.171312261Z [2024-04-06T03:42:01.171+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T03:42:01.171466367Z [2024-04-06T03:42:01.171+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:42:01.171563649Z [2024-04-06T03:42:01.171+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:42:01.172191045Z [2024-04-06T03:42:01.171+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:42:01.172203041Z 2024-04-06T03:42:01.172206515Z 2024-04-06T03:42:01.172209767Z 2024-04-06T03:42:01.175758921Z [2024-04-06T03:42:01.175+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:42:01.175891229Z [2024-04-06T03:42:01.175+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:42:01.176240837Z [2024-04-06T03:42:01.176+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:42:01.176428844Z [2024-04-06T03:42:01.176+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:42:01.177005111Z [2024-04-06T03:42:01.176+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:42:01.177287594Z [2024-04-06T03:42:01.177+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:42:01.578296117Z [2024-04-06T03:42:01.577+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:40:00+00:00 exited with status queued for try_number 1 2024-04-06T03:42:01.578541413Z [2024-04-06T03:42:01.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:41:00+00:00 exited with status queued for try_number 1 2024-04-06T03:42:01.578827969Z [2024-04-06T03:42:01.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:41:00+00:00 exited with status queued for try_number 1 2024-04-06T03:42:01.598021375Z [2024-04-06T03:42:01.596+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6fcb3af0-652f-45ca-bee9-00ce7e50a210 2024-04-06T03:42:01.598276453Z [2024-04-06T03:42:01.598+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6919140c-388a-43f0-a952-f6e8d2c71817 2024-04-06T03:42:01.598454232Z [2024-04-06T03:42:01.598+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8bcfd295-9506-40b7-9a7d-f6d7e531b371 2024-04-06T03:42:03.976917767Z [2024-04-06T03:42:03.976+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:42:03.977089404Z [2024-04-06T03:42:03.976+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 03:40:00+00:00, run_id=scheduled__2024-04-06T03:40:00+00:00, run_start_date=2024-04-06 03:42:01.098775+00:00, run_end_date=2024-04-06 03:42:03.976783+00:00, run_duration=2.878008, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:40:00+00:00, data_interval_end=2024-04-06 03:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T03:42:03.991878022Z [2024-04-06T03:42:03.991+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T03:42:00+00:00, run_after=2024-04-06T03:44:00+00:00 2024-04-06T03:42:04.082211805Z [2024-04-06T03:42:04.081+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:40:00+00:00 exited with status success for try_number 1 2024-04-06T03:42:04.094661456Z [2024-04-06T03:42:04.094+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T03:40:00+00:00, map_index=-1, run_start_date=2024-04-06 03:42:02.923623+00:00, run_end_date=2024-04-06 03:42:03.352831+00:00, run_duration=0.429208, state=success, executor_state=success, try_number=1, max_tries=1, job_id=457, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:42:01.173323+00:00, queued_by_job_id=2, pid=10252 2024-04-06T03:42:07.213069639Z [2024-04-06T03:42:07.212+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:42:07.213968067Z [2024-04-06T03:42:07.213+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:41:00+00:00, run_id=scheduled__2024-04-06T03:41:00+00:00, run_start_date=2024-04-06 03:42:01.101655+00:00, run_end_date=2024-04-06 03:42:07.212972+00:00, run_duration=6.111317, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:41:00+00:00, data_interval_end=2024-04-06 03:42:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:42:07.221564150Z [2024-04-06T03:42:07.221+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:42:00+00:00, run_after=2024-04-06T03:43:00+00:00 2024-04-06T03:42:07.227896393Z [2024-04-06T03:42:07.227+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:42:07.228807895Z [2024-04-06T03:42:07.228+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:41:00+00:00, run_id=scheduled__2024-04-06T03:41:00+00:00, run_start_date=2024-04-06 03:42:01.100227+00:00, run_end_date=2024-04-06 03:42:07.227990+00:00, run_duration=6.127763, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:41:00+00:00, data_interval_end=2024-04-06 03:42:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:42:07.240016844Z [2024-04-06T03:42:07.239+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:42:00+00:00, run_after=2024-04-06T03:43:00+00:00 2024-04-06T03:42:07.268033804Z [2024-04-06T03:42:07.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:41:00+00:00 exited with status success for try_number 1 2024-04-06T03:42:07.268063833Z [2024-04-06T03:42:07.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:41:00+00:00 exited with status success for try_number 1 2024-04-06T03:42:07.273539853Z [2024-04-06T03:42:07.273+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:41:00+00:00, map_index=-1, run_start_date=2024-04-06 03:42:04.080143+00:00, run_end_date=2024-04-06 03:42:07.060718+00:00, run_duration=2.980575, state=success, executor_state=success, try_number=1, max_tries=1, job_id=458, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:42:01.173323+00:00, queued_by_job_id=2, pid=10281 2024-04-06T03:42:07.273698709Z [2024-04-06T03:42:07.273+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:41:00+00:00, map_index=-1, run_start_date=2024-04-06 03:42:04.443776+00:00, run_end_date=2024-04-06 03:42:06.519752+00:00, run_duration=2.075976, state=success, executor_state=success, try_number=1, max_tries=1, job_id=459, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:42:01.173323+00:00, queued_by_job_id=2, pid=10286 2024-04-06T03:43:00.965791226Z [2024-04-06T03:43:00.963+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:43:00+00:00, run_after=2024-04-06T03:44:00+00:00 2024-04-06T03:43:00.974562926Z [2024-04-06T03:43:00.974+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:43:01.063577392Z [2024-04-06T03:43:01.063+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T03:43:01.063609227Z 2024-04-06T03:43:01.063626422Z 2024-04-06T03:43:01.063636432Z [2024-04-06T03:43:01.063+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:43:01.063672437Z [2024-04-06T03:43:01.063+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:43:01.064159923Z [2024-04-06T03:43:01.063+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:43:01.064170445Z 2024-04-06T03:43:01.064173542Z 2024-04-06T03:43:01.066782106Z [2024-04-06T03:43:01.066+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:43:01.066877451Z [2024-04-06T03:43:01.066+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:43:01.067089194Z [2024-04-06T03:43:01.066+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:43:01.067173524Z [2024-04-06T03:43:01.067+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:43:01.390247398Z [2024-04-06T03:43:01.389+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:42:00+00:00 exited with status queued for try_number 1 2024-04-06T03:43:01.390456575Z [2024-04-06T03:43:01.390+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:42:00+00:00 exited with status queued for try_number 1 2024-04-06T03:43:01.398466515Z [2024-04-06T03:43:01.398+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2925be1c-c65d-45a5-91bf-e9b860a395de 2024-04-06T03:43:01.398805626Z [2024-04-06T03:43:01.398+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6cf13256-73f5-4ad5-a9ca-24f28884fec0 2024-04-06T03:43:07.560457565Z [2024-04-06T03:43:07.559+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:43:07.560826982Z [2024-04-06T03:43:07.560+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:42:00+00:00, run_id=scheduled__2024-04-06T03:42:00+00:00, run_start_date=2024-04-06 03:43:01.008393+00:00, run_end_date=2024-04-06 03:43:07.560354+00:00, run_duration=6.551961, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:42:00+00:00, data_interval_end=2024-04-06 03:43:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:43:07.569681536Z [2024-04-06T03:43:07.569+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:43:00+00:00, run_after=2024-04-06T03:44:00+00:00 2024-04-06T03:43:07.576101528Z [2024-04-06T03:43:07.575+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:43:07.577151818Z [2024-04-06T03:43:07.576+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:42:00+00:00, run_id=scheduled__2024-04-06T03:42:00+00:00, run_start_date=2024-04-06 03:43:01.011990+00:00, run_end_date=2024-04-06 03:43:07.575985+00:00, run_duration=6.563995, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:42:00+00:00, data_interval_end=2024-04-06 03:43:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:43:07.585873163Z [2024-04-06T03:43:07.585+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:43:00+00:00, run_after=2024-04-06T03:44:00+00:00 2024-04-06T03:43:07.612224847Z [2024-04-06T03:43:07.611+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:42:00+00:00 exited with status success for try_number 1 2024-04-06T03:43:07.612249189Z [2024-04-06T03:43:07.612+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:42:00+00:00 exited with status success for try_number 1 2024-04-06T03:43:07.619904719Z [2024-04-06T03:43:07.618+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:42:00+00:00, map_index=-1, run_start_date=2024-04-06 03:43:04.520669+00:00, run_end_date=2024-04-06 03:43:06.885918+00:00, run_duration=2.365249, state=success, executor_state=success, try_number=1, max_tries=1, job_id=460, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:43:01.064649+00:00, queued_by_job_id=2, pid=10335 2024-04-06T03:43:07.620107503Z [2024-04-06T03:43:07.619+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:42:00+00:00, map_index=-1, run_start_date=2024-04-06 03:43:05.061041+00:00, run_end_date=2024-04-06 03:43:07.463008+00:00, run_duration=2.401967, state=success, executor_state=success, try_number=1, max_tries=1, job_id=461, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:43:01.064649+00:00, queued_by_job_id=2, pid=10337 2024-04-06T03:44:00.813408731Z [2024-04-06T03:44:00.812+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:44:00+00:00, run_after=2024-04-06T03:45:00+00:00 2024-04-06T03:44:00.821442497Z [2024-04-06T03:44:00.821+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:44:00.828195600Z [2024-04-06T03:44:00.827+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:44:00.908447851Z [2024-04-06T03:44:00.908+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T03:44:00.908480340Z 2024-04-06T03:44:00.908485181Z 2024-04-06T03:44:00.908489074Z 2024-04-06T03:44:00.908547895Z [2024-04-06T03:44:00.908+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T03:44:00.908737279Z [2024-04-06T03:44:00.908+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:44:00.908880082Z [2024-04-06T03:44:00.908+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:44:00.909494834Z [2024-04-06T03:44:00.909+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:44:00.909506784Z 2024-04-06T03:44:00.909510567Z 2024-04-06T03:44:00.909513772Z 2024-04-06T03:44:00.913941118Z [2024-04-06T03:44:00.913+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T03:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:44:00.914097082Z [2024-04-06T03:44:00.913+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:44:00.914323931Z [2024-04-06T03:44:00.914+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:44:00.914499664Z [2024-04-06T03:44:00.914+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:44:00.914717695Z [2024-04-06T03:44:00.914+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:44:00.914921289Z [2024-04-06T03:44:00.914+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:44:01.305737371Z [2024-04-06T03:44:01.304+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:42:00+00:00 exited with status queued for try_number 1 2024-04-06T03:44:01.306226504Z [2024-04-06T03:44:01.305+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:43:00+00:00 exited with status queued for try_number 1 2024-04-06T03:44:01.306410942Z [2024-04-06T03:44:01.306+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:43:00+00:00 exited with status queued for try_number 1 2024-04-06T03:44:01.318970401Z [2024-04-06T03:44:01.318+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a0e54d9-af63-4774-856e-bd07f320515e 2024-04-06T03:44:01.319034224Z [2024-04-06T03:44:01.318+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb2dfc4f-8feb-4e0e-a721-3f6b4a3235a7 2024-04-06T03:44:01.319126747Z [2024-04-06T03:44:01.319+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8932362d-eae6-4d81-b2b6-b8adc1e558f3 2024-04-06T03:44:03.751046086Z [2024-04-06T03:44:03.750+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:44:03.751554830Z [2024-04-06T03:44:03.751+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 03:42:00+00:00, run_id=scheduled__2024-04-06T03:42:00+00:00, run_start_date=2024-04-06 03:44:00.837145+00:00, run_end_date=2024-04-06 03:44:03.751013+00:00, run_duration=2.913868, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:42:00+00:00, data_interval_end=2024-04-06 03:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T03:44:03.758911328Z [2024-04-06T03:44:03.758+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T03:44:00+00:00, run_after=2024-04-06T03:46:00+00:00 2024-04-06T03:44:03.829076047Z [2024-04-06T03:44:03.828+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:42:00+00:00 exited with status success for try_number 1 2024-04-06T03:44:03.838826377Z [2024-04-06T03:44:03.837+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T03:42:00+00:00, map_index=-1, run_start_date=2024-04-06 03:44:02.169214+00:00, run_end_date=2024-04-06 03:44:03.001235+00:00, run_duration=0.832021, state=success, executor_state=success, try_number=1, max_tries=1, job_id=462, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:44:00.910633+00:00, queued_by_job_id=2, pid=10372 2024-04-06T03:44:05.802007552Z [2024-04-06T03:44:05.801+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:44:05.802567084Z [2024-04-06T03:44:05.802+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:43:00+00:00, run_id=scheduled__2024-04-06T03:43:00+00:00, run_start_date=2024-04-06 03:44:00.838715+00:00, run_end_date=2024-04-06 03:44:05.802173+00:00, run_duration=4.963458, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:43:00+00:00, data_interval_end=2024-04-06 03:44:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:44:05.812484457Z [2024-04-06T03:44:05.812+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:44:00+00:00, run_after=2024-04-06T03:45:00+00:00 2024-04-06T03:44:05.850513416Z [2024-04-06T03:44:05.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:43:00+00:00 exited with status success for try_number 1 2024-04-06T03:44:05.858374540Z [2024-04-06T03:44:05.858+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:43:00+00:00, map_index=-1, run_start_date=2024-04-06 03:44:03.952060+00:00, run_end_date=2024-04-06 03:44:05.546925+00:00, run_duration=1.594865, state=success, executor_state=success, try_number=1, max_tries=1, job_id=464, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:44:00.910633+00:00, queued_by_job_id=2, pid=10403 2024-04-06T03:44:06.406541880Z [2024-04-06T03:44:06.406+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:44:06.406859804Z [2024-04-06T03:44:06.406+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:43:00+00:00, run_id=scheduled__2024-04-06T03:43:00+00:00, run_start_date=2024-04-06 03:44:00.840108+00:00, run_end_date=2024-04-06 03:44:06.406538+00:00, run_duration=5.56643, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:43:00+00:00, data_interval_end=2024-04-06 03:44:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:44:06.414644103Z [2024-04-06T03:44:06.414+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:44:00+00:00, run_after=2024-04-06T03:45:00+00:00 2024-04-06T03:44:06.441937010Z [2024-04-06T03:44:06.441+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:43:00+00:00 exited with status success for try_number 1 2024-04-06T03:44:06.446558963Z [2024-04-06T03:44:06.446+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:43:00+00:00, map_index=-1, run_start_date=2024-04-06 03:44:03.924041+00:00, run_end_date=2024-04-06 03:44:05.972538+00:00, run_duration=2.048497, state=success, executor_state=success, try_number=1, max_tries=1, job_id=463, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:44:00.910633+00:00, queued_by_job_id=2, pid=10402 2024-04-06T03:45:00.413680893Z [2024-04-06T03:45:00.413+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:45:00+00:00, run_after=2024-04-06T03:46:00+00:00 2024-04-06T03:45:00.423991505Z [2024-04-06T03:45:00.423+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:45:00.450281583Z [2024-04-06T03:45:00.449+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:45:00+00:00, run_after=2024-04-06T03:50:00+00:00 2024-04-06T03:45:00.550719118Z [2024-04-06T03:45:00.550+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T03:45:00.550747921Z 2024-04-06T03:45:00.550755113Z 2024-04-06T03:45:00.550758403Z 2024-04-06T03:45:00.550761600Z [2024-04-06T03:45:00.550+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:45:00.550942828Z [2024-04-06T03:45:00.550+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:45:00.551102129Z [2024-04-06T03:45:00.550+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:45:00.551736336Z [2024-04-06T03:45:00.551+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:45:00.551763236Z 2024-04-06T03:45:00.551767015Z 2024-04-06T03:45:00.551773732Z 2024-04-06T03:45:00.556619374Z [2024-04-06T03:45:00.556+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-06T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-06T03:45:00.556963686Z [2024-04-06T03:45:00.556+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:45:00.557480762Z [2024-04-06T03:45:00.557+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:45:00.557776516Z [2024-04-06T03:45:00.557+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:45:00.558339380Z [2024-04-06T03:45:00.558+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:45:00.558729016Z [2024-04-06T03:45:00.558+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:45:01.009950280Z [2024-04-06T03:45:01.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T03:40:00+00:00 exited with status queued for try_number 1 2024-04-06T03:45:01.010170200Z [2024-04-06T03:45:01.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:44:00+00:00 exited with status queued for try_number 1 2024-04-06T03:45:01.010355422Z [2024-04-06T03:45:01.010+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:44:00+00:00 exited with status queued for try_number 1 2024-04-06T03:45:01.032932508Z [2024-04-06T03:45:01.032+0000] {scheduler_job.py:635} INFO - Setting external_id for to 200d7c4f-6c22-4236-8398-fb8901b95aa9 2024-04-06T03:45:01.037510805Z [2024-04-06T03:45:01.037+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1089a69d-ebeb-45a7-965d-a24cd8116a17 2024-04-06T03:45:01.037790667Z [2024-04-06T03:45:01.037+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f817142-54ea-42c2-ba75-92a0bad8c474 2024-04-06T03:45:05.578269040Z [2024-04-06T03:45:05.577+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:45:05.578315993Z 2024-04-06T03:45:05.578328879Z [2024-04-06T03:45:05.578+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:45:05.579207006Z [2024-04-06T03:45:05.578+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:45:05.579220480Z 2024-04-06T03:45:05.582501774Z [2024-04-06T03:45:05.582+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='split_metrics', run_id='scheduled__2024-04-06T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-06T03:45:05.582564072Z [2024-04-06T03:45:05.582+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:45:05.692860160Z [2024-04-06T03:45:05.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T03:40:00+00:00 exited with status queued for try_number 1 2024-04-06T03:45:05.701756225Z [2024-04-06T03:45:05.701+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77b7dfcc-189a-4441-a5ea-98fb38b30008 2024-04-06T03:45:05.905181665Z [2024-04-06T03:45:05.904+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T03:40:00+00:00 exited with status success for try_number 1 2024-04-06T03:45:05.914437434Z [2024-04-06T03:45:05.914+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-06T03:40:00+00:00, map_index=-1, run_start_date=2024-04-06 03:45:04.879221+00:00, run_end_date=2024-04-06 03:45:05.479157+00:00, run_duration=0.599936, state=success, executor_state=success, try_number=1, max_tries=1, job_id=467, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:45:00.552515+00:00, queued_by_job_id=2, pid=10479 2024-04-06T03:45:06.240931578Z [2024-04-06T03:45:06.240+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:45:06.241282239Z [2024-04-06T03:45:06.241+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:44:00+00:00, run_id=scheduled__2024-04-06T03:44:00+00:00, run_start_date=2024-04-06 03:45:00.471976+00:00, run_end_date=2024-04-06 03:45:06.240942+00:00, run_duration=5.768966, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:44:00+00:00, data_interval_end=2024-04-06 03:45:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:45:06.250460686Z [2024-04-06T03:45:06.250+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:45:00+00:00, run_after=2024-04-06T03:46:00+00:00 2024-04-06T03:45:06.304398779Z [2024-04-06T03:45:06.304+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:44:00+00:00 exited with status success for try_number 1 2024-04-06T03:45:06.310026219Z [2024-04-06T03:45:06.309+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:44:00+00:00, map_index=-1, run_start_date=2024-04-06 03:45:03.892261+00:00, run_end_date=2024-04-06 03:45:05.790446+00:00, run_duration=1.898185, state=success, executor_state=success, try_number=1, max_tries=1, job_id=465, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:45:00.552515+00:00, queued_by_job_id=2, pid=10459 2024-04-06T03:45:07.359704328Z [2024-04-06T03:45:07.359+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:45:07.360163233Z [2024-04-06T03:45:07.359+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:44:00+00:00, run_id=scheduled__2024-04-06T03:44:00+00:00, run_start_date=2024-04-06 03:45:00.474870+00:00, run_end_date=2024-04-06 03:45:07.359835+00:00, run_duration=6.884965, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:44:00+00:00, data_interval_end=2024-04-06 03:45:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:45:07.368470595Z [2024-04-06T03:45:07.368+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:45:00+00:00, run_after=2024-04-06T03:46:00+00:00 2024-04-06T03:45:07.416621142Z [2024-04-06T03:45:07.416+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:44:00+00:00 exited with status success for try_number 1 2024-04-06T03:45:07.422969812Z [2024-04-06T03:45:07.422+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:44:00+00:00, map_index=-1, run_start_date=2024-04-06 03:45:04.421539+00:00, run_end_date=2024-04-06 03:45:06.735141+00:00, run_duration=2.313602, state=success, executor_state=success, try_number=1, max_tries=1, job_id=466, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:45:00.552515+00:00, queued_by_job_id=2, pid=10469 2024-04-06T03:45:08.511284968Z [2024-04-06T03:45:08.510+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:45:08.511318800Z 2024-04-06T03:45:08.512750704Z [2024-04-06T03:45:08.510+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:45:08.512770798Z [2024-04-06T03:45:08.512+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:45:08.512777275Z 2024-04-06T03:45:08.515014529Z [2024-04-06T03:45:08.514+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='collect_metrics', run_id='scheduled__2024-04-06T03:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-06T03:45:08.515363092Z [2024-04-06T03:45:08.515+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T03:45:08.592187393Z [2024-04-06T03:45:08.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T03:40:00+00:00 exited with status queued for try_number 1 2024-04-06T03:45:08.592338121Z [2024-04-06T03:45:08.592+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T03:40:00+00:00 exited with status success for try_number 1 2024-04-06T03:45:08.598208698Z [2024-04-06T03:45:08.597+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f4c5533-9f0b-415c-b414-4a09451dab38 2024-04-06T03:45:08.598495035Z [2024-04-06T03:45:08.598+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=split_metrics, run_id=scheduled__2024-04-06T03:40:00+00:00, map_index=-1, run_start_date=2024-04-06 03:45:07.684497+00:00, run_end_date=2024-04-06 03:45:08.025443+00:00, run_duration=0.340946, state=success, executor_state=success, try_number=1, max_tries=1, job_id=468, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:45:05.579658+00:00, queued_by_job_id=2, pid=10509 2024-04-06T03:45:10.852330007Z [2024-04-06T03:45:10.851+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:45:10.852358008Z 2024-04-06T03:45:10.852514652Z [2024-04-06T03:45:10.852+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:45:10.853043161Z [2024-04-06T03:45:10.852+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:45:10.853054405Z 2024-04-06T03:45:10.855271286Z [2024-04-06T03:45:10.855+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='send_prometheus', run_id='scheduled__2024-04-06T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:45:10.855358839Z [2024-04-06T03:45:10.855+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:45:10.959838153Z [2024-04-06T03:45:10.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T03:40:00+00:00 exited with status queued for try_number 1 2024-04-06T03:45:10.959941343Z [2024-04-06T03:45:10.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T03:40:00+00:00 exited with status success for try_number 1 2024-04-06T03:45:10.968581423Z [2024-04-06T03:45:10.968+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7cf08295-b907-4841-8fd8-81191e935d4b 2024-04-06T03:45:10.968861437Z [2024-04-06T03:45:10.968+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=collect_metrics, run_id=scheduled__2024-04-06T03:40:00+00:00, map_index=0, run_start_date=2024-04-06 03:45:10.164891+00:00, run_end_date=2024-04-06 03:45:10.566888+00:00, run_duration=0.401997, state=success, executor_state=success, try_number=1, max_tries=1, job_id=469, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:45:08.512635+00:00, queued_by_job_id=2, pid=10531 2024-04-06T03:45:13.593806020Z [2024-04-06T03:45:13.593+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:45:13.593993600Z [2024-04-06T03:45:13.593+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:40:00+00:00, run_id=scheduled__2024-04-06T03:40:00+00:00, run_start_date=2024-04-06 03:45:00.470272+00:00, run_end_date=2024-04-06 03:45:13.593730+00:00, run_duration=13.123458, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:40:00+00:00, data_interval_end=2024-04-06 03:45:00+00:00, dag_hash=eecc559ff32fe9a7c4345875f113a0a9 2024-04-06T03:45:13.602524262Z [2024-04-06T03:45:13.602+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:45:00+00:00, run_after=2024-04-06T03:50:00+00:00 2024-04-06T03:45:13.637553302Z [2024-04-06T03:45:13.637+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T03:40:00+00:00 exited with status success for try_number 1 2024-04-06T03:45:13.649850608Z [2024-04-06T03:45:13.649+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=send_prometheus, run_id=scheduled__2024-04-06T03:40:00+00:00, map_index=-1, run_start_date=2024-04-06 03:45:12.603105+00:00, run_end_date=2024-04-06 03:45:12.991543+00:00, run_duration=0.388438, state=success, executor_state=success, try_number=1, max_tries=1, job_id=470, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:45:10.853379+00:00, queued_by_job_id=2, pid=10546 2024-04-06T03:45:21.084341859Z [2024-04-06T03:45:21.083+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-06T03:45:49.696701557Z [2024-04-06T03:45:49.695+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:45:49.696753635Z 2024-04-06T03:45:49.696780816Z [2024-04-06T03:45:49.696+0000] {scheduler_job.py:425} INFO - DAG vdu_alarm has 0/16 running and queued tasks 2024-04-06T03:45:49.697679709Z [2024-04-06T03:45:49.697+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:45:49.697695148Z 2024-04-06T03:45:49.701715581Z [2024-04-06T03:45:49.701+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_alarm', task_id='main_task', run_id='vdu_alarm_20240406034548_196957', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:45:49.702032925Z [2024-04-06T03:45:49.701+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240406034548_196957', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-04-06T03:45:49.765117064Z [2024-04-06T03:45:49.764+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240406034548_196957 exited with status queued for try_number 1 2024-04-06T03:45:49.779352394Z [2024-04-06T03:45:49.778+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee80a5d5-3f44-43cb-bc70-03d782cbb51f 2024-04-06T03:45:50.930251731Z [2024-04-06T03:45:50.929+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:45:50.931168134Z [2024-04-06T03:45:50.930+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_alarm, execution_date=2024-04-06 03:45:49.210259+00:00, run_id=vdu_alarm_20240406034548_196957, run_start_date=2024-04-06 03:45:49.651660+00:00, run_end_date=2024-04-06 03:45:50.930778+00:00, run_duration=1.279118, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-06 03:45:49.210259+00:00, data_interval_end=2024-04-06 03:45:49.210259+00:00, dag_hash=4c7a7f623757a362f63c388cf0edb231 2024-04-06T03:45:50.934306006Z [2024-04-06T03:45:50.934+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_alarm to None, run_after=None 2024-04-06T03:45:50.963638652Z [2024-04-06T03:45:50.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240406034548_196957 exited with status success for try_number 1 2024-04-06T03:45:50.968133282Z [2024-04-06T03:45:50.967+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_alarm, task_id=main_task, run_id=vdu_alarm_20240406034548_196957, map_index=-1, run_start_date=2024-04-06 03:45:50.394044+00:00, run_end_date=2024-04-06 03:45:50.810812+00:00, run_duration=0.416768, state=success, executor_state=success, try_number=1, max_tries=1, job_id=471, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:45:49.698378+00:00, queued_by_job_id=2, pid=10548 2024-04-06T03:46:00.353684830Z [2024-04-06T03:46:00.353+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:46:00+00:00, run_after=2024-04-06T03:47:00+00:00 2024-04-06T03:46:00.364114227Z [2024-04-06T03:46:00.363+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:46:00.374397993Z [2024-04-06T03:46:00.374+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:46:00.454318950Z [2024-04-06T03:46:00.453+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T03:46:00.454378452Z 2024-04-06T03:46:00.454390224Z 2024-04-06T03:46:00.454399897Z 2024-04-06T03:46:00.454409342Z [2024-04-06T03:46:00.454+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T03:46:00.454451278Z [2024-04-06T03:46:00.454+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:46:00.454482618Z [2024-04-06T03:46:00.454+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:46:00.455181619Z [2024-04-06T03:46:00.454+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:46:00.455195443Z 2024-04-06T03:46:00.455200030Z 2024-04-06T03:46:00.455203776Z 2024-04-06T03:46:00.459864507Z [2024-04-06T03:46:00.459+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T03:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:46:00.459986192Z [2024-04-06T03:46:00.459+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:46:00.460471618Z [2024-04-06T03:46:00.460+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:46:00.460750530Z [2024-04-06T03:46:00.460+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:46:00.461183503Z [2024-04-06T03:46:00.460+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:46:00.461473082Z [2024-04-06T03:46:00.461+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:46:00.796963421Z [2024-04-06T03:46:00.795+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:44:00+00:00 exited with status queued for try_number 1 2024-04-06T03:46:00.796998274Z [2024-04-06T03:46:00.796+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:45:00+00:00 exited with status queued for try_number 1 2024-04-06T03:46:00.797002180Z [2024-04-06T03:46:00.796+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:45:00+00:00 exited with status queued for try_number 1 2024-04-06T03:46:00.805889193Z [2024-04-06T03:46:00.805+0000] {scheduler_job.py:635} INFO - Setting external_id for to 402e1c3e-845e-41f4-9086-ede86ce9f014 2024-04-06T03:46:00.806056832Z [2024-04-06T03:46:00.805+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c94d066-2f55-4436-acb6-c1809ac1f0e7 2024-04-06T03:46:00.806318844Z [2024-04-06T03:46:00.806+0000] {scheduler_job.py:635} INFO - Setting external_id for to ffde47cb-53da-4adf-b91d-32d274e72e90 2024-04-06T03:46:03.130065923Z [2024-04-06T03:46:03.129+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:46:03.132152436Z [2024-04-06T03:46:03.131+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 03:44:00+00:00, run_id=scheduled__2024-04-06T03:44:00+00:00, run_start_date=2024-04-06 03:46:00.392623+00:00, run_end_date=2024-04-06 03:46:03.131701+00:00, run_duration=2.739078, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:44:00+00:00, data_interval_end=2024-04-06 03:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T03:46:03.145668320Z [2024-04-06T03:46:03.145+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T03:46:00+00:00, run_after=2024-04-06T03:48:00+00:00 2024-04-06T03:46:03.230825414Z [2024-04-06T03:46:03.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:44:00+00:00 exited with status success for try_number 1 2024-04-06T03:46:03.235241819Z [2024-04-06T03:46:03.234+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T03:44:00+00:00, map_index=-1, run_start_date=2024-04-06 03:46:01.844841+00:00, run_end_date=2024-04-06 03:46:02.507069+00:00, run_duration=0.662228, state=success, executor_state=success, try_number=1, max_tries=1, job_id=472, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:46:00.456196+00:00, queued_by_job_id=2, pid=10562 2024-04-06T03:46:05.983169765Z [2024-04-06T03:46:05.982+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:46:05.983768912Z [2024-04-06T03:46:05.983+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:45:00+00:00, run_id=scheduled__2024-04-06T03:45:00+00:00, run_start_date=2024-04-06 03:46:00.394212+00:00, run_end_date=2024-04-06 03:46:05.983219+00:00, run_duration=5.589007, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:45:00+00:00, data_interval_end=2024-04-06 03:46:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:46:05.997919286Z [2024-04-06T03:46:05.997+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:46:00+00:00, run_after=2024-04-06T03:47:00+00:00 2024-04-06T03:46:06.011680141Z [2024-04-06T03:46:06.011+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:46:06.012062312Z [2024-04-06T03:46:06.011+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:45:00+00:00, run_id=scheduled__2024-04-06T03:45:00+00:00, run_start_date=2024-04-06 03:46:00.395248+00:00, run_end_date=2024-04-06 03:46:06.011532+00:00, run_duration=5.616284, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:45:00+00:00, data_interval_end=2024-04-06 03:46:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:46:06.025506101Z [2024-04-06T03:46:06.025+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:46:00+00:00, run_after=2024-04-06T03:47:00+00:00 2024-04-06T03:46:06.058201628Z [2024-04-06T03:46:06.057+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:45:00+00:00 exited with status success for try_number 1 2024-04-06T03:46:06.058273546Z [2024-04-06T03:46:06.058+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:45:00+00:00 exited with status success for try_number 1 2024-04-06T03:46:06.068916056Z [2024-04-06T03:46:06.068+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:45:00+00:00, map_index=-1, run_start_date=2024-04-06 03:46:03.498072+00:00, run_end_date=2024-04-06 03:46:05.155126+00:00, run_duration=1.657054, state=success, executor_state=success, try_number=1, max_tries=1, job_id=474, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:46:00.456196+00:00, queued_by_job_id=2, pid=10597 2024-04-06T03:46:06.069085043Z [2024-04-06T03:46:06.068+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:45:00+00:00, map_index=-1, run_start_date=2024-04-06 03:46:03.105478+00:00, run_end_date=2024-04-06 03:46:04.867097+00:00, run_duration=1.761619, state=success, executor_state=success, try_number=1, max_tries=1, job_id=473, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:46:00.456196+00:00, queued_by_job_id=2, pid=10582 2024-04-06T03:47:00.204855945Z [2024-04-06T03:47:00.204+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:47:00.222497827Z [2024-04-06T03:47:00.222+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:47:00+00:00, run_after=2024-04-06T03:48:00+00:00 2024-04-06T03:47:00.281470578Z [2024-04-06T03:47:00.281+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T03:47:00.281604028Z 2024-04-06T03:47:00.281616338Z 2024-04-06T03:47:00.281683909Z [2024-04-06T03:47:00.281+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:47:00.281767409Z [2024-04-06T03:47:00.281+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:47:00.284161051Z [2024-04-06T03:47:00.282+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:47:00.284177736Z 2024-04-06T03:47:00.284181609Z 2024-04-06T03:47:00.291551985Z [2024-04-06T03:47:00.291+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:47:00.291758043Z [2024-04-06T03:47:00.291+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:47:00.292348893Z [2024-04-06T03:47:00.292+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:47:00.292670826Z [2024-04-06T03:47:00.292+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:47:00.469605410Z [2024-04-06T03:47:00.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:46:00+00:00 exited with status queued for try_number 1 2024-04-06T03:47:00.469755960Z [2024-04-06T03:47:00.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:46:00+00:00 exited with status queued for try_number 1 2024-04-06T03:47:00.479860429Z [2024-04-06T03:47:00.479+0000] {scheduler_job.py:635} INFO - Setting external_id for to af0f4b8c-f707-46bc-bc14-611ea5d6ac14 2024-04-06T03:47:00.480117768Z [2024-04-06T03:47:00.479+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9ec54bc6-d945-4e33-afee-06ceaa043b61 2024-04-06T03:47:04.197757371Z [2024-04-06T03:47:04.197+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:47:04.198099231Z [2024-04-06T03:47:04.197+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:46:00+00:00, run_id=scheduled__2024-04-06T03:46:00+00:00, run_start_date=2024-04-06 03:47:00.235485+00:00, run_end_date=2024-04-06 03:47:04.197629+00:00, run_duration=3.962144, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:46:00+00:00, data_interval_end=2024-04-06 03:47:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:47:04.206941883Z [2024-04-06T03:47:04.206+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:47:00+00:00, run_after=2024-04-06T03:48:00+00:00 2024-04-06T03:47:04.248584437Z [2024-04-06T03:47:04.248+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:46:00+00:00 exited with status success for try_number 1 2024-04-06T03:47:04.266014675Z [2024-04-06T03:47:04.261+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:46:00+00:00, map_index=-1, run_start_date=2024-04-06 03:47:02.456487+00:00, run_end_date=2024-04-06 03:47:03.987016+00:00, run_duration=1.530529, state=success, executor_state=success, try_number=1, max_tries=1, job_id=476, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:47:00.286250+00:00, queued_by_job_id=2, pid=10647 2024-04-06T03:47:05.200819231Z [2024-04-06T03:47:05.200+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:47:05.202999260Z [2024-04-06T03:47:05.200+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:46:00+00:00, run_id=scheduled__2024-04-06T03:46:00+00:00, run_start_date=2024-04-06 03:47:00.236853+00:00, run_end_date=2024-04-06 03:47:05.200722+00:00, run_duration=4.963869, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:46:00+00:00, data_interval_end=2024-04-06 03:47:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:47:05.217758501Z [2024-04-06T03:47:05.217+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:47:00+00:00, run_after=2024-04-06T03:48:00+00:00 2024-04-06T03:47:05.244058107Z [2024-04-06T03:47:05.243+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:46:00+00:00 exited with status success for try_number 1 2024-04-06T03:47:05.249931200Z [2024-04-06T03:47:05.249+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:46:00+00:00, map_index=-1, run_start_date=2024-04-06 03:47:02.300149+00:00, run_end_date=2024-04-06 03:47:04.367483+00:00, run_duration=2.067334, state=success, executor_state=success, try_number=1, max_tries=1, job_id=475, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:47:00.286250+00:00, queued_by_job_id=2, pid=10646 2024-04-06T03:48:00.110845116Z [2024-04-06T03:48:00.110+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:48:00.122373453Z [2024-04-06T03:48:00.121+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:48:00.140427978Z [2024-04-06T03:48:00.140+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:48:00+00:00, run_after=2024-04-06T03:49:00+00:00 2024-04-06T03:48:00.246387150Z [2024-04-06T03:48:00.246+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T03:48:00.246425053Z 2024-04-06T03:48:00.246433605Z 2024-04-06T03:48:00.246437125Z 2024-04-06T03:48:00.246702771Z [2024-04-06T03:48:00.246+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T03:48:00.246917529Z [2024-04-06T03:48:00.246+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:48:00.247073579Z [2024-04-06T03:48:00.246+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:48:00.247735056Z [2024-04-06T03:48:00.247+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:48:00.247746599Z 2024-04-06T03:48:00.247750143Z 2024-04-06T03:48:00.247753213Z 2024-04-06T03:48:00.250872503Z [2024-04-06T03:48:00.250+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T03:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:48:00.251097798Z [2024-04-06T03:48:00.250+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:48:00.251454678Z [2024-04-06T03:48:00.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:48:00.251654962Z [2024-04-06T03:48:00.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:48:00.252009912Z [2024-04-06T03:48:00.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:48:00.252207755Z [2024-04-06T03:48:00.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:48:00.578348153Z [2024-04-06T03:48:00.577+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:46:00+00:00 exited with status queued for try_number 1 2024-04-06T03:48:00.578658304Z [2024-04-06T03:48:00.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:47:00+00:00 exited with status queued for try_number 1 2024-04-06T03:48:00.578807737Z [2024-04-06T03:48:00.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:47:00+00:00 exited with status queued for try_number 1 2024-04-06T03:48:00.586839049Z [2024-04-06T03:48:00.586+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3ae0d8ff-5f3b-4789-b681-8770d8c0d025 2024-04-06T03:48:00.587048032Z [2024-04-06T03:48:00.586+0000] {scheduler_job.py:635} INFO - Setting external_id for to 692e50bc-aaf1-461a-87f8-2f12656f716f 2024-04-06T03:48:00.587228261Z [2024-04-06T03:48:00.587+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a35548f-a46b-493b-a4c0-b9b7cdc8cbc2 2024-04-06T03:48:01.870069386Z [2024-04-06T03:48:01.869+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:46:00+00:00 exited with status success for try_number 1 2024-04-06T03:48:01.877441925Z [2024-04-06T03:48:01.877+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T03:46:00+00:00, map_index=-1, run_start_date=2024-04-06 03:48:01.068083+00:00, run_end_date=2024-04-06 03:48:01.628445+00:00, run_duration=0.560362, state=success, executor_state=success, try_number=1, max_tries=1, job_id=477, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:48:00.248390+00:00, queued_by_job_id=2, pid=10682 2024-04-06T03:48:02.940593005Z [2024-04-06T03:48:02.940+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:48:02.941194418Z [2024-04-06T03:48:02.940+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 03:46:00+00:00, run_id=scheduled__2024-04-06T03:46:00+00:00, run_start_date=2024-04-06 03:48:00.155483+00:00, run_end_date=2024-04-06 03:48:02.940827+00:00, run_duration=2.785344, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:46:00+00:00, data_interval_end=2024-04-06 03:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T03:48:02.950996374Z [2024-04-06T03:48:02.950+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T03:48:00+00:00, run_after=2024-04-06T03:50:00+00:00 2024-04-06T03:48:05.173850514Z [2024-04-06T03:48:05.173+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:48:05.174574798Z [2024-04-06T03:48:05.173+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:47:00+00:00, run_id=scheduled__2024-04-06T03:47:00+00:00, run_start_date=2024-04-06 03:48:00.158392+00:00, run_end_date=2024-04-06 03:48:05.173776+00:00, run_duration=5.015384, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:47:00+00:00, data_interval_end=2024-04-06 03:48:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:48:05.183161638Z [2024-04-06T03:48:05.182+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:48:00+00:00, run_after=2024-04-06T03:49:00+00:00 2024-04-06T03:48:05.189059319Z [2024-04-06T03:48:05.188+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:48:05.189438687Z [2024-04-06T03:48:05.189+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:47:00+00:00, run_id=scheduled__2024-04-06T03:47:00+00:00, run_start_date=2024-04-06 03:48:00.166448+00:00, run_end_date=2024-04-06 03:48:05.188993+00:00, run_duration=5.022545, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:47:00+00:00, data_interval_end=2024-04-06 03:48:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:48:05.199741807Z [2024-04-06T03:48:05.199+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:48:00+00:00, run_after=2024-04-06T03:49:00+00:00 2024-04-06T03:48:05.227382067Z [2024-04-06T03:48:05.227+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:47:00+00:00 exited with status success for try_number 1 2024-04-06T03:48:05.227406103Z [2024-04-06T03:48:05.227+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:47:00+00:00 exited with status success for try_number 1 2024-04-06T03:48:05.234430122Z [2024-04-06T03:48:05.234+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:47:00+00:00, map_index=-1, run_start_date=2024-04-06 03:48:02.631291+00:00, run_end_date=2024-04-06 03:48:04.275239+00:00, run_duration=1.643948, state=success, executor_state=success, try_number=1, max_tries=1, job_id=479, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:48:00.248390+00:00, queued_by_job_id=2, pid=10713 2024-04-06T03:48:05.234664238Z [2024-04-06T03:48:05.234+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:47:00+00:00, map_index=-1, run_start_date=2024-04-06 03:48:02.419990+00:00, run_end_date=2024-04-06 03:48:04.771496+00:00, run_duration=2.351506, state=success, executor_state=success, try_number=1, max_tries=1, job_id=478, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:48:00.248390+00:00, queued_by_job_id=2, pid=10712 2024-04-06T03:49:00.060989973Z [2024-04-06T03:49:00.059+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:49:00+00:00, run_after=2024-04-06T03:50:00+00:00 2024-04-06T03:49:00.069778999Z [2024-04-06T03:49:00.069+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:49:00.125593159Z [2024-04-06T03:49:00.125+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T03:49:00.125618395Z 2024-04-06T03:49:00.125628626Z 2024-04-06T03:49:00.125896095Z [2024-04-06T03:49:00.125+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:49:00.126188172Z [2024-04-06T03:49:00.125+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:49:00.126935000Z [2024-04-06T03:49:00.126+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:49:00.126974780Z 2024-04-06T03:49:00.126980483Z 2024-04-06T03:49:00.130203569Z [2024-04-06T03:49:00.129+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:49:00.130218437Z [2024-04-06T03:49:00.129+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:49:00.130631518Z [2024-04-06T03:49:00.130+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:49:00.130903452Z [2024-04-06T03:49:00.130+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:49:00.293037897Z [2024-04-06T03:49:00.292+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:48:00+00:00 exited with status queued for try_number 1 2024-04-06T03:49:00.293206463Z [2024-04-06T03:49:00.293+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:48:00+00:00 exited with status queued for try_number 1 2024-04-06T03:49:00.299872321Z [2024-04-06T03:49:00.299+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71452294-e62a-4cdb-971b-063d538ad07a 2024-04-06T03:49:00.299919151Z [2024-04-06T03:49:00.299+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23f0b297-9efc-4182-8609-b91fed938907 2024-04-06T03:49:03.731376574Z [2024-04-06T03:49:03.730+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:49:03.746872063Z [2024-04-06T03:49:03.745+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:48:00+00:00, run_id=scheduled__2024-04-06T03:48:00+00:00, run_start_date=2024-04-06 03:49:00.080030+00:00, run_end_date=2024-04-06 03:49:03.744616+00:00, run_duration=3.664586, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:48:00+00:00, data_interval_end=2024-04-06 03:49:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:49:03.765975008Z [2024-04-06T03:49:03.765+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:49:00+00:00, run_after=2024-04-06T03:50:00+00:00 2024-04-06T03:49:03.801625892Z [2024-04-06T03:49:03.801+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:48:00+00:00 exited with status success for try_number 1 2024-04-06T03:49:03.806781613Z [2024-04-06T03:49:03.806+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:48:00+00:00, map_index=-1, run_start_date=2024-04-06 03:49:02.157900+00:00, run_end_date=2024-04-06 03:49:03.578489+00:00, run_duration=1.420589, state=success, executor_state=success, try_number=1, max_tries=1, job_id=481, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:49:00.127602+00:00, queued_by_job_id=2, pid=10768 2024-04-06T03:49:04.847781742Z [2024-04-06T03:49:04.847+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:49:04.847987082Z [2024-04-06T03:49:04.847+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:48:00+00:00, run_id=scheduled__2024-04-06T03:48:00+00:00, run_start_date=2024-04-06 03:49:00.081619+00:00, run_end_date=2024-04-06 03:49:04.847590+00:00, run_duration=4.765971, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:48:00+00:00, data_interval_end=2024-04-06 03:49:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:49:04.855759446Z [2024-04-06T03:49:04.855+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:49:00+00:00, run_after=2024-04-06T03:50:00+00:00 2024-04-06T03:49:04.890040756Z [2024-04-06T03:49:04.885+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:48:00+00:00 exited with status success for try_number 1 2024-04-06T03:49:04.891691157Z [2024-04-06T03:49:04.891+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:48:00+00:00, map_index=-1, run_start_date=2024-04-06 03:49:02.152406+00:00, run_end_date=2024-04-06 03:49:03.857323+00:00, run_duration=1.704917, state=success, executor_state=success, try_number=1, max_tries=1, job_id=480, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:49:00.127602+00:00, queued_by_job_id=2, pid=10767 2024-04-06T03:50:00.452918128Z [2024-04-06T03:50:00.451+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:50:00.481904513Z [2024-04-06T03:50:00.481+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:50:00+00:00, run_after=2024-04-06T03:51:00+00:00 2024-04-06T03:50:00.511261340Z [2024-04-06T03:50:00.510+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:50:00+00:00, run_after=2024-04-06T03:55:00+00:00 2024-04-06T03:50:00.521377329Z [2024-04-06T03:50:00.521+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:50:00.619253662Z [2024-04-06T03:50:00.618+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-06T03:50:00.619291088Z 2024-04-06T03:50:00.619298769Z 2024-04-06T03:50:00.619305552Z 2024-04-06T03:50:00.619311698Z 2024-04-06T03:50:00.619807029Z [2024-04-06T03:50:00.619+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:50:00.620434773Z [2024-04-06T03:50:00.620+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T03:50:00.620959110Z [2024-04-06T03:50:00.620+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:50:00.621321186Z [2024-04-06T03:50:00.621+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:50:00.622572350Z [2024-04-06T03:50:00.622+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:50:00.622593429Z 2024-04-06T03:50:00.622635813Z 2024-04-06T03:50:00.622642003Z 2024-04-06T03:50:00.622647336Z 2024-04-06T03:50:00.629745996Z [2024-04-06T03:50:00.629+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-06T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-06T03:50:00.630172172Z [2024-04-06T03:50:00.629+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:50:00.630717915Z [2024-04-06T03:50:00.630+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T03:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:50:00.631016541Z [2024-04-06T03:50:00.630+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:50:00.631382070Z [2024-04-06T03:50:00.631+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:50:00.631658958Z [2024-04-06T03:50:00.631+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:50:00.632025923Z [2024-04-06T03:50:00.631+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:50:00.632254146Z [2024-04-06T03:50:00.631+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:50:01.088454210Z [2024-04-06T03:50:01.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T03:45:00+00:00 exited with status queued for try_number 1 2024-04-06T03:50:01.090034702Z [2024-04-06T03:50:01.088+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:48:00+00:00 exited with status queued for try_number 1 2024-04-06T03:50:01.090562531Z [2024-04-06T03:50:01.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:49:00+00:00 exited with status queued for try_number 1 2024-04-06T03:50:01.090702096Z [2024-04-06T03:50:01.090+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:49:00+00:00 exited with status queued for try_number 1 2024-04-06T03:50:01.107041646Z [2024-04-06T03:50:01.106+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad3a6c29-315d-4027-841f-6f448781822f 2024-04-06T03:50:01.107304871Z [2024-04-06T03:50:01.106+0000] {scheduler_job.py:635} INFO - Setting external_id for to 734f09d9-2821-4b68-a34b-c1a729b2d9df 2024-04-06T03:50:01.108263314Z [2024-04-06T03:50:01.108+0000] {scheduler_job.py:635} INFO - Setting external_id for to b7f54c20-9b2a-43c4-9ea6-0a1522a17c78 2024-04-06T03:50:01.108410228Z [2024-04-06T03:50:01.108+0000] {scheduler_job.py:635} INFO - Setting external_id for to 45ff9797-0742-4a35-a159-82a69e2d5513 2024-04-06T03:50:03.734204775Z [2024-04-06T03:50:03.733+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:50:03.735695152Z [2024-04-06T03:50:03.735+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 03:48:00+00:00, run_id=scheduled__2024-04-06T03:48:00+00:00, run_start_date=2024-04-06 03:50:00.533464+00:00, run_end_date=2024-04-06 03:50:03.735256+00:00, run_duration=3.201792, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:48:00+00:00, data_interval_end=2024-04-06 03:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T03:50:03.756414517Z [2024-04-06T03:50:03.756+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T03:50:00+00:00, run_after=2024-04-06T03:52:00+00:00 2024-04-06T03:50:03.915393557Z [2024-04-06T03:50:03.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:48:00+00:00 exited with status success for try_number 1 2024-04-06T03:50:03.929459629Z [2024-04-06T03:50:03.929+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T03:48:00+00:00, map_index=-1, run_start_date=2024-04-06 03:50:01.726169+00:00, run_end_date=2024-04-06 03:50:02.451875+00:00, run_duration=0.725706, state=success, executor_state=success, try_number=1, max_tries=1, job_id=482, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:50:00.624984+00:00, queued_by_job_id=2, pid=10804 2024-04-06T03:50:05.120475960Z [2024-04-06T03:50:05.119+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:50:05.120585872Z 2024-04-06T03:50:05.121484855Z [2024-04-06T03:50:05.121+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:50:05.122251437Z [2024-04-06T03:50:05.122+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:50:05.122268451Z 2024-04-06T03:50:05.126914199Z [2024-04-06T03:50:05.126+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='split_metrics', run_id='scheduled__2024-04-06T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-06T03:50:05.127272644Z [2024-04-06T03:50:05.127+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:50:05.282304214Z [2024-04-06T03:50:05.279+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T03:45:00+00:00 exited with status queued for try_number 1 2024-04-06T03:50:05.302670874Z [2024-04-06T03:50:05.302+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0078a52d-fe6a-48b2-b2a6-2c30a1df41fa 2024-04-06T03:50:05.525474533Z [2024-04-06T03:50:05.525+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T03:45:00+00:00 exited with status success for try_number 1 2024-04-06T03:50:05.534404593Z [2024-04-06T03:50:05.534+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-06T03:45:00+00:00, map_index=-1, run_start_date=2024-04-06 03:50:04.478654+00:00, run_end_date=2024-04-06 03:50:05.006046+00:00, run_duration=0.527392, state=success, executor_state=success, try_number=1, max_tries=1, job_id=483, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:50:00.624984+00:00, queued_by_job_id=2, pid=10826 2024-04-06T03:50:07.311612254Z [2024-04-06T03:50:07.311+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:50:07.311919887Z [2024-04-06T03:50:07.311+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:49:00+00:00, run_id=scheduled__2024-04-06T03:49:00+00:00, run_start_date=2024-04-06 03:50:00.534580+00:00, run_end_date=2024-04-06 03:50:07.311503+00:00, run_duration=6.776923, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:49:00+00:00, data_interval_end=2024-04-06 03:50:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:50:07.324543788Z [2024-04-06T03:50:07.324+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:50:00+00:00, run_after=2024-04-06T03:51:00+00:00 2024-04-06T03:50:07.334266031Z [2024-04-06T03:50:07.333+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:50:07.334706849Z [2024-04-06T03:50:07.334+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:49:00+00:00, run_id=scheduled__2024-04-06T03:49:00+00:00, run_start_date=2024-04-06 03:50:00.535555+00:00, run_end_date=2024-04-06 03:50:07.334131+00:00, run_duration=6.798576, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:49:00+00:00, data_interval_end=2024-04-06 03:50:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:50:07.346217815Z [2024-04-06T03:50:07.345+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:50:00+00:00, run_after=2024-04-06T03:51:00+00:00 2024-04-06T03:50:07.407860416Z [2024-04-06T03:50:07.407+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:49:00+00:00 exited with status success for try_number 1 2024-04-06T03:50:07.408011669Z [2024-04-06T03:50:07.407+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:49:00+00:00 exited with status success for try_number 1 2024-04-06T03:50:07.423898090Z [2024-04-06T03:50:07.423+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:49:00+00:00, map_index=-1, run_start_date=2024-04-06 03:50:04.948342+00:00, run_end_date=2024-04-06 03:50:06.929549+00:00, run_duration=1.981207, state=success, executor_state=success, try_number=1, max_tries=1, job_id=485, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:50:00.624984+00:00, queued_by_job_id=2, pid=10855 2024-04-06T03:50:07.423950500Z [2024-04-06T03:50:07.423+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:49:00+00:00, map_index=-1, run_start_date=2024-04-06 03:50:04.919457+00:00, run_end_date=2024-04-06 03:50:06.547958+00:00, run_duration=1.628501, state=success, executor_state=success, try_number=1, max_tries=1, job_id=484, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:50:00.624984+00:00, queued_by_job_id=2, pid=10853 2024-04-06T03:50:07.691770148Z [2024-04-06T03:50:07.691+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:50:07.691814680Z 2024-04-06T03:50:07.692001218Z [2024-04-06T03:50:07.691+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:50:07.692672175Z [2024-04-06T03:50:07.692+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:50:07.692685394Z 2024-04-06T03:50:07.694902835Z [2024-04-06T03:50:07.694+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='collect_metrics', run_id='scheduled__2024-04-06T03:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-06T03:50:07.695112358Z [2024-04-06T03:50:07.694+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T03:50:07.743617480Z [2024-04-06T03:50:07.743+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T03:45:00+00:00 exited with status queued for try_number 1 2024-04-06T03:50:07.743803843Z [2024-04-06T03:50:07.743+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T03:45:00+00:00 exited with status success for try_number 1 2024-04-06T03:50:07.752843614Z [2024-04-06T03:50:07.752+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6389f84e-71a4-4239-9fb0-dbd6a6397c93 2024-04-06T03:50:07.753130646Z [2024-04-06T03:50:07.752+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=split_metrics, run_id=scheduled__2024-04-06T03:45:00+00:00, map_index=-1, run_start_date=2024-04-06 03:50:07.142074+00:00, run_end_date=2024-04-06 03:50:07.489553+00:00, run_duration=0.347479, state=success, executor_state=success, try_number=1, max_tries=1, job_id=486, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:50:05.122550+00:00, queued_by_job_id=2, pid=10885 2024-04-06T03:50:10.657015821Z [2024-04-06T03:50:10.656+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:50:10.657061497Z 2024-04-06T03:50:10.657754176Z [2024-04-06T03:50:10.657+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:50:10.659332300Z [2024-04-06T03:50:10.658+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:50:10.659358998Z 2024-04-06T03:50:10.664808416Z [2024-04-06T03:50:10.664+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='send_prometheus', run_id='scheduled__2024-04-06T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:50:10.665460749Z [2024-04-06T03:50:10.665+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:50:10.776837866Z [2024-04-06T03:50:10.776+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T03:45:00+00:00 exited with status queued for try_number 1 2024-04-06T03:50:10.776908121Z [2024-04-06T03:50:10.776+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T03:45:00+00:00 exited with status success for try_number 1 2024-04-06T03:50:10.787355712Z [2024-04-06T03:50:10.786+0000] {scheduler_job.py:635} INFO - Setting external_id for to a501456b-dde2-42a0-adac-41f4a5fbf3ff 2024-04-06T03:50:10.787397993Z [2024-04-06T03:50:10.786+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=collect_metrics, run_id=scheduled__2024-04-06T03:45:00+00:00, map_index=0, run_start_date=2024-04-06 03:50:09.696348+00:00, run_end_date=2024-04-06 03:50:10.144399+00:00, run_duration=0.448051, state=success, executor_state=success, try_number=1, max_tries=1, job_id=487, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:50:07.693048+00:00, queued_by_job_id=2, pid=10907 2024-04-06T03:50:13.923944593Z [2024-04-06T03:50:13.923+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:50:13.923989823Z [2024-04-06T03:50:13.923+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:45:00+00:00, run_id=scheduled__2024-04-06T03:45:00+00:00, run_start_date=2024-04-06 03:50:00.532285+00:00, run_end_date=2024-04-06 03:50:13.923629+00:00, run_duration=13.391344, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:45:00+00:00, data_interval_end=2024-04-06 03:50:00+00:00, dag_hash=eecc559ff32fe9a7c4345875f113a0a9 2024-04-06T03:50:13.931840137Z [2024-04-06T03:50:13.931+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:50:00+00:00, run_after=2024-04-06T03:55:00+00:00 2024-04-06T03:50:13.970828234Z [2024-04-06T03:50:13.970+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T03:45:00+00:00 exited with status success for try_number 1 2024-04-06T03:50:13.978552651Z [2024-04-06T03:50:13.977+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=send_prometheus, run_id=scheduled__2024-04-06T03:45:00+00:00, map_index=-1, run_start_date=2024-04-06 03:50:12.707524+00:00, run_end_date=2024-04-06 03:50:13.120669+00:00, run_duration=0.413145, state=success, executor_state=success, try_number=1, max_tries=1, job_id=488, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:50:10.660402+00:00, queued_by_job_id=2, pid=10921 2024-04-06T03:50:21.152169833Z [2024-04-06T03:50:21.151+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-06T03:51:00.890348673Z [2024-04-06T03:51:00.889+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:51:00.906875748Z [2024-04-06T03:51:00.906+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:51:00+00:00, run_after=2024-04-06T03:52:00+00:00 2024-04-06T03:51:00.967086060Z [2024-04-06T03:51:00.966+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T03:51:00.967133841Z 2024-04-06T03:51:00.967140805Z 2024-04-06T03:51:00.967147659Z [2024-04-06T03:51:00.966+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:51:00.967164312Z [2024-04-06T03:51:00.967+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:51:00.967574097Z [2024-04-06T03:51:00.967+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:51:00.967582521Z 2024-04-06T03:51:00.967588369Z 2024-04-06T03:51:00.970500019Z [2024-04-06T03:51:00.970+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:51:00.970536360Z [2024-04-06T03:51:00.970+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:51:00.970681737Z [2024-04-06T03:51:00.970+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:51:00.970870121Z [2024-04-06T03:51:00.970+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:51:01.134376700Z [2024-04-06T03:51:01.133+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:50:00+00:00 exited with status queued for try_number 1 2024-04-06T03:51:01.134418800Z [2024-04-06T03:51:01.134+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:50:00+00:00 exited with status queued for try_number 1 2024-04-06T03:51:01.141112199Z [2024-04-06T03:51:01.140+0000] {scheduler_job.py:635} INFO - Setting external_id for to f87e282e-5b59-40be-acaa-9ede686b216c 2024-04-06T03:51:01.141145853Z [2024-04-06T03:51:01.141+0000] {scheduler_job.py:635} INFO - Setting external_id for to ebfbb70e-f45f-498e-a6df-4876782ac9e7 2024-04-06T03:51:05.971924430Z [2024-04-06T03:51:05.971+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:51:05.972604336Z [2024-04-06T03:51:05.972+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:50:00+00:00, run_id=scheduled__2024-04-06T03:50:00+00:00, run_start_date=2024-04-06 03:51:00.916361+00:00, run_end_date=2024-04-06 03:51:05.972093+00:00, run_duration=5.055732, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:50:00+00:00, data_interval_end=2024-04-06 03:51:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:51:05.984436267Z [2024-04-06T03:51:05.984+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:51:00+00:00, run_after=2024-04-06T03:52:00+00:00 2024-04-06T03:51:05.995511910Z [2024-04-06T03:51:05.995+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:51:05.995752621Z [2024-04-06T03:51:05.995+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:50:00+00:00, run_id=scheduled__2024-04-06T03:50:00+00:00, run_start_date=2024-04-06 03:51:00.917908+00:00, run_end_date=2024-04-06 03:51:05.995430+00:00, run_duration=5.077522, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:50:00+00:00, data_interval_end=2024-04-06 03:51:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:51:06.009613749Z [2024-04-06T03:51:06.009+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:51:00+00:00, run_after=2024-04-06T03:52:00+00:00 2024-04-06T03:51:06.050372523Z [2024-04-06T03:51:06.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:50:00+00:00 exited with status success for try_number 1 2024-04-06T03:51:06.054869106Z [2024-04-06T03:51:06.054+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:50:00+00:00, map_index=-1, run_start_date=2024-04-06 03:51:03.400605+00:00, run_end_date=2024-04-06 03:51:05.293407+00:00, run_duration=1.892802, state=success, executor_state=success, try_number=1, max_tries=1, job_id=489, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:51:00.967939+00:00, queued_by_job_id=2, pid=10935 2024-04-06T03:51:06.528930798Z [2024-04-06T03:51:06.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:50:00+00:00 exited with status success for try_number 1 2024-04-06T03:51:06.538347781Z [2024-04-06T03:51:06.537+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:50:00+00:00, map_index=-1, run_start_date=2024-04-06 03:51:03.832862+00:00, run_end_date=2024-04-06 03:51:05.887129+00:00, run_duration=2.054267, state=success, executor_state=success, try_number=1, max_tries=1, job_id=490, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:51:00.967939+00:00, queued_by_job_id=2, pid=10945 2024-04-06T03:52:00.738316772Z [2024-04-06T03:52:00.737+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:52:00+00:00, run_after=2024-04-06T03:53:00+00:00 2024-04-06T03:52:00.744212969Z [2024-04-06T03:52:00.743+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:52:00.758658232Z [2024-04-06T03:52:00.749+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:52:00.806041029Z [2024-04-06T03:52:00.805+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T03:52:00.806081766Z 2024-04-06T03:52:00.806085855Z 2024-04-06T03:52:00.806088999Z 2024-04-06T03:52:00.806155320Z [2024-04-06T03:52:00.805+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T03:52:00.806274086Z [2024-04-06T03:52:00.806+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:52:00.806370261Z [2024-04-06T03:52:00.806+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:52:00.807025297Z [2024-04-06T03:52:00.806+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:52:00.807052032Z 2024-04-06T03:52:00.807055510Z 2024-04-06T03:52:00.807062479Z 2024-04-06T03:52:00.812323027Z [2024-04-06T03:52:00.812+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:52:00.812561847Z [2024-04-06T03:52:00.812+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:52:00.812828312Z [2024-04-06T03:52:00.812+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:52:00.812956710Z [2024-04-06T03:52:00.812+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:52:00.813176823Z [2024-04-06T03:52:00.813+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:52:00.813309607Z [2024-04-06T03:52:00.813+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:52:01.097289421Z [2024-04-06T03:52:01.096+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:50:00+00:00 exited with status queued for try_number 1 2024-04-06T03:52:01.097514278Z [2024-04-06T03:52:01.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:51:00+00:00 exited with status queued for try_number 1 2024-04-06T03:52:01.097700879Z [2024-04-06T03:52:01.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:51:00+00:00 exited with status queued for try_number 1 2024-04-06T03:52:01.107992804Z [2024-04-06T03:52:01.107+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f1dcb25-cb39-4533-835f-a0c5004893f0 2024-04-06T03:52:01.108369209Z [2024-04-06T03:52:01.108+0000] {scheduler_job.py:635} INFO - Setting external_id for to 969d7501-f877-484a-b71c-bdd029f62a2a 2024-04-06T03:52:01.108618118Z [2024-04-06T03:52:01.108+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7efa66a5-d80d-4fff-ba22-c00a09456e60 2024-04-06T03:52:03.582817822Z [2024-04-06T03:52:03.582+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:52:03.583165915Z [2024-04-06T03:52:03.582+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 03:50:00+00:00, run_id=scheduled__2024-04-06T03:50:00+00:00, run_start_date=2024-04-06 03:52:00.759126+00:00, run_end_date=2024-04-06 03:52:03.582724+00:00, run_duration=2.823598, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:50:00+00:00, data_interval_end=2024-04-06 03:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T03:52:03.590267234Z [2024-04-06T03:52:03.590+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T03:52:00+00:00, run_after=2024-04-06T03:54:00+00:00 2024-04-06T03:52:03.666274062Z [2024-04-06T03:52:03.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:50:00+00:00 exited with status success for try_number 1 2024-04-06T03:52:03.676272946Z [2024-04-06T03:52:03.675+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T03:50:00+00:00, map_index=-1, run_start_date=2024-04-06 03:52:02.051318+00:00, run_end_date=2024-04-06 03:52:03.026779+00:00, run_duration=0.975461, state=success, executor_state=success, try_number=1, max_tries=1, job_id=491, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:52:00.807840+00:00, queued_by_job_id=2, pid=10981 2024-04-06T03:52:05.831047218Z [2024-04-06T03:52:05.830+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:52:05.831160939Z [2024-04-06T03:52:05.830+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:51:00+00:00, run_id=scheduled__2024-04-06T03:51:00+00:00, run_start_date=2024-04-06 03:52:00.761100+00:00, run_end_date=2024-04-06 03:52:05.830860+00:00, run_duration=5.06976, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:51:00+00:00, data_interval_end=2024-04-06 03:52:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:52:05.839654745Z [2024-04-06T03:52:05.839+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:52:00+00:00, run_after=2024-04-06T03:53:00+00:00 2024-04-06T03:52:05.845300320Z [2024-04-06T03:52:05.844+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:52:05.845409800Z [2024-04-06T03:52:05.845+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:51:00+00:00, run_id=scheduled__2024-04-06T03:51:00+00:00, run_start_date=2024-04-06 03:52:00.762337+00:00, run_end_date=2024-04-06 03:52:05.845089+00:00, run_duration=5.082752, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:51:00+00:00, data_interval_end=2024-04-06 03:52:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:52:05.853386328Z [2024-04-06T03:52:05.853+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:52:00+00:00, run_after=2024-04-06T03:53:00+00:00 2024-04-06T03:52:05.895970908Z [2024-04-06T03:52:05.895+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:51:00+00:00 exited with status success for try_number 1 2024-04-06T03:52:05.895993622Z [2024-04-06T03:52:05.895+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:51:00+00:00 exited with status success for try_number 1 2024-04-06T03:52:05.901941557Z [2024-04-06T03:52:05.901+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:51:00+00:00, map_index=-1, run_start_date=2024-04-06 03:52:03.661187+00:00, run_end_date=2024-04-06 03:52:05.353665+00:00, run_duration=1.692478, state=success, executor_state=success, try_number=1, max_tries=1, job_id=493, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:52:00.807840+00:00, queued_by_job_id=2, pid=11020 2024-04-06T03:52:05.902038451Z [2024-04-06T03:52:05.901+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:51:00+00:00, map_index=-1, run_start_date=2024-04-06 03:52:03.033954+00:00, run_end_date=2024-04-06 03:52:05.428353+00:00, run_duration=2.394399, state=success, executor_state=success, try_number=1, max_tries=1, job_id=492, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:52:00.807840+00:00, queued_by_job_id=2, pid=11001 2024-04-06T03:53:00.621586650Z [2024-04-06T03:53:00.620+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:53:00+00:00, run_after=2024-04-06T03:54:00+00:00 2024-04-06T03:53:00.628926822Z [2024-04-06T03:53:00.628+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:53:00.679412135Z [2024-04-06T03:53:00.678+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T03:53:00.679441788Z 2024-04-06T03:53:00.679446178Z 2024-04-06T03:53:00.680383219Z [2024-04-06T03:53:00.679+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:53:00.681316969Z [2024-04-06T03:53:00.680+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:53:00.684059223Z [2024-04-06T03:53:00.683+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:53:00.684090013Z 2024-04-06T03:53:00.684094222Z 2024-04-06T03:53:00.699502351Z [2024-04-06T03:53:00.699+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:53:00.704416771Z [2024-04-06T03:53:00.704+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:53:00.705068946Z [2024-04-06T03:53:00.704+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:53:00.705422446Z [2024-04-06T03:53:00.705+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:53:00.978112384Z [2024-04-06T03:53:00.977+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:52:00+00:00 exited with status queued for try_number 1 2024-04-06T03:53:00.979619027Z [2024-04-06T03:53:00.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:52:00+00:00 exited with status queued for try_number 1 2024-04-06T03:53:00.996623035Z [2024-04-06T03:53:00.996+0000] {scheduler_job.py:635} INFO - Setting external_id for to e54a8214-9751-4b95-95f4-ef634c0d8d3c 2024-04-06T03:53:00.997439035Z [2024-04-06T03:53:00.997+0000] {scheduler_job.py:635} INFO - Setting external_id for to abe5c1d0-00d0-476c-9991-96825a94ccd4 2024-04-06T03:53:07.052097112Z [2024-04-06T03:53:07.051+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:53:07.052398322Z [2024-04-06T03:53:07.052+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:52:00+00:00, run_id=scheduled__2024-04-06T03:52:00+00:00, run_start_date=2024-04-06 03:53:00.638900+00:00, run_end_date=2024-04-06 03:53:07.051930+00:00, run_duration=6.41303, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:52:00+00:00, data_interval_end=2024-04-06 03:53:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:53:07.063777693Z [2024-04-06T03:53:07.063+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:53:00+00:00, run_after=2024-04-06T03:54:00+00:00 2024-04-06T03:53:07.071289136Z [2024-04-06T03:53:07.070+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:53:07.071421402Z [2024-04-06T03:53:07.071+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:52:00+00:00, run_id=scheduled__2024-04-06T03:52:00+00:00, run_start_date=2024-04-06 03:53:00.640204+00:00, run_end_date=2024-04-06 03:53:07.071042+00:00, run_duration=6.430838, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:52:00+00:00, data_interval_end=2024-04-06 03:53:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:53:07.080077232Z [2024-04-06T03:53:07.079+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:53:00+00:00, run_after=2024-04-06T03:54:00+00:00 2024-04-06T03:53:07.112654427Z [2024-04-06T03:53:07.112+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:52:00+00:00 exited with status success for try_number 1 2024-04-06T03:53:07.112754641Z [2024-04-06T03:53:07.112+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:52:00+00:00 exited with status success for try_number 1 2024-04-06T03:53:07.120760794Z [2024-04-06T03:53:07.120+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:52:00+00:00, map_index=-1, run_start_date=2024-04-06 03:53:04.354390+00:00, run_end_date=2024-04-06 03:53:06.341906+00:00, run_duration=1.987516, state=success, executor_state=success, try_number=1, max_tries=1, job_id=495, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:53:00.686668+00:00, queued_by_job_id=2, pid=11066 2024-04-06T03:53:07.121214194Z [2024-04-06T03:53:07.120+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:52:00+00:00, map_index=-1, run_start_date=2024-04-06 03:53:04.095676+00:00, run_end_date=2024-04-06 03:53:06.088984+00:00, run_duration=1.993308, state=success, executor_state=success, try_number=1, max_tries=1, job_id=494, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:53:00.686668+00:00, queued_by_job_id=2, pid=11065 2024-04-06T03:54:00.079994489Z [2024-04-06T03:54:00.079+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:54:00.096385811Z [2024-04-06T03:54:00.095+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:54:00.131235681Z [2024-04-06T03:54:00.130+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:54:00+00:00, run_after=2024-04-06T03:55:00+00:00 2024-04-06T03:54:00.249100316Z [2024-04-06T03:54:00.248+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T03:54:00.249161939Z 2024-04-06T03:54:00.249191367Z 2024-04-06T03:54:00.249199191Z 2024-04-06T03:54:00.249339398Z [2024-04-06T03:54:00.249+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T03:54:00.249584834Z [2024-04-06T03:54:00.249+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:54:00.249860651Z [2024-04-06T03:54:00.249+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:54:00.251287134Z [2024-04-06T03:54:00.251+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:54:00.251301137Z 2024-04-06T03:54:00.251305662Z 2024-04-06T03:54:00.251309509Z 2024-04-06T03:54:00.255640421Z [2024-04-06T03:54:00.255+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T03:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:54:00.255864852Z [2024-04-06T03:54:00.255+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:54:00.256183233Z [2024-04-06T03:54:00.256+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:54:00.257106748Z [2024-04-06T03:54:00.256+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:54:00.257539348Z [2024-04-06T03:54:00.257+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:54:00.257753424Z [2024-04-06T03:54:00.257+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:54:00.523675050Z [2024-04-06T03:54:00.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:52:00+00:00 exited with status queued for try_number 1 2024-04-06T03:54:00.524392265Z [2024-04-06T03:54:00.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:53:00+00:00 exited with status queued for try_number 1 2024-04-06T03:54:00.524810066Z [2024-04-06T03:54:00.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:53:00+00:00 exited with status queued for try_number 1 2024-04-06T03:54:00.533801085Z [2024-04-06T03:54:00.533+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3f884be-728b-4977-9f80-b6b14dbdcc0f 2024-04-06T03:54:00.534306427Z [2024-04-06T03:54:00.534+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a189460-e382-4306-ad7b-35ed54b71751 2024-04-06T03:54:00.534629196Z [2024-04-06T03:54:00.534+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7997df8e-1537-4727-9bff-b7d95bd2fc94 2024-04-06T03:54:01.697963859Z [2024-04-06T03:54:01.694+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:54:01.697976348Z [2024-04-06T03:54:01.695+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 03:52:00+00:00, run_id=scheduled__2024-04-06T03:52:00+00:00, run_start_date=2024-04-06 03:54:00.154258+00:00, run_end_date=2024-04-06 03:54:01.695211+00:00, run_duration=1.540953, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:52:00+00:00, data_interval_end=2024-04-06 03:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T03:54:01.725930852Z [2024-04-06T03:54:01.719+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T03:54:00+00:00, run_after=2024-04-06T03:56:00+00:00 2024-04-06T03:54:01.824459445Z [2024-04-06T03:54:01.823+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:52:00+00:00 exited with status success for try_number 1 2024-04-06T03:54:01.835220046Z [2024-04-06T03:54:01.834+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T03:52:00+00:00, map_index=-1, run_start_date=2024-04-06 03:54:01.204670+00:00, run_end_date=2024-04-06 03:54:01.608856+00:00, run_duration=0.404186, state=success, executor_state=success, try_number=1, max_tries=1, job_id=496, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:54:00.252238+00:00, queued_by_job_id=2, pid=11100 2024-04-06T03:54:05.395504270Z [2024-04-06T03:54:05.394+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:54:05.395737457Z [2024-04-06T03:54:05.395+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:53:00+00:00, run_id=scheduled__2024-04-06T03:53:00+00:00, run_start_date=2024-04-06 03:54:00.157364+00:00, run_end_date=2024-04-06 03:54:05.395458+00:00, run_duration=5.238094, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:53:00+00:00, data_interval_end=2024-04-06 03:54:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:54:05.409652084Z [2024-04-06T03:54:05.409+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:54:00+00:00, run_after=2024-04-06T03:55:00+00:00 2024-04-06T03:54:05.437088956Z [2024-04-06T03:54:05.436+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:54:05.437316698Z [2024-04-06T03:54:05.437+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:53:00+00:00, run_id=scheduled__2024-04-06T03:53:00+00:00, run_start_date=2024-04-06 03:54:00.159960+00:00, run_end_date=2024-04-06 03:54:05.437012+00:00, run_duration=5.277052, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:53:00+00:00, data_interval_end=2024-04-06 03:54:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:54:05.446420370Z [2024-04-06T03:54:05.446+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:54:00+00:00, run_after=2024-04-06T03:55:00+00:00 2024-04-06T03:54:05.484378751Z [2024-04-06T03:54:05.484+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:53:00+00:00 exited with status success for try_number 1 2024-04-06T03:54:05.484494444Z [2024-04-06T03:54:05.484+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:53:00+00:00 exited with status success for try_number 1 2024-04-06T03:54:05.499677480Z [2024-04-06T03:54:05.499+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:53:00+00:00, map_index=-1, run_start_date=2024-04-06 03:54:02.676666+00:00, run_end_date=2024-04-06 03:54:05.154280+00:00, run_duration=2.477614, state=success, executor_state=success, try_number=1, max_tries=1, job_id=497, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:54:00.252238+00:00, queued_by_job_id=2, pid=11130 2024-04-06T03:54:05.500746087Z [2024-04-06T03:54:05.500+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:53:00+00:00, map_index=-1, run_start_date=2024-04-06 03:54:02.890577+00:00, run_end_date=2024-04-06 03:54:04.524715+00:00, run_duration=1.634138, state=success, executor_state=success, try_number=1, max_tries=1, job_id=498, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:54:00.252238+00:00, queued_by_job_id=2, pid=11131 2024-04-06T03:55:00.139643160Z [2024-04-06T03:55:00.138+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:55:00.159058305Z [2024-04-06T03:55:00.158+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:55:00+00:00, run_after=2024-04-06T04:00:00+00:00 2024-04-06T03:55:00.187480322Z [2024-04-06T03:55:00.186+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:55:00+00:00, run_after=2024-04-06T03:56:00+00:00 2024-04-06T03:55:00.287120158Z [2024-04-06T03:55:00.286+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T03:55:00.287167882Z 2024-04-06T03:55:00.287204424Z 2024-04-06T03:55:00.287213213Z 2024-04-06T03:55:00.287222699Z [2024-04-06T03:55:00.286+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:55:00.287246999Z [2024-04-06T03:55:00.287+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:55:00.287663267Z [2024-04-06T03:55:00.287+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:55:00.288493771Z [2024-04-06T03:55:00.288+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:55:00.288535848Z 2024-04-06T03:55:00.288546256Z 2024-04-06T03:55:00.288554757Z 2024-04-06T03:55:00.292319888Z [2024-04-06T03:55:00.292+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-06T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-06T03:55:00.292489175Z [2024-04-06T03:55:00.292+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:55:00.292845651Z [2024-04-06T03:55:00.292+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:55:00.292952005Z [2024-04-06T03:55:00.292+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:55:00.293265464Z [2024-04-06T03:55:00.293+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:55:00.293474226Z [2024-04-06T03:55:00.293+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:55:00.501487779Z [2024-04-06T03:55:00.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T03:50:00+00:00 exited with status queued for try_number 1 2024-04-06T03:55:00.501776858Z [2024-04-06T03:55:00.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:54:00+00:00 exited with status queued for try_number 1 2024-04-06T03:55:00.501919639Z [2024-04-06T03:55:00.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:54:00+00:00 exited with status queued for try_number 1 2024-04-06T03:55:00.509441197Z [2024-04-06T03:55:00.509+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8f98739-1689-4f11-a777-1aad4588c8ca 2024-04-06T03:55:00.509647877Z [2024-04-06T03:55:00.509+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30626899-4edd-4132-b0f0-1e4fc1141f06 2024-04-06T03:55:00.509832067Z [2024-04-06T03:55:00.509+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb68a428-ab6c-4777-bcab-4553a57b2267 2024-04-06T03:55:04.477668948Z [2024-04-06T03:55:04.477+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:55:04.477695573Z 2024-04-06T03:55:04.477888605Z [2024-04-06T03:55:04.477+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:55:04.478452451Z [2024-04-06T03:55:04.478+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:55:04.478463676Z 2024-04-06T03:55:04.480965670Z [2024-04-06T03:55:04.480+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='split_metrics', run_id='scheduled__2024-04-06T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-06T03:55:04.481514901Z [2024-04-06T03:55:04.481+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:55:04.572952418Z [2024-04-06T03:55:04.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T03:50:00+00:00 exited with status queued for try_number 1 2024-04-06T03:55:04.573250636Z [2024-04-06T03:55:04.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T03:50:00+00:00 exited with status success for try_number 1 2024-04-06T03:55:04.581862845Z [2024-04-06T03:55:04.581+0000] {scheduler_job.py:635} INFO - Setting external_id for to 50965593-2694-4d7d-bfb3-9be87c3f63c3 2024-04-06T03:55:04.582354772Z [2024-04-06T03:55:04.582+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-06T03:50:00+00:00, map_index=-1, run_start_date=2024-04-06 03:55:03.571696+00:00, run_end_date=2024-04-06 03:55:04.037595+00:00, run_duration=0.465899, state=success, executor_state=success, try_number=1, max_tries=1, job_id=501, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:55:00.289163+00:00, queued_by_job_id=2, pid=11216 2024-04-06T03:55:05.716675118Z [2024-04-06T03:55:05.716+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:55:05.717300387Z [2024-04-06T03:55:05.717+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:54:00+00:00, run_id=scheduled__2024-04-06T03:54:00+00:00, run_start_date=2024-04-06 03:55:00.211383+00:00, run_end_date=2024-04-06 03:55:05.716821+00:00, run_duration=5.505438, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:54:00+00:00, data_interval_end=2024-04-06 03:55:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:55:05.734084276Z [2024-04-06T03:55:05.733+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:55:00+00:00, run_after=2024-04-06T03:56:00+00:00 2024-04-06T03:55:05.741640927Z [2024-04-06T03:55:05.741+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:55:05.741938423Z [2024-04-06T03:55:05.741+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:54:00+00:00, run_id=scheduled__2024-04-06T03:54:00+00:00, run_start_date=2024-04-06 03:55:00.213313+00:00, run_end_date=2024-04-06 03:55:05.741609+00:00, run_duration=5.528296, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:54:00+00:00, data_interval_end=2024-04-06 03:55:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:55:05.756921111Z [2024-04-06T03:55:05.756+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:55:00+00:00, run_after=2024-04-06T03:56:00+00:00 2024-04-06T03:55:05.805900146Z [2024-04-06T03:55:05.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:54:00+00:00 exited with status success for try_number 1 2024-04-06T03:55:05.806196928Z [2024-04-06T03:55:05.805+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:54:00+00:00 exited with status success for try_number 1 2024-04-06T03:55:05.814499141Z [2024-04-06T03:55:05.812+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:54:00+00:00, map_index=-1, run_start_date=2024-04-06 03:55:02.652918+00:00, run_end_date=2024-04-06 03:55:04.699561+00:00, run_duration=2.046643, state=success, executor_state=success, try_number=1, max_tries=1, job_id=499, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:55:00.289163+00:00, queued_by_job_id=2, pid=11188 2024-04-06T03:55:05.814515727Z [2024-04-06T03:55:05.812+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:54:00+00:00, map_index=-1, run_start_date=2024-04-06 03:55:02.743549+00:00, run_end_date=2024-04-06 03:55:05.104769+00:00, run_duration=2.36122, state=success, executor_state=success, try_number=1, max_tries=1, job_id=500, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:55:00.289163+00:00, queued_by_job_id=2, pid=11189 2024-04-06T03:55:07.697804429Z [2024-04-06T03:55:07.697+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:55:07.697928866Z 2024-04-06T03:55:07.698116992Z [2024-04-06T03:55:07.697+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:55:07.698869640Z [2024-04-06T03:55:07.698+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:55:07.698897751Z 2024-04-06T03:55:07.701912740Z [2024-04-06T03:55:07.701+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='collect_metrics', run_id='scheduled__2024-04-06T03:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-06T03:55:07.702122203Z [2024-04-06T03:55:07.701+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T03:55:07.775018774Z [2024-04-06T03:55:07.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T03:50:00+00:00 exited with status queued for try_number 1 2024-04-06T03:55:07.775471395Z [2024-04-06T03:55:07.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T03:50:00+00:00 exited with status success for try_number 1 2024-04-06T03:55:07.784749742Z [2024-04-06T03:55:07.783+0000] {scheduler_job.py:635} INFO - Setting external_id for to 02f33789-ce2f-49e3-8c55-34970ee2969c 2024-04-06T03:55:07.785247597Z [2024-04-06T03:55:07.784+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=split_metrics, run_id=scheduled__2024-04-06T03:50:00+00:00, map_index=-1, run_start_date=2024-04-06 03:55:06.507202+00:00, run_end_date=2024-04-06 03:55:06.908112+00:00, run_duration=0.40091, state=success, executor_state=success, try_number=1, max_tries=1, job_id=502, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:55:04.478851+00:00, queued_by_job_id=2, pid=11237 2024-04-06T03:55:10.709941436Z [2024-04-06T03:55:10.707+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T03:55:10.709979915Z 2024-04-06T03:55:10.709985991Z [2024-04-06T03:55:10.707+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:55:10.709990412Z [2024-04-06T03:55:10.708+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:55:10.710005456Z 2024-04-06T03:55:10.710497960Z [2024-04-06T03:55:10.710+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='send_prometheus', run_id='scheduled__2024-04-06T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:55:10.710543438Z [2024-04-06T03:55:10.710+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T03:55:10.786138992Z [2024-04-06T03:55:10.785+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T03:50:00+00:00 exited with status queued for try_number 1 2024-04-06T03:55:10.786204762Z [2024-04-06T03:55:10.786+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T03:50:00+00:00 exited with status success for try_number 1 2024-04-06T03:55:10.798166076Z [2024-04-06T03:55:10.793+0000] {scheduler_job.py:635} INFO - Setting external_id for to d068a612-d1eb-4c43-973e-c94ef42d66ae 2024-04-06T03:55:10.798186679Z [2024-04-06T03:55:10.794+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=collect_metrics, run_id=scheduled__2024-04-06T03:50:00+00:00, map_index=0, run_start_date=2024-04-06 03:55:09.556373+00:00, run_end_date=2024-04-06 03:55:09.891997+00:00, run_duration=0.335624, state=success, executor_state=success, try_number=1, max_tries=1, job_id=503, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:55:07.699288+00:00, queued_by_job_id=2, pid=11259 2024-04-06T03:55:13.195747809Z [2024-04-06T03:55:13.195+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:55:13.196206903Z [2024-04-06T03:55:13.195+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:50:00+00:00, run_id=scheduled__2024-04-06T03:50:00+00:00, run_start_date=2024-04-06 03:55:00.209608+00:00, run_end_date=2024-04-06 03:55:13.195614+00:00, run_duration=12.986006, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:50:00+00:00, data_interval_end=2024-04-06 03:55:00+00:00, dag_hash=eecc559ff32fe9a7c4345875f113a0a9 2024-04-06T03:55:13.203305621Z [2024-04-06T03:55:13.203+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:55:00+00:00, run_after=2024-04-06T04:00:00+00:00 2024-04-06T03:55:13.243277426Z [2024-04-06T03:55:13.242+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T03:50:00+00:00 exited with status success for try_number 1 2024-04-06T03:55:13.250351395Z [2024-04-06T03:55:13.249+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=send_prometheus, run_id=scheduled__2024-04-06T03:50:00+00:00, map_index=-1, run_start_date=2024-04-06 03:55:12.518163+00:00, run_end_date=2024-04-06 03:55:12.931618+00:00, run_duration=0.413455, state=success, executor_state=success, try_number=1, max_tries=1, job_id=504, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:55:10.708643+00:00, queued_by_job_id=2, pid=11274 2024-04-06T03:55:21.205537409Z [2024-04-06T03:55:21.205+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-06T03:56:00.320170008Z [2024-04-06T03:56:00.319+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:56:00.332473429Z [2024-04-06T03:56:00.332+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:56:00.350787213Z [2024-04-06T03:56:00.350+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:56:00+00:00, run_after=2024-04-06T03:57:00+00:00 2024-04-06T03:56:00.441839009Z [2024-04-06T03:56:00.441+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T03:56:00.441862803Z 2024-04-06T03:56:00.441866964Z 2024-04-06T03:56:00.441870025Z 2024-04-06T03:56:00.442321807Z [2024-04-06T03:56:00.442+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T03:56:00.442665648Z [2024-04-06T03:56:00.442+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:56:00.443008813Z [2024-04-06T03:56:00.442+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:56:00.444208374Z [2024-04-06T03:56:00.443+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:56:00.444217603Z 2024-04-06T03:56:00.444222158Z 2024-04-06T03:56:00.444226624Z 2024-04-06T03:56:00.448973150Z [2024-04-06T03:56:00.448+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T03:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:56:00.449642034Z [2024-04-06T03:56:00.449+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:56:00.452072940Z [2024-04-06T03:56:00.451+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:56:00.452378353Z [2024-04-06T03:56:00.452+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:56:00.452814697Z [2024-04-06T03:56:00.452+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:56:00.453057944Z [2024-04-06T03:56:00.452+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:56:00.685629449Z [2024-04-06T03:56:00.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:54:00+00:00 exited with status queued for try_number 1 2024-04-06T03:56:00.685761032Z [2024-04-06T03:56:00.685+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:55:00+00:00 exited with status queued for try_number 1 2024-04-06T03:56:00.685908429Z [2024-04-06T03:56:00.685+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:55:00+00:00 exited with status queued for try_number 1 2024-04-06T03:56:00.705906394Z [2024-04-06T03:56:00.704+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff5b3253-4aa3-4814-9325-c6053901bb8b 2024-04-06T03:56:00.705930096Z [2024-04-06T03:56:00.704+0000] {scheduler_job.py:635} INFO - Setting external_id for to f9d4bf1c-ddcf-4e08-8c59-bfd2dc370ab0 2024-04-06T03:56:00.705933577Z [2024-04-06T03:56:00.704+0000] {scheduler_job.py:635} INFO - Setting external_id for to e12c5bfe-3b57-4ff2-8298-1aef974c4526 2024-04-06T03:56:02.606255788Z [2024-04-06T03:56:02.605+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:56:02.606482609Z [2024-04-06T03:56:02.606+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 03:54:00+00:00, run_id=scheduled__2024-04-06T03:54:00+00:00, run_start_date=2024-04-06 03:56:00.364045+00:00, run_end_date=2024-04-06 03:56:02.606184+00:00, run_duration=2.242139, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:54:00+00:00, data_interval_end=2024-04-06 03:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T03:56:02.623172972Z [2024-04-06T03:56:02.622+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T03:56:00+00:00, run_after=2024-04-06T03:58:00+00:00 2024-04-06T03:56:02.669445794Z [2024-04-06T03:56:02.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:54:00+00:00 exited with status success for try_number 1 2024-04-06T03:56:02.674443218Z [2024-04-06T03:56:02.674+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T03:54:00+00:00, map_index=-1, run_start_date=2024-04-06 03:56:01.490439+00:00, run_end_date=2024-04-06 03:56:01.984248+00:00, run_duration=0.493809, state=success, executor_state=success, try_number=1, max_tries=1, job_id=505, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:56:00.445478+00:00, queued_by_job_id=2, pid=11278 2024-04-06T03:56:05.494471063Z [2024-04-06T03:56:05.492+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:56:05.495388207Z [2024-04-06T03:56:05.494+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:55:00+00:00, run_id=scheduled__2024-04-06T03:55:00+00:00, run_start_date=2024-04-06 03:56:00.365596+00:00, run_end_date=2024-04-06 03:56:05.494540+00:00, run_duration=5.128944, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:55:00+00:00, data_interval_end=2024-04-06 03:56:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:56:05.515792993Z [2024-04-06T03:56:05.515+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:56:00+00:00, run_after=2024-04-06T03:57:00+00:00 2024-04-06T03:56:05.535172618Z [2024-04-06T03:56:05.534+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:56:05.535530531Z [2024-04-06T03:56:05.535+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:55:00+00:00, run_id=scheduled__2024-04-06T03:55:00+00:00, run_start_date=2024-04-06 03:56:00.366919+00:00, run_end_date=2024-04-06 03:56:05.535217+00:00, run_duration=5.168298, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:55:00+00:00, data_interval_end=2024-04-06 03:56:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:56:05.553188774Z [2024-04-06T03:56:05.552+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:56:00+00:00, run_after=2024-04-06T03:57:00+00:00 2024-04-06T03:56:05.627852748Z [2024-04-06T03:56:05.627+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:55:00+00:00 exited with status success for try_number 1 2024-04-06T03:56:05.628091167Z [2024-04-06T03:56:05.627+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:55:00+00:00 exited with status success for try_number 1 2024-04-06T03:56:05.637790178Z [2024-04-06T03:56:05.637+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:55:00+00:00, map_index=-1, run_start_date=2024-04-06 03:56:03.153994+00:00, run_end_date=2024-04-06 03:56:04.715184+00:00, run_duration=1.56119, state=success, executor_state=success, try_number=1, max_tries=1, job_id=506, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:56:00.445478+00:00, queued_by_job_id=2, pid=11299 2024-04-06T03:56:05.638256847Z [2024-04-06T03:56:05.638+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:55:00+00:00, map_index=-1, run_start_date=2024-04-06 03:56:03.450545+00:00, run_end_date=2024-04-06 03:56:05.273670+00:00, run_duration=1.823125, state=success, executor_state=success, try_number=1, max_tries=1, job_id=507, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:56:00.445478+00:00, queued_by_job_id=2, pid=11309 2024-04-06T03:57:00.189172483Z [2024-04-06T03:57:00.188+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:57:00.206831898Z [2024-04-06T03:57:00.206+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:57:00+00:00, run_after=2024-04-06T03:58:00+00:00 2024-04-06T03:57:00.273262929Z [2024-04-06T03:57:00.272+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T03:57:00.273386538Z 2024-04-06T03:57:00.273399609Z 2024-04-06T03:57:00.273440324Z [2024-04-06T03:57:00.273+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:57:00.274521239Z [2024-04-06T03:57:00.274+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:57:00.276694351Z [2024-04-06T03:57:00.276+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:57:00.276724516Z 2024-04-06T03:57:00.276734389Z 2024-04-06T03:57:00.285568159Z [2024-04-06T03:57:00.285+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:57:00.286333347Z [2024-04-06T03:57:00.285+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:57:00.287018168Z [2024-04-06T03:57:00.286+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:57:00.287457759Z [2024-04-06T03:57:00.287+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:57:00.475649308Z [2024-04-06T03:57:00.474+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:56:00+00:00 exited with status queued for try_number 1 2024-04-06T03:57:00.475995602Z [2024-04-06T03:57:00.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:56:00+00:00 exited with status queued for try_number 1 2024-04-06T03:57:00.487227901Z [2024-04-06T03:57:00.486+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30447556-efad-4e69-a127-bd0aaf2e3c84 2024-04-06T03:57:00.487373192Z [2024-04-06T03:57:00.487+0000] {scheduler_job.py:635} INFO - Setting external_id for to 36f2d49c-21e5-464c-b215-5c7b34acef93 2024-04-06T03:57:04.293960266Z [2024-04-06T03:57:04.293+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:57:04.298180812Z [2024-04-06T03:57:04.293+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:56:00+00:00, run_id=scheduled__2024-04-06T03:56:00+00:00, run_start_date=2024-04-06 03:57:00.219836+00:00, run_end_date=2024-04-06 03:57:04.293663+00:00, run_duration=4.073827, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:56:00+00:00, data_interval_end=2024-04-06 03:57:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:57:04.303401930Z [2024-04-06T03:57:04.302+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:57:00+00:00, run_after=2024-04-06T03:58:00+00:00 2024-04-06T03:57:04.345300825Z [2024-04-06T03:57:04.344+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:56:00+00:00 exited with status success for try_number 1 2024-04-06T03:57:04.351126720Z [2024-04-06T03:57:04.350+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:56:00+00:00, map_index=-1, run_start_date=2024-04-06 03:57:02.547201+00:00, run_end_date=2024-04-06 03:57:04.077122+00:00, run_duration=1.529921, state=success, executor_state=success, try_number=1, max_tries=1, job_id=509, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:57:00.279356+00:00, queued_by_job_id=2, pid=11373 2024-04-06T03:57:05.400932243Z [2024-04-06T03:57:05.400+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:57:05.401117583Z [2024-04-06T03:57:05.400+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:56:00+00:00, run_id=scheduled__2024-04-06T03:56:00+00:00, run_start_date=2024-04-06 03:57:00.221144+00:00, run_end_date=2024-04-06 03:57:05.400840+00:00, run_duration=5.179696, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:56:00+00:00, data_interval_end=2024-04-06 03:57:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:57:05.410834527Z [2024-04-06T03:57:05.410+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:57:00+00:00, run_after=2024-04-06T03:58:00+00:00 2024-04-06T03:57:05.444061458Z [2024-04-06T03:57:05.443+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:56:00+00:00 exited with status success for try_number 1 2024-04-06T03:57:05.454616159Z [2024-04-06T03:57:05.454+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:56:00+00:00, map_index=-1, run_start_date=2024-04-06 03:57:02.242200+00:00, run_end_date=2024-04-06 03:57:04.783725+00:00, run_duration=2.541525, state=success, executor_state=success, try_number=1, max_tries=1, job_id=508, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:57:00.279356+00:00, queued_by_job_id=2, pid=11363 2024-04-06T03:58:00.551120034Z [2024-04-06T03:58:00.550+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:58:00.574612089Z [2024-04-06T03:58:00.574+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:58:00+00:00, run_after=2024-04-06T03:59:00+00:00 2024-04-06T03:58:00.584735579Z [2024-04-06T03:58:00.584+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:58:00.665243343Z [2024-04-06T03:58:00.664+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T03:58:00.665284559Z 2024-04-06T03:58:00.665310347Z 2024-04-06T03:58:00.665317512Z 2024-04-06T03:58:00.665370956Z [2024-04-06T03:58:00.665+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T03:58:00.665532812Z [2024-04-06T03:58:00.665+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:58:00.665783345Z [2024-04-06T03:58:00.665+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:58:00.666658718Z [2024-04-06T03:58:00.666+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:58:00.666675994Z 2024-04-06T03:58:00.666681620Z 2024-04-06T03:58:00.666686668Z 2024-04-06T03:58:00.671885042Z [2024-04-06T03:58:00.671+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T03:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:58:00.672153233Z [2024-04-06T03:58:00.671+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T03:58:00.672720941Z [2024-04-06T03:58:00.672+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:58:00.672981741Z [2024-04-06T03:58:00.672+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:58:00.673269150Z [2024-04-06T03:58:00.672+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:58:00.673302281Z [2024-04-06T03:58:00.673+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:58:00.995665401Z [2024-04-06T03:58:00.995+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:56:00+00:00 exited with status queued for try_number 1 2024-04-06T03:58:00.995820975Z [2024-04-06T03:58:00.995+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:57:00+00:00 exited with status queued for try_number 1 2024-04-06T03:58:00.996005488Z [2024-04-06T03:58:00.995+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:57:00+00:00 exited with status queued for try_number 1 2024-04-06T03:58:01.007901427Z [2024-04-06T03:58:01.007+0000] {scheduler_job.py:635} INFO - Setting external_id for to d640ce28-0a55-480d-b070-f2c7c771245f 2024-04-06T03:58:01.008084425Z [2024-04-06T03:58:01.007+0000] {scheduler_job.py:635} INFO - Setting external_id for to 975d68a5-d1c8-4e38-9e9e-8fff9d734224 2024-04-06T03:58:01.008259430Z [2024-04-06T03:58:01.008+0000] {scheduler_job.py:635} INFO - Setting external_id for to a307f1fd-2198-4c88-9aaa-d74a6b6447c6 2024-04-06T03:58:03.729174916Z [2024-04-06T03:58:03.728+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:58:03.729386201Z [2024-04-06T03:58:03.729+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 03:56:00+00:00, run_id=scheduled__2024-04-06T03:56:00+00:00, run_start_date=2024-04-06 03:58:00.597342+00:00, run_end_date=2024-04-06 03:58:03.729082+00:00, run_duration=3.13174, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:56:00+00:00, data_interval_end=2024-04-06 03:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T03:58:03.741902422Z [2024-04-06T03:58:03.741+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T03:58:00+00:00, run_after=2024-04-06T04:00:00+00:00 2024-04-06T03:58:03.802407727Z [2024-04-06T03:58:03.802+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:56:00+00:00 exited with status success for try_number 1 2024-04-06T03:58:03.807254729Z [2024-04-06T03:58:03.806+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T03:56:00+00:00, map_index=-1, run_start_date=2024-04-06 03:58:02.007935+00:00, run_end_date=2024-04-06 03:58:02.774639+00:00, run_duration=0.766704, state=success, executor_state=success, try_number=1, max_tries=1, job_id=510, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:58:00.667647+00:00, queued_by_job_id=2, pid=11400 2024-04-06T03:58:04.870630768Z [2024-04-06T03:58:04.870+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:58:04.870974262Z [2024-04-06T03:58:04.870+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:57:00+00:00, run_id=scheduled__2024-04-06T03:57:00+00:00, run_start_date=2024-04-06 03:58:00.598635+00:00, run_end_date=2024-04-06 03:58:04.870553+00:00, run_duration=4.271918, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:57:00+00:00, data_interval_end=2024-04-06 03:58:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:58:04.881101785Z [2024-04-06T03:58:04.880+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:58:00+00:00, run_after=2024-04-06T03:59:00+00:00 2024-04-06T03:58:06.007079917Z [2024-04-06T03:58:06.006+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:58:06.007445422Z [2024-04-06T03:58:06.007+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:57:00+00:00, run_id=scheduled__2024-04-06T03:57:00+00:00, run_start_date=2024-04-06 03:58:00.599904+00:00, run_end_date=2024-04-06 03:58:06.006909+00:00, run_duration=5.407005, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:57:00+00:00, data_interval_end=2024-04-06 03:58:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:58:06.032988766Z [2024-04-06T03:58:06.028+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:58:00+00:00, run_after=2024-04-06T03:59:00+00:00 2024-04-06T03:58:06.074966603Z [2024-04-06T03:58:06.074+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:57:00+00:00 exited with status success for try_number 1 2024-04-06T03:58:06.075461001Z [2024-04-06T03:58:06.074+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:57:00+00:00 exited with status success for try_number 1 2024-04-06T03:58:06.085317832Z [2024-04-06T03:58:06.084+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:57:00+00:00, map_index=-1, run_start_date=2024-04-06 03:58:03.342384+00:00, run_end_date=2024-04-06 03:58:04.826622+00:00, run_duration=1.484238, state=success, executor_state=success, try_number=1, max_tries=1, job_id=512, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:58:00.667647+00:00, queued_by_job_id=2, pid=11430 2024-04-06T03:58:06.085914079Z [2024-04-06T03:58:06.085+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:57:00+00:00, map_index=-1, run_start_date=2024-04-06 03:58:03.221483+00:00, run_end_date=2024-04-06 03:58:05.174170+00:00, run_duration=1.952687, state=success, executor_state=success, try_number=1, max_tries=1, job_id=511, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:58:00.667647+00:00, queued_by_job_id=2, pid=11429 2024-04-06T03:59:00.575477356Z [2024-04-06T03:59:00.574+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:59:00+00:00, run_after=2024-04-06T04:00:00+00:00 2024-04-06T03:59:00.590590254Z [2024-04-06T03:59:00.590+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T03:59:00.665718943Z [2024-04-06T03:59:00.665+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T03:59:00.665758227Z 2024-04-06T03:59:00.665765903Z 2024-04-06T03:59:00.665900587Z [2024-04-06T03:59:00.665+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:59:00.666051325Z [2024-04-06T03:59:00.665+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T03:59:00.666817739Z [2024-04-06T03:59:00.666+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T03:59:00.666829557Z 2024-04-06T03:59:00.666836492Z 2024-04-06T03:59:00.671277395Z [2024-04-06T03:59:00.670+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:59:00.671617437Z [2024-04-06T03:59:00.671+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T03:59:00.672035458Z [2024-04-06T03:59:00.671+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T03:59:00.672230375Z [2024-04-06T03:59:00.672+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T03:59:00.955258023Z [2024-04-06T03:59:00.954+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:58:00+00:00 exited with status queued for try_number 1 2024-04-06T03:59:00.955445855Z [2024-04-06T03:59:00.955+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:58:00+00:00 exited with status queued for try_number 1 2024-04-06T03:59:00.966086729Z [2024-04-06T03:59:00.965+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c34f237-48d9-42ac-ae44-411010815317 2024-04-06T03:59:00.966262586Z [2024-04-06T03:59:00.966+0000] {scheduler_job.py:635} INFO - Setting external_id for to 82714ea5-75d6-4966-9572-b319ea2cb879 2024-04-06T03:59:05.257945103Z [2024-04-06T03:59:05.257+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:59:05.260321008Z [2024-04-06T03:59:05.259+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:58:00+00:00, run_id=scheduled__2024-04-06T03:58:00+00:00, run_start_date=2024-04-06 03:59:00.607830+00:00, run_end_date=2024-04-06 03:59:05.259773+00:00, run_duration=4.651943, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:58:00+00:00, data_interval_end=2024-04-06 03:59:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T03:59:05.275333004Z [2024-04-06T03:59:05.274+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:59:00+00:00, run_after=2024-04-06T04:00:00+00:00 2024-04-06T03:59:05.332487253Z [2024-04-06T03:59:05.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:58:00+00:00 exited with status success for try_number 1 2024-04-06T03:59:05.353052685Z [2024-04-06T03:59:05.352+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:58:00+00:00, map_index=-1, run_start_date=2024-04-06 03:59:03.151801+00:00, run_end_date=2024-04-06 03:59:04.848669+00:00, run_duration=1.696868, state=success, executor_state=success, try_number=1, max_tries=1, job_id=514, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:59:00.667567+00:00, queued_by_job_id=2, pid=11495 2024-04-06T03:59:06.394406138Z [2024-04-06T03:59:06.393+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T03:59:06.394594825Z [2024-04-06T03:59:06.394+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:58:00+00:00, run_id=scheduled__2024-04-06T03:58:00+00:00, run_start_date=2024-04-06 03:59:00.609866+00:00, run_end_date=2024-04-06 03:59:06.394287+00:00, run_duration=5.784421, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:58:00+00:00, data_interval_end=2024-04-06 03:59:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T03:59:06.403910539Z [2024-04-06T03:59:06.403+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T03:59:00+00:00, run_after=2024-04-06T04:00:00+00:00 2024-04-06T03:59:06.441883399Z [2024-04-06T03:59:06.441+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:58:00+00:00 exited with status success for try_number 1 2024-04-06T03:59:06.449622575Z [2024-04-06T03:59:06.449+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:58:00+00:00, map_index=-1, run_start_date=2024-04-06 03:59:02.689540+00:00, run_end_date=2024-04-06 03:59:05.488961+00:00, run_duration=2.799421, state=success, executor_state=success, try_number=1, max_tries=1, job_id=513, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 03:59:00.667567+00:00, queued_by_job_id=2, pid=11476 2024-04-06T04:00:00.700158381Z [2024-04-06T04:00:00.699+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T04:00:00.718677439Z [2024-04-06T04:00:00.713+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T04:00:00+00:00, run_after=2024-04-06T04:05:00+00:00 2024-04-06T04:00:00.727994077Z [2024-04-06T04:00:00.727+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T04:00:00.743668264Z [2024-04-06T04:00:00.742+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T04:00:00+00:00, run_after=2024-04-06T04:01:00+00:00 2024-04-06T04:00:00.845777949Z [2024-04-06T04:00:00.845+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-06T04:00:00.845848405Z 2024-04-06T04:00:00.845856145Z 2024-04-06T04:00:00.845865292Z 2024-04-06T04:00:00.845871514Z 2024-04-06T04:00:00.847325613Z [2024-04-06T04:00:00.847+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T04:00:00.847594894Z [2024-04-06T04:00:00.847+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T04:00:00.847850085Z [2024-04-06T04:00:00.847+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T04:00:00.848695538Z [2024-04-06T04:00:00.848+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T04:00:00.849584653Z [2024-04-06T04:00:00.849+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T04:00:00.849602039Z 2024-04-06T04:00:00.849630620Z 2024-04-06T04:00:00.849637872Z 2024-04-06T04:00:00.849643981Z 2024-04-06T04:00:00.854379923Z [2024-04-06T04:00:00.854+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-06T03:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-06T04:00:00.854736522Z [2024-04-06T04:00:00.854+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-06T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T04:00:00.855183042Z [2024-04-06T04:00:00.854+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T03:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T04:00:00.855472150Z [2024-04-06T04:00:00.855+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T04:00:00.855865743Z [2024-04-06T04:00:00.855+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T04:00:00.856308461Z [2024-04-06T04:00:00.855+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T04:00:00.856714348Z [2024-04-06T04:00:00.856+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T03:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T04:00:00.857004156Z [2024-04-06T04:00:00.856+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T03:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T04:00:01.287144325Z [2024-04-06T04:00:01.286+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T03:55:00+00:00 exited with status queued for try_number 1 2024-04-06T04:00:01.287207477Z [2024-04-06T04:00:01.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:58:00+00:00 exited with status queued for try_number 1 2024-04-06T04:00:01.287266415Z [2024-04-06T04:00:01.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:59:00+00:00 exited with status queued for try_number 1 2024-04-06T04:00:01.287313154Z [2024-04-06T04:00:01.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:59:00+00:00 exited with status queued for try_number 1 2024-04-06T04:00:01.297835769Z [2024-04-06T04:00:01.297+0000] {scheduler_job.py:635} INFO - Setting external_id for to 74dc595a-0cd6-43a0-adb2-fb08e0ad3bae 2024-04-06T04:00:01.297965580Z [2024-04-06T04:00:01.297+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c69faef-09af-45c7-be54-afcca262c3c9 2024-04-06T04:00:01.298092724Z [2024-04-06T04:00:01.297+0000] {scheduler_job.py:635} INFO - Setting external_id for to a40fd583-6844-4fdc-a464-c9b822b25f49 2024-04-06T04:00:01.298225238Z [2024-04-06T04:00:01.298+0000] {scheduler_job.py:635} INFO - Setting external_id for to af213bec-a12d-4833-9f51-2f78104fd3be 2024-04-06T04:00:03.516279854Z [2024-04-06T04:00:03.515+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T04:00:03.519696476Z [2024-04-06T04:00:03.518+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 03:58:00+00:00, run_id=scheduled__2024-04-06T03:58:00+00:00, run_start_date=2024-04-06 04:00:00.762464+00:00, run_end_date=2024-04-06 04:00:03.518096+00:00, run_duration=2.755632, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:58:00+00:00, data_interval_end=2024-04-06 04:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T04:00:03.542434181Z [2024-04-06T04:00:03.542+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T04:00:00+00:00, run_after=2024-04-06T04:02:00+00:00 2024-04-06T04:00:03.715945032Z [2024-04-06T04:00:03.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T03:58:00+00:00 exited with status success for try_number 1 2024-04-06T04:00:03.727393962Z [2024-04-06T04:00:03.727+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T03:58:00+00:00, map_index=-1, run_start_date=2024-04-06 04:00:01.964907+00:00, run_end_date=2024-04-06 04:00:03.161159+00:00, run_duration=1.196252, state=success, executor_state=success, try_number=1, max_tries=1, job_id=515, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 04:00:00.850737+00:00, queued_by_job_id=2, pid=11523 2024-04-06T04:00:06.250986205Z [2024-04-06T04:00:06.249+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T04:00:06.252002074Z [2024-04-06T04:00:06.251+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:59:00+00:00, run_id=scheduled__2024-04-06T03:59:00+00:00, run_start_date=2024-04-06 04:00:00.765222+00:00, run_end_date=2024-04-06 04:00:06.250914+00:00, run_duration=5.485692, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:59:00+00:00, data_interval_end=2024-04-06 04:00:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T04:00:06.267752258Z [2024-04-06T04:00:06.267+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T04:00:00+00:00, run_after=2024-04-06T04:01:00+00:00 2024-04-06T04:00:06.301412862Z [2024-04-06T04:00:06.301+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T04:00:06.301440022Z 2024-04-06T04:00:06.301963042Z [2024-04-06T04:00:06.301+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T04:00:06.302786737Z [2024-04-06T04:00:06.302+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T04:00:06.302802302Z 2024-04-06T04:00:06.305801853Z [2024-04-06T04:00:06.305+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='split_metrics', run_id='scheduled__2024-04-06T03:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-06T04:00:06.306097279Z [2024-04-06T04:00:06.305+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'split_metrics', 'scheduled__2024-04-06T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T04:00:06.418814136Z [2024-04-06T04:00:06.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T03:55:00+00:00 exited with status queued for try_number 1 2024-04-06T04:00:06.418844861Z [2024-04-06T04:00:06.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.extract_metrics_from_vnfrs run_id=scheduled__2024-04-06T03:55:00+00:00 exited with status success for try_number 1 2024-04-06T04:00:06.418908452Z [2024-04-06T04:00:06.418+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:59:00+00:00 exited with status success for try_number 1 2024-04-06T04:00:06.426736157Z [2024-04-06T04:00:06.426+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-06T03:55:00+00:00, map_index=-1, run_start_date=2024-04-06 04:00:05.042756+00:00, run_end_date=2024-04-06 04:00:05.421584+00:00, run_duration=0.378828, state=success, executor_state=success, try_number=1, max_tries=1, job_id=517, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 04:00:00.850737+00:00, queued_by_job_id=2, pid=11564 2024-04-06T04:00:06.426950872Z [2024-04-06T04:00:06.426+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:59:00+00:00, map_index=-1, run_start_date=2024-04-06 04:00:04.065153+00:00, run_end_date=2024-04-06 04:00:05.888739+00:00, run_duration=1.823586, state=success, executor_state=success, try_number=1, max_tries=1, job_id=516, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 04:00:00.850737+00:00, queued_by_job_id=2, pid=11545 2024-04-06T04:00:06.427135464Z [2024-04-06T04:00:06.427+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5f8b8be2-e60d-47cb-a268-0284dcf6d1b3 2024-04-06T04:00:08.839260219Z [2024-04-06T04:00:08.838+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T04:00:08.839591084Z [2024-04-06T04:00:08.839+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:59:00+00:00, run_id=scheduled__2024-04-06T03:59:00+00:00, run_start_date=2024-04-06 04:00:00.766699+00:00, run_end_date=2024-04-06 04:00:08.839296+00:00, run_duration=8.072597, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:59:00+00:00, data_interval_end=2024-04-06 04:00:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T04:00:08.848246272Z [2024-04-06T04:00:08.848+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T04:00:00+00:00, run_after=2024-04-06T04:01:00+00:00 2024-04-06T04:00:08.887672224Z [2024-04-06T04:00:08.887+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T04:00:08.887693367Z 2024-04-06T04:00:08.887990892Z [2024-04-06T04:00:08.887+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T04:00:08.888841759Z [2024-04-06T04:00:08.888+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T04:00:08.888854336Z 2024-04-06T04:00:08.891913136Z [2024-04-06T04:00:08.891+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='collect_metrics', run_id='scheduled__2024-04-06T03:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-06T04:00:08.892143456Z [2024-04-06T04:00:08.891+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'collect_metrics', 'scheduled__2024-04-06T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-06T04:00:08.959514754Z [2024-04-06T04:00:08.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T03:55:00+00:00 exited with status queued for try_number 1 2024-04-06T04:00:08.960052353Z [2024-04-06T04:00:08.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T03:59:00+00:00 exited with status success for try_number 1 2024-04-06T04:00:08.960306537Z [2024-04-06T04:00:08.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.split_metrics run_id=scheduled__2024-04-06T03:55:00+00:00 exited with status success for try_number 1 2024-04-06T04:00:08.970512058Z [2024-04-06T04:00:08.970+0000] {scheduler_job.py:635} INFO - Setting external_id for to f8a37d2a-636a-46ac-8f1e-dc87e5e333ad 2024-04-06T04:00:08.970771629Z [2024-04-06T04:00:08.970+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=split_metrics, run_id=scheduled__2024-04-06T03:55:00+00:00, map_index=-1, run_start_date=2024-04-06 04:00:08.015713+00:00, run_end_date=2024-04-06 04:00:08.513954+00:00, run_duration=0.498241, state=success, executor_state=success, try_number=1, max_tries=1, job_id=519, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 04:00:06.303445+00:00, queued_by_job_id=2, pid=11604 2024-04-06T04:00:08.971049532Z [2024-04-06T04:00:08.970+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T03:59:00+00:00, map_index=-1, run_start_date=2024-04-06 04:00:05.588707+00:00, run_end_date=2024-04-06 04:00:08.645704+00:00, run_duration=3.056997, state=success, executor_state=success, try_number=1, max_tries=1, job_id=518, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 04:00:00.850737+00:00, queued_by_job_id=2, pid=11583 2024-04-06T04:00:11.275679543Z [2024-04-06T04:00:11.270+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-06T04:00:11.275702224Z 2024-04-06T04:00:11.275706291Z [2024-04-06T04:00:11.271+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T04:00:11.275728293Z [2024-04-06T04:00:11.271+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T04:00:11.275731704Z 2024-04-06T04:00:11.290199692Z [2024-04-06T04:00:11.275+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='send_prometheus', run_id='scheduled__2024-04-06T03:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T04:00:11.290240716Z [2024-04-06T04:00:11.275+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'send_prometheus', 'scheduled__2024-04-06T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-06T04:00:11.356728926Z [2024-04-06T04:00:11.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T03:55:00+00:00 exited with status queued for try_number 1 2024-04-06T04:00:11.356825783Z [2024-04-06T04:00:11.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.collect_metrics run_id=scheduled__2024-04-06T03:55:00+00:00 exited with status success for try_number 1 2024-04-06T04:00:11.369368366Z [2024-04-06T04:00:11.368+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9759367b-488f-400a-b43a-6431884c9adc 2024-04-06T04:00:11.369525155Z [2024-04-06T04:00:11.369+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=collect_metrics, run_id=scheduled__2024-04-06T03:55:00+00:00, map_index=0, run_start_date=2024-04-06 04:00:10.490820+00:00, run_end_date=2024-04-06 04:00:10.886156+00:00, run_duration=0.395336, state=success, executor_state=success, try_number=1, max_tries=1, job_id=520, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 04:00:08.889446+00:00, queued_by_job_id=2, pid=11626 2024-04-06T04:00:13.661486715Z [2024-04-06T04:00:13.661+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T04:00:13.664153751Z [2024-04-06T04:00:13.662+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 03:55:00+00:00, run_id=scheduled__2024-04-06T03:55:00+00:00, run_start_date=2024-04-06 04:00:00.759592+00:00, run_end_date=2024-04-06 04:00:13.661368+00:00, run_duration=12.901776, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 03:55:00+00:00, data_interval_end=2024-04-06 04:00:00+00:00, dag_hash=eecc559ff32fe9a7c4345875f113a0a9 2024-04-06T04:00:13.672260953Z [2024-04-06T04:00:13.671+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T04:00:00+00:00, run_after=2024-04-06T04:05:00+00:00 2024-04-06T04:00:13.739303249Z [2024-04-06T04:00:13.738+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df.send_prometheus run_id=scheduled__2024-04-06T03:55:00+00:00 exited with status success for try_number 1 2024-04-06T04:00:13.748099855Z [2024-04-06T04:00:13.747+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=send_prometheus, run_id=scheduled__2024-04-06T03:55:00+00:00, map_index=-1, run_start_date=2024-04-06 04:00:13.154798+00:00, run_end_date=2024-04-06 04:00:13.507388+00:00, run_duration=0.35259, state=success, executor_state=success, try_number=1, max_tries=1, job_id=521, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 04:00:11.272630+00:00, queued_by_job_id=2, pid=11641 2024-04-06T04:00:21.291733610Z [2024-04-06T04:00:21.290+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-06T04:01:00.807470178Z [2024-04-06T04:01:00.806+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T04:01:00+00:00, run_after=2024-04-06T04:02:00+00:00 2024-04-06T04:01:00.815782509Z [2024-04-06T04:01:00.815+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T04:01:00.874692273Z [2024-04-06T04:01:00.874+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T04:01:00.874727299Z 2024-04-06T04:01:00.874734111Z 2024-04-06T04:01:00.874823544Z [2024-04-06T04:01:00.874+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T04:01:00.874953270Z [2024-04-06T04:01:00.874+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T04:01:00.877034947Z [2024-04-06T04:01:00.876+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T04:01:00.877057783Z 2024-04-06T04:01:00.877063248Z 2024-04-06T04:01:00.882708964Z [2024-04-06T04:01:00.882+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T04:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T04:01:00.882743261Z [2024-04-06T04:01:00.882+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T04:01:00.882947061Z [2024-04-06T04:01:00.882+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T04:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T04:01:00.883017523Z [2024-04-06T04:01:00.882+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T04:01:01.078374244Z [2024-04-06T04:01:01.077+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T04:00:00+00:00 exited with status queued for try_number 1 2024-04-06T04:01:01.078545717Z [2024-04-06T04:01:01.078+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T04:00:00+00:00 exited with status queued for try_number 1 2024-04-06T04:01:01.087676829Z [2024-04-06T04:01:01.087+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e418a01-b97e-48d4-95f1-86461e4bbb7c 2024-04-06T04:01:01.088099326Z [2024-04-06T04:01:01.087+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b469d98-36d2-441f-b4db-8d123e6f9d7b 2024-04-06T04:01:04.807473971Z [2024-04-06T04:01:04.806+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T04:01:04.807886776Z [2024-04-06T04:01:04.807+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 04:00:00+00:00, run_id=scheduled__2024-04-06T04:00:00+00:00, run_start_date=2024-04-06 04:01:00.827226+00:00, run_end_date=2024-04-06 04:01:04.807402+00:00, run_duration=3.980176, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 04:00:00+00:00, data_interval_end=2024-04-06 04:01:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T04:01:04.817065551Z [2024-04-06T04:01:04.816+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T04:01:00+00:00, run_after=2024-04-06T04:02:00+00:00 2024-04-06T04:01:04.853838033Z [2024-04-06T04:01:04.853+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T04:00:00+00:00 exited with status success for try_number 1 2024-04-06T04:01:04.859931983Z [2024-04-06T04:01:04.859+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T04:00:00+00:00, map_index=-1, run_start_date=2024-04-06 04:01:03.035478+00:00, run_end_date=2024-04-06 04:01:04.576502+00:00, run_duration=1.541024, state=success, executor_state=success, try_number=1, max_tries=1, job_id=522, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 04:01:00.877522+00:00, queued_by_job_id=2, pid=11662 2024-04-06T04:01:05.924184032Z [2024-04-06T04:01:05.923+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T04:01:05.924291172Z [2024-04-06T04:01:05.924+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 04:00:00+00:00, run_id=scheduled__2024-04-06T04:00:00+00:00, run_start_date=2024-04-06 04:01:00.828455+00:00, run_end_date=2024-04-06 04:01:05.923919+00:00, run_duration=5.095464, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 04:00:00+00:00, data_interval_end=2024-04-06 04:01:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T04:01:05.936172810Z [2024-04-06T04:01:05.935+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T04:01:00+00:00, run_after=2024-04-06T04:02:00+00:00 2024-04-06T04:01:06.002938977Z [2024-04-06T04:01:06.002+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T04:00:00+00:00 exited with status success for try_number 1 2024-04-06T04:01:06.022178913Z [2024-04-06T04:01:06.021+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T04:00:00+00:00, map_index=-1, run_start_date=2024-04-06 04:01:03.120250+00:00, run_end_date=2024-04-06 04:01:05.130238+00:00, run_duration=2.009988, state=success, executor_state=success, try_number=1, max_tries=1, job_id=523, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 04:01:00.877522+00:00, queued_by_job_id=2, pid=11663 2024-04-06T04:02:00.653105224Z [2024-04-06T04:02:00.652+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T04:02:00+00:00, run_after=2024-04-06T04:03:00+00:00 2024-04-06T04:02:00.660023034Z [2024-04-06T04:02:00.659+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T04:02:00.665121690Z [2024-04-06T04:02:00.664+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T04:02:00.727841378Z [2024-04-06T04:02:00.727+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-06T04:02:00.727881541Z 2024-04-06T04:02:00.727891827Z 2024-04-06T04:02:00.727900049Z 2024-04-06T04:02:00.727926812Z [2024-04-06T04:02:00.727+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-06T04:02:00.727958594Z [2024-04-06T04:02:00.727+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T04:02:00.727988042Z [2024-04-06T04:02:00.727+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T04:02:00.732017119Z [2024-04-06T04:02:00.728+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T04:02:00.732037995Z 2024-04-06T04:02:00.732044358Z 2024-04-06T04:02:00.732049872Z 2024-04-06T04:02:00.732056317Z [2024-04-06T04:02:00.731+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-06T04:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T04:02:00.732062574Z [2024-04-06T04:02:00.731+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-06T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-06T04:02:00.732068366Z [2024-04-06T04:02:00.731+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T04:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T04:02:00.732073797Z [2024-04-06T04:02:00.731+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T04:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T04:02:00.732078971Z [2024-04-06T04:02:00.731+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T04:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T04:02:00.732084574Z [2024-04-06T04:02:00.731+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T04:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T04:02:00.995997013Z [2024-04-06T04:02:00.995+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T04:00:00+00:00 exited with status queued for try_number 1 2024-04-06T04:02:00.996248269Z [2024-04-06T04:02:00.995+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T04:01:00+00:00 exited with status queued for try_number 1 2024-04-06T04:02:00.996481239Z [2024-04-06T04:02:00.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T04:01:00+00:00 exited with status queued for try_number 1 2024-04-06T04:02:01.008854903Z [2024-04-06T04:02:01.008+0000] {scheduler_job.py:635} INFO - Setting external_id for to 260b4214-432a-4550-9f85-c8f9b693411d 2024-04-06T04:02:01.009102402Z [2024-04-06T04:02:01.008+0000] {scheduler_job.py:635} INFO - Setting external_id for to c13b054d-96dc-4319-a701-4bbf3994e8f7 2024-04-06T04:02:01.009300419Z [2024-04-06T04:02:01.009+0000] {scheduler_job.py:635} INFO - Setting external_id for to c0d36da9-2fe6-48bc-a7a4-59b18398a401 2024-04-06T04:02:03.724736200Z [2024-04-06T04:02:03.724+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T04:02:03.726468498Z [2024-04-06T04:02:03.726+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-06 04:00:00+00:00, run_id=scheduled__2024-04-06T04:00:00+00:00, run_start_date=2024-04-06 04:02:00.677065+00:00, run_end_date=2024-04-06 04:02:03.724752+00:00, run_duration=3.047687, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 04:00:00+00:00, data_interval_end=2024-04-06 04:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-06T04:02:03.763453400Z [2024-04-06T04:02:03.761+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-06T04:02:00+00:00, run_after=2024-04-06T04:04:00+00:00 2024-04-06T04:02:03.830509767Z [2024-04-06T04:02:03.830+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-06T04:00:00+00:00 exited with status success for try_number 1 2024-04-06T04:02:03.835178694Z [2024-04-06T04:02:03.834+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-06T04:00:00+00:00, map_index=-1, run_start_date=2024-04-06 04:02:02.018991+00:00, run_end_date=2024-04-06 04:02:02.990404+00:00, run_duration=0.971413, state=success, executor_state=success, try_number=1, max_tries=1, job_id=524, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 04:02:00.729081+00:00, queued_by_job_id=2, pid=11698 2024-04-06T04:02:07.197471611Z [2024-04-06T04:02:07.197+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T04:02:07.197772097Z [2024-04-06T04:02:07.197+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 04:01:00+00:00, run_id=scheduled__2024-04-06T04:01:00+00:00, run_start_date=2024-04-06 04:02:00.678425+00:00, run_end_date=2024-04-06 04:02:07.197301+00:00, run_duration=6.518876, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 04:01:00+00:00, data_interval_end=2024-04-06 04:02:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T04:02:07.206468171Z [2024-04-06T04:02:07.206+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T04:02:00+00:00, run_after=2024-04-06T04:03:00+00:00 2024-04-06T04:02:07.212331080Z [2024-04-06T04:02:07.211+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T04:02:07.212609879Z [2024-04-06T04:02:07.212+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 04:01:00+00:00, run_id=scheduled__2024-04-06T04:01:00+00:00, run_start_date=2024-04-06 04:02:00.679528+00:00, run_end_date=2024-04-06 04:02:07.212105+00:00, run_duration=6.532577, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 04:01:00+00:00, data_interval_end=2024-04-06 04:02:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T04:02:07.221446065Z [2024-04-06T04:02:07.221+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T04:02:00+00:00, run_after=2024-04-06T04:03:00+00:00 2024-04-06T04:02:07.258534352Z [2024-04-06T04:02:07.258+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T04:01:00+00:00 exited with status success for try_number 1 2024-04-06T04:02:07.258646507Z [2024-04-06T04:02:07.258+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T04:01:00+00:00 exited with status success for try_number 1 2024-04-06T04:02:07.267516655Z [2024-04-06T04:02:07.267+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T04:01:00+00:00, map_index=-1, run_start_date=2024-04-06 04:02:04.415050+00:00, run_end_date=2024-04-06 04:02:06.742783+00:00, run_duration=2.327733, state=success, executor_state=success, try_number=1, max_tries=1, job_id=526, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 04:02:00.729081+00:00, queued_by_job_id=2, pid=11728 2024-04-06T04:02:07.267764872Z [2024-04-06T04:02:07.267+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T04:01:00+00:00, map_index=-1, run_start_date=2024-04-06 04:02:04.051671+00:00, run_end_date=2024-04-06 04:02:06.259944+00:00, run_duration=2.208273, state=success, executor_state=success, try_number=1, max_tries=1, job_id=525, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 04:02:00.729081+00:00, queued_by_job_id=2, pid=11727 2024-04-06T04:03:00.061298260Z [2024-04-06T04:03:00.060+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-06T04:03:00.083313029Z [2024-04-06T04:03:00.082+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T04:03:00+00:00, run_after=2024-04-06T04:04:00+00:00 2024-04-06T04:03:00.147065658Z [2024-04-06T04:03:00.146+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-06T04:03:00.147161720Z 2024-04-06T04:03:00.147182624Z 2024-04-06T04:03:00.147245254Z [2024-04-06T04:03:00.146+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T04:03:00.147301986Z [2024-04-06T04:03:00.146+0000] {scheduler_job.py:425} INFO - DAG vim_status_26366e96-ab6b-4bac-84af-b822e289d1df has 0/16 running and queued tasks 2024-04-06T04:03:00.148124965Z [2024-04-06T04:03:00.147+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-06T04:03:00.148148401Z 2024-04-06T04:03:00.148154081Z 2024-04-06T04:03:00.152102214Z [2024-04-06T04:03:00.151+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T04:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T04:03:00.152470308Z [2024-04-06T04:03:00.152+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-06T04:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-06T04:03:00.152892408Z [2024-04-06T04:03:00.152+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-06T04:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-06T04:03:00.153131485Z [2024-04-06T04:03:00.152+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_26366e96-ab6b-4bac-84af-b822e289d1df', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-06T04:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-06T04:03:00.338981104Z [2024-04-06T04:03:00.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T04:02:00+00:00 exited with status queued for try_number 1 2024-04-06T04:03:00.339187610Z [2024-04-06T04:03:00.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T04:02:00+00:00 exited with status queued for try_number 1 2024-04-06T04:03:00.348815992Z [2024-04-06T04:03:00.348+0000] {scheduler_job.py:635} INFO - Setting external_id for to 810ebda6-d1e6-451b-9999-705de9227b73 2024-04-06T04:03:00.349177866Z [2024-04-06T04:03:00.348+0000] {scheduler_job.py:635} INFO - Setting external_id for to cc76ae3d-b2cc-4b30-be06-9a8dcd75f747 2024-04-06T04:03:04.195678256Z [2024-04-06T04:03:04.193+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T04:03:04.195707430Z [2024-04-06T04:03:04.194+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 04:02:00+00:00, run_id=scheduled__2024-04-06T04:02:00+00:00, run_start_date=2024-04-06 04:03:00.097793+00:00, run_end_date=2024-04-06 04:03:04.194261+00:00, run_duration=4.096468, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 04:02:00+00:00, data_interval_end=2024-04-06 04:03:00+00:00, dag_hash=8352631bdc8b5b438afe9607d269f660 2024-04-06T04:03:04.204008811Z [2024-04-06T04:03:04.203+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T04:03:00+00:00, run_after=2024-04-06T04:04:00+00:00 2024-04-06T04:03:04.211512933Z [2024-04-06T04:03:04.211+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-06T04:03:04.211748990Z [2024-04-06T04:03:04.211+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, execution_date=2024-04-06 04:02:00+00:00, run_id=scheduled__2024-04-06T04:02:00+00:00, run_start_date=2024-04-06 04:03:00.099129+00:00, run_end_date=2024-04-06 04:03:04.211450+00:00, run_duration=4.112321, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-06 04:02:00+00:00, data_interval_end=2024-04-06 04:03:00+00:00, dag_hash=f1329db4d9beb445d77fdee68d8fba94 2024-04-06T04:03:04.224873421Z [2024-04-06T04:03:04.224+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df to 2024-04-06T04:03:00+00:00, run_after=2024-04-06T04:04:00+00:00 2024-04-06T04:03:04.271892834Z [2024-04-06T04:03:04.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-06T04:02:00+00:00 exited with status success for try_number 1 2024-04-06T04:03:04.271914060Z [2024-04-06T04:03:04.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_26366e96-ab6b-4bac-84af-b822e289d1df.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-06T04:02:00+00:00 exited with status success for try_number 1 2024-04-06T04:03:04.281935403Z [2024-04-06T04:03:04.280+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T04:02:00+00:00, map_index=-1, run_start_date=2024-04-06 04:03:02.328632+00:00, run_end_date=2024-04-06 04:03:03.744694+00:00, run_duration=1.416062, state=success, executor_state=success, try_number=1, max_tries=1, job_id=528, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 04:03:00.148848+00:00, queued_by_job_id=2, pid=11783 2024-04-06T04:03:04.281952611Z [2024-04-06T04:03:04.280+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_26366e96-ab6b-4bac-84af-b822e289d1df, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-06T04:02:00+00:00, map_index=-1, run_start_date=2024-04-06 04:03:02.143889+00:00, run_end_date=2024-04-06 04:03:04.021463+00:00, run_duration=1.877574, state=success, executor_state=success, try_number=1, max_tries=1, job_id=527, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-06 04:03:00.148848+00:00, queued_by_job_id=2, pid=11782 2024-04-06T01:29:56.229925485Z 2024-04-06T01:29:56.237073293Z Cleaning logs every 900 seconds 2024-04-06T01:29:56.259201992Z Trimming airflow logs to 15 days. 2024-04-06T01:30:00.387060044Z Trimming airflow logs to 15 days. 2024-04-06T01:30:01.470039222Z Trimming airflow logs to 15 days. 2024-04-06T01:45:00.606208070Z Trimming airflow logs to 15 days. 2024-04-06T01:45:01.638763018Z Trimming airflow logs to 15 days. 2024-04-06T02:00:00.741802691Z Trimming airflow logs to 15 days. 2024-04-06T02:00:01.779127527Z Trimming airflow logs to 15 days. 2024-04-06T02:15:00.815726751Z Trimming airflow logs to 15 days. 2024-04-06T02:15:01.850357886Z Trimming airflow logs to 15 days. 2024-04-06T02:30:00.906879432Z Trimming airflow logs to 15 days. 2024-04-06T02:30:01.947322968Z Trimming airflow logs to 15 days. 2024-04-06T02:45:01.010025504Z Trimming airflow logs to 15 days. 2024-04-06T03:00:00.051234339Z Trimming airflow logs to 15 days. 2024-04-06T03:00:01.072745333Z Trimming airflow logs to 15 days. 2024-04-06T03:15:00.122147434Z Trimming airflow logs to 15 days. 2024-04-06T03:15:01.139873945Z Trimming airflow logs to 15 days. 2024-04-06T03:30:00.192613679Z Trimming airflow logs to 15 days. 2024-04-06T03:30:01.221343159Z Trimming airflow logs to 15 days. 2024-04-06T03:45:00.255834051Z Trimming airflow logs to 15 days. 2024-04-06T03:45:01.287141383Z Trimming airflow logs to 15 days. 2024-04-06T04:00:00.333253470Z Trimming airflow logs to 15 days. 2024-04-06T04:00:01.366090058Z Trimming airflow logs to 15 days.